2022-04-03T21:39:12.204 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-03T21:39:12.205 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} --owner scheduled_vshankar@teuthology --verbose --name vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775668 -- /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775668/orig.config.yaml 2022-04-03T21:39:12.256 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-04-03T21:39:12.325 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775668 branch: wip-vshankar-testing-20220403-170344 description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} email: vshankar@redhat.com first_in_suite: false job_id: '6775668' kernel: client: branch: testing flavor: default kdb: true sha1: 26d8230c8f919f5e2d8da795fb3fbca12f8ebd85 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20220403-170344 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: cfb8f943163b374162da0d7b0240f267dd46e4e1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cfb8f943163b374162da0d7b0240f267dd46e4e1 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20220403-170344 sha1: cfb8f943163b374162da0d7b0240f267dd46e4e1 owner: scheduled_vshankar@teuthology priority: 100 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 sha1: cfb8f943163b374162da0d7b0240f267dd46e4e1 sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20220403-170344 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: cfb8f943163b374162da0d7b0240f267dd46e4e1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcx6FNUI1+8IhYWPjRR05YLwLbzlNwRkh+BjacmtArX8/l9VlODyae8zxqgcfE035IF/jZSJ08cifu11EDuH9Pb5bgHyZd8riLhOddNZioOXq3eswWIl3zklgt8pS2wXL//pv9L/HfUz20qJGAmzqL2e+9boYQApSn5e34pxEnJ3pYVlzsCs0XO7MeaRociyEEr0NpITMGZ65xzvjKCt+abPO1xUuQ8Vvk8+oJ8sUvFZ7qfb5ooS8v/qRlXZ9asRdjxsXQktA7Q6LbTYTnZJk0w9EfgQM3qFjkf6Mo8xw6hqLYbYZyZ7SjfxJqVqO73KQVFj40zblgLUfpYkuI3v+QgkWqHhsFFLvMCRqRC+aRqaCwwvCz1mefZGzng1fmPNTt7ohGGciS7hhQqyEkP5tqmdr/cMmzueru4IG/tsScKE0kDUP+FygdUDyc5x0Ie+HFRJY/ENit1bULESlx9OpxV1K42qN0IYGg92s9E4Etx6bHBJahtj7pYz1bAyKjpcc= smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2n0KUnOcrabfO+SDulzmks2AdtqPx78dAGzF/gfk0twvbCAsea+9vnH4TVfejC8NLTQOR7UyvjDdlrVuiDPCqY1BgcLw+8IzgbgaM7UdrzSly181ASQMoBA6nMafWAkYzivZyv3VeahBcoPvev7UU/hgPPj8rqTPtnbYdjovgeXtkatBJdzxYPUae8rebYHpTnxzi4OQBoLXcBLGI04MngEIWyiB3k9vQHMbB7ZKpFvgdq7lh9qfF3085NuRt8OCjO5M3+nzYhAga9NGNOhnRUF1D5jJiq4NEf6RZWRtTPjzoa6wCK9nu4P2Qdv+M/QzeQLqwh7Q41mGj/PXYOEcY6DhMsu3V+VaMsURMGYBEzuZVTXHJRxsOyIIJiNc/lvFZMLr/La6REUJqqWgeCkpmp1CJ4036Ds6hbtYEzD8DEBG/KG4fpRkudoU+kBcQh49kg/x6Te965erwRIvy0bNUoTZZD4UnrWqiYVs6nYwxixprFvMC/5O0Hm7nTHc/cMc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - workunit: clients: all: - fs/snaps teuthology_branch: master teuthology_sha1: d877b023166308f282187444de8e8e725ffb27d2 timestamp: 2022-04-03_15:22:48 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.22301 2022-04-03T21:39:12.325 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa; will attempt to use it 2022-04-03T21:39:12.326 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks 2022-04-03T21:39:12.327 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-04-03T21:39:12.329 INFO:teuthology.task.internal:Checking packages... 2022-04-03T21:39:12.348 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'cfb8f943163b374162da0d7b0240f267dd46e4e1' 2022-04-03T21:39:12.349 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-03T21:39:12.349 INFO:teuthology.packaging:ref: None 2022-04-03T21:39:12.350 INFO:teuthology.packaging:tag: None 2022-04-03T21:39:12.350 INFO:teuthology.packaging:branch: wip-vshankar-testing-20220403-170344 2022-04-03T21:39:12.350 INFO:teuthology.packaging:sha1: cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:39:12.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20220403-170344 2022-04-03T21:39:12.504 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-11442.gcfb8f943 2022-04-03T21:39:12.505 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-04-03T21:39:12.517 INFO:teuthology.task.internal:no buildpackages task found 2022-04-03T21:39:12.517 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-04-03T21:39:12.646 INFO:teuthology.task.internal:Saving configuration 2022-04-03T21:39:12.662 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-04-03T21:39:12.693 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-03T21:39:12.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775668', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-04-03 21:33:24.341935', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4sFySqu2GH9eVf3V4coSbLbu/HiBZhCNTUEGdlc3/0n1qLJT1ZOn2IRgtYt9tl8f7BJsgo/BCFNrIIR1smDrg='} 2022-04-03T21:39:12.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775668', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-04-03 21:33:24.340505', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH9MuZPV/UW7aiogGik/r8Q81g4DlI7HG08Vm40/nVMKjxK4Qs8kK0W1Wy7Xy/HwEczUaW87CTz47YVytCA/4+w='} 2022-04-03T21:39:12.739 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-04-03T21:39:12.750 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-04-03T21:39:12.751 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-04-03T21:39:12.751 INFO:teuthology.run_tasks:Running task console_log... 2022-04-03T21:39:12.854 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3415fd9b70>, signals=[15]) 2022-04-03T21:39:12.855 INFO:teuthology.run_tasks:Running task internal.connect... 2022-04-03T21:39:12.866 INFO:teuthology.task.internal:Opening connections... 2022-04-03T21:39:12.866 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:39:12.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:39:12.937 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2022-04-03T21:39:12.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:39:13.004 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-04-03T21:39:13.015 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2022-04-03T21:39:13.036 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2022-04-03T21:39:13.036 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2022-04-03T21:39:13.095 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2022-04-03T21:39:13.095 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2022-04-03T21:39:13.095 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2022-04-03T21:39:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2022-04-03T21:39:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2022-04-03T21:39:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2022-04-03T21:39:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-03T21:39:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2022-04-03T21:39:13.097 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-03T21:39:13.097 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2022-04-03T21:39:13.097 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-03T21:39:13.097 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-03T21:39:13.098 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-03T21:39:13.098 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2022-04-03T21:39:13.117 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2022-04-03T21:39:13.137 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2022-04-03T21:39:13.137 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2022-04-03T21:39:13.196 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2022-04-03T21:39:13.196 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8" 2022-04-03T21:39:13.196 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2022-04-03T21:39:13.197 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2022-04-03T21:39:13.197 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2022-04-03T21:39:13.197 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2022-04-03T21:39:13.197 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-03T21:39:13.198 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2022-04-03T21:39:13.198 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-03T21:39:13.198 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2022-04-03T21:39:13.198 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-03T21:39:13.199 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-03T21:39:13.199 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-03T21:39:13.199 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2022-04-03T21:39:13.215 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-04-03T21:39:13.229 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-04-03T21:39:13.260 INFO:teuthology.task.internal:Checking for old test directory... 2022-04-03T21:39:13.260 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2022-04-03T21:39:13.263 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2022-04-03T21:39:13.281 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-04-03T21:39:13.298 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-04-03T21:39:13.299 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2022-04-03T21:39:13.322 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2022-04-03T21:39:13.352 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-04-03T21:39:13.405 INFO:teuthology.run_tasks:Running task kernel... 2022-04-03T21:39:13.424 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '26d8230c8f919f5e2d8da795fb3fbca12f8ebd85'} 2022-04-03T21:39:13.424 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2022-04-03T21:39:13.425 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2022-04-03T21:39:13.425 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2022-04-03T21:39:13.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-03T21:39:13.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo lsb_release -is 2022-04-03T21:39:13.532 INFO:teuthology.orchestra.run.smithi049.stdout:CentOSStream 2022-04-03T21:39:13.534 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:39:13.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2022-04-03T21:39:13.779 DEBUG:teuthology.task.kernel:sha1 for client.0 is 26d8230c8f919f5e2d8da795fb3fbca12f8ebd85 2022-04-03T21:39:13.780 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "26d8230c8f919f5e2d8da795fb3fbca12f8ebd85"... 2022-04-03T21:39:13.780 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2022-04-03T21:39:13.800 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-373.el8.x86_64 2022-04-03T21:39:13.801 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-373.el8.x86_64 vs 26d8230c8f919f5e2d8da795fb3fbca12f8ebd85 2022-04-03T21:39:13.801 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-04-03T21:39:13.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum upgrade -y linux-firmware 2022-04-03T21:39:16.047 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - AppStream 36 MB/s | 21 MB 00:00 2022-04-03T21:39:20.439 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - Base 40 MB/s | 21 MB 00:00 2022-04-03T21:39:23.713 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - Extras 156 kB/s | 18 kB 00:00 2022-04-03T21:39:24.158 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - PowerTools 14 MB/s | 4.4 MB 00:00 2022-04-03T21:39:27.031 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2022-04-03T21:39:28.039 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 13 MB/s | 11 MB 00:00 2022-04-03T21:39:30.890 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 496 kB/s | 24 kB 00:00 2022-04-03T21:39:33.680 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2022-04-03T21:39:33.681 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2022-04-03T21:39:33.681 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2022-04-03T21:39:33.786 INFO:teuthology.task.kernel:Downloading kernel 26d8230c8f919f5e2d8da795fb3fbca12f8ebd85 on client.0... 2022-04-03T21:39:33.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo lsb_release -is 2022-04-03T21:39:33.824 INFO:teuthology.orchestra.run.smithi049.stdout:CentOSStream 2022-04-03T21:39:33.825 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:39:33.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=26d8230c8f919f5e2d8da795fb3fbca12f8ebd85 2022-04-03T21:39:33.985 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/26d8230c8f919f5e2d8da795fb3fbca12f8ebd85/centos/8/flavors/default/x86_64/ 2022-04-03T21:39:33.986 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.17.0_rc6_ceph_g26d8230c8f91-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/26d8230c8f919f5e2d8da795fb3fbca12f8ebd85/centos/8/flavors/default/x86_64/ --input-file=- 2022-04-03T21:39:33.988 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi049.front.sepia.ceph.com to complete... 2022-04-03T21:39:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03 21:39:55 URL:https://3.chacra.ceph.com/r/kernel/testing/26d8230c8f919f5e2d8da795fb3fbca12f8ebd85/centos/8/flavors/default/x86_64/kernel-5.17.0_rc6_ceph_g26d8230c8f91-1.x86_64.rpm [510009892/510009892] -> "/tmp/kernel.x86_64.rpm" [1] 2022-04-03T21:39:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:FINISHED --2022-04-03 21:39:55-- 2022-04-03T21:39:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:Total wall clock time: 21s 2022-04-03T21:39:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:Downloaded: 1 files, 486M in 21s (23.0 MB/s) 2022-04-03T21:39:55.351 INFO:teuthology.task.kernel:Installing kernel 26d8230c8f919f5e2d8da795fb3fbca12f8ebd85 on client.0... 2022-04-03T21:39:55.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-04-03T21:39:57.553 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying... ######################################## 2022-04-03T21:39:57.761 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing... ######################################## 2022-04-03T21:39:57.878 INFO:teuthology.orchestra.run.smithi049.stdout:Updating / installing... 2022-04-03T21:40:38.533 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.17.0_rc6_ceph_g26d8230c8f91-1######################################## 2022-04-03T21:41:03.988 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-04-03T21:41:03.989 DEBUG:teuthology.orchestra.run.smithi049:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-04-03T21:41:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/System.map-5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/config-5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/vmlinux-5.17.0-rc6-ceph-g26d8230c8f91.bz2 2022-04-03T21:41:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:/boot/vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel 2022-04-03T21:41:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch 2022-04-03T21:41:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86 2022-04-03T21:41:04.056 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto 2022-04-03T21:41:04.056 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-04-03T21:41:04.056 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-04-03T21:41:04.056 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-04-03T21:41:04.057 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-04-03T21:41:04.057 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-04-03T21:41:04.057 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-04-03T21:41:04.057 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-04-03T21:41:04.058 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/crc32c-intel.ko 2022-04-03T21:41:04.058 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-04-03T21:41:04.058 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-04-03T21:41:04.058 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-04-03T21:41:04.058 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-04-03T21:41:04.059 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/serpent-avx2.ko 2022-04-03T21:41:04.059 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-04-03T21:41:04.059 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-04-03T21:41:04.059 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-04-03T21:41:04.060 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-04-03T21:41:04.060 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-04-03T21:41:04.060 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-04-03T21:41:04.060 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-04-03T21:41:04.061 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kernel 2022-04-03T21:41:04.061 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kernel/cpu 2022-04-03T21:41:04.061 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kernel/cpu/mce 2022-04-03T21:41:04.061 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-04-03T21:41:04.061 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kvm 2022-04-03T21:41:04.062 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kvm/kvm-amd.ko 2022-04-03T21:41:04.062 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kvm/kvm-intel.ko 2022-04-03T21:41:04.062 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/arch/x86/kvm/kvm.ko 2022-04-03T21:41:04.062 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto 2022-04-03T21:41:04.063 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/ansi_cprng.ko 2022-04-03T21:41:04.063 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/anubis.ko 2022-04-03T21:41:04.063 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/arc4.ko 2022-04-03T21:41:04.063 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx 2022-04-03T21:41:04.064 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx/async_memcpy.ko 2022-04-03T21:41:04.064 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx/async_pq.ko 2022-04-03T21:41:04.064 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx/async_raid6_recov.ko 2022-04-03T21:41:04.064 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx/async_tx.ko 2022-04-03T21:41:04.064 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx/async_xor.ko 2022-04-03T21:41:04.065 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/async_tx/raid6test.ko 2022-04-03T21:41:04.065 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/authenc.ko 2022-04-03T21:41:04.065 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/authencesn.ko 2022-04-03T21:41:04.065 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/blake2b_generic.ko 2022-04-03T21:41:04.065 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/blowfish_common.ko 2022-04-03T21:41:04.066 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/blowfish_generic.ko 2022-04-03T21:41:04.066 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/camellia_generic.ko 2022-04-03T21:41:04.066 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/cast5_generic.ko 2022-04-03T21:41:04.066 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/cast6_generic.ko 2022-04-03T21:41:04.067 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/cast_common.ko 2022-04-03T21:41:04.067 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/ccm.ko 2022-04-03T21:41:04.067 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/cmac.ko 2022-04-03T21:41:04.067 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/crc32_generic.ko 2022-04-03T21:41:04.067 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/crypto_engine.ko 2022-04-03T21:41:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/crypto_user.ko 2022-04-03T21:41:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/cts.ko 2022-04-03T21:41:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/des_generic.ko 2022-04-03T21:41:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/dh_generic.ko 2022-04-03T21:41:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/echainiv.ko 2022-04-03T21:41:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/essiv.ko 2022-04-03T21:41:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/fcrypt.ko 2022-04-03T21:41:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/khazad.ko 2022-04-03T21:41:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/lz4.ko 2022-04-03T21:41:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/lz4hc.ko 2022-04-03T21:41:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/md4.ko 2022-04-03T21:41:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/michael_mic.ko 2022-04-03T21:41:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/pcbc.ko 2022-04-03T21:41:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/pcrypt.ko 2022-04-03T21:41:04.071 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/rmd160.ko 2022-04-03T21:41:04.071 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/seed.ko 2022-04-03T21:41:04.071 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/serpent_generic.ko 2022-04-03T21:41:04.071 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/tcrypt.ko 2022-04-03T21:41:04.071 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/tea.ko 2022-04-03T21:41:04.072 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/twofish_common.ko 2022-04-03T21:41:04.072 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/twofish_generic.ko 2022-04-03T21:41:04.072 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/vmac.ko 2022-04-03T21:41:04.072 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/wp512.ko 2022-04-03T21:41:04.072 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/xcbc.ko 2022-04-03T21:41:04.073 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/xor.ko 2022-04-03T21:41:04.073 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/crypto/xxhash_generic.ko 2022-04-03T21:41:04.073 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers 2022-04-03T21:41:04.073 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi 2022-04-03T21:41:04.074 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/acpi_ipmi.ko 2022-04-03T21:41:04.074 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/acpi_pad.ko 2022-04-03T21:41:04.074 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/custom_method.ko 2022-04-03T21:41:04.074 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/ec_sys.ko 2022-04-03T21:41:04.075 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/platform_profile.ko 2022-04-03T21:41:04.075 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/sbs.ko 2022-04-03T21:41:04.075 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/sbshc.ko 2022-04-03T21:41:04.075 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/acpi/video.ko 2022-04-03T21:41:04.075 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata 2022-04-03T21:41:04.076 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/acard-ahci.ko 2022-04-03T21:41:04.076 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/ahci_platform.ko 2022-04-03T21:41:04.076 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/ata_generic.ko 2022-04-03T21:41:04.076 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/libahci_platform.ko 2022-04-03T21:41:04.076 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_acpi.ko 2022-04-03T21:41:04.077 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_ali.ko 2022-04-03T21:41:04.077 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_amd.ko 2022-04-03T21:41:04.077 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_artop.ko 2022-04-03T21:41:04.077 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_atiixp.ko 2022-04-03T21:41:04.078 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_atp867x.ko 2022-04-03T21:41:04.078 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_cmd640.ko 2022-04-03T21:41:04.078 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_cmd64x.ko 2022-04-03T21:41:04.078 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_cypress.ko 2022-04-03T21:41:04.078 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_efar.ko 2022-04-03T21:41:04.079 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_hpt366.ko 2022-04-03T21:41:04.079 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_hpt37x.ko 2022-04-03T21:41:04.079 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_hpt3x2n.ko 2022-04-03T21:41:04.079 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_hpt3x3.ko 2022-04-03T21:41:04.080 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_it8213.ko 2022-04-03T21:41:04.080 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_it821x.ko 2022-04-03T21:41:04.080 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_jmicron.ko 2022-04-03T21:41:04.080 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_marvell.ko 2022-04-03T21:41:04.080 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_mpiix.ko 2022-04-03T21:41:04.081 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_netcell.ko 2022-04-03T21:41:04.081 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_ninja32.ko 2022-04-03T21:41:04.081 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_ns87410.ko 2022-04-03T21:41:04.081 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_ns87415.ko 2022-04-03T21:41:04.082 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_oldpiix.ko 2022-04-03T21:41:04.082 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_opti.ko 2022-04-03T21:41:04.082 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_optidma.ko 2022-04-03T21:41:04.082 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_pcmcia.ko 2022-04-03T21:41:04.082 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_pdc2027x.ko 2022-04-03T21:41:04.083 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-04-03T21:41:04.083 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_piccolo.ko 2022-04-03T21:41:04.083 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_rdc.ko 2022-04-03T21:41:04.083 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_sch.ko 2022-04-03T21:41:04.084 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_serverworks.ko 2022-04-03T21:41:04.084 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_sil680.ko 2022-04-03T21:41:04.084 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_sis.ko 2022-04-03T21:41:04.084 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_sl82c105.ko 2022-04-03T21:41:04.084 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_triflex.ko 2022-04-03T21:41:04.085 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pata_via.ko 2022-04-03T21:41:04.085 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/pdc_adma.ko 2022-04-03T21:41:04.085 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_inic162x.ko 2022-04-03T21:41:04.085 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_mv.ko 2022-04-03T21:41:04.085 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_nv.ko 2022-04-03T21:41:04.086 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_promise.ko 2022-04-03T21:41:04.086 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_qstor.ko 2022-04-03T21:41:04.086 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_sil.ko 2022-04-03T21:41:04.086 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_sil24.ko 2022-04-03T21:41:04.086 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_sis.ko 2022-04-03T21:41:04.087 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_svw.ko 2022-04-03T21:41:04.087 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_sx4.ko 2022-04-03T21:41:04.087 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_uli.ko 2022-04-03T21:41:04.087 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_via.ko 2022-04-03T21:41:04.088 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ata/sata_vsc.ko 2022-04-03T21:41:04.088 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/auxdisplay 2022-04-03T21:41:04.088 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/auxdisplay/ks0108.ko 2022-04-03T21:41:04.088 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/base 2022-04-03T21:41:04.089 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/base/regmap 2022-04-03T21:41:04.089 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/base/regmap/regmap-i2c.ko 2022-04-03T21:41:04.089 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/bcma 2022-04-03T21:41:04.089 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/bcma/bcma.ko 2022-04-03T21:41:04.090 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block 2022-04-03T21:41:04.090 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/aoe 2022-04-03T21:41:04.090 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/aoe/aoe.ko 2022-04-03T21:41:04.090 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/brd.ko 2022-04-03T21:41:04.090 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/drbd 2022-04-03T21:41:04.091 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/drbd/drbd.ko 2022-04-03T21:41:04.091 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/floppy.ko 2022-04-03T21:41:04.091 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/loop.ko 2022-04-03T21:41:04.091 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/mtip32xx 2022-04-03T21:41:04.091 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-04-03T21:41:04.092 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/nbd.ko 2022-04-03T21:41:04.092 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/null_blk 2022-04-03T21:41:04.092 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/null_blk/null_blk.ko 2022-04-03T21:41:04.092 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/pktcdvd.ko 2022-04-03T21:41:04.093 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/rbd.ko 2022-04-03T21:41:04.093 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/sx8.ko 2022-04-03T21:41:04.093 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/virtio_blk.ko 2022-04-03T21:41:04.093 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/xen-blkback 2022-04-03T21:41:04.093 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-04-03T21:41:04.094 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/xen-blkfront.ko 2022-04-03T21:41:04.094 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/zram 2022-04-03T21:41:04.094 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/block/zram/zram.ko 2022-04-03T21:41:04.094 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char 2022-04-03T21:41:04.094 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hangcheck-timer.ko 2022-04-03T21:41:04.095 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hw_random 2022-04-03T21:41:04.095 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hw_random/amd-rng.ko 2022-04-03T21:41:04.095 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hw_random/intel-rng.ko 2022-04-03T21:41:04.095 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-04-03T21:41:04.096 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hw_random/via-rng.ko 2022-04-03T21:41:04.096 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/hw_random/virtio-rng.ko 2022-04-03T21:41:04.096 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi 2022-04-03T21:41:04.096 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-04-03T21:41:04.096 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-04-03T21:41:04.097 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-04-03T21:41:04.097 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi/ipmi_si.ko 2022-04-03T21:41:04.097 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-04-03T21:41:04.097 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-04-03T21:41:04.097 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/lp.ko 2022-04-03T21:41:04.098 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/mwave 2022-04-03T21:41:04.098 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/mwave/mwave.ko 2022-04-03T21:41:04.098 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/pcmcia 2022-04-03T21:41:04.098 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-04-03T21:41:04.099 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-04-03T21:41:04.099 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/ppdev.ko 2022-04-03T21:41:04.099 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tlclk.ko 2022-04-03T21:41:04.099 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm 2022-04-03T21:41:04.099 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm/tpm.ko 2022-04-03T21:41:04.100 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm/tpm_atmel.ko 2022-04-03T21:41:04.100 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm/tpm_infineon.ko 2022-04-03T21:41:04.100 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm/tpm_nsc.ko 2022-04-03T21:41:04.100 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm/tpm_tis.ko 2022-04-03T21:41:04.101 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-04-03T21:41:04.101 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/uv_mmtimer.ko 2022-04-03T21:41:04.101 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/char/virtio_console.ko 2022-04-03T21:41:04.101 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq 2022-04-03T21:41:04.101 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-04-03T21:41:04.102 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-04-03T21:41:04.102 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq/p4-clockmod.ko 2022-04-03T21:41:04.102 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-04-03T21:41:04.102 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq/powernow-k8.ko 2022-04-03T21:41:04.103 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/cpufreq/speedstep-lib.ko 2022-04-03T21:41:04.103 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto 2022-04-03T21:41:04.103 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/ccp 2022-04-03T21:41:04.103 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-04-03T21:41:04.103 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/ccp/ccp.ko 2022-04-03T21:41:04.104 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/padlock-aes.ko 2022-04-03T21:41:04.104 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/padlock-sha.ko 2022-04-03T21:41:04.104 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/qat 2022-04-03T21:41:04.104 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/qat/qat_common 2022-04-03T21:41:04.104 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-04-03T21:41:04.105 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/qat/qat_dh895xcc 2022-04-03T21:41:04.105 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-04-03T21:41:04.105 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/virtio 2022-04-03T21:41:04.105 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-04-03T21:41:04.106 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dca 2022-04-03T21:41:04.106 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dca/dca.ko 2022-04-03T21:41:04.106 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/devfreq 2022-04-03T21:41:04.106 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-04-03T21:41:04.106 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dma 2022-04-03T21:41:04.107 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dma/dw 2022-04-03T21:41:04.107 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dma/dw/dw_dmac.ko 2022-04-03T21:41:04.107 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dma/ioat 2022-04-03T21:41:04.107 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/dma/ioat/ioatdma.ko 2022-04-03T21:41:04.107 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac 2022-04-03T21:41:04.108 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/amd64_edac.ko 2022-04-03T21:41:04.108 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/e752x_edac.ko 2022-04-03T21:41:04.108 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/edac_mce_amd.ko 2022-04-03T21:41:04.108 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i3000_edac.ko 2022-04-03T21:41:04.109 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i3200_edac.ko 2022-04-03T21:41:04.109 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i5000_edac.ko 2022-04-03T21:41:04.109 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i5100_edac.ko 2022-04-03T21:41:04.109 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i5400_edac.ko 2022-04-03T21:41:04.109 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i7300_edac.ko 2022-04-03T21:41:04.110 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i7core_edac.ko 2022-04-03T21:41:04.110 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/i82975x_edac.ko 2022-04-03T21:41:04.110 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/ie31200_edac.ko 2022-04-03T21:41:04.110 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/sb_edac.ko 2022-04-03T21:41:04.110 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/edac/x38_edac.ko 2022-04-03T21:41:04.111 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/firmware 2022-04-03T21:41:04.111 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/firmware/edd.ko 2022-04-03T21:41:04.111 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/firmware/iscsi_ibft.ko 2022-04-03T21:41:04.111 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/gpio 2022-04-03T21:41:04.111 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/gpio/gpio-ich.ko 2022-04-03T21:41:04.112 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/gpio/gpio-viperboard.ko 2022-04-03T21:41:04.112 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid 2022-04-03T21:41:04.112 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-appleir.ko 2022-04-03T21:41:04.112 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-aureal.ko 2022-04-03T21:41:04.112 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-axff.ko 2022-04-03T21:41:04.113 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-dr.ko 2022-04-03T21:41:04.113 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-elecom.ko 2022-04-03T21:41:04.113 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-elo.ko 2022-04-03T21:41:04.113 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-emsff.ko 2022-04-03T21:41:04.113 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-gaff.ko 2022-04-03T21:41:04.114 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-gt683r.ko 2022-04-03T21:41:04.114 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-gyration.ko 2022-04-03T21:41:04.114 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-holtek-kbd.ko 2022-04-03T21:41:04.114 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-holtek-mouse.ko 2022-04-03T21:41:04.114 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-holtekff.ko 2022-04-03T21:41:04.115 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-hyperv.ko 2022-04-03T21:41:04.115 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-icade.ko 2022-04-03T21:41:04.115 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-keytouch.ko 2022-04-03T21:41:04.115 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-kye.ko 2022-04-03T21:41:04.115 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-lcpower.ko 2022-04-03T21:41:04.116 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-led.ko 2022-04-03T21:41:04.116 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-lenovo.ko 2022-04-03T21:41:04.116 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-logitech-dj.ko 2022-04-03T21:41:04.116 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-04-03T21:41:04.116 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-multitouch.ko 2022-04-03T21:41:04.117 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-ortek.ko 2022-04-03T21:41:04.117 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-penmount.ko 2022-04-03T21:41:04.117 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-petalynx.ko 2022-04-03T21:41:04.117 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-picolcd.ko 2022-04-03T21:41:04.118 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-pl.ko 2022-04-03T21:41:04.118 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-plantronics.ko 2022-04-03T21:41:04.118 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-primax.ko 2022-04-03T21:41:04.118 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-rmi.ko 2022-04-03T21:41:04.118 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-arvo.ko 2022-04-03T21:41:04.119 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-common.ko 2022-04-03T21:41:04.119 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-isku.ko 2022-04-03T21:41:04.119 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-kone.ko 2022-04-03T21:41:04.119 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-04-03T21:41:04.119 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-konepure.ko 2022-04-03T21:41:04.120 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-04-03T21:41:04.120 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-lua.ko 2022-04-03T21:41:04.120 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-pyra.ko 2022-04-03T21:41:04.120 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-ryos.ko 2022-04-03T21:41:04.120 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat-savu.ko 2022-04-03T21:41:04.121 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-roccat.ko 2022-04-03T21:41:04.121 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-saitek.ko 2022-04-03T21:41:04.121 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-samsung.ko 2022-04-03T21:41:04.121 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-sensor-hub.ko 2022-04-03T21:41:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-sjoy.ko 2022-04-03T21:41:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-sony.ko 2022-04-03T21:41:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-speedlink.ko 2022-04-03T21:41:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-steelseries.ko 2022-04-03T21:41:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-sunplus.ko 2022-04-03T21:41:04.123 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-thrustmaster.ko 2022-04-03T21:41:04.123 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-tivo.ko 2022-04-03T21:41:04.123 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-tmff.ko 2022-04-03T21:41:04.123 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-topseed.ko 2022-04-03T21:41:04.123 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-twinhan.ko 2022-04-03T21:41:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-uclogic.ko 2022-04-03T21:41:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-waltop.ko 2022-04-03T21:41:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-wiimote.ko 2022-04-03T21:41:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-xinmo.ko 2022-04-03T21:41:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-zpff.ko 2022-04-03T21:41:04.125 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/hid-zydacron.ko 2022-04-03T21:41:04.125 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/uhid.ko 2022-04-03T21:41:04.125 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hid/wacom.ko 2022-04-03T21:41:04.125 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hv 2022-04-03T21:41:04.125 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hv/hv_balloon.ko 2022-04-03T21:41:04.126 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hv/hv_utils.ko 2022-04-03T21:41:04.126 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hv/hv_vmbus.ko 2022-04-03T21:41:04.126 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon 2022-04-03T21:41:04.126 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/abituguru.ko 2022-04-03T21:41:04.127 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/abituguru3.ko 2022-04-03T21:41:04.127 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/acpi_power_meter.ko 2022-04-03T21:41:04.127 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ad7414.ko 2022-04-03T21:41:04.127 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ad7418.ko 2022-04-03T21:41:04.127 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adc128d818.ko 2022-04-03T21:41:04.128 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adm1021.ko 2022-04-03T21:41:04.128 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adm1025.ko 2022-04-03T21:41:04.128 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adm1026.ko 2022-04-03T21:41:04.128 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adm1029.ko 2022-04-03T21:41:04.129 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adm1031.ko 2022-04-03T21:41:04.129 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adm9240.ko 2022-04-03T21:41:04.129 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ads7828.ko 2022-04-03T21:41:04.129 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adt7410.ko 2022-04-03T21:41:04.129 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adt7411.ko 2022-04-03T21:41:04.130 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adt7462.ko 2022-04-03T21:41:04.130 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adt7470.ko 2022-04-03T21:41:04.130 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adt7475.ko 2022-04-03T21:41:04.130 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/adt7x10.ko 2022-04-03T21:41:04.130 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/amc6821.ko 2022-04-03T21:41:04.131 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/applesmc.ko 2022-04-03T21:41:04.131 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/asb100.ko 2022-04-03T21:41:04.131 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/asc7621.ko 2022-04-03T21:41:04.131 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/asus_atk0110.ko 2022-04-03T21:41:04.131 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/atxp1.ko 2022-04-03T21:41:04.132 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/coretemp.ko 2022-04-03T21:41:04.132 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-04-03T21:41:04.132 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/dme1737.ko 2022-04-03T21:41:04.132 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ds1621.ko 2022-04-03T21:41:04.132 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ds620.ko 2022-04-03T21:41:04.133 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/emc1403.ko 2022-04-03T21:41:04.133 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/emc6w201.ko 2022-04-03T21:41:04.133 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/f71805f.ko 2022-04-03T21:41:04.133 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/f71882fg.ko 2022-04-03T21:41:04.134 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/f75375s.ko 2022-04-03T21:41:04.134 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/fam15h_power.ko 2022-04-03T21:41:04.134 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/fschmd.ko 2022-04-03T21:41:04.134 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/g760a.ko 2022-04-03T21:41:04.134 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/g762.ko 2022-04-03T21:41:04.135 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/gl518sm.ko 2022-04-03T21:41:04.135 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/gl520sm.ko 2022-04-03T21:41:04.135 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/hwmon-vid.ko 2022-04-03T21:41:04.135 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/i5500_temp.ko 2022-04-03T21:41:04.135 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/i5k_amb.ko 2022-04-03T21:41:04.136 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ibmaem.ko 2022-04-03T21:41:04.136 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ibmpex.ko 2022-04-03T21:41:04.136 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ina209.ko 2022-04-03T21:41:04.136 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ina2xx.ko 2022-04-03T21:41:04.136 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/it87.ko 2022-04-03T21:41:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/k10temp.ko 2022-04-03T21:41:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/k8temp.ko 2022-04-03T21:41:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lineage-pem.ko 2022-04-03T21:41:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm63.ko 2022-04-03T21:41:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm73.ko 2022-04-03T21:41:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm75.ko 2022-04-03T21:41:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm77.ko 2022-04-03T21:41:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm78.ko 2022-04-03T21:41:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm80.ko 2022-04-03T21:41:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm83.ko 2022-04-03T21:41:04.139 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm85.ko 2022-04-03T21:41:04.139 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm87.ko 2022-04-03T21:41:04.139 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm90.ko 2022-04-03T21:41:04.139 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm92.ko 2022-04-03T21:41:04.139 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm93.ko 2022-04-03T21:41:04.140 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm95234.ko 2022-04-03T21:41:04.140 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm95241.ko 2022-04-03T21:41:04.140 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/lm95245.ko 2022-04-03T21:41:04.140 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc2945.ko 2022-04-03T21:41:04.140 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc4151.ko 2022-04-03T21:41:04.141 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc4215.ko 2022-04-03T21:41:04.141 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc4222.ko 2022-04-03T21:41:04.141 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc4245.ko 2022-04-03T21:41:04.141 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc4260.ko 2022-04-03T21:41:04.141 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/ltc4261.ko 2022-04-03T21:41:04.142 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max16065.ko 2022-04-03T21:41:04.142 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max1619.ko 2022-04-03T21:41:04.142 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max1668.ko 2022-04-03T21:41:04.142 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max197.ko 2022-04-03T21:41:04.142 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max6639.ko 2022-04-03T21:41:04.143 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max6642.ko 2022-04-03T21:41:04.143 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max6650.ko 2022-04-03T21:41:04.143 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/max6697.ko 2022-04-03T21:41:04.143 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/mcp3021.ko 2022-04-03T21:41:04.143 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/nct6683.ko 2022-04-03T21:41:04.144 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/nct6775.ko 2022-04-03T21:41:04.144 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/nct7802.ko 2022-04-03T21:41:04.144 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pc87360.ko 2022-04-03T21:41:04.144 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pc87427.ko 2022-04-03T21:41:04.145 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pcf8591.ko 2022-04-03T21:41:04.145 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus 2022-04-03T21:41:04.145 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-04-03T21:41:04.145 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-04-03T21:41:04.145 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-04-03T21:41:04.145 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/max16064.ko 2022-04-03T21:41:04.146 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/max34440.ko 2022-04-03T21:41:04.146 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/max8688.ko 2022-04-03T21:41:04.146 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-04-03T21:41:04.146 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-04-03T21:41:04.146 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-04-03T21:41:04.147 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-04-03T21:41:04.147 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-04-03T21:41:04.147 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-04-03T21:41:04.147 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/powr1220.ko 2022-04-03T21:41:04.147 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/sch5627.ko 2022-04-03T21:41:04.148 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/sch5636.ko 2022-04-03T21:41:04.148 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/sch56xx-common.ko 2022-04-03T21:41:04.148 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/sht15.ko 2022-04-03T21:41:04.148 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/sht21.ko 2022-04-03T21:41:04.148 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/shtc1.ko 2022-04-03T21:41:04.149 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/sis5595.ko 2022-04-03T21:41:04.149 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/smsc47b397.ko 2022-04-03T21:41:04.149 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/smsc47m1.ko 2022-04-03T21:41:04.149 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/smsc47m192.ko 2022-04-03T21:41:04.149 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/thmc50.ko 2022-04-03T21:41:04.150 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/tmp102.ko 2022-04-03T21:41:04.150 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/tmp103.ko 2022-04-03T21:41:04.150 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/tmp401.ko 2022-04-03T21:41:04.150 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/tmp421.ko 2022-04-03T21:41:04.151 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/via-cputemp.ko 2022-04-03T21:41:04.151 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/via686a.ko 2022-04-03T21:41:04.151 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/vt1211.ko 2022-04-03T21:41:04.151 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/vt8231.ko 2022-04-03T21:41:04.151 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83627ehf.ko 2022-04-03T21:41:04.152 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83627hf.ko 2022-04-03T21:41:04.152 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83781d.ko 2022-04-03T21:41:04.152 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83791d.ko 2022-04-03T21:41:04.152 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83792d.ko 2022-04-03T21:41:04.152 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83793.ko 2022-04-03T21:41:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83795.ko 2022-04-03T21:41:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83l785ts.ko 2022-04-03T21:41:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/hwmon/w83l786ng.ko 2022-04-03T21:41:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c 2022-04-03T21:41:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/algos 2022-04-03T21:41:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-04-03T21:41:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-04-03T21:41:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses 2022-04-03T21:41:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-04-03T21:41:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-04-03T21:41:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-04-03T21:41:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-04-03T21:41:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-04-03T21:41:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-04-03T21:41:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-04-03T21:41:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-i801.ko 2022-04-03T21:41:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-isch.ko 2022-04-03T21:41:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-04-03T21:41:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-04-03T21:41:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-04-03T21:41:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-parport.ko 2022-04-03T21:41:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-04-03T21:41:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-04-03T21:41:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-04-03T21:41:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-04-03T21:41:04.158 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-04-03T21:41:04.158 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-04-03T21:41:04.158 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-via.ko 2022-04-03T21:41:04.158 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-04-03T21:41:04.158 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-04-03T21:41:04.159 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/i2c-dev.ko 2022-04-03T21:41:04.159 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/i2c-mux.ko 2022-04-03T21:41:04.159 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-04-03T21:41:04.159 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/i2c-smbus.ko 2022-04-03T21:41:04.159 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/i2c/i2c-stub.ko 2022-04-03T21:41:04.159 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband 2022-04-03T21:41:04.160 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core 2022-04-03T21:41:04.160 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/ib_cm.ko 2022-04-03T21:41:04.160 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/ib_core.ko 2022-04-03T21:41:04.160 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/ib_umad.ko 2022-04-03T21:41:04.160 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-04-03T21:41:04.161 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/iw_cm.ko 2022-04-03T21:41:04.161 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/rdma_cm.ko 2022-04-03T21:41:04.161 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-04-03T21:41:04.161 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw 2022-04-03T21:41:04.161 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/cxgb4 2022-04-03T21:41:04.162 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-04-03T21:41:04.162 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/mlx4 2022-04-03T21:41:04.162 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-04-03T21:41:04.162 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/mlx5 2022-04-03T21:41:04.162 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-04-03T21:41:04.163 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/mthca 2022-04-03T21:41:04.163 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-04-03T21:41:04.163 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp 2022-04-03T21:41:04.163 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/ipoib 2022-04-03T21:41:04.163 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-04-03T21:41:04.164 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/iser 2022-04-03T21:41:04.164 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-04-03T21:41:04.164 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/isert 2022-04-03T21:41:04.164 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-04-03T21:41:04.164 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/srp 2022-04-03T21:41:04.165 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-04-03T21:41:04.165 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/srpt 2022-04-03T21:41:04.165 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-04-03T21:41:04.165 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input 2022-04-03T21:41:04.165 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/gameport 2022-04-03T21:41:04.166 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-04-03T21:41:04.166 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/gameport/fm801-gp.ko 2022-04-03T21:41:04.166 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/gameport/gameport.ko 2022-04-03T21:41:04.166 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/gameport/lightning.ko 2022-04-03T21:41:04.166 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/gameport/ns558.ko 2022-04-03T21:41:04.167 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/joydev.ko 2022-04-03T21:41:04.167 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/keyboard 2022-04-03T21:41:04.167 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/keyboard/gpio_keys.ko 2022-04-03T21:41:04.167 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse 2022-04-03T21:41:04.167 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/appletouch.ko 2022-04-03T21:41:04.168 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/bcm5974.ko 2022-04-03T21:41:04.168 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/cyapatp.ko 2022-04-03T21:41:04.168 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/elan_i2c.ko 2022-04-03T21:41:04.168 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/sermouse.ko 2022-04-03T21:41:04.168 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-04-03T21:41:04.168 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/synaptics_usb.ko 2022-04-03T21:41:04.169 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/mouse/vsxxxaa.ko 2022-04-03T21:41:04.169 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/rmi4 2022-04-03T21:41:04.169 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/rmi4/rmi_core.ko 2022-04-03T21:41:04.169 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/serio 2022-04-03T21:41:04.169 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/serio/altera_ps2.ko 2022-04-03T21:41:04.170 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/serio/arc_ps2.ko 2022-04-03T21:41:04.170 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-04-03T21:41:04.170 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/serio/serio_raw.ko 2022-04-03T21:41:04.170 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/input/sparse-keymap.ko 2022-04-03T21:41:04.170 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/iommu 2022-04-03T21:41:04.171 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/iommu/amd 2022-04-03T21:41:04.171 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/iommu/amd/iommu_v2.ko 2022-04-03T21:41:04.171 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds 2022-04-03T21:41:04.171 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/leds-blinkm.ko 2022-04-03T21:41:04.171 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/leds-clevo-mail.ko 2022-04-03T21:41:04.172 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/leds-lm3530.ko 2022-04-03T21:41:04.172 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/leds-lp3944.ko 2022-04-03T21:41:04.172 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/leds-ss4200.ko 2022-04-03T21:41:04.172 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger 2022-04-03T21:41:04.172 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-04-03T21:41:04.173 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-04-03T21:41:04.173 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-04-03T21:41:04.173 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-04-03T21:41:04.173 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-04-03T21:41:04.173 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-04-03T21:41:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-04-03T21:41:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-04-03T21:41:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-04-03T21:41:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md 2022-04-03T21:41:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/bcache 2022-04-03T21:41:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/bcache/bcache.ko 2022-04-03T21:41:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-bio-prison.ko 2022-04-03T21:41:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-cache-smq.ko 2022-04-03T21:41:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-cache.ko 2022-04-03T21:41:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-crypt.ko 2022-04-03T21:41:04.176 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-delay.ko 2022-04-03T21:41:04.176 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-flakey.ko 2022-04-03T21:41:04.176 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-log-userspace.ko 2022-04-03T21:41:04.176 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-multipath.ko 2022-04-03T21:41:04.176 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-queue-length.ko 2022-04-03T21:41:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-raid.ko 2022-04-03T21:41:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-round-robin.ko 2022-04-03T21:41:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-service-time.ko 2022-04-03T21:41:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-switch.ko 2022-04-03T21:41:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-thin-pool.ko 2022-04-03T21:41:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/dm-verity.ko 2022-04-03T21:41:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/faulty.ko 2022-04-03T21:41:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/linear.ko 2022-04-03T21:41:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/multipath.ko 2022-04-03T21:41:04.179 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/persistent-data 2022-04-03T21:41:04.179 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-04-03T21:41:04.179 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/raid0.ko 2022-04-03T21:41:04.179 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/raid1.ko 2022-04-03T21:41:04.179 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/raid10.ko 2022-04-03T21:41:04.179 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/md/raid456.ko 2022-04-03T21:41:04.180 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message 2022-04-03T21:41:04.180 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion 2022-04-03T21:41:04.180 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptbase.ko 2022-04-03T21:41:04.180 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptctl.ko 2022-04-03T21:41:04.180 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptfc.ko 2022-04-03T21:41:04.181 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptlan.ko 2022-04-03T21:41:04.181 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptsas.ko 2022-04-03T21:41:04.181 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptscsih.ko 2022-04-03T21:41:04.181 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/message/fusion/mptspi.ko 2022-04-03T21:41:04.181 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd 2022-04-03T21:41:04.182 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/lpc_ich.ko 2022-04-03T21:41:04.182 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/lpc_sch.ko 2022-04-03T21:41:04.182 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/mfd-core.ko 2022-04-03T21:41:04.182 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/sm501.ko 2022-04-03T21:41:04.182 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/viperboard.ko 2022-04-03T21:41:04.183 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/vx855.ko 2022-04-03T21:41:04.183 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/mfd/wl1273-core.ko 2022-04-03T21:41:04.183 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc 2022-04-03T21:41:04.183 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/altera-stapl 2022-04-03T21:41:04.183 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-04-03T21:41:04.184 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/apds9802als.ko 2022-04-03T21:41:04.184 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/apds990x.ko 2022-04-03T21:41:04.184 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/bh1770glc.ko 2022-04-03T21:41:04.184 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/cb710 2022-04-03T21:41:04.184 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/cb710/cb710.ko 2022-04-03T21:41:04.185 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/eeprom 2022-04-03T21:41:04.185 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/eeprom/at24.ko 2022-04-03T21:41:04.185 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/eeprom/eeprom.ko 2022-04-03T21:41:04.185 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-04-03T21:41:04.185 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/eeprom/max6875.ko 2022-04-03T21:41:04.186 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/enclosure.ko 2022-04-03T21:41:04.186 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/hpilo.ko 2022-04-03T21:41:04.186 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/isl29003.ko 2022-04-03T21:41:04.186 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/isl29020.ko 2022-04-03T21:41:04.186 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/lis3lv02d 2022-04-03T21:41:04.187 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-04-03T21:41:04.187 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-04-03T21:41:04.187 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/mei 2022-04-03T21:41:04.187 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/mei/mei-me.ko 2022-04-03T21:41:04.187 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/mei/mei-txe.ko 2022-04-03T21:41:04.188 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/mei/mei.ko 2022-04-03T21:41:04.188 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/sgi-gru 2022-04-03T21:41:04.188 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/sgi-gru/gru.ko 2022-04-03T21:41:04.188 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/sgi-xp 2022-04-03T21:41:04.189 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/sgi-xp/xp.ko 2022-04-03T21:41:04.189 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/sgi-xp/xpc.ko 2022-04-03T21:41:04.189 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-04-03T21:41:04.189 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/tifm_7xx1.ko 2022-04-03T21:41:04.189 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/tifm_core.ko 2022-04-03T21:41:04.190 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/tsl2550.ko 2022-04-03T21:41:04.190 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/vmw_balloon.ko 2022-04-03T21:41:04.190 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/vmw_vmci 2022-04-03T21:41:04.190 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-04-03T21:41:04.190 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net 2022-04-03T21:41:04.191 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/bonding 2022-04-03T21:41:04.191 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/bonding/bonding.ko 2022-04-03T21:41:04.191 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa 2022-04-03T21:41:04.191 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa/b53 2022-04-03T21:41:04.191 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa/b53/b53_common.ko 2022-04-03T21:41:04.191 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa/bcm-sf2.ko 2022-04-03T21:41:04.192 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa/mv88e6060.ko 2022-04-03T21:41:04.192 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa/mv88e6xxx 2022-04-03T21:41:04.192 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-04-03T21:41:04.192 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/dummy.ko 2022-04-03T21:41:04.193 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/eql.ko 2022-04-03T21:41:04.193 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet 2022-04-03T21:41:04.193 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/3com 2022-04-03T21:41:04.193 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-04-03T21:41:04.193 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-04-03T21:41:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-04-03T21:41:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-04-03T21:41:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/8390 2022-04-03T21:41:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/8390/8390.ko 2022-04-03T21:41:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-04-03T21:41:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-04-03T21:41:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-04-03T21:41:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/adaptec 2022-04-03T21:41:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-04-03T21:41:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/agere 2022-04-03T21:41:04.196 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/agere/et131x.ko 2022-04-03T21:41:04.196 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/alteon 2022-04-03T21:41:04.196 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-04-03T21:41:04.196 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/altera 2022-04-03T21:41:04.196 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-04-03T21:41:04.197 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/amd 2022-04-03T21:41:04.197 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-04-03T21:41:04.197 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-04-03T21:41:04.197 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-04-03T21:41:04.197 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros 2022-04-03T21:41:04.198 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/alx 2022-04-03T21:41:04.198 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-04-03T21:41:04.198 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atl1c 2022-04-03T21:41:04.198 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-04-03T21:41:04.198 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atl1e 2022-04-03T21:41:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-04-03T21:41:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atlx 2022-04-03T21:41:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-04-03T21:41:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-04-03T21:41:04.199 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom 2022-04-03T21:41:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-04-03T21:41:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-04-03T21:41:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-04-03T21:41:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-04-03T21:41:04.200 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-04-03T21:41:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/genet 2022-04-03T21:41:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-04-03T21:41:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-04-03T21:41:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/brocade 2022-04-03T21:41:04.201 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/brocade/bna 2022-04-03T21:41:04.202 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-04-03T21:41:04.202 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio 2022-04-03T21:41:04.202 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb 2022-04-03T21:41:04.202 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-04-03T21:41:04.203 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-04-03T21:41:04.203 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-04-03T21:41:04.203 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-04-03T21:41:04.203 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-04-03T21:41:04.203 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-04-03T21:41:04.204 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-04-03T21:41:04.204 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-04-03T21:41:04.204 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-04-03T21:41:04.204 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/cisco 2022-04-03T21:41:04.204 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/cisco/enic 2022-04-03T21:41:04.204 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-04-03T21:41:04.205 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec 2022-04-03T21:41:04.205 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip 2022-04-03T21:41:04.205 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-04-03T21:41:04.205 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2022-04-03T21:41:04.205 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-04-03T21:41:04.206 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-04-03T21:41:04.206 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-04-03T21:41:04.206 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-04-03T21:41:04.206 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-04-03T21:41:04.206 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dlink 2022-04-03T21:41:04.207 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-04-03T21:41:04.207 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-04-03T21:41:04.207 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/dnet.ko 2022-04-03T21:41:04.207 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/emulex 2022-04-03T21:41:04.208 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/emulex/benet 2022-04-03T21:41:04.208 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-04-03T21:41:04.208 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/ethoc.ko 2022-04-03T21:41:04.208 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/fealnx.ko 2022-04-03T21:41:04.208 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel 2022-04-03T21:41:04.208 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/e100.ko 2022-04-03T21:41:04.209 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/e1000 2022-04-03T21:41:04.209 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-04-03T21:41:04.209 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/e1000e 2022-04-03T21:41:04.209 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-04-03T21:41:04.209 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/fm10k 2022-04-03T21:41:04.210 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-04-03T21:41:04.210 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/i40e 2022-04-03T21:41:04.210 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-04-03T21:41:04.210 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/iavf 2022-04-03T21:41:04.210 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-04-03T21:41:04.211 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/igb 2022-04-03T21:41:04.211 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-04-03T21:41:04.211 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/igbvf 2022-04-03T21:41:04.211 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-04-03T21:41:04.212 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/ixgb 2022-04-03T21:41:04.212 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-04-03T21:41:04.212 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/ixgbe 2022-04-03T21:41:04.212 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-04-03T21:41:04.212 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/ixgbevf 2022-04-03T21:41:04.213 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-04-03T21:41:04.213 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/jme.ko 2022-04-03T21:41:04.213 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/marvell 2022-04-03T21:41:04.213 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-04-03T21:41:04.213 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/marvell/skge.ko 2022-04-03T21:41:04.214 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-04-03T21:41:04.214 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox 2022-04-03T21:41:04.214 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox/mlx4 2022-04-03T21:41:04.214 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-04-03T21:41:04.214 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-04-03T21:41:04.215 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox/mlx5 2022-04-03T21:41:04.215 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-04-03T21:41:04.215 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-04-03T21:41:04.215 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/micrel 2022-04-03T21:41:04.215 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-04-03T21:41:04.216 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/myricom 2022-04-03T21:41:04.216 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/myricom/myri10ge 2022-04-03T21:41:04.216 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-04-03T21:41:04.216 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/natsemi 2022-04-03T21:41:04.216 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-04-03T21:41:04.217 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-04-03T21:41:04.217 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/neterion 2022-04-03T21:41:04.217 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-04-03T21:41:04.217 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/neterion/vxge 2022-04-03T21:41:04.217 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2022-04-03T21:41:04.218 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/nvidia 2022-04-03T21:41:04.218 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-04-03T21:41:04.218 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/packetengines 2022-04-03T21:41:04.218 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-04-03T21:41:04.218 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-04-03T21:41:04.219 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/qlogic 2022-04-03T21:41:04.219 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/qlogic/netxen 2022-04-03T21:41:04.219 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-04-03T21:41:04.219 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-04-03T21:41:04.220 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-04-03T21:41:04.220 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-04-03T21:41:04.220 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/rdc 2022-04-03T21:41:04.220 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-04-03T21:41:04.220 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/realtek 2022-04-03T21:41:04.221 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-04-03T21:41:04.221 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-04-03T21:41:04.221 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/realtek/atp.ko 2022-04-03T21:41:04.221 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-04-03T21:41:04.221 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/rocker 2022-04-03T21:41:04.222 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-04-03T21:41:04.222 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sfc 2022-04-03T21:41:04.222 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-04-03T21:41:04.222 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/silan 2022-04-03T21:41:04.223 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-04-03T21:41:04.223 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sis 2022-04-03T21:41:04.223 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sis/sis190.ko 2022-04-03T21:41:04.223 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sis/sis900.ko 2022-04-03T21:41:04.223 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/smsc 2022-04-03T21:41:04.224 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-04-03T21:41:04.224 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-04-03T21:41:04.224 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-04-03T21:41:04.224 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-04-03T21:41:04.224 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/stmicro 2022-04-03T21:41:04.225 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/stmicro/stmmac 2022-04-03T21:41:04.225 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-04-03T21:41:04.225 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-04-03T21:41:04.225 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sun 2022-04-03T21:41:04.225 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sun/cassini.ko 2022-04-03T21:41:04.226 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sun/niu.ko 2022-04-03T21:41:04.226 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sun/sungem.ko 2022-04-03T21:41:04.226 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-04-03T21:41:04.226 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/tehuti 2022-04-03T21:41:04.227 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-04-03T21:41:04.227 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/ti 2022-04-03T21:41:04.227 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/ti/tlan.ko 2022-04-03T21:41:04.227 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/via 2022-04-03T21:41:04.227 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-04-03T21:41:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-04-03T21:41:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/wiznet 2022-04-03T21:41:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-04-03T21:41:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-04-03T21:41:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/xircom 2022-04-03T21:41:04.229 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-04-03T21:41:04.229 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/geneve.ko 2022-04-03T21:41:04.229 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/hyperv 2022-04-03T21:41:04.229 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-04-03T21:41:04.230 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ieee802154 2022-04-03T21:41:04.230 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ieee802154/fakelb.ko 2022-04-03T21:41:04.230 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ifb.ko 2022-04-03T21:41:04.230 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ipvlan 2022-04-03T21:41:04.230 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ipvlan/ipvlan.ko 2022-04-03T21:41:04.231 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/macvlan.ko 2022-04-03T21:41:04.231 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/macvtap.ko 2022-04-03T21:41:04.231 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/mdio 2022-04-03T21:41:04.231 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/mdio.ko 2022-04-03T21:41:04.231 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-04-03T21:41:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-04-03T21:41:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/mii.ko 2022-04-03T21:41:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/net_failover.ko 2022-04-03T21:41:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/netconsole.ko 2022-04-03T21:41:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/nlmon.ko 2022-04-03T21:41:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/pcs 2022-04-03T21:41:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-04-03T21:41:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy 2022-04-03T21:41:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/amd.ko 2022-04-03T21:41:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-04-03T21:41:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/bcm7xxx.ko 2022-04-03T21:41:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/bcm87xx.ko 2022-04-03T21:41:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/broadcom.ko 2022-04-03T21:41:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/cicada.ko 2022-04-03T21:41:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/davicom.ko 2022-04-03T21:41:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/dp83640.ko 2022-04-03T21:41:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/et1011c.ko 2022-04-03T21:41:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/icplus.ko 2022-04-03T21:41:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/lxt.ko 2022-04-03T21:41:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/marvell.ko 2022-04-03T21:41:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/micrel.ko 2022-04-03T21:41:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/national.ko 2022-04-03T21:41:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/phylink.ko 2022-04-03T21:41:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/qsemi.ko 2022-04-03T21:41:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/realtek.ko 2022-04-03T21:41:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/smsc.ko 2022-04-03T21:41:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/ste10Xp.ko 2022-04-03T21:41:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/phy/vitesse.ko 2022-04-03T21:41:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp 2022-04-03T21:41:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/bsd_comp.ko 2022-04-03T21:41:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/ppp_async.ko 2022-04-03T21:41:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/ppp_deflate.ko 2022-04-03T21:41:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/ppp_generic.ko 2022-04-03T21:41:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/ppp_mppe.ko 2022-04-03T21:41:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/ppp_synctty.ko 2022-04-03T21:41:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/pppoe.ko 2022-04-03T21:41:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/pppox.ko 2022-04-03T21:41:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/ppp/pptp.ko 2022-04-03T21:41:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/slip 2022-04-03T21:41:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/slip/slhc.ko 2022-04-03T21:41:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/slip/slip.ko 2022-04-03T21:41:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/sungem_phy.ko 2022-04-03T21:41:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/tap.ko 2022-04-03T21:41:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team 2022-04-03T21:41:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team/team.ko 2022-04-03T21:41:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team/team_mode_activebackup.ko 2022-04-03T21:41:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team/team_mode_broadcast.ko 2022-04-03T21:41:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-04-03T21:41:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team/team_mode_random.ko 2022-04-03T21:41:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-04-03T21:41:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/tun.ko 2022-04-03T21:41:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/veth.ko 2022-04-03T21:41:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/virtio_net.ko 2022-04-03T21:41:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/vmxnet3 2022-04-03T21:41:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-04-03T21:41:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/vxlan.ko 2022-04-03T21:41:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/xen-netback 2022-04-03T21:41:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/xen-netback/xen-netback.ko 2022-04-03T21:41:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/net/xen-netfront.ko 2022-04-03T21:41:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ntb 2022-04-03T21:41:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ntb/ntb.ko 2022-04-03T21:41:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/nvme 2022-04-03T21:41:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/nvme/host 2022-04-03T21:41:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/nvme/host/nvme-core.ko 2022-04-03T21:41:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/nvme/host/nvme.ko 2022-04-03T21:41:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/parport 2022-04-03T21:41:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/parport/parport.ko 2022-04-03T21:41:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/parport/parport_cs.ko 2022-04-03T21:41:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/parport/parport_pc.ko 2022-04-03T21:41:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/parport/parport_serial.ko 2022-04-03T21:41:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pci 2022-04-03T21:41:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pci/hotplug 2022-04-03T21:41:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-04-03T21:41:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pci/pcie 2022-04-03T21:41:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pci/pcie/aer_inject.ko 2022-04-03T21:41:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pci/xen-pcifront.ko 2022-04-03T21:41:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pcmcia 2022-04-03T21:41:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pcmcia/i82092.ko 2022-04-03T21:41:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pcmcia/pd6729.ko 2022-04-03T21:41:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pcmcia/yenta_socket.ko 2022-04-03T21:41:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pinctrl 2022-04-03T21:41:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pinctrl/intel 2022-04-03T21:41:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-04-03T21:41:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform 2022-04-03T21:41:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86 2022-04-03T21:41:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/acer-wmi.ko 2022-04-03T21:41:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/acerhdf.ko 2022-04-03T21:41:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/apple-gmux.ko 2022-04-03T21:41:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/asus-laptop.ko 2022-04-03T21:41:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-04-03T21:41:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/asus-wmi.ko 2022-04-03T21:41:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/classmate-laptop.ko 2022-04-03T21:41:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-04-03T21:41:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-04-03T21:41:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-04-03T21:41:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-04-03T21:41:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/hdaps.ko 2022-04-03T21:41:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/hp-wmi.ko 2022-04-03T21:41:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/hp_accel.ko 2022-04-03T21:41:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/intel 2022-04-03T21:41:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-04-03T21:41:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/intel_ips.ko 2022-04-03T21:41:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/msi-wmi.ko 2022-04-03T21:41:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/mxm-wmi.ko 2022-04-03T21:41:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-04-03T21:41:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/samsung-laptop.ko 2022-04-03T21:41:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/samsung-q10.ko 2022-04-03T21:41:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/topstar-laptop.ko 2022-04-03T21:41:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-04-03T21:41:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/toshiba_haps.ko 2022-04-03T21:41:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/wmi-bmof.ko 2022-04-03T21:41:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/platform/x86/wmi.ko 2022-04-03T21:41:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/powercap 2022-04-03T21:41:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/powercap/intel_rapl_common.ko 2022-04-03T21:41:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/powercap/intel_rapl_msr.ko 2022-04-03T21:41:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pps 2022-04-03T21:41:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pps/clients 2022-04-03T21:41:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pps/clients/pps-gpio.ko 2022-04-03T21:41:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pps/clients/pps-ldisc.ko 2022-04-03T21:41:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pps/clients/pps_parport.ko 2022-04-03T21:41:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/pps/pps_core.ko 2022-04-03T21:41:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ptp 2022-04-03T21:41:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ptp/ptp.ko 2022-04-03T21:41:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ptp/ptp_kvm.ko 2022-04-03T21:41:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc 2022-04-03T21:41:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-bq32k.ko 2022-04-03T21:41:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-bq4802.ko 2022-04-03T21:41:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1286.ko 2022-04-03T21:41:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1307.ko 2022-04-03T21:41:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1374.ko 2022-04-03T21:41:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1511.ko 2022-04-03T21:41:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1553.ko 2022-04-03T21:41:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1672.ko 2022-04-03T21:41:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds1742.ko 2022-04-03T21:41:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds2404.ko 2022-04-03T21:41:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-ds3232.ko 2022-04-03T21:41:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-em3027.ko 2022-04-03T21:41:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-fm3130.ko 2022-04-03T21:41:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-isl12022.ko 2022-04-03T21:41:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-isl1208.ko 2022-04-03T21:41:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-m41t80.ko 2022-04-03T21:41:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-m48t35.ko 2022-04-03T21:41:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-m48t59.ko 2022-04-03T21:41:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-max6900.ko 2022-04-03T21:41:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-msm6242.ko 2022-04-03T21:41:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-pcf2127.ko 2022-04-03T21:41:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-pcf85063.ko 2022-04-03T21:41:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-pcf8523.ko 2022-04-03T21:41:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-pcf8563.ko 2022-04-03T21:41:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-pcf8583.ko 2022-04-03T21:41:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-rp5c01.ko 2022-04-03T21:41:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-rs5c372.ko 2022-04-03T21:41:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-04-03T21:41:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-rx8025.ko 2022-04-03T21:41:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-rx8581.ko 2022-04-03T21:41:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-04-03T21:41:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-v3020.ko 2022-04-03T21:41:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/rtc/rtc-x1205.ko 2022-04-03T21:41:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi 2022-04-03T21:41:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/3w-9xxx.ko 2022-04-03T21:41:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/3w-sas.ko 2022-04-03T21:41:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/3w-xxxx.ko 2022-04-03T21:41:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/BusLogic.ko 2022-04-03T21:41:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/a100u2w.ko 2022-04-03T21:41:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/aacraid 2022-04-03T21:41:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/aacraid/aacraid.ko 2022-04-03T21:41:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/advansys.ko 2022-04-03T21:41:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/aic7xxx 2022-04-03T21:41:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-04-03T21:41:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-04-03T21:41:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/am53c974.ko 2022-04-03T21:41:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/arcmsr 2022-04-03T21:41:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-04-03T21:41:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/atp870u.ko 2022-04-03T21:41:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/be2iscsi 2022-04-03T21:41:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-04-03T21:41:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/bfa 2022-04-03T21:41:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/bfa/bfa.ko 2022-04-03T21:41:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/bnx2fc 2022-04-03T21:41:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-04-03T21:41:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/bnx2i 2022-04-03T21:41:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-04-03T21:41:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ch.ko 2022-04-03T21:41:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/csiostor 2022-04-03T21:41:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/csiostor/csiostor.ko 2022-04-03T21:41:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/cxgbi 2022-04-03T21:41:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/cxgbi/cxgb3i 2022-04-03T21:41:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-04-03T21:41:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/cxgbi/cxgb4i 2022-04-03T21:41:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-04-03T21:41:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-04-03T21:41:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/dc395x.ko 2022-04-03T21:41:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/device_handler 2022-04-03T21:41:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-04-03T21:41:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-04-03T21:41:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-04-03T21:41:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-04-03T21:41:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/dmx3191d.ko 2022-04-03T21:41:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/esas2r 2022-04-03T21:41:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/esas2r/esas2r.ko 2022-04-03T21:41:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/esp_scsi.ko 2022-04-03T21:41:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/fcoe 2022-04-03T21:41:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/fcoe/fcoe.ko 2022-04-03T21:41:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-04-03T21:41:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/fnic 2022-04-03T21:41:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/fnic/fnic.ko 2022-04-03T21:41:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/hpsa.ko 2022-04-03T21:41:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/hptiop.ko 2022-04-03T21:41:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/hv_storvsc.ko 2022-04-03T21:41:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/initio.ko 2022-04-03T21:41:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ipr.ko 2022-04-03T21:41:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ips.ko 2022-04-03T21:41:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/isci 2022-04-03T21:41:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/isci/isci.ko 2022-04-03T21:41:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-04-03T21:41:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/iscsi_tcp.ko 2022-04-03T21:41:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/libfc 2022-04-03T21:41:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/libfc/libfc.ko 2022-04-03T21:41:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/libiscsi.ko 2022-04-03T21:41:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/libiscsi_tcp.ko 2022-04-03T21:41:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/libsas 2022-04-03T21:41:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/libsas/libsas.ko 2022-04-03T21:41:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/lpfc 2022-04-03T21:41:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/lpfc/lpfc.ko 2022-04-03T21:41:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/megaraid 2022-04-03T21:41:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/megaraid.ko 2022-04-03T21:41:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-04-03T21:41:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-04-03T21:41:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-04-03T21:41:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/mpt3sas 2022-04-03T21:41:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-04-03T21:41:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/mvsas 2022-04-03T21:41:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/mvsas/mvsas.ko 2022-04-03T21:41:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/mvumi.ko 2022-04-03T21:41:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/pm8001 2022-04-03T21:41:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-04-03T21:41:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/pmcraid.ko 2022-04-03T21:41:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/qla1280.ko 2022-04-03T21:41:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/qla2xxx 2022-04-03T21:41:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-04-03T21:41:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-04-03T21:41:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/qla4xxx 2022-04-03T21:41:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-04-03T21:41:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/raid_class.ko 2022-04-03T21:41:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/scsi_debug.ko 2022-04-03T21:41:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/scsi_transport_fc.ko 2022-04-03T21:41:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-04-03T21:41:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/scsi_transport_sas.ko 2022-04-03T21:41:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/scsi_transport_spi.ko 2022-04-03T21:41:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/scsi_transport_srp.ko 2022-04-03T21:41:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ses.ko 2022-04-03T21:41:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/st.ko 2022-04-03T21:41:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/stex.ko 2022-04-03T21:41:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/sym53c8xx_2 2022-04-03T21:41:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-04-03T21:41:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ufs 2022-04-03T21:41:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ufs/ufshcd-core.ko 2022-04-03T21:41:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2022-04-03T21:41:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/virtio_scsi.ko 2022-04-03T21:41:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/vmw_pvscsi.ko 2022-04-03T21:41:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/scsi/wd719x.ko 2022-04-03T21:41:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ssb 2022-04-03T21:41:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/ssb/ssb.ko 2022-04-03T21:41:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target 2022-04-03T21:41:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/iscsi 2022-04-03T21:41:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-04-03T21:41:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/loopback 2022-04-03T21:41:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/loopback/tcm_loop.ko 2022-04-03T21:41:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/target_core_file.ko 2022-04-03T21:41:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/target_core_iblock.ko 2022-04-03T21:41:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/target_core_mod.ko 2022-04-03T21:41:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/target_core_pscsi.ko 2022-04-03T21:41:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/target_core_user.ko 2022-04-03T21:41:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/tcm_fc 2022-04-03T21:41:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-04-03T21:41:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal 2022-04-03T21:41:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel 2022-04-03T21:41:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal 2022-04-03T21:41:04.290 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-04-03T21:41:04.290 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-04-03T21:41:04.290 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-04-03T21:41:04.290 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-04-03T21:41:04.290 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-04-03T21:41:04.291 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-04-03T21:41:04.291 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-04-03T21:41:04.291 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-04-03T21:41:04.291 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-04-03T21:41:04.291 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-04-03T21:41:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-04-03T21:41:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-04-03T21:41:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-04-03T21:41:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-04-03T21:41:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-04-03T21:41:04.293 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty 2022-04-03T21:41:04.293 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/ipwireless 2022-04-03T21:41:04.293 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-04-03T21:41:04.293 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/n_gsm.ko 2022-04-03T21:41:04.293 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/n_hdlc.ko 2022-04-03T21:41:04.294 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/nozomi.ko 2022-04-03T21:41:04.294 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/serial 2022-04-03T21:41:04.294 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/serial/8250 2022-04-03T21:41:04.294 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-04-03T21:41:04.294 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/serial/arc_uart.ko 2022-04-03T21:41:04.295 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/serial/jsm 2022-04-03T21:41:04.295 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/serial/jsm/jsm.ko 2022-04-03T21:41:04.295 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/tty/synclink_gt.ko 2022-04-03T21:41:04.295 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/uio 2022-04-03T21:41:04.296 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/uio/uio.ko 2022-04-03T21:41:04.296 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/uio/uio_aec.ko 2022-04-03T21:41:04.296 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/uio/uio_cif.ko 2022-04-03T21:41:04.296 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/uio/uio_pci_generic.ko 2022-04-03T21:41:04.296 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/uio/uio_sercos3.ko 2022-04-03T21:41:04.297 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb 2022-04-03T21:41:04.297 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/class 2022-04-03T21:41:04.297 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/class/cdc-acm.ko 2022-04-03T21:41:04.297 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/class/cdc-wdm.ko 2022-04-03T21:41:04.297 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/class/usblp.ko 2022-04-03T21:41:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/class/usbtmc.ko 2022-04-03T21:41:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/host 2022-04-03T21:41:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/host/sl811-hcd.ko 2022-04-03T21:41:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/host/u132-hcd.ko 2022-04-03T21:41:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/image 2022-04-03T21:41:04.305 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/image/mdc800.ko 2022-04-03T21:41:04.305 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/image/microtek.ko 2022-04-03T21:41:04.305 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc 2022-04-03T21:41:04.306 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/adutux.ko 2022-04-03T21:41:04.306 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/appledisplay.ko 2022-04-03T21:41:04.306 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/emi26.ko 2022-04-03T21:41:04.306 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/emi62.ko 2022-04-03T21:41:04.307 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/ezusb.ko 2022-04-03T21:41:04.307 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/ftdi-elan.ko 2022-04-03T21:41:04.307 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/idmouse.ko 2022-04-03T21:41:04.307 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/iowarrior.ko 2022-04-03T21:41:04.307 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/isight_firmware.ko 2022-04-03T21:41:04.308 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/ldusb.ko 2022-04-03T21:41:04.308 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/legousbtower.ko 2022-04-03T21:41:04.308 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/sisusbvga 2022-04-03T21:41:04.308 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-04-03T21:41:04.308 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/trancevibrator.ko 2022-04-03T21:41:04.309 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/usb3503.ko 2022-04-03T21:41:04.309 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/usblcd.ko 2022-04-03T21:41:04.309 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/usbsevseg.ko 2022-04-03T21:41:04.309 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/uss720.ko 2022-04-03T21:41:04.309 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/misc/yurex.ko 2022-04-03T21:41:04.310 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/phy 2022-04-03T21:41:04.310 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/phy/phy-generic.ko 2022-04-03T21:41:04.310 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial 2022-04-03T21:41:04.310 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/aircable.ko 2022-04-03T21:41:04.310 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ark3116.ko 2022-04-03T21:41:04.311 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/belkin_sa.ko 2022-04-03T21:41:04.311 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ch341.ko 2022-04-03T21:41:04.311 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/cp210x.ko 2022-04-03T21:41:04.311 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/cyberjack.ko 2022-04-03T21:41:04.311 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/cypress_m8.ko 2022-04-03T21:41:04.312 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/digi_acceleport.ko 2022-04-03T21:41:04.312 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/empeg.ko 2022-04-03T21:41:04.312 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ftdi_sio.ko 2022-04-03T21:41:04.312 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/garmin_gps.ko 2022-04-03T21:41:04.312 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/io_edgeport.ko 2022-04-03T21:41:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/io_ti.ko 2022-04-03T21:41:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ipaq.ko 2022-04-03T21:41:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ipw.ko 2022-04-03T21:41:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ir-usb.ko 2022-04-03T21:41:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-04-03T21:41:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/keyspan.ko 2022-04-03T21:41:04.314 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/keyspan_pda.ko 2022-04-03T21:41:04.314 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/kl5kusb105.ko 2022-04-03T21:41:04.314 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/kobil_sct.ko 2022-04-03T21:41:04.314 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/mct_u232.ko 2022-04-03T21:41:04.314 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/mos7720.ko 2022-04-03T21:41:04.315 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/mos7840.ko 2022-04-03T21:41:04.315 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/navman.ko 2022-04-03T21:41:04.315 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/omninet.ko 2022-04-03T21:41:04.315 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/opticon.ko 2022-04-03T21:41:04.315 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/option.ko 2022-04-03T21:41:04.316 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/oti6858.ko 2022-04-03T21:41:04.316 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/pl2303.ko 2022-04-03T21:41:04.316 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/qcaux.ko 2022-04-03T21:41:04.316 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/qcserial.ko 2022-04-03T21:41:04.316 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/quatech2.ko 2022-04-03T21:41:04.317 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/safe_serial.ko 2022-04-03T21:41:04.317 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/sierra.ko 2022-04-03T21:41:04.317 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/spcp8x5.ko 2022-04-03T21:41:04.317 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ssu100.ko 2022-04-03T21:41:04.317 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/symbolserial.ko 2022-04-03T21:41:04.318 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-04-03T21:41:04.318 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-04-03T21:41:04.318 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/usb_debug.ko 2022-04-03T21:41:04.318 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/usb_wwan.ko 2022-04-03T21:41:04.318 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/visor.ko 2022-04-03T21:41:04.319 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/whiteheat.ko 2022-04-03T21:41:04.319 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/serial/xsens_mt.ko 2022-04-03T21:41:04.319 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage 2022-04-03T21:41:04.319 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/uas.ko 2022-04-03T21:41:04.319 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-alauda.ko 2022-04-03T21:41:04.320 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-cypress.ko 2022-04-03T21:41:04.320 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-datafab.ko 2022-04-03T21:41:04.320 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-04-03T21:41:04.320 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-freecom.ko 2022-04-03T21:41:04.321 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-isd200.ko 2022-04-03T21:41:04.321 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-04-03T21:41:04.321 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-karma.ko 2022-04-03T21:41:04.321 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-onetouch.ko 2022-04-03T21:41:04.321 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-realtek.ko 2022-04-03T21:41:04.322 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-sddr09.ko 2022-04-03T21:41:04.322 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-sddr55.ko 2022-04-03T21:41:04.322 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/ums-usbat.ko 2022-04-03T21:41:04.322 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/storage/usb-storage.ko 2022-04-03T21:41:04.322 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/usbip 2022-04-03T21:41:04.323 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/usbip/usbip-core.ko 2022-04-03T21:41:04.323 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/usbip/usbip-host.ko 2022-04-03T21:41:04.323 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-04-03T21:41:04.323 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio 2022-04-03T21:41:04.323 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio/pci 2022-04-03T21:41:04.324 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-04-03T21:41:04.324 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio/pci/vfio-pci.ko 2022-04-03T21:41:04.324 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio/vfio.ko 2022-04-03T21:41:04.324 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-04-03T21:41:04.324 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vfio/vfio_virqfd.ko 2022-04-03T21:41:04.325 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vhost 2022-04-03T21:41:04.325 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vhost/vhost.ko 2022-04-03T21:41:04.325 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vhost/vhost_iotlb.ko 2022-04-03T21:41:04.325 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vhost/vhost_net.ko 2022-04-03T21:41:04.325 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/vhost/vhost_scsi.ko 2022-04-03T21:41:04.326 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/video 2022-04-03T21:41:04.326 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/video/backlight 2022-04-03T21:41:04.326 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/video/backlight/apple_bl.ko 2022-04-03T21:41:04.326 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/video/backlight/lcd.ko 2022-04-03T21:41:04.326 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/video/backlight/platform_lcd.ko 2022-04-03T21:41:04.327 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio 2022-04-03T21:41:04.327 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio.ko 2022-04-03T21:41:04.327 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio_balloon.ko 2022-04-03T21:41:04.327 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio_mmio.ko 2022-04-03T21:41:04.327 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio_pci.ko 2022-04-03T21:41:04.328 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-04-03T21:41:04.328 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-04-03T21:41:04.328 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/virtio/virtio_ring.ko 2022-04-03T21:41:04.328 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1 2022-04-03T21:41:04.328 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/masters 2022-04-03T21:41:04.329 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/masters/ds1wm.ko 2022-04-03T21:41:04.329 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/masters/ds2482.ko 2022-04-03T21:41:04.329 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/masters/ds2490.ko 2022-04-03T21:41:04.329 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves 2022-04-03T21:41:04.329 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-04-03T21:41:04.330 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-04-03T21:41:04.330 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-04-03T21:41:04.330 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-04-03T21:41:04.330 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-04-03T21:41:04.331 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-04-03T21:41:04.331 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-04-03T21:41:04.331 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-04-03T21:41:04.331 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-04-03T21:41:04.331 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_smem.ko 2022-04-03T21:41:04.332 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/slaves/w1_therm.ko 2022-04-03T21:41:04.332 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/w1/wire.ko 2022-04-03T21:41:04.332 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog 2022-04-03T21:41:04.332 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/alim1535_wdt.ko 2022-04-03T21:41:04.332 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/alim7101_wdt.ko 2022-04-03T21:41:04.333 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/f71808e_wdt.ko 2022-04-03T21:41:04.333 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/hpwdt.ko 2022-04-03T21:41:04.333 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/i6300esb.ko 2022-04-03T21:41:04.333 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-04-03T21:41:04.333 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/iTCO_wdt.ko 2022-04-03T21:41:04.334 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/ib700wdt.ko 2022-04-03T21:41:04.334 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/ibmasr.ko 2022-04-03T21:41:04.334 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-04-03T21:41:04.334 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/it8712f_wdt.ko 2022-04-03T21:41:04.334 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/it87_wdt.ko 2022-04-03T21:41:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/machzwd.ko 2022-04-03T21:41:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/nv_tco.ko 2022-04-03T21:41:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/pcwd_pci.ko 2022-04-03T21:41:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/pcwd_usb.ko 2022-04-03T21:41:04.335 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-04-03T21:41:04.336 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/sch311x_wdt.ko 2022-04-03T21:41:04.336 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/softdog.ko 2022-04-03T21:41:04.336 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/sp5100_tco.ko 2022-04-03T21:41:04.336 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/via_wdt.ko 2022-04-03T21:41:04.336 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-04-03T21:41:04.337 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/w83877f_wdt.ko 2022-04-03T21:41:04.337 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/w83977f_wdt.ko 2022-04-03T21:41:04.337 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/wdt_pci.ko 2022-04-03T21:41:04.337 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/watchdog/xen_wdt.ko 2022-04-03T21:41:04.337 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen 2022-04-03T21:41:04.338 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-acpi-processor.ko 2022-04-03T21:41:04.338 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-evtchn.ko 2022-04-03T21:41:04.338 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-gntalloc.ko 2022-04-03T21:41:04.338 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-gntdev.ko 2022-04-03T21:41:04.338 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-pciback 2022-04-03T21:41:04.339 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-04-03T21:41:04.339 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xen-privcmd.ko 2022-04-03T21:41:04.339 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xenfs 2022-04-03T21:41:04.339 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/drivers/xen/xenfs/xenfs.ko 2022-04-03T21:41:04.339 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs 2022-04-03T21:41:04.339 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/9p 2022-04-03T21:41:04.340 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/9p/9p.ko 2022-04-03T21:41:04.340 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/affs 2022-04-03T21:41:04.340 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/affs/affs.ko 2022-04-03T21:41:04.340 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/befs 2022-04-03T21:41:04.340 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/befs/befs.ko 2022-04-03T21:41:04.341 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/binfmt_misc.ko 2022-04-03T21:41:04.341 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/btrfs 2022-04-03T21:41:04.341 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/btrfs/btrfs.ko 2022-04-03T21:41:04.341 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/cachefiles 2022-04-03T21:41:04.341 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/cachefiles/cachefiles.ko 2022-04-03T21:41:04.342 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ceph 2022-04-03T21:41:04.342 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ceph/ceph.ko 2022-04-03T21:41:04.342 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/cifs 2022-04-03T21:41:04.342 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/cifs/cifs.ko 2022-04-03T21:41:04.342 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/coda 2022-04-03T21:41:04.343 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/coda/coda.ko 2022-04-03T21:41:04.343 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/cramfs 2022-04-03T21:41:04.343 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/cramfs/cramfs.ko 2022-04-03T21:41:04.343 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/dlm 2022-04-03T21:41:04.343 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/dlm/dlm.ko 2022-04-03T21:41:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ecryptfs 2022-04-03T21:41:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ecryptfs/ecryptfs.ko 2022-04-03T21:41:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/f2fs 2022-04-03T21:41:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/f2fs/f2fs.ko 2022-04-03T21:41:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fat 2022-04-03T21:41:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fat/fat.ko 2022-04-03T21:41:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fat/msdos.ko 2022-04-03T21:41:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fat/vfat.ko 2022-04-03T21:41:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fscache 2022-04-03T21:41:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fscache/fscache.ko 2022-04-03T21:41:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fuse 2022-04-03T21:41:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fuse/cuse.ko 2022-04-03T21:41:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/fuse/fuse.ko 2022-04-03T21:41:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/gfs2 2022-04-03T21:41:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/gfs2/gfs2.ko 2022-04-03T21:41:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/hfs 2022-04-03T21:41:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/hfs/hfs.ko 2022-04-03T21:41:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/hfsplus 2022-04-03T21:41:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/hfsplus/hfsplus.ko 2022-04-03T21:41:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/isofs 2022-04-03T21:41:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/isofs/isofs.ko 2022-04-03T21:41:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/jfs 2022-04-03T21:41:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/jfs/jfs.ko 2022-04-03T21:41:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/lockd 2022-04-03T21:41:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/lockd/lockd.ko 2022-04-03T21:41:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/minix 2022-04-03T21:41:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/minix/minix.ko 2022-04-03T21:41:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/netfs 2022-04-03T21:41:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/netfs/netfs.ko 2022-04-03T21:41:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs 2022-04-03T21:41:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/blocklayout 2022-04-03T21:41:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-04-03T21:41:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/filelayout 2022-04-03T21:41:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-04-03T21:41:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/flexfilelayout 2022-04-03T21:41:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-04-03T21:41:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/nfs.ko 2022-04-03T21:41:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/nfsv3.ko 2022-04-03T21:41:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs/nfsv4.ko 2022-04-03T21:41:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs_common 2022-04-03T21:41:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs_common/grace.ko 2022-04-03T21:41:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfs_common/nfs_acl.ko 2022-04-03T21:41:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfsd 2022-04-03T21:41:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nfsd/nfsd.ko 2022-04-03T21:41:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nilfs2 2022-04-03T21:41:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nilfs2/nilfs2.ko 2022-04-03T21:41:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls 2022-04-03T21:41:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-celtic.ko 2022-04-03T21:41:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-centeuro.ko 2022-04-03T21:41:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-croatian.ko 2022-04-03T21:41:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-cyrillic.ko 2022-04-03T21:41:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-gaelic.ko 2022-04-03T21:41:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-greek.ko 2022-04-03T21:41:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-iceland.ko 2022-04-03T21:41:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-inuit.ko 2022-04-03T21:41:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-roman.ko 2022-04-03T21:41:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-romanian.ko 2022-04-03T21:41:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/mac-turkish.ko 2022-04-03T21:41:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp1250.ko 2022-04-03T21:41:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp1251.ko 2022-04-03T21:41:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp1255.ko 2022-04-03T21:41:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp737.ko 2022-04-03T21:41:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp775.ko 2022-04-03T21:41:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp850.ko 2022-04-03T21:41:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp852.ko 2022-04-03T21:41:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp855.ko 2022-04-03T21:41:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp857.ko 2022-04-03T21:41:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp860.ko 2022-04-03T21:41:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp861.ko 2022-04-03T21:41:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp862.ko 2022-04-03T21:41:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp863.ko 2022-04-03T21:41:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp864.ko 2022-04-03T21:41:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp865.ko 2022-04-03T21:41:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp866.ko 2022-04-03T21:41:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp869.ko 2022-04-03T21:41:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp874.ko 2022-04-03T21:41:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp932.ko 2022-04-03T21:41:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp936.ko 2022-04-03T21:41:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp949.ko 2022-04-03T21:41:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_cp950.ko 2022-04-03T21:41:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_euc-jp.ko 2022-04-03T21:41:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-1.ko 2022-04-03T21:41:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-13.ko 2022-04-03T21:41:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-14.ko 2022-04-03T21:41:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-15.ko 2022-04-03T21:41:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-2.ko 2022-04-03T21:41:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-3.ko 2022-04-03T21:41:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-4.ko 2022-04-03T21:41:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-5.ko 2022-04-03T21:41:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-6.ko 2022-04-03T21:41:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-7.ko 2022-04-03T21:41:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_iso8859-9.ko 2022-04-03T21:41:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_koi8-r.ko 2022-04-03T21:41:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_koi8-ru.ko 2022-04-03T21:41:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_koi8-u.ko 2022-04-03T21:41:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/nls/nls_utf8.ko 2022-04-03T21:41:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2 2022-04-03T21:41:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/cluster 2022-04-03T21:41:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-04-03T21:41:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/dlm 2022-04-03T21:41:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-04-03T21:41:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/dlmfs 2022-04-03T21:41:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-04-03T21:41:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/ocfs2.ko 2022-04-03T21:41:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-04-03T21:41:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-04-03T21:41:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-04-03T21:41:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/overlayfs 2022-04-03T21:41:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/overlayfs/overlay.ko 2022-04-03T21:41:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/pstore 2022-04-03T21:41:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/pstore/ramoops.ko 2022-04-03T21:41:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/reiserfs 2022-04-03T21:41:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/reiserfs/reiserfs.ko 2022-04-03T21:41:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/romfs 2022-04-03T21:41:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/romfs/romfs.ko 2022-04-03T21:41:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/smbfs_common 2022-04-03T21:41:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/smbfs_common/cifs_arc4.ko 2022-04-03T21:41:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/smbfs_common/cifs_md4.ko 2022-04-03T21:41:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/squashfs 2022-04-03T21:41:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/squashfs/squashfs.ko 2022-04-03T21:41:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/sysv 2022-04-03T21:41:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/sysv/sysv.ko 2022-04-03T21:41:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/udf 2022-04-03T21:41:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/udf/udf.ko 2022-04-03T21:41:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ufs 2022-04-03T21:41:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/ufs/ufs.ko 2022-04-03T21:41:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/xfs 2022-04-03T21:41:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/fs/xfs/xfs.ko 2022-04-03T21:41:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/kernel 2022-04-03T21:41:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/kernel/rcu 2022-04-03T21:41:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/kernel/rcu/rcutorture.ko 2022-04-03T21:41:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/kernel/torture.ko 2022-04-03T21:41:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/kernel/trace 2022-04-03T21:41:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-04-03T21:41:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib 2022-04-03T21:41:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/asn1_encoder.ko 2022-04-03T21:41:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/crc-itu-t.ko 2022-04-03T21:41:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/crc64.ko 2022-04-03T21:41:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/crc8.ko 2022-04-03T21:41:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/crypto 2022-04-03T21:41:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/crypto/libarc4.ko 2022-04-03T21:41:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/crypto/libdes.ko 2022-04-03T21:41:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/libcrc32c.ko 2022-04-03T21:41:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/lru_cache.ko 2022-04-03T21:41:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/lz4 2022-04-03T21:41:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/lz4/lz4_compress.ko 2022-04-03T21:41:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/lz4/lz4hc_compress.ko 2022-04-03T21:41:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/math 2022-04-03T21:41:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/math/cordic.ko 2022-04-03T21:41:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/raid6 2022-04-03T21:41:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/raid6/raid6_pq.ko 2022-04-03T21:41:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/reed_solomon 2022-04-03T21:41:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/reed_solomon/reed_solomon.ko 2022-04-03T21:41:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/ts_bm.ko 2022-04-03T21:41:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/ts_fsm.ko 2022-04-03T21:41:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/ts_kmp.ko 2022-04-03T21:41:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/zstd 2022-04-03T21:41:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/lib/zstd/zstd_compress.ko 2022-04-03T21:41:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/mm 2022-04-03T21:41:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/mm/hwpoison-inject.ko 2022-04-03T21:41:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net 2022-04-03T21:41:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan 2022-04-03T21:41:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/6lowpan.ko 2022-04-03T21:41:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_dest.ko 2022-04-03T21:41:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_fragment.ko 2022-04-03T21:41:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_hop.ko 2022-04-03T21:41:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_ipv6.ko 2022-04-03T21:41:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_mobility.ko 2022-04-03T21:41:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_routing.ko 2022-04-03T21:41:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/6lowpan/nhc_udp.ko 2022-04-03T21:41:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/802 2022-04-03T21:41:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/802/garp.ko 2022-04-03T21:41:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/802/mrp.ko 2022-04-03T21:41:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/802/p8022.ko 2022-04-03T21:41:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/802/psnap.ko 2022-04-03T21:41:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/802/stp.ko 2022-04-03T21:41:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/8021q 2022-04-03T21:41:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/8021q/8021q.ko 2022-04-03T21:41:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/9p 2022-04-03T21:41:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/9p/9pnet.ko 2022-04-03T21:41:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/9p/9pnet_fd.ko 2022-04-03T21:41:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/9p/9pnet_rdma.ko 2022-04-03T21:41:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/9p/9pnet_virtio.ko 2022-04-03T21:41:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/batman-adv 2022-04-03T21:41:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/batman-adv/batman-adv.ko 2022-04-03T21:41:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge 2022-04-03T21:41:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/br_netfilter.ko 2022-04-03T21:41:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/bridge.ko 2022-04-03T21:41:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter 2022-04-03T21:41:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-04-03T21:41:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_among.ko 2022-04-03T21:41:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_arp.ko 2022-04-03T21:41:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-04-03T21:41:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-04-03T21:41:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_ip.ko 2022-04-03T21:41:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-04-03T21:41:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_limit.ko 2022-04-03T21:41:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_log.ko 2022-04-03T21:41:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_mark.ko 2022-04-03T21:41:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-04-03T21:41:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-04-03T21:41:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-04-03T21:41:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-04-03T21:41:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_snat.ko 2022-04-03T21:41:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_stp.ko 2022-04-03T21:41:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-04-03T21:41:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-04-03T21:41:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-04-03T21:41:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-04-03T21:41:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/ebtables.ko 2022-04-03T21:41:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-04-03T21:41:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-04-03T21:41:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-04-03T21:41:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ceph 2022-04-03T21:41:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ceph/libceph.ko 2022-04-03T21:41:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/core 2022-04-03T21:41:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/core/failover.ko 2022-04-03T21:41:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/core/pktgen.ko 2022-04-03T21:41:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dccp 2022-04-03T21:41:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dccp/dccp.ko 2022-04-03T21:41:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dccp/dccp_diag.ko 2022-04-03T21:41:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dccp/dccp_ipv4.ko 2022-04-03T21:41:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dccp/dccp_ipv6.ko 2022-04-03T21:41:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dns_resolver 2022-04-03T21:41:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dns_resolver/dns_resolver.ko 2022-04-03T21:41:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dsa 2022-04-03T21:41:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dsa/dsa_core.ko 2022-04-03T21:41:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dsa/tag_brcm.ko 2022-04-03T21:41:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dsa/tag_dsa.ko 2022-04-03T21:41:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/dsa/tag_trailer.ko 2022-04-03T21:41:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ieee802154 2022-04-03T21:41:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ieee802154/6lowpan 2022-04-03T21:41:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-04-03T21:41:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ieee802154/ieee802154.ko 2022-04-03T21:41:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ieee802154/ieee802154_socket.ko 2022-04-03T21:41:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4 2022-04-03T21:41:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/ah4.ko 2022-04-03T21:41:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/esp4.ko 2022-04-03T21:41:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/fou.ko 2022-04-03T21:41:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/gre.ko 2022-04-03T21:41:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/inet_diag.ko 2022-04-03T21:41:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/ip_gre.ko 2022-04-03T21:41:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/ip_tunnel.ko 2022-04-03T21:41:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/ip_vti.ko 2022-04-03T21:41:04.393 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/ipcomp.ko 2022-04-03T21:41:04.393 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/ipip.ko 2022-04-03T21:41:04.393 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter 2022-04-03T21:41:04.393 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/arp_tables.ko 2022-04-03T21:41:04.393 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-04-03T21:41:04.394 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-04-03T21:41:04.394 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-04-03T21:41:04.394 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-04-03T21:41:04.394 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-04-03T21:41:04.395 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-04-03T21:41:04.395 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-04-03T21:41:04.395 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-04-03T21:41:04.395 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-04-03T21:41:04.395 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-04-03T21:41:04.396 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/iptable_security.ko 2022-04-03T21:41:04.396 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-04-03T21:41:04.396 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-04-03T21:41:04.396 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-04-03T21:41:04.396 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-04-03T21:41:04.397 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-04-03T21:41:04.397 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-04-03T21:41:04.397 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-04-03T21:41:04.397 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-04-03T21:41:04.397 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-04-03T21:41:04.398 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-04-03T21:41:04.398 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_bic.ko 2022-04-03T21:41:04.398 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_dctcp.ko 2022-04-03T21:41:04.398 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_diag.ko 2022-04-03T21:41:04.399 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_highspeed.ko 2022-04-03T21:41:04.399 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_htcp.ko 2022-04-03T21:41:04.399 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_hybla.ko 2022-04-03T21:41:04.399 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_illinois.ko 2022-04-03T21:41:04.399 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_lp.ko 2022-04-03T21:41:04.400 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_scalable.ko 2022-04-03T21:41:04.400 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_vegas.ko 2022-04-03T21:41:04.400 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_veno.ko 2022-04-03T21:41:04.400 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_westwood.ko 2022-04-03T21:41:04.400 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tcp_yeah.ko 2022-04-03T21:41:04.401 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/tunnel4.ko 2022-04-03T21:41:04.401 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/udp_diag.ko 2022-04-03T21:41:04.401 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/udp_tunnel.ko 2022-04-03T21:41:04.401 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv4/xfrm4_tunnel.ko 2022-04-03T21:41:04.401 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6 2022-04-03T21:41:04.402 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/ah6.ko 2022-04-03T21:41:04.402 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/esp6.ko 2022-04-03T21:41:04.402 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/fou6.ko 2022-04-03T21:41:04.402 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/ip6_tunnel.ko 2022-04-03T21:41:04.402 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-04-03T21:41:04.403 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/ip6_vti.ko 2022-04-03T21:41:04.403 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/ipcomp6.ko 2022-04-03T21:41:04.403 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter 2022-04-03T21:41:04.403 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-04-03T21:41:04.403 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-04-03T21:41:04.404 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-04-03T21:41:04.404 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-04-03T21:41:04.404 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-04-03T21:41:04.404 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-04-03T21:41:04.405 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-04-03T21:41:04.405 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-04-03T21:41:04.405 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-04-03T21:41:04.405 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-04-03T21:41:04.405 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-04-03T21:41:04.406 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-04-03T21:41:04.406 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-04-03T21:41:04.406 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-04-03T21:41:04.406 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-04-03T21:41:04.407 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-04-03T21:41:04.407 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-04-03T21:41:04.407 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-04-03T21:41:04.407 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-04-03T21:41:04.407 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-04-03T21:41:04.408 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-04-03T21:41:04.408 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-04-03T21:41:04.408 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-04-03T21:41:04.408 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-04-03T21:41:04.408 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/sit.ko 2022-04-03T21:41:04.408 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/tunnel6.ko 2022-04-03T21:41:04.409 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/ipv6/xfrm6_tunnel.ko 2022-04-03T21:41:04.409 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/key 2022-04-03T21:41:04.409 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/key/af_key.ko 2022-04-03T21:41:04.409 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp 2022-04-03T21:41:04.409 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_core.ko 2022-04-03T21:41:04.410 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_debugfs.ko 2022-04-03T21:41:04.410 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_eth.ko 2022-04-03T21:41:04.410 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_ip.ko 2022-04-03T21:41:04.410 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_ip6.ko 2022-04-03T21:41:04.410 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_netlink.ko 2022-04-03T21:41:04.411 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/l2tp/l2tp_ppp.ko 2022-04-03T21:41:04.411 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/llc 2022-04-03T21:41:04.411 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/llc/llc.ko 2022-04-03T21:41:04.411 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/mac802154 2022-04-03T21:41:04.411 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/mac802154/mac802154.ko 2022-04-03T21:41:04.412 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/mpls 2022-04-03T21:41:04.412 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/mpls/mpls_gso.ko 2022-04-03T21:41:04.412 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter 2022-04-03T21:41:04.412 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset 2022-04-03T21:41:04.412 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set.ko 2022-04-03T21:41:04.413 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-04-03T21:41:04.413 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-04-03T21:41:04.413 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-04-03T21:41:04.413 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-04-03T21:41:04.413 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-04-03T21:41:04.414 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-04-03T21:41:04.414 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-04-03T21:41:04.414 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-04-03T21:41:04.414 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-04-03T21:41:04.414 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-04-03T21:41:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-04-03T21:41:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-04-03T21:41:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-04-03T21:41:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-04-03T21:41:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-04-03T21:41:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs 2022-04-03T21:41:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs.ko 2022-04-03T21:41:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-04-03T21:41:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-04-03T21:41:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-04-03T21:41:04.417 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-04-03T21:41:04.417 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-04-03T21:41:04.417 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-04-03T21:41:04.417 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-04-03T21:41:04.418 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-04-03T21:41:04.418 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-04-03T21:41:04.418 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-04-03T21:41:04.418 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-04-03T21:41:04.418 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-04-03T21:41:04.419 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-04-03T21:41:04.419 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conncount.ko 2022-04-03T21:41:04.419 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack.ko 2022-04-03T21:41:04.419 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-04-03T21:41:04.419 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-04-03T21:41:04.420 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-04-03T21:41:04.420 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_h323.ko 2022-04-03T21:41:04.420 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_irc.ko 2022-04-03T21:41:04.420 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-04-03T21:41:04.420 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-04-03T21:41:04.421 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-04-03T21:41:04.421 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_sane.ko 2022-04-03T21:41:04.421 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_sip.ko 2022-04-03T21:41:04.421 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-04-03T21:41:04.421 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-04-03T21:41:04.422 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_dup_netdev.ko 2022-04-03T21:41:04.422 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_flow_table.ko 2022-04-03T21:41:04.422 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_flow_table_inet.ko 2022-04-03T21:41:04.422 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_log_syslog.ko 2022-04-03T21:41:04.423 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_nat.ko 2022-04-03T21:41:04.423 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_nat_amanda.ko 2022-04-03T21:41:04.423 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_nat_ftp.ko 2022-04-03T21:41:04.423 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_nat_irc.ko 2022-04-03T21:41:04.423 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_nat_sip.ko 2022-04-03T21:41:04.424 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_nat_tftp.ko 2022-04-03T21:41:04.424 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_synproxy_core.ko 2022-04-03T21:41:04.424 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nf_tables.ko 2022-04-03T21:41:04.424 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nfnetlink.ko 2022-04-03T21:41:04.424 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nfnetlink_acct.ko 2022-04-03T21:41:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nfnetlink_log.ko 2022-04-03T21:41:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nfnetlink_osf.ko 2022-04-03T21:41:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nfnetlink_queue.ko 2022-04-03T21:41:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_chain_nat.ko 2022-04-03T21:41:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_compat.ko 2022-04-03T21:41:04.426 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_ct.ko 2022-04-03T21:41:04.426 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_dup_netdev.ko 2022-04-03T21:41:04.426 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_fib.ko 2022-04-03T21:41:04.426 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_fwd_netdev.ko 2022-04-03T21:41:04.426 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_hash.ko 2022-04-03T21:41:04.427 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_limit.ko 2022-04-03T21:41:04.427 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_log.ko 2022-04-03T21:41:04.427 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_masq.ko 2022-04-03T21:41:04.427 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_nat.ko 2022-04-03T21:41:04.427 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_numgen.ko 2022-04-03T21:41:04.428 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_objref.ko 2022-04-03T21:41:04.428 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_queue.ko 2022-04-03T21:41:04.428 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_quota.ko 2022-04-03T21:41:04.428 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_redir.ko 2022-04-03T21:41:04.428 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_reject.ko 2022-04-03T21:41:04.429 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_reject_inet.ko 2022-04-03T21:41:04.429 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_socket.ko 2022-04-03T21:41:04.429 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/nft_tunnel.ko 2022-04-03T21:41:04.429 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_AUDIT.ko 2022-04-03T21:41:04.429 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_CHECKSUM.ko 2022-04-03T21:41:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_CLASSIFY.ko 2022-04-03T21:41:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-04-03T21:41:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_CT.ko 2022-04-03T21:41:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_DSCP.ko 2022-04-03T21:41:04.431 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_HL.ko 2022-04-03T21:41:04.431 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_HMARK.ko 2022-04-03T21:41:04.431 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_IDLETIMER.ko 2022-04-03T21:41:04.431 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_LED.ko 2022-04-03T21:41:04.431 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_LOG.ko 2022-04-03T21:41:04.432 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_MASQUERADE.ko 2022-04-03T21:41:04.432 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_NETMAP.ko 2022-04-03T21:41:04.432 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_NFLOG.ko 2022-04-03T21:41:04.432 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_NFQUEUE.ko 2022-04-03T21:41:04.432 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_RATEEST.ko 2022-04-03T21:41:04.433 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_REDIRECT.ko 2022-04-03T21:41:04.433 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_SECMARK.ko 2022-04-03T21:41:04.433 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_TCPMSS.ko 2022-04-03T21:41:04.433 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-04-03T21:41:04.433 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_TEE.ko 2022-04-03T21:41:04.434 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_TPROXY.ko 2022-04-03T21:41:04.434 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_TRACE.ko 2022-04-03T21:41:04.434 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_addrtype.ko 2022-04-03T21:41:04.434 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_bpf.ko 2022-04-03T21:41:04.435 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_cgroup.ko 2022-04-03T21:41:04.435 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_cluster.ko 2022-04-03T21:41:04.435 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_comment.ko 2022-04-03T21:41:04.435 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_connbytes.ko 2022-04-03T21:41:04.435 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_connlabel.ko 2022-04-03T21:41:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_connlimit.ko 2022-04-03T21:41:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_connmark.ko 2022-04-03T21:41:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_conntrack.ko 2022-04-03T21:41:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_cpu.ko 2022-04-03T21:41:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_dccp.ko 2022-04-03T21:41:04.436 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_devgroup.ko 2022-04-03T21:41:04.437 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_dscp.ko 2022-04-03T21:41:04.437 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_ecn.ko 2022-04-03T21:41:04.437 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_esp.ko 2022-04-03T21:41:04.437 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_hashlimit.ko 2022-04-03T21:41:04.437 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_helper.ko 2022-04-03T21:41:04.438 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_hl.ko 2022-04-03T21:41:04.438 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_ipcomp.ko 2022-04-03T21:41:04.438 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_iprange.ko 2022-04-03T21:41:04.438 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_ipvs.ko 2022-04-03T21:41:04.439 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_l2tp.ko 2022-04-03T21:41:04.439 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_length.ko 2022-04-03T21:41:04.439 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_limit.ko 2022-04-03T21:41:04.439 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_mac.ko 2022-04-03T21:41:04.439 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_mark.ko 2022-04-03T21:41:04.439 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_multiport.ko 2022-04-03T21:41:04.440 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_nat.ko 2022-04-03T21:41:04.440 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_nfacct.ko 2022-04-03T21:41:04.440 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_osf.ko 2022-04-03T21:41:04.440 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_owner.ko 2022-04-03T21:41:04.441 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_physdev.ko 2022-04-03T21:41:04.441 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_pkttype.ko 2022-04-03T21:41:04.441 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_policy.ko 2022-04-03T21:41:04.441 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_quota.ko 2022-04-03T21:41:04.441 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_rateest.ko 2022-04-03T21:41:04.441 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_realm.ko 2022-04-03T21:41:04.442 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_recent.ko 2022-04-03T21:41:04.442 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_sctp.ko 2022-04-03T21:41:04.442 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_set.ko 2022-04-03T21:41:04.442 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_socket.ko 2022-04-03T21:41:04.442 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_state.ko 2022-04-03T21:41:04.443 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_statistic.ko 2022-04-03T21:41:04.443 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_string.ko 2022-04-03T21:41:04.443 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_tcpmss.ko 2022-04-03T21:41:04.443 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_time.ko 2022-04-03T21:41:04.443 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netfilter/xt_u32.ko 2022-04-03T21:41:04.444 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netlink 2022-04-03T21:41:04.444 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/netlink/netlink_diag.ko 2022-04-03T21:41:04.444 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/nsh 2022-04-03T21:41:04.444 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/nsh/nsh.ko 2022-04-03T21:41:04.445 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/openvswitch 2022-04-03T21:41:04.445 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/openvswitch/openvswitch.ko 2022-04-03T21:41:04.445 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/openvswitch/vport-geneve.ko 2022-04-03T21:41:04.445 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/openvswitch/vport-gre.ko 2022-04-03T21:41:04.445 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/openvswitch/vport-vxlan.ko 2022-04-03T21:41:04.445 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/packet 2022-04-03T21:41:04.446 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/packet/af_packet_diag.ko 2022-04-03T21:41:04.446 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/rds 2022-04-03T21:41:04.446 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/rds/rds.ko 2022-04-03T21:41:04.446 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/rds/rds_rdma.ko 2022-04-03T21:41:04.446 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/rds/rds_tcp.ko 2022-04-03T21:41:04.447 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched 2022-04-03T21:41:04.447 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_csum.ko 2022-04-03T21:41:04.447 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_gact.ko 2022-04-03T21:41:04.447 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_ipt.ko 2022-04-03T21:41:04.447 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_mirred.ko 2022-04-03T21:41:04.448 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_nat.ko 2022-04-03T21:41:04.448 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_pedit.ko 2022-04-03T21:41:04.448 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_police.ko 2022-04-03T21:41:04.448 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_simple.ko 2022-04-03T21:41:04.448 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_skbedit.ko 2022-04-03T21:41:04.449 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/act_vlan.ko 2022-04-03T21:41:04.449 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_basic.ko 2022-04-03T21:41:04.449 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_bpf.ko 2022-04-03T21:41:04.449 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_flow.ko 2022-04-03T21:41:04.449 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_fw.ko 2022-04-03T21:41:04.450 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_route.ko 2022-04-03T21:41:04.450 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_rsvp.ko 2022-04-03T21:41:04.450 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_rsvp6.ko 2022-04-03T21:41:04.450 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_tcindex.ko 2022-04-03T21:41:04.450 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/cls_u32.ko 2022-04-03T21:41:04.451 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/em_cmp.ko 2022-04-03T21:41:04.451 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/em_ipset.ko 2022-04-03T21:41:04.451 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/em_meta.ko 2022-04-03T21:41:04.451 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/em_nbyte.ko 2022-04-03T21:41:04.451 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/em_text.ko 2022-04-03T21:41:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/em_u32.ko 2022-04-03T21:41:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_cbq.ko 2022-04-03T21:41:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_choke.ko 2022-04-03T21:41:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_codel.ko 2022-04-03T21:41:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_drr.ko 2022-04-03T21:41:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_dsmark.ko 2022-04-03T21:41:04.453 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_fq.ko 2022-04-03T21:41:04.453 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_gred.ko 2022-04-03T21:41:04.453 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_hfsc.ko 2022-04-03T21:41:04.453 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_hhf.ko 2022-04-03T21:41:04.454 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_htb.ko 2022-04-03T21:41:04.454 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_ingress.ko 2022-04-03T21:41:04.454 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_mqprio.ko 2022-04-03T21:41:04.454 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_multiq.ko 2022-04-03T21:41:04.454 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_netem.ko 2022-04-03T21:41:04.455 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_pie.ko 2022-04-03T21:41:04.455 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_plug.ko 2022-04-03T21:41:04.455 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_prio.ko 2022-04-03T21:41:04.455 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_qfq.ko 2022-04-03T21:41:04.455 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_red.ko 2022-04-03T21:41:04.456 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_sfb.ko 2022-04-03T21:41:04.456 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_sfq.ko 2022-04-03T21:41:04.456 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_tbf.ko 2022-04-03T21:41:04.456 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sched/sch_teql.ko 2022-04-03T21:41:04.456 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sctp 2022-04-03T21:41:04.457 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sctp/sctp.ko 2022-04-03T21:41:04.457 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sctp/sctp_diag.ko 2022-04-03T21:41:04.457 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc 2022-04-03T21:41:04.457 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc/auth_gss 2022-04-03T21:41:04.457 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-04-03T21:41:04.458 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-04-03T21:41:04.458 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc/sunrpc.ko 2022-04-03T21:41:04.458 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc/xprtrdma 2022-04-03T21:41:04.458 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-04-03T21:41:04.458 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/tipc 2022-04-03T21:41:04.459 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/tipc/diag.ko 2022-04-03T21:41:04.459 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/tipc/tipc.ko 2022-04-03T21:41:04.459 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/unix 2022-04-03T21:41:04.459 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/unix/unix_diag.ko 2022-04-03T21:41:04.459 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/vmw_vsock 2022-04-03T21:41:04.460 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-04-03T21:41:04.460 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-04-03T21:41:04.460 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/vmw_vsock/vsock.ko 2022-04-03T21:41:04.460 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/vmw_vsock/vsock_diag.ko 2022-04-03T21:41:04.461 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/vmw_vsock/vsock_loopback.ko 2022-04-03T21:41:04.461 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/xfrm 2022-04-03T21:41:04.461 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/net/xfrm/xfrm_ipcomp.ko 2022-04-03T21:41:04.461 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/security 2022-04-03T21:41:04.461 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/security/keys 2022-04-03T21:41:04.462 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/security/keys/encrypted-keys 2022-04-03T21:41:04.462 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-04-03T21:41:04.462 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/security/keys/trusted-keys 2022-04-03T21:41:04.462 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/security/keys/trusted-keys/trusted.ko 2022-04-03T21:41:04.462 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/virt 2022-04-03T21:41:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/virt/lib 2022-04-03T21:41:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/kernel/virt/lib/irqbypass.ko 2022-04-03T21:41:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.alias 2022-04-03T21:41:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.alias.bin 2022-04-03T21:41:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.builtin 2022-04-03T21:41:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.builtin.bin 2022-04-03T21:41:04.464 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.builtin.modinfo 2022-04-03T21:41:04.464 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.dep 2022-04-03T21:41:04.464 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.dep.bin 2022-04-03T21:41:04.464 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.devname 2022-04-03T21:41:04.464 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.order 2022-04-03T21:41:04.465 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.softdep 2022-04-03T21:41:04.465 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.symbols 2022-04-03T21:41:04.465 INFO:teuthology.orchestra.run.smithi049.stdout:/lib/modules/5.17.0-rc6-ceph-g26d8230c8f91/modules.symbols.bin 2022-04-03T21:41:04.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/lib/.build-id 2022-04-03T21:41:04.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/lib/.build-id/1c 2022-04-03T21:41:04.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/lib/.build-id/1c/d444cc390db5679c4430ab1d870001eba1d44d 2022-04-03T21:41:04.466 DEBUG:teuthology.task.kernel:get_image_version: 5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.467 DEBUG:teuthology.orchestra.run.smithi049:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-04-03T21:41:04.494 INFO:teuthology.orchestra.run.smithi049.stdout:postinstall scriptlet (using /bin/sh): 2022-04-03T21:41:04.495 INFO:teuthology.orchestra.run.smithi049.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91 -a -r /boot/System.map-5.17.0-rc6-ceph-g26d8230c8f91 ]; then 2022-04-03T21:41:04.495 INFO:teuthology.orchestra.run.smithi049.stdout:cp /boot/vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91 /boot/.vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91-rpm 2022-04-03T21:41:04.495 INFO:teuthology.orchestra.run.smithi049.stdout:cp /boot/System.map-5.17.0-rc6-ceph-g26d8230c8f91 /boot/.System.map-5.17.0-rc6-ceph-g26d8230c8f91-rpm 2022-04-03T21:41:04.496 INFO:teuthology.orchestra.run.smithi049.stdout:rm -f /boot/vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91 /boot/System.map-5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.496 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/installkernel 5.17.0-rc6-ceph-g26d8230c8f91 /boot/.vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91-rpm /boot/.System.map-5.17.0-rc6-ceph-g26d8230c8f91-rpm 2022-04-03T21:41:04.496 INFO:teuthology.orchestra.run.smithi049.stdout:rm -f /boot/.vmlinuz-5.17.0-rc6-ceph-g26d8230c8f91-rpm /boot/.System.map-5.17.0-rc6-ceph-g26d8230c8f91-rpm 2022-04-03T21:41:04.496 INFO:teuthology.orchestra.run.smithi049.stdout:fi 2022-04-03T21:41:04.496 INFO:teuthology.orchestra.run.smithi049.stdout:preuninstall scriptlet (using /bin/sh): 2022-04-03T21:41:04.497 INFO:teuthology.orchestra.run.smithi049.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-04-03T21:41:04.497 INFO:teuthology.orchestra.run.smithi049.stdout:new-kernel-pkg --remove 5.17.0-rc6-ceph-g26d8230c8f91 --rminitrd --initrdfile=/boot/initramfs-5.17.0-rc6-ceph-g26d8230c8f91.img 2022-04-03T21:41:04.497 INFO:teuthology.orchestra.run.smithi049.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-04-03T21:41:04.497 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-install remove 5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.498 INFO:teuthology.orchestra.run.smithi049.stdout:fi 2022-04-03T21:41:04.498 INFO:teuthology.orchestra.run.smithi049.stdout:postuninstall scriptlet (using /bin/sh): 2022-04-03T21:41:04.498 INFO:teuthology.orchestra.run.smithi049.stdout:if [ -x /sbin/update-bootloader ]; then 2022-04-03T21:41:04.498 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/update-bootloader --remove 5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.499 INFO:teuthology.orchestra.run.smithi049.stdout:fi 2022-04-03T21:41:04.500 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2022-04-03T21:41:04.579 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2022-04-03T21:41:04.580 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2022-04-03T21:41:04.580 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.02 2022-04-03T21:41:04.580 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 106.el8 2022-04-03T21:41:04.580 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2022-04-03T21:41:04.581 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Sun 03 Apr 2022 12:21:32 PM UTC 2022-04-03T21:41:04.581 INFO:teuthology.orchestra.run.smithi049.stdout:Group : System Environment/Base 2022-04-03T21:41:04.581 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 9265339 2022-04-03T21:41:04.581 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2022-04-03T21:41:04.581 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-04-03T21:41:04.582 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-04-03T21:41:04.582 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-04-03T21:41:04.582 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : kbuilder.bsys.centos.org 2022-04-03T21:41:04.582 INFO:teuthology.orchestra.run.smithi049.stdout:Relocations : (not relocatable) 2022-04-03T21:41:04.583 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : CentOS BuildSystem 2022-04-03T21:41:04.583 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2022-04-03T21:41:04.583 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2022-04-03T21:41:04.583 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2022-04-03T21:41:04.583 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2022-04-03T21:41:04.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:41:04.584 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-04-03T21:41:04.584 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2022-04-03T21:41:04.584 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2022-04-03T21:41:04.584 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2022-04-03T21:41:04.585 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:41:04.585 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2022-04-03T21:41:04.586 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-04-03T21:41:04.586 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:04.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-04-03T21:41:07.063 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2022-04-03T21:41:09.502 INFO:teuthology.orchestra.run.smithi049.stderr:done 2022-04-03T21:41:09.504 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2022-04-03T21:41:09.553 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.8KLCSC9JXh 2022-04-03T21:41:09.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8KLCSC9JXh 2022-04-03T21:41:09.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.8KLCSC9JXh 2022-04-03T21:41:09.750 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.8KLCSC9JXh is 6KB 2022-04-03T21:41:09.772 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.8KLCSC9JXh 2022-04-03T21:41:09.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2022-04-03T21:41:09.854 INFO:teuthology.orchestra.run.smithi049.stdout:4ad79b7c198642dcb893bc13d0eca5c6-0-rescue.conf 2022-04-03T21:41:09.854 INFO:teuthology.orchestra.run.smithi049.stdout:4ad79b7c198642dcb893bc13d0eca5c6-4.18.0-305.3.1.el8.x86_64.conf 2022-04-03T21:41:09.854 INFO:teuthology.orchestra.run.smithi049.stdout:4ad79b7c198642dcb893bc13d0eca5c6-4.18.0-373.el8.x86_64.conf 2022-04-03T21:41:09.855 INFO:teuthology.orchestra.run.smithi049.stdout:4ad79b7c198642dcb893bc13d0eca5c6-5.17.0-rc6-ceph-g26d8230c8f91.conf 2022-04-03T21:41:09.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default 4ad79b7c198642dcb893bc13d0eca5c6-5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:41:09.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2022-04-03T21:41:39.989 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2022-04-03T21:41:39.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2022-04-03T21:41:39.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:41:58.347 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2022-04-03T21:42:28.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2022-04-03T21:42:28.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:42:31.403 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2022-04-03T21:43:01.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2022-04-03T21:43:01.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:43:17.000 DEBUG:teuthology.orchestra.run.smithi049:> true 2022-04-03T21:43:17.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2022-04-03T21:43:17.354 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.17.0-rc6-ceph-g26d8230c8f91"... 2022-04-03T21:43:17.358 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2022-04-03T21:43:17.411 INFO:teuthology.orchestra.run.smithi049.stdout:5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:43:17.411 DEBUG:teuthology.task.kernel:current kernel version is 5.17.0-rc6-ceph-g26d8230c8f91 vs 5.17.0-rc6-ceph-g26d8230c8f91 2022-04-03T21:43:17.411 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-04-03T21:43:17.412 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-04-03T21:43:18.413 DEBUG:teuthology.parallel:result is None 2022-04-03T21:43:18.414 INFO:teuthology.run_tasks:Running task internal.base... 2022-04-03T21:43:18.426 INFO:teuthology.task.internal:Creating test directory... 2022-04-03T21:43:18.427 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-04-03T21:43:18.432 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-04-03T21:43:18.485 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-04-03T21:43:18.496 INFO:teuthology.run_tasks:Running task internal.archive... 2022-04-03T21:43:18.547 INFO:teuthology.task.internal:Creating archive directory... 2022-04-03T21:43:18.547 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-04-03T21:43:18.552 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-04-03T21:43:18.616 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-04-03T21:43:18.629 INFO:teuthology.task.internal:Enabling coredump saving... 2022-04-03T21:43:18.629 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2022-04-03T21:43:18.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-03T21:43:18.648 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-04-03T21:43:18.652 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-04-03T21:43:18.737 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-03T21:43:18.753 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-03T21:43:18.811 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-03T21:43:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-03T21:43:18.854 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-04-03T21:43:18.865 INFO:teuthology.task.internal:Configuring sudo... 2022-04-03T21:43:18.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-04-03T21:43:18.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-04-03T21:43:18.947 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-04-03T21:43:18.959 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-04-03T21:43:18.959 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-04-03T21:43:18.964 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-04-03T21:43:19.013 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-03T21:43:19.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-03T21:43:19.187 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-03T21:43:19.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-03T21:43:19.348 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:43:19.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-04-03T21:43:19.429 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-03T21:43:19.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-03T21:43:19.559 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-03T21:43:19.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-03T21:43:19.651 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:43:19.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-04-03T21:43:19.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2022-04-03T21:43:19.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2022-04-03T21:43:19.817 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-04-03T21:43:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-04-03T21:43:20.217 INFO:teuthology.run_tasks:Running task internal.timer... 2022-04-03T21:43:20.228 INFO:teuthology.task.internal:Starting timer... 2022-04-03T21:43:20.229 INFO:teuthology.run_tasks:Running task pcp... 2022-04-03T21:43:20.282 INFO:teuthology.run_tasks:Running task selinux... 2022-04-03T21:43:20.346 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-04-03T21:43:20.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2022-04-03T21:43:20.490 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2022-04-03T21:43:20.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2022-04-03T21:43:20.551 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2022-04-03T21:43:20.553 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-04-03T21:43:20.553 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2022-04-03T21:43:20.607 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2022-04-03T21:43:20.608 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2022-04-03T21:43:20.629 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2022-04-03T21:43:20.630 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2022-04-03T21:43:20.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-04-03T21:43:20.712 INFO:teuthology.orchestra.run.smithi049.stdout:type=AVC msg=audit(1649022200.767:167): avc: denied { node_bind } for pid=1400 comm="ping" saddr=172.21.15.49 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1 2022-04-03T21:43:20.714 DEBUG:teuthology.task.selinux:ubuntu@smithi049.front.sepia.ceph.com has 1 denials 2022-04-03T21:43:20.714 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-04-03T21:43:20.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-03T21:43:20.741 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-04-03T21:43:20.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2022-04-03T21:43:20.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2022-04-03T21:43:20.884 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-04-03T21:43:20.895 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-04-03T21:43:20.902 INFO:teuthology.repo_utils:Fetching master from origin 2022-04-03T21:43:20.934 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-04-03T21:43:20.951 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-04-03T21:43:20.952 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-04-03T21:46:19.129 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2022-04-03T21:46:19.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2022-04-03T21:46:19.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:46:19.191 DEBUG:teuthology.orchestra.run.smithi049:> true 2022-04-03T21:46:19.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2022-04-03T21:46:19.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-03T21:46:19.371 DEBUG:teuthology.orchestra.run.smithi117:> true 2022-04-03T21:46:19.441 INFO:teuthology.run_tasks:Running task clock... 2022-04-03T21:46:19.452 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-04-03T21:46:19.452 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-04-03T21:46:19.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-04-03T21:46:19.459 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-04-03T21:46:19.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-04-03T21:46:19.514 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-04-03T21:46:19.529 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-04-03T21:46:19.540 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-04-03T21:46:19.578 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-04-03T21:46:19.607 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2022-04-03T21:46:19.618 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2022-04-03T21:46:19.632 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-04-03T21:46:19.645 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-04-03T21:46:19.672 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2022-04-03T21:46:19.704 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2022-04-03T21:46:19.708 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2022-04-03T21:46:19.712 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-04-03T21:46:19.712 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2022-04-03T21:46:19.712 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.712 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.713 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.713 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.741 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-04-03T21:46:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-04-03T21:46:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2022-04-03T21:46:19.881 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-04-03T21:46:19.881 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2022-04-03T21:46:19.881 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.882 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.882 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.882 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-03T21:46:19.883 INFO:teuthology.run_tasks:Running task install... 2022-04-03T21:46:19.894 DEBUG:teuthology.task.install:project ceph 2022-04-03T21:46:19.895 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1'}} 2022-04-03T21:46:19.895 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1'} 2022-04-03T21:46:19.896 INFO:teuthology.task.install:Using flavor: default 2022-04-03T21:46:19.902 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-04-03T21:46:19.903 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-04-03T21:46:19.904 DEBUG:teuthology.orchestra.run.smithi049:> sudo lsb_release -is 2022-04-03T21:46:20.015 INFO:teuthology.orchestra.run.smithi049.stdout:CentOSStream 2022-04-03T21:46:20.019 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:46:20.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2022-04-03T21:46:20.021 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1', 'tag': None, 'wait_for_package': False} 2022-04-03T21:46:20.021 DEBUG:teuthology.orchestra.run.smithi049:> sudo lsb_release -is 2022-04-03T21:46:20.057 INFO:teuthology.orchestra.run.smithi117.stdout:CentOSStream 2022-04-03T21:46:20.058 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:46:20.059 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1', 'tag': None, 'wait_for_package': False} 2022-04-03T21:46:20.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2022-04-03T21:46:20.133 INFO:teuthology.orchestra.run.smithi117.stdout:CentOSStream 2022-04-03T21:46:20.133 INFO:teuthology.orchestra.run.smithi049.stdout:CentOSStream 2022-04-03T21:46:20.134 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:46:20.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:46:20.140 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:46:20.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:46:20.289 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/ 2022-04-03T21:46:20.289 INFO:teuthology.task.install.rpm:Package version is 17.0.0-11442.gcfb8f943 2022-04-03T21:46:20.294 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/ 2022-04-03T21:46:20.295 INFO:teuthology.task.install.rpm:Package version is 17.0.0-11442.gcfb8f943 2022-04-03T21:46:20.408 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-04-03T21:46:20.408 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:46:20.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-04-03T21:46:20.415 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220403-170344/cfb8f943163b374162da0d7b0240f267dd46e4e1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-04-03T21:46:20.416 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:46:20.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-04-03T21:46:20.435 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-04-03T21:46:20.435 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cfb8f943163b374162da0d7b0240f267dd46e4e1/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-04-03T21:46:20.497 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-04-03T21:46:20.497 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cfb8f943163b374162da0d7b0240f267dd46e4e1/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-04-03T21:46:20.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-04-03T21:46:20.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-04-03T21:46:20.581 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-04-03T21:46:20.647 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2022-04-03T21:46:20.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2022-04-03T21:46:20.702 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-04-03T21:46:20.783 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2022-04-03T21:46:20.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2022-04-03T21:46:20.883 INFO:teuthology.orchestra.run.smithi117.stdout:50 files removed 2022-04-03T21:46:20.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-04-03T21:46:21.116 INFO:teuthology.orchestra.run.smithi049.stdout:50 files removed 2022-04-03T21:46:21.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-04-03T21:46:21.500 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 221 kB/s | 62 kB 00:00 2022-04-03T21:46:21.784 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 36 kB/s | 9.1 kB 00:00 2022-04-03T21:46:21.996 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 209 kB/s | 62 kB 00:00 2022-04-03T21:46:22.068 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2022-04-03T21:46:22.297 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 35 kB/s | 9.1 kB 00:00 2022-04-03T21:46:22.589 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 5.4 kB/s | 1.4 kB 00:00 2022-04-03T21:46:22.670 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - AppStream 36 MB/s | 21 MB 00:00 2022-04-03T21:46:23.208 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - AppStream 35 MB/s | 21 MB 00:00 2022-04-03T21:46:26.854 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - Base 43 MB/s | 21 MB 00:00 2022-04-03T21:46:28.009 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - Base 37 MB/s | 21 MB 00:00 2022-04-03T21:46:29.936 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - Extras 187 kB/s | 18 kB 00:00 2022-04-03T21:46:30.296 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-8 - PowerTools 19 MB/s | 4.4 MB 00:00 2022-04-03T21:46:31.549 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - Extras 142 kB/s | 18 kB 00:00 2022-04-03T21:46:31.952 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-8 - PowerTools 17 MB/s | 4.4 MB 00:00 2022-04-03T21:46:33.387 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2022-04-03T21:46:34.362 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 13 MB/s | 11 MB 00:00 2022-04-03T21:46:34.818 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2022-04-03T21:46:36.001 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:01 2022-04-03T21:46:37.070 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 415 kB/s | 24 kB 00:00 2022-04-03T21:46:39.451 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 360 kB/s | 24 kB 00:00 2022-04-03T21:46:39.769 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.37.2-1.el8.x86_64 is already installed. 2022-04-03T21:46:39.769 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-initscripts-updown-1:1.37.2-1.el8.noarch is already installed. 2022-04-03T21:46:39.770 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-04-03T21:46:39.770 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-04-03T21:46:39.773 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-04-03T21:46:39.774 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-04-03T21:46:39.844 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2022-04-03T21:46:39.856 INFO:teuthology.orchestra.run.smithi117.stdout:===================================================================================================== 2022-04-03T21:46:39.857 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2022-04-03T21:46:39.857 INFO:teuthology.orchestra.run.smithi117.stdout:===================================================================================================== 2022-04-03T21:46:39.858 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2022-04-03T21:46:39.858 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-04-03T21:46:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 6.5 k 2022-04-03T21:46:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 5.3 M 2022-04-03T21:46:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 880 k 2022-04-03T21:46:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 169 k 2022-04-03T21:46:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 1.5 M 2022-04-03T21:46:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 105 k 2022-04-03T21:46:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 1.6 M 2022-04-03T21:46:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 7.4 M 2022-04-03T21:46:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 47 k 2022-04-03T21:46:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 16 M 2022-04-03T21:46:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 52 M 2022-04-03T21:46:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 257 k 2022-04-03T21:46:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 71 k 2022-04-03T21:46:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 273 k 2022-04-03T21:46:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 14 k 2022-04-03T21:46:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 CentOS-Base 60 k 2022-04-03T21:46:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-04-03T21:46:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-devel x86_64 2.2.53-1.el8 CentOS-Base 79 k 2022-04-03T21:46:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-04-03T21:46:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: libattr-devel x86_64 2.4.48-3.el8 CentOS-Base 34 k 2022-04-03T21:46:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 25 k 2022-04-03T21:46:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 795 k 2022-04-03T21:46:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 125 k 2022-04-03T21:46:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.4 M 2022-04-03T21:46:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.9 M 2022-04-03T21:46:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-04-03T21:46:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.32.1-35.el8 CentOS-Base 98 k 2022-04-03T21:46:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:1.1.1k-6.el8 CentOS-Base 2.3 M 2022-04-03T21:46:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 179 k 2022-04-03T21:46:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 367 k 2022-04-03T21:46:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 345 k 2022-04-03T21:46:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 109 k 2022-04-03T21:46:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 94 k 2022-04-03T21:46:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.8 M 2022-04-03T21:46:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 175 k 2022-04-03T21:46:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-Base 72 k 2022-04-03T21:46:39.867 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2022-04-03T21:46:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: annobin x86_64 10.58-1.el8 CentOS-AppStream 951 k 2022-04-03T21:46:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: autoconf noarch 2.69-29.el8 CentOS-AppStream 710 k 2022-04-03T21:46:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-04-03T21:46:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 23 M 2022-04-03T21:46:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 23 k 2022-04-03T21:46:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 2.3 M 2022-04-03T21:46:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 227 k 2022-04-03T21:46:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.9 M 2022-04-03T21:46:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 17 M 2022-04-03T21:46:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 15 k 2022-04-03T21:46:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 24 k 2022-04-03T21:46:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: cpp x86_64 8.5.0-10.el8 CentOS-AppStream 10 M 2022-04-03T21:46:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-04-03T21:46:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: gcc x86_64 8.5.0-10.el8 CentOS-AppStream 23 M 2022-04-03T21:46:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: glibc-devel x86_64 2.28-196.el8 CentOS-Base 80 k 2022-04-03T21:46:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: glibc-headers x86_64 2.28-196.el8 CentOS-Base 484 k 2022-04-03T21:46:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-04-03T21:46:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: isl x86_64 0.16.1-6.el8 CentOS-AppStream 841 k 2022-04-03T21:46:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-04-03T21:46:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-headers x86_64 4.18.0-373.el8 CentOS-Base 9.3 M 2022-04-03T21:46:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-04-03T21:46:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-04-03T21:46:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: libbabeltrace x86_64 1.5.6-2.el8 lab-extras 200 k 2022-04-03T21:46:39.873 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 170 k 2022-04-03T21:46:39.873 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel x86_64 1.45.6-4.el8 CentOS-Base 39 k 2022-04-03T21:46:39.873 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-04-03T21:46:39.873 INFO:teuthology.orchestra.run.smithi117.stdout: libmpc x86_64 1.1.0-9.1.el8 CentOS-AppStream 61 k 2022-04-03T21:46:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-04-03T21:46:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-04-03T21:46:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-04-03T21:46:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 484 k 2022-04-03T21:46:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-04-03T21:46:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: librdmacm x86_64 37.2-1.el8 CentOS-Base 78 k 2022-04-03T21:46:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 5.3 M 2022-04-03T21:46:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-04-03T21:46:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-04-03T21:46:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-04-03T21:46:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-04-03T21:46:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: libxcrypt-devel x86_64 4.1.1-6.el8 CentOS-Base 25 k 2022-04-03T21:46:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-04-03T21:46:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-04-03T21:46:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-04-03T21:46:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-04-03T21:46:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-04-03T21:46:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-04-03T21:46:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-04-03T21:46:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: platform-python-devel x86_64 3.6.8-46.el8 CentOS-AppStream 250 k 2022-04-03T21:46:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-04-03T21:46:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-04-03T21:46:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-04-03T21:46:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-04-03T21:46:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-04-03T21:46:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 45 k 2022-04-03T21:46:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 105 k 2022-04-03T21:46:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-04-03T21:46:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-04-03T21:46:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-04-03T21:46:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-04-03T21:46:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-04-03T21:46:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-04-03T21:46:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-04-03T21:46:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-04-03T21:46:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-04-03T21:46:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-04-03T21:46:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-04-03T21:46:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-04-03T21:46:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-04-03T21:46:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-04-03T21:46:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-04-03T21:46:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-04-03T21:46:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-04-03T21:46:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-04-03T21:46:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-04-03T21:46:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-04-03T21:46:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-04-03T21:46:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-04-03T21:46:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-04-03T21:46:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-04-03T21:46:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-04-03T21:46:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-04-03T21:46:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-04-03T21:46:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-04-03T21:46:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-04-03T21:46:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-04-03T21:46:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-04-03T21:46:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-04-03T21:46:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rpm-generators noarch 5-7.el8 CentOS-AppStream 25 k 2022-04-03T21:46:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-04-03T21:46:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-04-03T21:46:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-04-03T21:46:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-04-03T21:46:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-04-03T21:46:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-04-03T21:46:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-04-03T21:46:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-04-03T21:46:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-04-03T21:46:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-04-03T21:46:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-04-03T21:46:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-04-03T21:46:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-04-03T21:46:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-04-03T21:46:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: userspace-rcu x86_64 0.10.1-4.el8 CentOS-Base 101 k 2022-04-03T21:46:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-04-03T21:46:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-04-03T21:46:39.891 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:46:39.891 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2022-04-03T21:46:39.891 INFO:teuthology.orchestra.run.smithi117.stdout:===================================================================================================== 2022-04-03T21:46:39.891 INFO:teuthology.orchestra.run.smithi117.stdout:Install 141 Packages 2022-04-03T21:46:39.891 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:46:39.892 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 249 M 2022-04-03T21:46:39.893 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 1.0 G 2022-04-03T21:46:39.893 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2022-04-03T21:46:40.021 INFO:teuthology.orchestra.run.smithi117.stdout:(1/141): ceph-17.0.0-11442.gcfb8f943.el8.x86_64 44 kB/s | 6.5 kB 00:00 2022-04-03T21:46:40.368 INFO:teuthology.orchestra.run.smithi117.stdout:(2/141): ceph-fuse-17.0.0-11442.gcfb8f943.el8.x 2.5 MB/s | 880 kB 00:00 2022-04-03T21:46:40.463 INFO:teuthology.orchestra.run.smithi117.stdout:(3/141): ceph-immutable-object-cache-17.0.0-114 1.7 MB/s | 169 kB 00:00 2022-04-03T21:46:40.530 INFO:teuthology.orchestra.run.smithi117.stdout:(4/141): ceph-base-17.0.0-11442.gcfb8f943.el8.x 8.0 MB/s | 5.3 MB 00:00 2022-04-03T21:46:40.714 INFO:teuthology.orchestra.run.smithi117.stdout:(5/141): ceph-mgr-17.0.0-11442.gcfb8f943.el8.x8 8.4 MB/s | 1.5 MB 00:00 2022-04-03T21:46:41.106 INFO:teuthology.orchestra.run.smithi117.stdout:(6/141): ceph-mds-17.0.0-11442.gcfb8f943.el8.x8 3.6 MB/s | 2.3 MB 00:00 2022-04-03T21:46:41.164 INFO:teuthology.orchestra.run.smithi117.stdout:(7/141): ceph-mon-17.0.0-11442.gcfb8f943.el8.x8 8.6 MB/s | 3.9 MB 00:00 2022-04-03T21:46:41.856 INFO:teuthology.orchestra.run.smithi117.stdout:(8/141): ceph-common-17.0.0-11442.gcfb8f943.el8 12 MB/s | 23 MB 00:01 2022-04-03T21:46:41.907 INFO:teuthology.orchestra.run.smithi117.stdout:(9/141): ceph-selinux-17.0.0-11442.gcfb8f943.el 490 kB/s | 24 kB 00:00 2022-04-03T21:46:42.479 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.37.2-1.el8.x86_64 is already installed. 2022-04-03T21:46:42.480 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-initscripts-updown-1:1.37.2-1.el8.noarch is already installed. 2022-04-03T21:46:42.481 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-04-03T21:46:42.481 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-04-03T21:46:42.485 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-04-03T21:46:42.485 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-04-03T21:46:42.566 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2022-04-03T21:46:42.580 INFO:teuthology.orchestra.run.smithi049.stdout:===================================================================================================== 2022-04-03T21:46:42.580 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2022-04-03T21:46:42.581 INFO:teuthology.orchestra.run.smithi049.stdout:===================================================================================================== 2022-04-03T21:46:42.581 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2022-04-03T21:46:42.581 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-04-03T21:46:42.581 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 6.5 k 2022-04-03T21:46:42.582 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 5.3 M 2022-04-03T21:46:42.582 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 880 k 2022-04-03T21:46:42.582 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 169 k 2022-04-03T21:46:42.582 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 1.5 M 2022-04-03T21:46:42.583 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 105 k 2022-04-03T21:46:42.583 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 1.6 M 2022-04-03T21:46:42.583 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 7.4 M 2022-04-03T21:46:42.583 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 47 k 2022-04-03T21:46:42.584 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 16 M 2022-04-03T21:46:42.584 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 52 M 2022-04-03T21:46:42.584 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 257 k 2022-04-03T21:46:42.584 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 71 k 2022-04-03T21:46:42.584 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 273 k 2022-04-03T21:46:42.585 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 14 k 2022-04-03T21:46:42.585 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 CentOS-Base 60 k 2022-04-03T21:46:42.585 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-04-03T21:46:42.585 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-devel x86_64 2.2.53-1.el8 CentOS-Base 79 k 2022-04-03T21:46:42.586 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-04-03T21:46:42.586 INFO:teuthology.orchestra.run.smithi049.stdout: libattr-devel x86_64 2.4.48-3.el8 CentOS-Base 34 k 2022-04-03T21:46:42.586 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 25 k 2022-04-03T21:46:42.586 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 795 k 2022-04-03T21:46:42.586 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 125 k 2022-04-03T21:46:42.587 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.4 M 2022-04-03T21:46:42.587 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.9 M 2022-04-03T21:46:42.587 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-04-03T21:46:42.587 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.32.1-35.el8 CentOS-Base 98 k 2022-04-03T21:46:42.588 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:1.1.1k-6.el8 CentOS-Base 2.3 M 2022-04-03T21:46:42.588 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 179 k 2022-04-03T21:46:42.588 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 367 k 2022-04-03T21:46:42.588 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 345 k 2022-04-03T21:46:42.588 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 109 k 2022-04-03T21:46:42.589 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 94 k 2022-04-03T21:46:42.589 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.8 M 2022-04-03T21:46:42.589 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 175 k 2022-04-03T21:46:42.589 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-Base 72 k 2022-04-03T21:46:42.590 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2022-04-03T21:46:42.590 INFO:teuthology.orchestra.run.smithi049.stdout: annobin x86_64 10.58-1.el8 CentOS-AppStream 951 k 2022-04-03T21:46:42.590 INFO:teuthology.orchestra.run.smithi049.stdout: autoconf noarch 2.69-29.el8 CentOS-AppStream 710 k 2022-04-03T21:46:42.590 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-04-03T21:46:42.590 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 23 M 2022-04-03T21:46:42.591 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 23 k 2022-04-03T21:46:42.591 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 2.3 M 2022-04-03T21:46:42.591 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 227 k 2022-04-03T21:46:42.591 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 3.9 M 2022-04-03T21:46:42.592 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 17 M 2022-04-03T21:46:42.592 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:17.0.0-11442.gcfb8f943.el8 ceph-noarch 15 k 2022-04-03T21:46:42.592 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 24 k 2022-04-03T21:46:42.592 INFO:teuthology.orchestra.run.smithi049.stdout: cpp x86_64 8.5.0-10.el8 CentOS-AppStream 10 M 2022-04-03T21:46:42.592 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-04-03T21:46:42.593 INFO:teuthology.orchestra.run.smithi049.stdout: gcc x86_64 8.5.0-10.el8 CentOS-AppStream 23 M 2022-04-03T21:46:42.593 INFO:teuthology.orchestra.run.smithi049.stdout: glibc-devel x86_64 2.28-196.el8 CentOS-Base 80 k 2022-04-03T21:46:42.593 INFO:teuthology.orchestra.run.smithi049.stdout: glibc-headers x86_64 2.28-196.el8 CentOS-Base 484 k 2022-04-03T21:46:42.593 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-04-03T21:46:42.593 INFO:teuthology.orchestra.run.smithi049.stdout: isl x86_64 0.16.1-6.el8 CentOS-AppStream 841 k 2022-04-03T21:46:42.594 INFO:teuthology.orchestra.run.smithi049.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-04-03T21:46:42.594 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-headers x86_64 4.18.0-373.el8 CentOS-Base 9.3 M 2022-04-03T21:46:42.594 INFO:teuthology.orchestra.run.smithi049.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-04-03T21:46:42.594 INFO:teuthology.orchestra.run.smithi049.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-04-03T21:46:42.595 INFO:teuthology.orchestra.run.smithi049.stdout: libbabeltrace x86_64 1.5.6-2.el8 lab-extras 200 k 2022-04-03T21:46:42.595 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 170 k 2022-04-03T21:46:42.595 INFO:teuthology.orchestra.run.smithi049.stdout: libcom_err-devel x86_64 1.45.6-4.el8 CentOS-Base 39 k 2022-04-03T21:46:42.595 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-04-03T21:46:42.595 INFO:teuthology.orchestra.run.smithi049.stdout: libmpc x86_64 1.1.0-9.1.el8 CentOS-AppStream 61 k 2022-04-03T21:46:42.596 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-04-03T21:46:42.596 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-04-03T21:46:42.596 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-04-03T21:46:42.596 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 484 k 2022-04-03T21:46:42.597 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-04-03T21:46:42.597 INFO:teuthology.orchestra.run.smithi049.stdout: librdmacm x86_64 37.2-1.el8 CentOS-Base 78 k 2022-04-03T21:46:42.597 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 5.3 M 2022-04-03T21:46:42.597 INFO:teuthology.orchestra.run.smithi049.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-04-03T21:46:42.597 INFO:teuthology.orchestra.run.smithi049.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-04-03T21:46:42.598 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-04-03T21:46:42.598 INFO:teuthology.orchestra.run.smithi049.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-04-03T21:46:42.598 INFO:teuthology.orchestra.run.smithi049.stdout: libxcrypt-devel x86_64 4.1.1-6.el8 CentOS-Base 25 k 2022-04-03T21:46:42.598 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-04-03T21:46:42.598 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-04-03T21:46:42.599 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-04-03T21:46:42.599 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-04-03T21:46:42.600 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-04-03T21:46:42.600 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-04-03T21:46:42.600 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-04-03T21:46:42.600 INFO:teuthology.orchestra.run.smithi049.stdout: platform-python-devel x86_64 3.6.8-46.el8 CentOS-AppStream 250 k 2022-04-03T21:46:42.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-04-03T21:46:42.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-04-03T21:46:42.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-04-03T21:46:42.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-04-03T21:46:42.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-04-03T21:46:42.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 45 k 2022-04-03T21:46:42.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:17.0.0-11442.gcfb8f943.el8 ceph 105 k 2022-04-03T21:46:42.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-04-03T21:46:42.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-04-03T21:46:42.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-04-03T21:46:42.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-04-03T21:46:42.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-04-03T21:46:42.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-04-03T21:46:42.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-04-03T21:46:42.604 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-04-03T21:46:42.604 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-04-03T21:46:42.604 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-04-03T21:46:42.604 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-04-03T21:46:42.604 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-04-03T21:46:42.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-04-03T21:46:42.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-04-03T21:46:42.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-04-03T21:46:42.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-04-03T21:46:42.605 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-04-03T21:46:42.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-04-03T21:46:42.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-04-03T21:46:42.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-04-03T21:46:42.606 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-04-03T21:46:42.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-04-03T21:46:42.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-04-03T21:46:42.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-04-03T21:46:42.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-04-03T21:46:42.607 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-04-03T21:46:42.608 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-04-03T21:46:42.608 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-04-03T21:46:42.608 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-04-03T21:46:42.608 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-04-03T21:46:42.609 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-04-03T21:46:42.609 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-04-03T21:46:42.609 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rpm-generators noarch 5-7.el8 CentOS-AppStream 25 k 2022-04-03T21:46:42.609 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-04-03T21:46:42.609 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-04-03T21:46:42.610 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-04-03T21:46:42.610 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-04-03T21:46:42.610 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-04-03T21:46:42.610 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-04-03T21:46:42.610 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-04-03T21:46:42.611 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-04-03T21:46:42.611 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-04-03T21:46:42.611 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-04-03T21:46:42.611 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-04-03T21:46:42.611 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-04-03T21:46:42.612 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-04-03T21:46:42.612 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-04-03T21:46:42.612 INFO:teuthology.orchestra.run.smithi049.stdout: userspace-rcu x86_64 0.10.1-4.el8 CentOS-Base 101 k 2022-04-03T21:46:42.612 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-04-03T21:46:42.612 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-04-03T21:46:42.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:46:42.613 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2022-04-03T21:46:42.613 INFO:teuthology.orchestra.run.smithi049.stdout:===================================================================================================== 2022-04-03T21:46:42.613 INFO:teuthology.orchestra.run.smithi049.stdout:Install 141 Packages 2022-04-03T21:46:42.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:46:42.614 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 249 M 2022-04-03T21:46:42.615 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 1.0 G 2022-04-03T21:46:42.615 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2022-04-03T21:46:42.682 INFO:teuthology.orchestra.run.smithi117.stdout:(10/141): ceph-radosgw-17.0.0-11442.gcfb8f943.e 11 MB/s | 16 MB 00:01 2022-04-03T21:46:42.748 INFO:teuthology.orchestra.run.smithi117.stdout:(11/141): cephfs-mirror-17.0.0-11442.gcfb8f943. 4.0 MB/s | 273 kB 00:00 2022-04-03T21:46:42.786 INFO:teuthology.orchestra.run.smithi049.stdout:(1/141): ceph-17.0.0-11442.gcfb8f943.el8.x86_64 36 kB/s | 6.5 kB 00:00 2022-04-03T21:46:42.815 INFO:teuthology.orchestra.run.smithi117.stdout:(12/141): libcephfs-devel-17.0.0-11442.gcfb8f94 374 kB/s | 25 kB 00:00 2022-04-03T21:46:42.932 INFO:teuthology.orchestra.run.smithi117.stdout:(13/141): libcephfs2-17.0.0-11442.gcfb8f943.el8 6.7 MB/s | 795 kB 00:00 2022-04-03T21:46:43.016 INFO:teuthology.orchestra.run.smithi117.stdout:(14/141): libcephsqlite-17.0.0-11442.gcfb8f943. 2.0 MB/s | 170 kB 00:00 2022-04-03T21:46:43.099 INFO:teuthology.orchestra.run.smithi117.stdout:(15/141): librados-devel-17.0.0-11442.gcfb8f943 1.5 MB/s | 125 kB 00:00 2022-04-03T21:46:43.550 INFO:teuthology.orchestra.run.smithi117.stdout:(16/141): librados2-17.0.0-11442.gcfb8f943.el8. 7.7 MB/s | 3.4 MB 00:00 2022-04-03T21:46:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:(2/141): ceph-fuse-17.0.0-11442.gcfb8f943.el8.x 1.1 MB/s | 880 kB 00:00 2022-04-03T21:46:43.641 INFO:teuthology.orchestra.run.smithi117.stdout:(17/141): libradosstriper1-17.0.0-11442.gcfb8f9 5.2 MB/s | 484 kB 00:00 2022-04-03T21:46:43.728 INFO:teuthology.orchestra.run.smithi049.stdout:(3/141): ceph-immutable-object-cache-17.0.0-114 1.2 MB/s | 169 kB 00:00 2022-04-03T21:46:44.083 INFO:teuthology.orchestra.run.smithi117.stdout:(18/141): librbd1-17.0.0-11442.gcfb8f943.el8.x8 8.8 MB/s | 3.9 MB 00:00 2022-04-03T21:46:44.684 INFO:teuthology.orchestra.run.smithi117.stdout:(19/141): librgw2-17.0.0-11442.gcfb8f943.el8.x8 8.9 MB/s | 5.3 MB 00:00 2022-04-03T21:46:44.720 INFO:teuthology.orchestra.run.smithi049.stdout:(4/141): ceph-mds-17.0.0-11442.gcfb8f943.el8.x8 2.3 MB/s | 2.3 MB 00:00 2022-04-03T21:46:44.759 INFO:teuthology.orchestra.run.smithi117.stdout:(20/141): python3-ceph-argparse-17.0.0-11442.gc 593 kB/s | 45 kB 00:00 2022-04-03T21:46:44.843 INFO:teuthology.orchestra.run.smithi117.stdout:(21/141): python3-ceph-common-17.0.0-11442.gcfb 1.2 MB/s | 105 kB 00:00 2022-04-03T21:46:44.926 INFO:teuthology.orchestra.run.smithi117.stdout:(22/141): python3-cephfs-17.0.0-11442.gcfb8f943 2.1 MB/s | 179 kB 00:00 2022-04-03T21:46:45.027 INFO:teuthology.orchestra.run.smithi117.stdout:(23/141): python3-rados-17.0.0-11442.gcfb8f943. 3.6 MB/s | 367 kB 00:00 2022-04-03T21:46:45.152 INFO:teuthology.orchestra.run.smithi117.stdout:(24/141): python3-rbd-17.0.0-11442.gcfb8f943.el 2.7 MB/s | 345 kB 00:00 2022-04-03T21:46:45.178 INFO:teuthology.orchestra.run.smithi049.stdout:(5/141): ceph-mgr-17.0.0-11442.gcfb8f943.el8.x8 3.4 MB/s | 1.5 MB 00:00 2022-04-03T21:46:45.227 INFO:teuthology.orchestra.run.smithi117.stdout:(25/141): python3-rgw-17.0.0-11442.gcfb8f943.el 1.4 MB/s | 109 kB 00:00 2022-04-03T21:46:45.451 INFO:teuthology.orchestra.run.smithi117.stdout:(26/141): ceph-osd-17.0.0-11442.gcfb8f943.el8.x 3.9 MB/s | 17 MB 00:04 2022-04-03T21:46:45.477 INFO:teuthology.orchestra.run.smithi117.stdout:(27/141): rbd-fuse-17.0.0-11442.gcfb8f943.el8.x 374 kB/s | 94 kB 00:00 2022-04-03T21:46:45.586 INFO:teuthology.orchestra.run.smithi117.stdout:(28/141): rbd-nbd-17.0.0-11442.gcfb8f943.el8.x8 1.6 MB/s | 175 kB 00:00 2022-04-03T21:46:45.678 INFO:teuthology.orchestra.run.smithi117.stdout:(29/141): ceph-grafana-dashboards-17.0.0-11442. 247 kB/s | 23 kB 00:00 2022-04-03T21:46:45.778 INFO:teuthology.orchestra.run.smithi117.stdout:(30/141): ceph-mgr-cephadm-17.0.0-11442.gcfb8f9 1.0 MB/s | 105 kB 00:00 2022-04-03T21:46:45.870 INFO:teuthology.orchestra.run.smithi049.stdout:(6/141): ceph-mon-17.0.0-11442.gcfb8f943.el8.x8 5.6 MB/s | 3.9 MB 00:00 2022-04-03T21:46:46.112 INFO:teuthology.orchestra.run.smithi049.stdout:(7/141): ceph-base-17.0.0-11442.gcfb8f943.el8.x 1.5 MB/s | 5.3 MB 00:03 2022-04-03T21:46:46.237 INFO:teuthology.orchestra.run.smithi117.stdout:(31/141): ceph-test-17.0.0-11442.gcfb8f943.el8. 12 MB/s | 52 MB 00:04 2022-04-03T21:46:46.279 INFO:teuthology.orchestra.run.smithi117.stdout:(32/141): ceph-mgr-dashboard-17.0.0-11442.gcfb8 3.2 MB/s | 1.6 MB 00:00 2022-04-03T21:46:46.746 INFO:teuthology.orchestra.run.smithi117.stdout:(33/141): rbd-mirror-17.0.0-11442.gcfb8f943.el8 2.9 MB/s | 3.8 MB 00:01 2022-04-03T21:46:46.880 INFO:teuthology.orchestra.run.smithi117.stdout:(34/141): ceph-mgr-rook-17.0.0-11442.gcfb8f943. 352 kB/s | 47 kB 00:00 2022-04-03T21:46:46.963 INFO:teuthology.orchestra.run.smithi117.stdout:(35/141): ceph-prometheus-alerts-17.0.0-11442.g 176 kB/s | 15 kB 00:00 2022-04-03T21:46:47.039 INFO:teuthology.orchestra.run.smithi117.stdout:(36/141): ceph-mgr-modules-core-17.0.0-11442.gc 299 kB/s | 227 kB 00:00 2022-04-03T21:46:47.139 INFO:teuthology.orchestra.run.smithi117.stdout:(37/141): ceph-volume-17.0.0-11442.gcfb8f943.el 1.4 MB/s | 257 kB 00:00 2022-04-03T21:46:47.164 INFO:teuthology.orchestra.run.smithi117.stdout:(38/141): cephadm-17.0.0-11442.gcfb8f943.el8.no 572 kB/s | 71 kB 00:00 2022-04-03T21:46:47.264 INFO:teuthology.orchestra.run.smithi117.stdout:(39/141): ceph-mgr-diskprediction-local-17.0.0- 7.2 MB/s | 7.4 MB 00:01 2022-04-03T21:46:47.314 INFO:teuthology.orchestra.run.smithi117.stdout:(40/141): cephfs-top-17.0.0-11442.gcfb8f943.el8 82 kB/s | 14 kB 00:00 2022-04-03T21:46:47.373 INFO:teuthology.orchestra.run.smithi117.stdout:(41/141): annobin-10.58-1.el8.x86_64.rpm 4.5 MB/s | 951 kB 00:00 2022-04-03T21:46:47.415 INFO:teuthology.orchestra.run.smithi117.stdout:(42/141): bison-3.0.4-10.el8.x86_64.rpm 17 MB/s | 688 kB 00:00 2022-04-03T21:46:47.421 INFO:teuthology.orchestra.run.smithi049.stdout:(8/141): ceph-common-17.0.0-11442.gcfb8f943.el8 4.8 MB/s | 23 MB 00:04 2022-04-03T21:46:47.456 INFO:teuthology.orchestra.run.smithi117.stdout:(43/141): autoconf-2.69-29.el8.noarch.rpm 3.6 MB/s | 710 kB 00:00 2022-04-03T21:46:47.463 INFO:teuthology.orchestra.run.smithi049.stdout:(9/141): ceph-selinux-17.0.0-11442.gcfb8f943.el 587 kB/s | 24 kB 00:00 2022-04-03T21:46:47.499 INFO:teuthology.orchestra.run.smithi117.stdout:(44/141): automake-1.16.1-7.el8.noarch.rpm 3.9 MB/s | 713 kB 00:00 2022-04-03T21:46:47.532 INFO:teuthology.orchestra.run.smithi117.stdout:(45/141): flex-2.6.1-9.el8.x86_64.rpm 4.2 MB/s | 320 kB 00:00 2022-04-03T21:46:47.616 INFO:teuthology.orchestra.run.smithi117.stdout:(46/141): isl-0.16.1-6.el8.x86_64.rpm 9.9 MB/s | 841 kB 00:00 2022-04-03T21:46:47.649 INFO:teuthology.orchestra.run.smithi117.stdout:(47/141): jq-1.6-3.el8.x86_64.rpm 5.9 MB/s | 202 kB 00:00 2022-04-03T21:46:47.675 INFO:teuthology.orchestra.run.smithi117.stdout:(48/141): libmpc-1.1.0-9.1.el8.x86_64.rpm 2.4 MB/s | 61 kB 00:00 2022-04-03T21:46:47.717 INFO:teuthology.orchestra.run.smithi117.stdout:(49/141): librdkafka-0.11.4-3.el8.x86_64.rpm 8.4 MB/s | 354 kB 00:00 2022-04-03T21:46:47.788 INFO:teuthology.orchestra.run.smithi049.stdout:(10/141): ceph-osd-17.0.0-11442.gcfb8f943.el8.x 8.8 MB/s | 17 MB 00:01 2022-04-03T21:46:47.792 INFO:teuthology.orchestra.run.smithi117.stdout:(50/141): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2022-04-03T21:46:47.839 INFO:teuthology.orchestra.run.smithi049.stdout:(11/141): cephfs-mirror-17.0.0-11442.gcfb8f943. 5.4 MB/s | 273 kB 00:00 2022-04-03T21:46:47.910 INFO:teuthology.orchestra.run.smithi117.stdout:(51/141): cpp-8.5.0-10.el8.x86_64.rpm 21 MB/s | 10 MB 00:00 2022-04-03T21:46:47.922 INFO:teuthology.orchestra.run.smithi049.stdout:(12/141): libcephfs-devel-17.0.0-11442.gcfb8f94 299 kB/s | 25 kB 00:00 2022-04-03T21:46:47.935 INFO:teuthology.orchestra.run.smithi117.stdout:(52/141): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2022-04-03T21:46:47.960 INFO:teuthology.orchestra.run.smithi117.stdout:(53/141): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2022-04-03T21:46:48.039 INFO:teuthology.orchestra.run.smithi049.stdout:(13/141): libcephfs2-17.0.0-11442.gcfb8f943.el8 6.7 MB/s | 795 kB 00:00 2022-04-03T21:46:48.114 INFO:teuthology.orchestra.run.smithi049.stdout:(14/141): libcephsqlite-17.0.0-11442.gcfb8f943. 2.2 MB/s | 170 kB 00:00 2022-04-03T21:46:48.127 INFO:teuthology.orchestra.run.smithi117.stdout:(54/141): openblas-threads-0.3.15-3.el8.x86_64. 29 MB/s | 4.9 MB 00:00 2022-04-03T21:46:48.160 INFO:teuthology.orchestra.run.smithi117.stdout:(55/141): platform-python-devel-3.6.8-46.el8.x8 7.4 MB/s | 250 kB 00:00 2022-04-03T21:46:48.201 INFO:teuthology.orchestra.run.smithi049.stdout:(15/141): librados-devel-17.0.0-11442.gcfb8f943 1.4 MB/s | 125 kB 00:00 2022-04-03T21:46:48.360 INFO:teuthology.orchestra.run.smithi117.stdout:(56/141): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2022-04-03T21:46:48.411 INFO:teuthology.orchestra.run.smithi117.stdout:(57/141): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2022-04-03T21:46:48.436 INFO:teuthology.orchestra.run.smithi117.stdout:(58/141): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2022-04-03T21:46:48.461 INFO:teuthology.orchestra.run.smithi117.stdout:(59/141): python3-jsonpointer-1.10-11.el8.noarc 798 kB/s | 20 kB 00:00 2022-04-03T21:46:48.582 INFO:teuthology.orchestra.run.smithi049.stdout:(16/141): librados2-17.0.0-11442.gcfb8f943.el8. 9.1 MB/s | 3.4 MB 00:00 2022-04-03T21:46:48.649 INFO:teuthology.orchestra.run.smithi049.stdout:(17/141): libradosstriper1-17.0.0-11442.gcfb8f9 7.1 MB/s | 484 kB 00:00 2022-04-03T21:46:48.695 INFO:teuthology.orchestra.run.smithi117.stdout:(60/141): gcc-8.5.0-10.el8.x86_64.rpm 20 MB/s | 23 MB 00:01 2022-04-03T21:46:48.762 INFO:teuthology.orchestra.run.smithi117.stdout:(61/141): openblas-0.3.15-3.el8.x86_64.rpm 5.7 MB/s | 4.7 MB 00:00 2022-04-03T21:46:48.778 INFO:teuthology.orchestra.run.smithi117.stdout:(62/141): python3-mako-1.0.6-13.el8.noarch.rpm 494 kB/s | 157 kB 00:00 2022-04-03T21:46:48.804 INFO:teuthology.orchestra.run.smithi117.stdout:(63/141): python3-markupsafe-0.23-19.el8.x86_64 357 kB/s | 39 kB 00:00 2022-04-03T21:46:48.829 INFO:teuthology.orchestra.run.smithi117.stdout:(64/141): python3-prettytable-0.7.2-14.el8.noar 1.7 MB/s | 44 kB 00:00 2022-04-03T21:46:48.854 INFO:teuthology.orchestra.run.smithi117.stdout:(65/141): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2022-04-03T21:46:48.879 INFO:teuthology.orchestra.run.smithi117.stdout:(66/141): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2022-04-03T21:46:48.905 INFO:teuthology.orchestra.run.smithi117.stdout:(67/141): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2022-04-03T21:46:48.930 INFO:teuthology.orchestra.run.smithi117.stdout:(68/141): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2022-04-03T21:46:48.947 INFO:teuthology.orchestra.run.smithi117.stdout:(69/141): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2022-04-03T21:46:48.964 INFO:teuthology.orchestra.run.smithi117.stdout:(70/141): python3-rpm-generators-5-7.el8.noarch 737 kB/s | 25 kB 00:00 2022-04-03T21:46:48.997 INFO:teuthology.orchestra.run.smithi117.stdout:(71/141): python3-werkzeug-0.12.2-4.el8.noarch. 13 MB/s | 457 kB 00:00 2022-04-03T21:46:49.031 INFO:teuthology.orchestra.run.smithi117.stdout:(72/141): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2022-04-03T21:46:49.048 INFO:teuthology.orchestra.run.smithi117.stdout:(73/141): elfutils-libelf-devel-0.186-1.el8.x86 3.5 MB/s | 60 kB 00:00 2022-04-03T21:46:49.065 INFO:teuthology.orchestra.run.smithi049.stdout:(18/141): librbd1-17.0.0-11442.gcfb8f943.el8.x8 9.3 MB/s | 3.9 MB 00:00 2022-04-03T21:46:49.073 INFO:teuthology.orchestra.run.smithi117.stdout:(74/141): fuse-2.9.7-15.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2022-04-03T21:46:49.098 INFO:teuthology.orchestra.run.smithi117.stdout:(75/141): glibc-devel-2.28-196.el8.x86_64.rpm 3.1 MB/s | 80 kB 00:00 2022-04-03T21:46:49.157 INFO:teuthology.orchestra.run.smithi117.stdout:(76/141): glibc-headers-2.28-196.el8.x86_64.rpm 8.1 MB/s | 484 kB 00:00 2022-04-03T21:46:49.291 INFO:teuthology.orchestra.run.smithi117.stdout:(77/141): python3-numpy-1.14.3-10.el8.x86_64.rp 7.1 MB/s | 3.7 MB 00:00 2022-04-03T21:46:49.308 INFO:teuthology.orchestra.run.smithi117.stdout:(78/141): keyutils-libs-devel-1.5.10-9.el8.x86_ 2.8 MB/s | 48 kB 00:00 2022-04-03T21:46:49.366 INFO:teuthology.orchestra.run.smithi117.stdout:(79/141): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2022-04-03T21:46:49.400 INFO:teuthology.orchestra.run.smithi117.stdout:(80/141): libacl-devel-2.2.53-1.el8.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2022-04-03T21:46:49.425 INFO:teuthology.orchestra.run.smithi117.stdout:(81/141): libaio-devel-0.3.112-1.el8.x86_64.rpm 739 kB/s | 19 kB 00:00 2022-04-03T21:46:49.451 INFO:teuthology.orchestra.run.smithi117.stdout:(82/141): libattr-devel-2.4.48-3.el8.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2022-04-03T21:46:49.476 INFO:teuthology.orchestra.run.smithi117.stdout:(83/141): libcom_err-devel-1.45.6-4.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2022-04-03T21:46:49.543 INFO:teuthology.orchestra.run.smithi117.stdout:(84/141): libgfortran-8.5.0-10.el8.x86_64.rpm 9.4 MB/s | 643 kB 00:00 2022-04-03T21:46:49.600 INFO:teuthology.orchestra.run.smithi117.stdout:(85/141): libquadmath-8.5.0-10.el8.x86_64.rpm 3.0 MB/s | 171 kB 00:00 2022-04-03T21:46:49.631 INFO:teuthology.orchestra.run.smithi049.stdout:(19/141): librgw2-17.0.0-11442.gcfb8f943.el8.x8 9.5 MB/s | 5.3 MB 00:00 2022-04-03T21:46:49.635 INFO:teuthology.orchestra.run.smithi117.stdout:(86/141): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2022-04-03T21:46:49.669 INFO:teuthology.orchestra.run.smithi117.stdout:(87/141): librdmacm-37.2-1.el8.x86_64.rpm 2.3 MB/s | 78 kB 00:00 2022-04-03T21:46:49.699 INFO:teuthology.orchestra.run.smithi049.stdout:(20/141): python3-ceph-argparse-17.0.0-11442.gc 656 kB/s | 45 kB 00:00 2022-04-03T21:46:49.769 INFO:teuthology.orchestra.run.smithi117.stdout:(88/141): kernel-headers-4.18.0-373.el8.x86_64. 15 MB/s | 9.3 MB 00:00 2022-04-03T21:46:49.774 INFO:teuthology.orchestra.run.smithi049.stdout:(21/141): python3-ceph-common-17.0.0-11442.gcfb 1.4 MB/s | 105 kB 00:00 2022-04-03T21:46:49.794 INFO:teuthology.orchestra.run.smithi117.stdout:(89/141): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2022-04-03T21:46:49.820 INFO:teuthology.orchestra.run.smithi117.stdout:(90/141): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2022-04-03T21:46:49.845 INFO:teuthology.orchestra.run.smithi117.stdout:(91/141): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2022-04-03T21:46:49.850 INFO:teuthology.orchestra.run.smithi049.stdout:(22/141): python3-cephfs-17.0.0-11442.gcfb8f943 2.3 MB/s | 179 kB 00:00 2022-04-03T21:46:49.870 INFO:teuthology.orchestra.run.smithi117.stdout:(92/141): libverto-devel-0.3.0-5.el8.x86_64.rpm 356 kB/s | 18 kB 00:00 2022-04-03T21:46:49.895 INFO:teuthology.orchestra.run.smithi117.stdout:(93/141): libxcrypt-devel-4.1.1-6.el8.x86_64.rp 502 kB/s | 25 kB 00:00 2022-04-03T21:46:49.950 INFO:teuthology.orchestra.run.smithi049.stdout:(23/141): python3-rados-17.0.0-11442.gcfb8f943. 3.6 MB/s | 367 kB 00:00 2022-04-03T21:46:49.954 INFO:teuthology.orchestra.run.smithi117.stdout:(94/141): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2022-04-03T21:46:49.988 INFO:teuthology.orchestra.run.smithi117.stdout:(95/141): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.7 MB/s | 229 kB 00:00 2022-04-03T21:46:50.025 INFO:teuthology.orchestra.run.smithi049.stdout:(24/141): python3-rbd-17.0.0-11442.gcfb8f943.el 4.5 MB/s | 345 kB 00:00 2022-04-03T21:46:50.092 INFO:teuthology.orchestra.run.smithi049.stdout:(25/141): python3-rgw-17.0.0-11442.gcfb8f943.el 1.6 MB/s | 109 kB 00:00 2022-04-03T21:46:50.146 INFO:teuthology.orchestra.run.smithi117.stdout:(96/141): python3-scipy-1.0.0-21.module_el8.5.0 11 MB/s | 14 MB 00:01 2022-04-03T21:46:50.159 INFO:teuthology.orchestra.run.smithi049.stdout:(26/141): rbd-fuse-17.0.0-11442.gcfb8f943.el8.x 1.4 MB/s | 94 kB 00:00 2022-04-03T21:46:50.171 INFO:teuthology.orchestra.run.smithi117.stdout:(97/141): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2022-04-03T21:46:50.197 INFO:teuthology.orchestra.run.smithi117.stdout:(98/141): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 237 kB 00:00 2022-04-03T21:46:50.247 INFO:teuthology.orchestra.run.smithi117.stdout:(99/141): openssl-devel-1.1.1k-6.el8.x86_64.rpm 6.2 MB/s | 2.3 MB 00:00 2022-04-03T21:46:50.272 INFO:teuthology.orchestra.run.smithi117.stdout:(100/141): python3-jwt-1.6.1-2.el8.noarch.rpm 566 kB/s | 43 kB 00:00 2022-04-03T21:46:50.297 INFO:teuthology.orchestra.run.smithi117.stdout:(101/141): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2022-04-03T21:46:50.323 INFO:teuthology.orchestra.run.smithi117.stdout:(102/141): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2022-04-03T21:46:50.348 INFO:teuthology.orchestra.run.smithi117.stdout:(103/141): python3-requests-oauthlib-1.0.0-1.el 849 kB/s | 43 kB 00:00 2022-04-03T21:46:50.373 INFO:teuthology.orchestra.run.smithi117.stdout:(104/141): userspace-rcu-0.10.1-4.el8.x86_64.rp 2.0 MB/s | 101 kB 00:00 2022-04-03T21:46:50.399 INFO:teuthology.orchestra.run.smithi117.stdout:(105/141): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2022-04-03T21:46:50.424 INFO:teuthology.orchestra.run.smithi117.stdout:(106/141): python3-cryptography-3.2.1-5.el8.x86 2.2 MB/s | 559 kB 00:00 2022-04-03T21:46:50.449 INFO:teuthology.orchestra.run.smithi117.stdout:(107/141): zlib-devel-1.2.11-17.el8.x86_64.rpm 762 kB/s | 58 kB 00:00 2022-04-03T21:46:50.585 INFO:teuthology.orchestra.run.smithi049.stdout:(27/141): rbd-mirror-17.0.0-11442.gcfb8f943.el8 8.9 MB/s | 3.8 MB 00:00 2022-04-03T21:46:50.616 INFO:teuthology.orchestra.run.smithi117.stdout:(108/141): liboath-2.6.2-3.el8.x86_64.rpm 306 kB/s | 59 kB 00:00 2022-04-03T21:46:50.642 INFO:teuthology.orchestra.run.smithi117.stdout:(109/141): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2022-04-03T21:46:50.651 INFO:teuthology.orchestra.run.smithi049.stdout:(28/141): rbd-nbd-17.0.0-11442.gcfb8f943.el8.x8 2.6 MB/s | 175 kB 00:00 2022-04-03T21:46:50.709 INFO:teuthology.orchestra.run.smithi117.stdout:(110/141): gperftools-libs-2.7-9.el8.x86_64.rpm 989 kB/s | 306 kB 00:00 2022-04-03T21:46:50.760 INFO:teuthology.orchestra.run.smithi049.stdout:(29/141): ceph-grafana-dashboards-17.0.0-11442. 341 kB/s | 23 kB 00:00 2022-04-03T21:46:50.760 INFO:teuthology.orchestra.run.smithi117.stdout:(111/141): python3-bcrypt-3.1.6-2.el8.1.x86_64. 474 kB/s | 44 kB 00:00 2022-04-03T21:46:50.817 INFO:teuthology.orchestra.run.smithi117.stdout:(112/141): python3-beautifulsoup4-4.6.3-2.el8.1 1.7 MB/s | 185 kB 00:00 2022-04-03T21:46:50.843 INFO:teuthology.orchestra.run.smithi117.stdout:(113/141): python3-cachetools-3.1.1-4.el8.noarc 303 kB/s | 33 kB 00:00 2022-04-03T21:46:50.876 INFO:teuthology.orchestra.run.smithi117.stdout:(114/141): python3-asyncssh-2.7.0-2.el8.noarch. 1.8 MB/s | 476 kB 00:00 2022-04-03T21:46:50.902 INFO:teuthology.orchestra.run.smithi117.stdout:(115/141): python3-certifi-2018.10.15-7.el8.noa 194 kB/s | 16 kB 00:00 2022-04-03T21:46:50.952 INFO:teuthology.orchestra.run.smithi117.stdout:(116/141): python3-cheroot-8.5.2-1.el8.noarch.r 1.6 MB/s | 173 kB 00:00 2022-04-03T21:46:50.977 INFO:teuthology.orchestra.run.smithi117.stdout:(117/141): python3-google-auth-1.1.1-10.el8.noa 1.1 MB/s | 81 kB 00:00 2022-04-03T21:46:51.003 INFO:teuthology.orchestra.run.smithi117.stdout:(118/141): python3-cherrypy-18.4.0-1.el8.noarch 3.0 MB/s | 384 kB 00:00 2022-04-03T21:46:51.051 INFO:teuthology.orchestra.run.smithi117.stdout:(119/141): python3-jaraco-6.2-6.el8.noarch.rpm 112 kB/s | 11 kB 00:00 2022-04-03T21:46:51.078 INFO:teuthology.orchestra.run.smithi117.stdout:(120/141): python3-jaraco-functools-2.0-4.el8.n 175 kB/s | 18 kB 00:00 2022-04-03T21:46:51.145 INFO:teuthology.orchestra.run.smithi117.stdout:(121/141): python3-logutils-0.3.5-11.el8.noarch 520 kB/s | 49 kB 00:00 2022-04-03T21:46:51.170 INFO:teuthology.orchestra.run.smithi117.stdout:(122/141): python3-more-itertools-7.2.0-3.el8.n 640 kB/s | 59 kB 00:00 2022-04-03T21:46:51.204 INFO:teuthology.orchestra.run.smithi117.stdout:(123/141): python3-kubernetes-11.0.0-6.el8.noar 5.8 MB/s | 1.2 MB 00:00 2022-04-03T21:46:51.246 INFO:teuthology.orchestra.run.smithi117.stdout:(124/141): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2022-04-03T21:46:51.271 INFO:teuthology.orchestra.run.smithi117.stdout:(125/141): python3-natsort-7.1.1-2.el8.noarch.r 479 kB/s | 60 kB 00:00 2022-04-03T21:46:51.296 INFO:teuthology.orchestra.run.smithi117.stdout:(126/141): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2022-04-03T21:46:51.302 INFO:teuthology.orchestra.run.smithi049.stdout:(30/141): ceph-test-17.0.0-11442.gcfb8f943.el8. 14 MB/s | 52 MB 00:03 2022-04-03T21:46:51.321 INFO:teuthology.orchestra.run.smithi117.stdout:(127/141): python3-repoze-lru-0.7-6.el8.noarch. 446 kB/s | 34 kB 00:00 2022-04-03T21:46:51.327 INFO:teuthology.orchestra.run.smithi049.stdout:(31/141): ceph-mgr-cephadm-17.0.0-11442.gcfb8f9 173 kB/s | 105 kB 00:00 2022-04-03T21:46:51.346 INFO:teuthology.orchestra.run.smithi117.stdout:(128/141): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2022-04-03T21:46:51.372 INFO:teuthology.orchestra.run.smithi117.stdout:(129/141): python3-rsa-4.8-1.el8.noarch.rpm 815 kB/s | 61 kB 00:00 2022-04-03T21:46:51.397 INFO:teuthology.orchestra.run.smithi117.stdout:(130/141): python3-simplegeneric-0.8.1-17.el8.n 248 kB/s | 19 kB 00:00 2022-04-03T21:46:51.422 INFO:teuthology.orchestra.run.smithi117.stdout:(131/141): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2022-04-03T21:46:51.448 INFO:teuthology.orchestra.run.smithi117.stdout:(132/141): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2022-04-03T21:46:51.461 INFO:teuthology.orchestra.run.smithi049.stdout:(32/141): ceph-mgr-dashboard-17.0.0-11442.gcfb8 10 MB/s | 1.6 MB 00:00 2022-04-03T21:46:51.473 INFO:teuthology.orchestra.run.smithi117.stdout:(133/141): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2022-04-03T21:46:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:(33/141): ceph-mgr-modules-core-17.0.0-11442.gc 3.0 MB/s | 227 kB 00:00 2022-04-03T21:46:51.540 INFO:teuthology.orchestra.run.smithi117.stdout:(134/141): python3-waitress-1.2.1-2.el8.1.noarc 2.0 MB/s | 241 kB 00:00 2022-04-03T21:46:51.565 INFO:teuthology.orchestra.run.smithi117.stdout:(135/141): python3-websocket-client-0.56.0-5.el 666 kB/s | 61 kB 00:00 2022-04-03T21:46:51.591 INFO:teuthology.orchestra.run.smithi117.stdout:(136/141): python3-webob-1.8.5-1.el8.1.noarch.r 1.7 MB/s | 251 kB 00:00 2022-04-03T21:46:51.604 INFO:teuthology.orchestra.run.smithi049.stdout:(34/141): ceph-mgr-rook-17.0.0-11442.gcfb8f943. 706 kB/s | 47 kB 00:00 2022-04-03T21:46:51.616 INFO:teuthology.orchestra.run.smithi117.stdout:(137/141): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2022-04-03T21:46:51.633 INFO:teuthology.orchestra.run.smithi117.stdout:(138/141): python3-zc-lockfile-2.0-2.el8.noarch 343 kB/s | 23 kB 00:00 2022-04-03T21:46:51.666 INFO:teuthology.orchestra.run.smithi117.stdout:(139/141): libbabeltrace-1.5.6-2.el8.x86_64.rpm 5.9 MB/s | 200 kB 00:00 2022-04-03T21:46:51.695 INFO:teuthology.orchestra.run.smithi049.stdout:(35/141): ceph-prometheus-alerts-17.0.0-11442.g 161 kB/s | 15 kB 00:00 2022-04-03T21:46:51.700 INFO:teuthology.orchestra.run.smithi117.stdout:(140/141): xmlstarlet-1.6.1-11.el8.x86_64.rpm 826 kB/s | 69 kB 00:00 2022-04-03T21:46:51.762 INFO:teuthology.orchestra.run.smithi049.stdout:(36/141): ceph-volume-17.0.0-11442.gcfb8f943.el 3.8 MB/s | 257 kB 00:00 2022-04-03T21:46:51.821 INFO:teuthology.orchestra.run.smithi049.stdout:(37/141): cephadm-17.0.0-11442.gcfb8f943.el8.no 1.2 MB/s | 71 kB 00:00 2022-04-03T21:46:51.833 INFO:teuthology.orchestra.run.smithi117.stdout:(141/141): thrift-0.13.0-2.el8.x86_64.rpm 7.2 MB/s | 1.7 MB 00:00 2022-04-03T21:46:51.838 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2022-04-03T21:46:51.838 INFO:teuthology.orchestra.run.smithi117.stdout:Total 21 MB/s | 249 MB 00:11 2022-04-03T21:46:51.959 INFO:teuthology.orchestra.run.smithi049.stdout:(38/141): ceph-mgr-diskprediction-local-17.0.0- 12 MB/s | 7.4 MB 00:00 2022-04-03T21:46:51.979 INFO:teuthology.orchestra.run.smithi049.stdout:(39/141): cephfs-top-17.0.0-11442.gcfb8f943.el8 91 kB/s | 14 kB 00:00 2022-04-03T21:46:52.055 INFO:teuthology.orchestra.run.smithi049.stdout:(40/141): autoconf-2.69-29.el8.noarch.rpm 9.3 MB/s | 710 kB 00:00 2022-04-03T21:46:52.106 INFO:teuthology.orchestra.run.smithi049.stdout:(41/141): annobin-10.58-1.el8.x86_64.rpm 7.4 MB/s | 951 kB 00:00 2022-04-03T21:46:52.306 INFO:teuthology.orchestra.run.smithi049.stdout:(42/141): ceph-radosgw-17.0.0-11442.gcfb8f943.e 2.6 MB/s | 16 MB 00:06 2022-04-03T21:46:52.339 INFO:teuthology.orchestra.run.smithi049.stdout:(43/141): automake-1.16.1-7.el8.noarch.rpm 2.5 MB/s | 713 kB 00:00 2022-04-03T21:46:52.373 INFO:teuthology.orchestra.run.smithi049.stdout:(44/141): flex-2.6.1-9.el8.x86_64.rpm 9.6 MB/s | 320 kB 00:00 2022-04-03T21:46:52.406 INFO:teuthology.orchestra.run.smithi049.stdout:(45/141): bison-3.0.4-10.el8.x86_64.rpm 2.2 MB/s | 688 kB 00:00 2022-04-03T21:46:52.473 INFO:teuthology.orchestra.run.smithi049.stdout:(46/141): isl-0.16.1-6.el8.x86_64.rpm 12 MB/s | 841 kB 00:00 2022-04-03T21:46:52.507 INFO:teuthology.orchestra.run.smithi049.stdout:(47/141): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2022-04-03T21:46:52.532 INFO:teuthology.orchestra.run.smithi049.stdout:(48/141): libmpc-1.1.0-9.1.el8.x86_64.rpm 2.4 MB/s | 61 kB 00:00 2022-04-03T21:46:52.599 INFO:teuthology.orchestra.run.smithi049.stdout:(49/141): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2022-04-03T21:46:52.675 INFO:teuthology.orchestra.run.smithi049.stdout:(50/141): libtool-2.4.6-25.el8.x86_64.rpm 9.3 MB/s | 709 kB 00:00 2022-04-03T21:46:52.717 INFO:teuthology.orchestra.run.smithi049.stdout:(51/141): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2022-04-03T21:46:52.750 INFO:teuthology.orchestra.run.smithi049.stdout:(52/141): oniguruma-6.8.2-2.el8.x86_64.rpm 5.6 MB/s | 187 kB 00:00 2022-04-03T21:46:52.955 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2022-04-03T21:46:52.975 INFO:teuthology.orchestra.run.smithi049.stdout:(53/141): cpp-8.5.0-10.el8.x86_64.rpm 16 MB/s | 10 MB 00:00 2022-04-03T21:46:53.096 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2022-04-03T21:46:53.096 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2022-04-03T21:46:53.176 INFO:teuthology.orchestra.run.smithi049.stdout:(54/141): openblas-threads-0.3.15-3.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2022-04-03T21:46:53.209 INFO:teuthology.orchestra.run.smithi049.stdout:(55/141): platform-python-devel-3.6.8-46.el8.x8 7.4 MB/s | 250 kB 00:00 2022-04-03T21:46:53.518 INFO:teuthology.orchestra.run.smithi049.stdout:(56/141): gcc-8.5.0-10.el8.x86_64.rpm 20 MB/s | 23 MB 00:01 2022-04-03T21:46:53.602 INFO:teuthology.orchestra.run.smithi049.stdout:(57/141): openblas-0.3.15-3.el8.x86_64.rpm 5.6 MB/s | 4.7 MB 00:00 2022-04-03T21:46:53.627 INFO:teuthology.orchestra.run.smithi049.stdout:(58/141): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2022-04-03T21:46:53.652 INFO:teuthology.orchestra.run.smithi049.stdout:(59/141): python3-jsonpointer-1.10-11.el8.noarc 808 kB/s | 20 kB 00:00 2022-04-03T21:46:53.694 INFO:teuthology.orchestra.run.smithi049.stdout:(60/141): python3-jinja2-2.10.1-3.el8.noarch.rp 3.0 MB/s | 538 kB 00:00 2022-04-03T21:46:53.720 INFO:teuthology.orchestra.run.smithi049.stdout:(61/141): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2022-04-03T21:46:53.744 INFO:teuthology.orchestra.run.smithi049.stdout:(62/141): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2022-04-03T21:46:53.803 INFO:teuthology.orchestra.run.smithi049.stdout:(63/141): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2022-04-03T21:46:53.837 INFO:teuthology.orchestra.run.smithi049.stdout:(64/141): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2022-04-03T21:46:53.912 INFO:teuthology.orchestra.run.smithi049.stdout:(65/141): python3-babel-2.5.1-7.el8.noarch.rpm 6.8 MB/s | 4.8 MB 00:00 2022-04-03T21:46:53.929 INFO:teuthology.orchestra.run.smithi049.stdout:(66/141): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.1 MB/s | 103 kB 00:00 2022-04-03T21:46:53.955 INFO:teuthology.orchestra.run.smithi049.stdout:(67/141): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.9 MB/s | 126 kB 00:00 2022-04-03T21:46:53.980 INFO:teuthology.orchestra.run.smithi049.stdout:(68/141): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2022-04-03T21:46:53.997 INFO:teuthology.orchestra.run.smithi049.stdout:(69/141): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2022-04-03T21:46:54.014 INFO:teuthology.orchestra.run.smithi049.stdout:(70/141): python3-rpm-generators-5-7.el8.noarch 734 kB/s | 25 kB 00:00 2022-04-03T21:46:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:(71/141): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2022-04-03T21:46:54.148 INFO:teuthology.orchestra.run.smithi049.stdout:(72/141): python3-numpy-1.14.3-10.el8.x86_64.rp 8.7 MB/s | 3.7 MB 00:00 2022-04-03T21:46:54.173 INFO:teuthology.orchestra.run.smithi049.stdout:(73/141): elfutils-libelf-devel-0.186-1.el8.x86 2.4 MB/s | 60 kB 00:00 2022-04-03T21:46:54.206 INFO:teuthology.orchestra.run.smithi049.stdout:(74/141): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2022-04-03T21:46:54.232 INFO:teuthology.orchestra.run.smithi049.stdout:(75/141): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2022-04-03T21:46:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:(76/141): glibc-devel-2.28-196.el8.x86_64.rpm 2.4 MB/s | 80 kB 00:00 2022-04-03T21:46:54.299 INFO:teuthology.orchestra.run.smithi049.stdout:(77/141): glibc-headers-2.28-196.el8.x86_64.rpm 7.1 MB/s | 484 kB 00:00 2022-04-03T21:46:54.355 INFO:teuthology.orchestra.run.smithi049.stdout:(78/141): keyutils-libs-devel-1.5.10-9.el8.x86_ 866 kB/s | 48 kB 00:00 2022-04-03T21:46:54.408 INFO:teuthology.orchestra.run.smithi049.stdout:(79/141): krb5-devel-1.18.2-14.el8.x86_64.rpm 10 MB/s | 560 kB 00:00 2022-04-03T21:46:54.433 INFO:teuthology.orchestra.run.smithi049.stdout:(80/141): libacl-devel-2.2.53-1.el8.x86_64.rpm 3.1 MB/s | 79 kB 00:00 2022-04-03T21:46:54.459 INFO:teuthology.orchestra.run.smithi049.stdout:(81/141): libaio-devel-0.3.112-1.el8.x86_64.rpm 753 kB/s | 19 kB 00:00 2022-04-03T21:46:54.484 INFO:teuthology.orchestra.run.smithi049.stdout:(82/141): libattr-devel-2.4.48-3.el8.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2022-04-03T21:46:54.509 INFO:teuthology.orchestra.run.smithi049.stdout:(83/141): libcom_err-devel-1.45.6-4.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2022-04-03T21:46:54.551 INFO:teuthology.orchestra.run.smithi049.stdout:(84/141): libgfortran-8.5.0-10.el8.x86_64.rpm 15 MB/s | 643 kB 00:00 2022-04-03T21:46:54.585 INFO:teuthology.orchestra.run.smithi049.stdout:(85/141): libquadmath-8.5.0-10.el8.x86_64.rpm 5.1 MB/s | 171 kB 00:00 2022-04-03T21:46:54.611 INFO:teuthology.orchestra.run.smithi049.stdout:(86/141): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-04-03T21:46:54.777 INFO:teuthology.orchestra.run.smithi049.stdout:(87/141): librdmacm-37.2-1.el8.x86_64.rpm 468 kB/s | 78 kB 00:00 2022-04-03T21:46:54.810 INFO:teuthology.orchestra.run.smithi049.stdout:(88/141): libselinux-devel-2.9-5.el8.x86_64.rpm 6.0 MB/s | 200 kB 00:00 2022-04-03T21:46:54.836 INFO:teuthology.orchestra.run.smithi049.stdout:(89/141): libsepol-devel-2.9-3.el8.x86_64.rpm 3.4 MB/s | 87 kB 00:00 2022-04-03T21:46:54.861 INFO:teuthology.orchestra.run.smithi049.stdout:(90/141): libuuid-devel-2.32.1-35.el8.x86_64.rp 3.8 MB/s | 98 kB 00:00 2022-04-03T21:46:54.871 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2022-04-03T21:46:54.886 INFO:teuthology.orchestra.run.smithi049.stdout:(91/141): libverto-devel-0.3.0-5.el8.x86_64.rpm 732 kB/s | 18 kB 00:00 2022-04-03T21:46:54.894 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2022-04-03T21:46:54.935 INFO:teuthology.orchestra.run.smithi049.stdout:(92/141): libxcrypt-devel-4.1.1-6.el8.x86_64.rp 523 kB/s | 25 kB 00:00 2022-04-03T21:46:55.054 INFO:teuthology.orchestra.run.smithi049.stdout:(93/141): openssl-devel-1.1.1k-6.el8.x86_64.rpm 20 MB/s | 2.3 MB 00:00 2022-04-03T21:46:55.146 INFO:teuthology.orchestra.run.smithi049.stdout:(94/141): pcre2-devel-10.32-2.el8.x86_64.rpm 6.5 MB/s | 605 kB 00:00 2022-04-03T21:46:55.179 INFO:teuthology.orchestra.run.smithi049.stdout:(95/141): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.8 MB/s | 229 kB 00:00 2022-04-03T21:46:55.230 INFO:teuthology.orchestra.run.smithi049.stdout:(96/141): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2022-04-03T21:46:55.264 INFO:teuthology.orchestra.run.smithi049.stdout:(97/141): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.0 MB/s | 237 kB 00:00 2022-04-03T21:46:55.306 INFO:teuthology.orchestra.run.smithi049.stdout:(98/141): python3-cryptography-3.2.1-5.el8.x86_ 13 MB/s | 559 kB 00:00 2022-04-03T21:46:55.331 INFO:teuthology.orchestra.run.smithi049.stdout:(99/141): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2022-04-03T21:46:55.365 INFO:teuthology.orchestra.run.smithi049.stdout:(100/141): python3-oauthlib-2.1.0-1.el8.noarch. 4.5 MB/s | 155 kB 00:00 2022-04-03T21:46:55.390 INFO:teuthology.orchestra.run.smithi049.stdout:(101/141): python3-pycparser-2.14-14.el8.noarch 4.3 MB/s | 109 kB 00:00 2022-04-03T21:46:55.415 INFO:teuthology.orchestra.run.smithi049.stdout:(102/141): python3-requests-oauthlib-1.0.0-1.el 1.7 MB/s | 43 kB 00:00 2022-04-03T21:46:55.440 INFO:teuthology.orchestra.run.smithi049.stdout:(103/141): userspace-rcu-0.10.1-4.el8.x86_64.rp 4.0 MB/s | 101 kB 00:00 2022-04-03T21:46:55.466 INFO:teuthology.orchestra.run.smithi049.stdout:(104/141): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.8 MB/s | 72 kB 00:00 2022-04-03T21:46:55.516 INFO:teuthology.orchestra.run.smithi049.stdout:(105/141): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2022-04-03T21:46:55.641 INFO:teuthology.orchestra.run.smithi049.stdout:(106/141): kernel-headers-4.18.0-373.el8.x86_64 6.8 MB/s | 9.3 MB 00:01 2022-04-03T21:46:55.825 INFO:teuthology.orchestra.run.smithi049.stdout:(107/141): python3-scipy-1.0.0-21.module_el8.5. 7.5 MB/s | 14 MB 00:01 2022-04-03T21:46:55.934 INFO:teuthology.orchestra.run.smithi049.stdout:(108/141): gperftools-libs-2.7-9.el8.x86_64.rpm 734 kB/s | 306 kB 00:00 2022-04-03T21:46:55.959 INFO:teuthology.orchestra.run.smithi049.stdout:(109/141): liboath-2.6.2-3.el8.x86_64.rpm 186 kB/s | 59 kB 00:00 2022-04-03T21:46:55.985 INFO:teuthology.orchestra.run.smithi049.stdout:(110/141): libunwind-1.3.1-3.el8.x86_64.rpm 474 kB/s | 75 kB 00:00 2022-04-03T21:46:56.010 INFO:teuthology.orchestra.run.smithi049.stdout:(111/141): python3-bcrypt-3.1.6-2.el8.1.x86_64. 865 kB/s | 44 kB 00:00 2022-04-03T21:46:56.043 INFO:teuthology.orchestra.run.smithi049.stdout:(112/141): python3-asyncssh-2.7.0-2.el8.noarch. 4.3 MB/s | 476 kB 00:00 2022-04-03T21:46:56.093 INFO:teuthology.orchestra.run.smithi049.stdout:(113/141): python3-cachetools-3.1.1-4.el8.noarc 396 kB/s | 33 kB 00:00 2022-04-03T21:46:56.120 INFO:teuthology.orchestra.run.smithi049.stdout:(114/141): python3-certifi-2018.10.15-7.el8.noa 217 kB/s | 16 kB 00:00 2022-04-03T21:46:56.144 INFO:teuthology.orchestra.run.smithi049.stdout:(115/141): python3-beautifulsoup4-4.6.3-2.el8.1 1.1 MB/s | 185 kB 00:00 2022-04-03T21:46:56.178 INFO:teuthology.orchestra.run.smithi049.stdout:(116/141): python3-cherrypy-18.4.0-1.el8.noarch 6.4 MB/s | 384 kB 00:00 2022-04-03T21:46:56.203 INFO:teuthology.orchestra.run.smithi049.stdout:(117/141): python3-cheroot-8.5.2-1.el8.noarch.r 1.5 MB/s | 173 kB 00:00 2022-04-03T21:46:56.228 INFO:teuthology.orchestra.run.smithi049.stdout:(118/141): python3-google-auth-1.1.1-10.el8.noa 968 kB/s | 81 kB 00:00 2022-04-03T21:46:56.253 INFO:teuthology.orchestra.run.smithi049.stdout:(119/141): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2022-04-03T21:46:56.279 INFO:teuthology.orchestra.run.smithi049.stdout:(120/141): python3-jaraco-functools-2.0-4.el8.n 233 kB/s | 18 kB 00:00 2022-04-03T21:46:56.304 INFO:teuthology.orchestra.run.smithi049.stdout:(121/141): python3-logutils-0.3.5-11.el8.noarch 972 kB/s | 49 kB 00:00 2022-04-03T21:46:56.329 INFO:teuthology.orchestra.run.smithi049.stdout:(122/141): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2022-04-03T21:46:56.354 INFO:teuthology.orchestra.run.smithi049.stdout:(123/141): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2022-04-03T21:46:56.413 INFO:teuthology.orchestra.run.smithi049.stdout:(124/141): python3-kubernetes-11.0.0-6.el8.noar 6.3 MB/s | 1.2 MB 00:00 2022-04-03T21:46:56.438 INFO:teuthology.orchestra.run.smithi049.stdout:(125/141): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2022-04-03T21:46:56.481 INFO:teuthology.orchestra.run.smithi049.stdout:(126/141): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2022-04-03T21:46:56.507 INFO:teuthology.orchestra.run.smithi049.stdout:(127/141): python3-repoze-lru-0.7-6.el8.noarch. 365 kB/s | 34 kB 00:00 2022-04-03T21:46:56.532 INFO:teuthology.orchestra.run.smithi049.stdout:(128/141): python3-routes-2.4.1-12.el8.noarch.r 2.1 MB/s | 196 kB 00:00 2022-04-03T21:46:56.557 INFO:teuthology.orchestra.run.smithi049.stdout:(129/141): python3-rsa-4.8-1.el8.noarch.rpm 819 kB/s | 61 kB 00:00 2022-04-03T21:46:56.582 INFO:teuthology.orchestra.run.smithi049.stdout:(130/141): python3-simplegeneric-0.8.1-17.el8.n 248 kB/s | 19 kB 00:00 2022-04-03T21:46:56.607 INFO:teuthology.orchestra.run.smithi049.stdout:(131/141): python3-singledispatch-3.4.0.3-18.el 318 kB/s | 24 kB 00:00 2022-04-03T21:46:56.634 INFO:teuthology.orchestra.run.smithi049.stdout:(132/141): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2022-04-03T21:46:56.682 INFO:teuthology.orchestra.run.smithi049.stdout:(133/141): python3-trustme-0.6.0-4.el8.noarch.r 275 kB/s | 27 kB 00:00 2022-04-03T21:46:56.716 INFO:teuthology.orchestra.run.smithi049.stdout:(134/141): python3-waitress-1.2.1-2.el8.1.noarc 2.2 MB/s | 241 kB 00:00 2022-04-03T21:46:56.741 INFO:teuthology.orchestra.run.smithi049.stdout:(135/141): python3-webob-1.8.5-1.el8.1.noarch.r 2.3 MB/s | 251 kB 00:00 2022-04-03T21:46:56.767 INFO:teuthology.orchestra.run.smithi049.stdout:(136/141): python3-websocket-client-0.56.0-5.el 730 kB/s | 61 kB 00:00 2022-04-03T21:46:56.792 INFO:teuthology.orchestra.run.smithi049.stdout:(137/141): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2022-04-03T21:46:56.817 INFO:teuthology.orchestra.run.smithi049.stdout:(138/141): python3-zc-lockfile-2.0-2.el8.noarch 305 kB/s | 23 kB 00:00 2022-04-03T21:46:56.851 INFO:teuthology.orchestra.run.smithi049.stdout:(139/141): libbabeltrace-1.5.6-2.el8.x86_64.rpm 6.0 MB/s | 200 kB 00:00 2022-04-03T21:46:56.876 INFO:teuthology.orchestra.run.smithi049.stdout:(140/141): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2022-04-03T21:46:57.001 INFO:teuthology.orchestra.run.smithi049.stdout:(141/141): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2022-04-03T21:46:57.006 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2022-04-03T21:46:57.006 INFO:teuthology.orchestra.run.smithi049.stdout:Total 17 MB/s | 249 MB 00:14 2022-04-03T21:47:00.021 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2022-04-03T21:47:00.210 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2022-04-03T21:47:00.211 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2022-04-03T21:47:00.281 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2022-04-03T21:47:00.460 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdmacm-37.2-1.el8.x86_64 1/141 2022-04-03T21:47:00.525 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librdmacm-37.2-1.el8.x86_64 1/141 2022-04-03T21:47:00.826 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/141 2022-04-03T21:47:01.007 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.13.0-2.el8.x86_64 3/141 2022-04-03T21:47:01.191 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/141 2022-04-03T21:47:01.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/141 2022-04-03T21:47:01.492 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/141 2022-04-03T21:47:01.688 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 6/141 2022-04-03T21:47:01.924 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 7/141 2022-04-03T21:47:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 8/141 2022-04-03T21:47:02.341 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 9/141 2022-04-03T21:47:02.468 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 10/141 2022-04-03T21:47:02.486 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2022-04-03T21:47:02.497 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2022-04-03T21:47:02.593 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 10/141 2022-04-03T21:47:02.759 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 11/141 2022-04-03T21:47:03.355 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 11/141 2022-04-03T21:47:03.838 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.15-3.el8.x86_64 12/141 2022-04-03T21:47:04.485 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 12/141 2022-04-03T21:47:04.643 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 13/141 2022-04-03T21:47:05.344 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 13/141 2022-04-03T21:47:05.735 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 14/141 2022-04-03T21:47:05.965 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 15/141 2022-04-03T21:47:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/141 2022-04-03T21:47:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/141 2022-04-03T21:47:06.566 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libmpc-1.1.0-9.1.el8.x86_64 18/141 2022-04-03T21:47:06.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : autoconf-2.69-29.el8.noarch 19/141 2022-04-03T21:47:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: autoconf-2.69-29.el8.noarch 19/141 2022-04-03T21:47:07.081 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:17.0.0-11442.gcfb8f943.el8 20/141 2022-04-03T21:47:07.278 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:17.0.0-11442.gcfb8f943.e 21/141 2022-04-03T21:47:08.251 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2022-04-03T21:47:08.320 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.1-7.el8.noarch 22/141 2022-04-03T21:47:08.428 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdmacm-37.2-1.el8.x86_64 1/141 2022-04-03T21:47:08.491 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cpp-8.5.0-10.el8.x86_64 23/141 2022-04-03T21:47:08.553 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cpp-8.5.0-10.el8.x86_64 23/141 2022-04-03T21:47:08.638 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librdmacm-37.2-1.el8.x86_64 1/141 2022-04-03T21:47:08.992 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/141 2022-04-03T21:47:09.201 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.13.0-2.el8.x86_64 3/141 2022-04-03T21:47:09.391 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/141 2022-04-03T21:47:09.539 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 24/141 2022-04-03T21:47:09.611 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/141 2022-04-03T21:47:09.708 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/141 2022-04-03T21:47:09.889 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 25/141 2022-04-03T21:47:09.944 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 6/141 2022-04-03T21:47:10.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 26/141 2022-04-03T21:47:10.247 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 7/141 2022-04-03T21:47:10.342 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 27/141 2022-04-03T21:47:10.567 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.8-1.el8.noarch 28/141 2022-04-03T21:47:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 8/141 2022-04-03T21:47:10.752 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libbabeltrace-1.5.6-2.el8.x86_64 29/141 2022-04-03T21:47:10.811 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 9/141 2022-04-03T21:47:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 30/141 2022-04-03T21:47:10.977 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 10/141 2022-04-03T21:47:11.157 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 10/141 2022-04-03T21:47:11.160 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 31/141 2022-04-03T21:47:11.335 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 11/141 2022-04-03T21:47:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 32/141 2022-04-03T21:47:11.664 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 33/141 2022-04-03T21:47:11.828 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 34/141 2022-04-03T21:47:12.026 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 35/141 2022-04-03T21:47:12.099 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 11/141 2022-04-03T21:47:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 36/141 2022-04-03T21:47:12.252 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.15-3.el8.x86_64 12/141 2022-04-03T21:47:12.471 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 37/141 2022-04-03T21:47:12.686 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 38/141 2022-04-03T21:47:12.911 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 39/141 2022-04-03T21:47:13.080 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 40/141 2022-04-03T21:47:13.095 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 12/141 2022-04-03T21:47:13.261 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 41/141 2022-04-03T21:47:13.285 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 13/141 2022-04-03T21:47:13.455 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 42/141 2022-04-03T21:47:13.632 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-2.6-1.el8.noarch 43/141 2022-04-03T21:47:13.865 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 44/141 2022-04-03T21:47:14.074 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 45/141 2022-04-03T21:47:14.250 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 13/141 2022-04-03T21:47:14.323 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 46/141 2022-04-03T21:47:14.569 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 47/141 2022-04-03T21:47:14.641 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 14/141 2022-04-03T21:47:14.855 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 15/141 2022-04-03T21:47:14.910 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 48/141 2022-04-03T21:47:15.061 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/141 2022-04-03T21:47:15.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 49/141 2022-04-03T21:47:15.277 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/141 2022-04-03T21:47:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 50/141 2022-04-03T21:47:15.529 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libmpc-1.1.0-9.1.el8.x86_64 18/141 2022-04-03T21:47:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 51/141 2022-04-03T21:47:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : userspace-rcu-0.10.1-4.el8.x86_64 52/141 2022-04-03T21:47:15.951 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : autoconf-2.69-29.el8.noarch 19/141 2022-04-03T21:47:15.967 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: userspace-rcu-0.10.1-4.el8.x86_64 52/141 2022-04-03T21:47:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: autoconf-2.69-29.el8.noarch 19/141 2022-04-03T21:47:16.198 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 53/141 2022-04-03T21:47:16.293 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:17.0.0-11442.gcfb8f943.el8 20/141 2022-04-03T21:47:16.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:17.0.0-11442.gcfb8f943.e 21/141 2022-04-03T21:47:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 53/141 2022-04-03T21:47:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 54/141 2022-04-03T21:47:17.194 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 54/141 2022-04-03T21:47:17.406 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 55/141 2022-04-03T21:47:17.562 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 55/141 2022-04-03T21:47:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.1-7.el8.noarch 22/141 2022-04-03T21:47:17.773 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 56/141 2022-04-03T21:47:17.873 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 56/141 2022-04-03T21:47:17.959 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cpp-8.5.0-10.el8.x86_64 23/141 2022-04-03T21:47:18.074 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cpp-8.5.0-10.el8.x86_64 23/141 2022-04-03T21:47:18.579 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:17.0.0-11442.gcfb8f943.el8.x86_6 57/141 2022-04-03T21:47:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 58/141 2022-04-03T21:47:18.848 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 58/141 2022-04-03T21:47:19.047 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_6 59/141 2022-04-03T21:47:19.152 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_6 59/141 2022-04-03T21:47:19.296 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 24/141 2022-04-03T21:47:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x8 60/141 2022-04-03T21:47:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x8 60/141 2022-04-03T21:47:19.640 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 61/141 2022-04-03T21:47:19.676 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 25/141 2022-04-03T21:47:19.915 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:17.0.0-11442.gcfb8f943.el8.x86_ 62/141 2022-04-03T21:47:19.961 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 26/141 2022-04-03T21:47:20.172 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 27/141 2022-04-03T21:47:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 63/141 2022-04-03T21:47:20.363 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.8-1.el8.noarch 28/141 2022-04-03T21:47:20.461 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:17.0.0-11442.gcfb8f943.el8.x86_ 64/141 2022-04-03T21:47:20.573 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libbabeltrace-1.5.6-2.el8.x86_64 29/141 2022-04-03T21:47:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/141 2022-04-03T21:47:20.787 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 30/141 2022-04-03T21:47:21.149 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 66/141 2022-04-03T21:47:21.197 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 31/141 2022-04-03T21:47:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 67/141 2022-04-03T21:47:21.521 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 32/141 2022-04-03T21:47:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/141 2022-04-03T21:47:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 33/141 2022-04-03T21:47:21.949 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 34/141 2022-04-03T21:47:22.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 69/141 2022-04-03T21:47:22.126 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 35/141 2022-04-03T21:47:22.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/141 2022-04-03T21:47:22.383 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 36/141 2022-04-03T21:47:22.631 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 37/141 2022-04-03T21:47:22.830 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 38/141 2022-04-03T21:47:23.014 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 39/141 2022-04-03T21:47:23.227 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 40/141 2022-04-03T21:47:23.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/141 2022-04-03T21:47:23.436 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 41/141 2022-04-03T21:47:23.609 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 42/141 2022-04-03T21:47:23.637 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 72/141 2022-04-03T21:47:23.812 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-2.6-1.el8.noarch 43/141 2022-04-03T21:47:23.871 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 73/141 2022-04-03T21:47:24.058 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 44/141 2022-04-03T21:47:24.120 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 74/141 2022-04-03T21:47:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 45/141 2022-04-03T21:47:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 75/141 2022-04-03T21:47:24.607 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 46/141 2022-04-03T21:47:24.731 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 76/141 2022-04-03T21:47:24.898 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 47/141 2022-04-03T21:47:24.982 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/141 2022-04-03T21:47:25.182 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 78/141 2022-04-03T21:47:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 48/141 2022-04-03T21:47:25.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 79/141 2022-04-03T21:47:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 49/141 2022-04-03T21:47:25.731 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 80/141 2022-04-03T21:47:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 50/141 2022-04-03T21:47:25.912 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 81/141 2022-04-03T21:47:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 51/141 2022-04-03T21:47:26.100 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 82/141 2022-04-03T21:47:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : userspace-rcu-0.10.1-4.el8.x86_64 52/141 2022-04-03T21:47:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/141 2022-04-03T21:47:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: userspace-rcu-0.10.1-4.el8.x86_64 52/141 2022-04-03T21:47:26.599 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 84/141 2022-04-03T21:47:26.683 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 53/141 2022-04-03T21:47:26.750 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 85/141 2022-04-03T21:47:26.975 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/141 2022-04-03T21:47:27.172 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 53/141 2022-04-03T21:47:27.433 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 54/141 2022-04-03T21:47:27.650 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 87/141 2022-04-03T21:47:27.980 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-headers-4.18.0-373.el8.x86_64 88/141 2022-04-03T21:47:27.984 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 54/141 2022-04-03T21:47:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: glibc-headers-2.28-196.el8.x86_64 89/141 2022-04-03T21:47:28.199 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 55/141 2022-04-03T21:47:28.373 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 55/141 2022-04-03T21:47:28.376 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : glibc-headers-2.28-196.el8.x86_64 89/141 2022-04-03T21:47:28.547 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libxcrypt-devel-4.1.1-6.el8.x86_64 90/141 2022-04-03T21:47:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 56/141 2022-04-03T21:47:28.737 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : glibc-devel-2.28-196.el8.x86_64 91/141 2022-04-03T21:47:28.750 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: glibc-devel-2.28-196.el8.x86_64 91/141 2022-04-03T21:47:28.768 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 56/141 2022-04-03T21:47:28.926 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libattr-devel-2.4.48-3.el8.x86_64 92/141 2022-04-03T21:47:29.243 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.7-15.el8.x86_64 93/141 2022-04-03T21:47:29.407 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 94/141 2022-04-03T21:47:29.584 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:17.0.0-11442.gcfb8f943.el8.x86_6 57/141 2022-04-03T21:47:29.718 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rpm-generators-5-7.el8.noarch 95/141 2022-04-03T21:47:29.816 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 58/141 2022-04-03T21:47:30.027 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : platform-python-devel-3.6.8-46.el8.x86_64 96/141 2022-04-03T21:47:30.082 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 58/141 2022-04-03T21:47:30.270 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 97/141 2022-04-03T21:47:30.282 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_6 59/141 2022-04-03T21:47:30.416 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_6 59/141 2022-04-03T21:47:30.632 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x8 60/141 2022-04-03T21:47:30.729 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x8 60/141 2022-04-03T21:47:31.014 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 61/141 2022-04-03T21:47:31.333 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:17.0.0-11442.gcfb8f943.el8.x86_ 62/141 2022-04-03T21:47:31.625 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 63/141 2022-04-03T21:47:31.927 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:17.0.0-11442.gcfb8f943.el8.x86_ 64/141 2022-04-03T21:47:32.045 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 97/141 2022-04-03T21:47:32.195 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/141 2022-04-03T21:47:32.320 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 98/141 2022-04-03T21:47:32.503 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/141 2022-04-03T21:47:32.713 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 66/141 2022-04-03T21:47:33.026 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 67/141 2022-04-03T21:47:33.259 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/141 2022-04-03T21:47:33.572 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 69/141 2022-04-03T21:47:33.838 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/141 2022-04-03T21:47:35.338 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/141 2022-04-03T21:47:35.754 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 72/141 2022-04-03T21:47:36.010 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 73/141 2022-04-03T21:47:36.260 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 74/141 2022-04-03T21:47:36.414 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 100/141 2022-04-03T21:47:36.589 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 75/141 2022-04-03T21:47:36.702 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 100/141 2022-04-03T21:47:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 76/141 2022-04-03T21:47:37.155 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/141 2022-04-03T21:47:37.295 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 100/141 2022-04-03T21:47:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 78/141 2022-04-03T21:47:37.622 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 101/141 2022-04-03T21:47:37.712 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 101/141 2022-04-03T21:47:37.744 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 79/141 2022-04-03T21:47:37.852 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 102/141 2022-04-03T21:47:37.917 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 80/141 2022-04-03T21:47:38.125 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 81/141 2022-04-03T21:47:38.339 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 82/141 2022-04-03T21:47:38.692 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/141 2022-04-03T21:47:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 84/141 2022-04-03T21:47:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 85/141 2022-04-03T21:47:39.462 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/141 2022-04-03T21:47:40.396 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 87/141 2022-04-03T21:47:40.732 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-headers-4.18.0-373.el8.x86_64 88/141 2022-04-03T21:47:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: glibc-headers-2.28-196.el8.x86_64 89/141 2022-04-03T21:47:41.428 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : glibc-headers-2.28-196.el8.x86_64 89/141 2022-04-03T21:47:41.655 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libxcrypt-devel-4.1.1-6.el8.x86_64 90/141 2022-04-03T21:47:41.839 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : glibc-devel-2.28-196.el8.x86_64 91/141 2022-04-03T21:47:41.887 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: glibc-devel-2.28-196.el8.x86_64 91/141 2022-04-03T21:47:42.087 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libattr-devel-2.4.48-3.el8.x86_64 92/141 2022-04-03T21:47:42.334 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.7-15.el8.x86_64 93/141 2022-04-03T21:47:42.519 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 94/141 2022-04-03T21:47:42.821 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rpm-generators-5-7.el8.noarch 95/141 2022-04-03T21:47:43.216 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : platform-python-devel-3.6.8-46.el8.x86_64 96/141 2022-04-03T21:47:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 97/141 2022-04-03T21:47:45.864 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 97/141 2022-04-03T21:47:46.166 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 98/141 2022-04-03T21:47:47.609 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/141 2022-04-03T21:47:53.298 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 100/141 2022-04-03T21:47:53.605 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 100/141 2022-04-03T21:47:54.401 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 100/141 2022-04-03T21:47:54.729 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 101/141 2022-04-03T21:47:54.871 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 101/141 2022-04-03T21:47:55.078 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 102/141 2022-04-03T21:47:56.758 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 102/141 2022-04-03T21:47:56.759 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2022-04-03T21:47:56.759 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2022-04-03T21:47:56.759 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2022-04-03T21:47:56.760 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /run 2022-04-03T21:47:56.760 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2022-04-03T21:47:56.760 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2022-04-03T21:47:56.760 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2022-04-03T21:47:56.761 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2022-04-03T21:47:56.761 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2022-04-03T21:47:56.761 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:47:57.114 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 103/141 2022-04-03T21:47:58.623 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 103/141 2022-04-03T21:47:58.851 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 104/141 2022-04-03T21:47:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 104/141 2022-04-03T21:47:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 105/141 2022-04-03T21:47:59.638 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 105/141 2022-04-03T21:47:59.863 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 106/141 2022-04-03T21:47:59.886 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 106/141 2022-04-03T21:48:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/141 2022-04-03T21:48:00.307 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/141 2022-04-03T21:48:00.480 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/141 2022-04-03T21:48:00.556 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/141 2022-04-03T21:48:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-3.el8.x86_64 110/141 2022-04-03T21:48:01.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : isl-0.16.1-6.el8.x86_64 111/141 2022-04-03T21:48:02.491 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: isl-0.16.1-6.el8.x86_64 111/141 2022-04-03T21:48:02.771 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gcc-8.5.0-10.el8.x86_64 112/141 2022-04-03T21:48:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: gcc-8.5.0-10.el8.x86_64 112/141 2022-04-03T21:48:04.260 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 113/141 2022-04-03T21:48:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 113/141 2022-04-03T21:48:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-11442.gcfb8f943. 114/141 2022-04-03T21:48:04.729 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-11442.gcfb8f943 115/141 2022-04-03T21:48:04.879 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.no 116/141 2022-04-03T21:48:05.075 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.no 116/141 2022-04-03T21:48:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8. 117/141 2022-04-03T21:48:06.351 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8. 117/141 2022-04-03T21:48:06.562 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-11442.gcf 118/141 2022-04-03T21:48:06.649 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-11442.gcf 118/141 2022-04-03T21:48:07.035 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-11442.gcfb8f943.e 119/141 2022-04-03T21:48:07.257 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 120/141 2022-04-03T21:48:07.291 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 120/141 2022-04-03T21:48:07.478 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarc 121/141 2022-04-03T21:48:07.488 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarc 121/141 2022-04-03T21:48:07.614 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:17.0.0-11442.gcfb8f943.el8.x86_64 122/141 2022-04-03T21:48:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : annobin-10.58-1.el8.x86_64 123/141 2022-04-03T21:48:08.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-25.el8.x86_64 124/141 2022-04-03T21:48:13.011 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 124/141 2022-04-03T21:48:14.703 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:17.0.0-11442.gcfb8f943.el8.x86_64 125/141 2022-04-03T21:48:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 126/141 2022-04-03T21:48:15.054 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 126/141 2022-04-03T21:48:15.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-11442.gcfb8 127/141 2022-04-03T21:48:15.303 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11442.gcfb8 127/141 2022-04-03T21:48:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_6 128/141 2022-04-03T21:48:15.869 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_6 128/141 2022-04-03T21:48:16.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 129/141 2022-04-03T21:48:16.180 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 129/141 2022-04-03T21:48:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 130/141 2022-04-03T21:48:17.222 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libacl-devel-2.2.53-1.el8.x86_64 131/141 2022-04-03T21:48:17.267 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 102/141 2022-04-03T21:48:17.267 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2022-04-03T21:48:17.267 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2022-04-03T21:48:17.268 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2022-04-03T21:48:17.268 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /run 2022-04-03T21:48:17.268 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2022-04-03T21:48:17.269 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2022-04-03T21:48:17.269 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2022-04-03T21:48:17.270 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2022-04-03T21:48:17.270 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2022-04-03T21:48:17.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:17.598 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:1.1.1k-6.el8.x86_64 132/141 2022-04-03T21:48:17.667 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 103/141 2022-04-03T21:48:17.771 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 133/141 2022-04-03T21:48:17.947 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:17.0.0-11442.gcfb8f943.el8.x86 134/141 2022-04-03T21:48:18.185 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:17.0.0-11442.gcfb8f943.el8.noarch 135/141 2022-04-03T21:48:18.410 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 136/141 2022-04-03T21:48:18.630 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 137/141 2022-04-03T21:48:18.835 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 138/141 2022-04-03T21:48:19.071 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 139/141 2022-04-03T21:48:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.1-9.el8.x86_64 140/141 2022-04-03T21:48:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 140/141 2022-04-03T21:48:19.530 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 103/141 2022-04-03T21:48:19.567 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.0.4-10.el8.x86_64 141/141 2022-04-03T21:48:19.800 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 104/141 2022-04-03T21:48:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 141/141 2022-04-03T21:48:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:17.0.0-11442.gcfb8f943.el8.x86_64 1/141 2022-04-03T21:48:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 2/141 2022-04-03T21:48:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 3/141 2022-04-03T21:48:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 4/141 2022-04-03T21:48:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11442.gcfb8 5/141 2022-04-03T21:48:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 6/141 2022-04-03T21:48:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 7/141 2022-04-03T21:48:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 8/141 2022-04-03T21:48:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 9/141 2022-04-03T21:48:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 10/141 2022-04-03T21:48:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 11/141 2022-04-03T21:48:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:17.0.0-11442.gcfb8f943.el8.x86_64 12/141 2022-04-03T21:48:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_6 13/141 2022-04-03T21:48:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:17.0.0-11442.gcfb8f943.el8.x86 14/141 2022-04-03T21:48:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 15/141 2022-04-03T21:48:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_6 16/141 2022-04-03T21:48:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:17.0.0-11442.gcfb8f943.el8.x86_ 17/141 2022-04-03T21:48:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 18/141 2022-04-03T21:48:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x8 19/141 2022-04-03T21:48:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 20/141 2022-04-03T21:48:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 21/141 2022-04-03T21:48:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11442.gcfb8f943.e 22/141 2022-04-03T21:48:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:17.0.0-11442.gcfb8f943.el8 23/141 2022-04-03T21:48:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:17.0.0-11442.gcfb8f943.el8.x86_ 24/141 2022-04-03T21:48:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:17.0.0-11442.gcfb8f943.el8.x86_6 25/141 2022-04-03T21:48:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 26/141 2022-04-03T21:48:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 27/141 2022-04-03T21:48:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 28/141 2022-04-03T21:48:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 29/141 2022-04-03T21:48:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 30/141 2022-04-03T21:48:20.127 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 104/141 2022-04-03T21:48:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-11442.gcfb8f943 31/141 2022-04-03T21:48:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.no 32/141 2022-04-03T21:48:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8. 33/141 2022-04-03T21:48:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-11442.gcf 34/141 2022-04-03T21:48:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11442.gcfb8f943.e 35/141 2022-04-03T21:48:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarc 36/141 2022-04-03T21:48:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-11442.gcfb8f943. 37/141 2022-04-03T21:48:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 38/141 2022-04-03T21:48:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 39/141 2022-04-03T21:48:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:17.0.0-11442.gcfb8f943.el8.noarch 40/141 2022-04-03T21:48:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : annobin-10.58-1.el8.x86_64 41/141 2022-04-03T21:48:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : autoconf-2.69-29.el8.noarch 42/141 2022-04-03T21:48:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.1-7.el8.noarch 43/141 2022-04-03T21:48:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.0.4-10.el8.x86_64 44/141 2022-04-03T21:48:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cpp-8.5.0-10.el8.x86_64 45/141 2022-04-03T21:48:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.1-9.el8.x86_64 46/141 2022-04-03T21:48:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gcc-8.5.0-10.el8.x86_64 47/141 2022-04-03T21:48:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : isl-0.16.1-6.el8.x86_64 48/141 2022-04-03T21:48:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-3.el8.x86_64 49/141 2022-04-03T21:48:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmpc-1.1.0-9.1.el8.x86_64 50/141 2022-04-03T21:48:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 51/141 2022-04-03T21:48:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 52/141 2022-04-03T21:48:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 53/141 2022-04-03T21:48:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 54/141 2022-04-03T21:48:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 55/141 2022-04-03T21:48:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 56/141 2022-04-03T21:48:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : platform-python-devel-3.6.8-46.el8.x86_64 57/141 2022-04-03T21:48:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 58/141 2022-04-03T21:48:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 59/141 2022-04-03T21:48:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 60/141 2022-04-03T21:48:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 61/141 2022-04-03T21:48:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 62/141 2022-04-03T21:48:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 63/141 2022-04-03T21:48:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 64/141 2022-04-03T21:48:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 65/141 2022-04-03T21:48:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 66/141 2022-04-03T21:48:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/141 2022-04-03T21:48:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 68/141 2022-04-03T21:48:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 69/141 2022-04-03T21:48:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 70/141 2022-04-03T21:48:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rpm-generators-5-7.el8.noarch 71/141 2022-04-03T21:48:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 72/141 2022-04-03T21:48:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 73/141 2022-04-03T21:48:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/141 2022-04-03T21:48:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 75/141 2022-04-03T21:48:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 76/141 2022-04-03T21:48:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : glibc-devel-2.28-196.el8.x86_64 77/141 2022-04-03T21:48:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : glibc-headers-2.28-196.el8.x86_64 78/141 2022-04-03T21:48:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-headers-4.18.0-373.el8.x86_64 79/141 2022-04-03T21:48:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 80/141 2022-04-03T21:48:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/141 2022-04-03T21:48:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 82/141 2022-04-03T21:48:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 83/141 2022-04-03T21:48:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libattr-devel-2.4.48-3.el8.x86_64 84/141 2022-04-03T21:48:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 85/141 2022-04-03T21:48:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 86/141 2022-04-03T21:48:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 87/141 2022-04-03T21:48:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/141 2022-04-03T21:48:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdmacm-37.2-1.el8.x86_64 89/141 2022-04-03T21:48:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 90/141 2022-04-03T21:48:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 91/141 2022-04-03T21:48:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/141 2022-04-03T21:48:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 93/141 2022-04-03T21:48:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libxcrypt-devel-4.1.1-6.el8.x86_64 94/141 2022-04-03T21:48:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:1.1.1k-6.el8.x86_64 95/141 2022-04-03T21:48:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 96/141 2022-04-03T21:48:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 97/141 2022-04-03T21:48:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 98/141 2022-04-03T21:48:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 99/141 2022-04-03T21:48:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 100/141 2022-04-03T21:48:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 101/141 2022-04-03T21:48:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 102/141 2022-04-03T21:48:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/141 2022-04-03T21:48:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 104/141 2022-04-03T21:48:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : userspace-rcu-0.10.1-4.el8.x86_64 105/141 2022-04-03T21:48:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 106/141 2022-04-03T21:48:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 107/141 2022-04-03T21:48:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 108/141 2022-04-03T21:48:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 109/141 2022-04-03T21:48:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 110/141 2022-04-03T21:48:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 111/141 2022-04-03T21:48:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 112/141 2022-04-03T21:48:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 113/141 2022-04-03T21:48:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 114/141 2022-04-03T21:48:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 115/141 2022-04-03T21:48:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 116/141 2022-04-03T21:48:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 117/141 2022-04-03T21:48:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 118/141 2022-04-03T21:48:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 119/141 2022-04-03T21:48:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 120/141 2022-04-03T21:48:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 121/141 2022-04-03T21:48:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 122/141 2022-04-03T21:48:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 123/141 2022-04-03T21:48:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 124/141 2022-04-03T21:48:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 125/141 2022-04-03T21:48:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-2.6-1.el8.noarch 126/141 2022-04-03T21:48:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 127/141 2022-04-03T21:48:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 128/141 2022-04-03T21:48:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 129/141 2022-04-03T21:48:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 130/141 2022-04-03T21:48:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 131/141 2022-04-03T21:48:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 132/141 2022-04-03T21:48:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 133/141 2022-04-03T21:48:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 134/141 2022-04-03T21:48:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 135/141 2022-04-03T21:48:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 136/141 2022-04-03T21:48:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 137/141 2022-04-03T21:48:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 138/141 2022-04-03T21:48:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 139/141 2022-04-03T21:48:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 140/141 2022-04-03T21:48:20.375 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 105/141 2022-04-03T21:48:20.894 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 105/141 2022-04-03T21:48:21.133 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 106/141 2022-04-03T21:48:21.204 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 106/141 2022-04-03T21:48:21.426 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/141 2022-04-03T21:48:21.648 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/141 2022-04-03T21:48:21.824 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/141 2022-04-03T21:48:21.948 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/141 2022-04-03T21:48:21.990 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libbabeltrace-1.5.6-2.el8.x86_64 141/141 2022-04-03T21:48:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:21.991 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2022-04-03T21:48:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: annobin-10.58-1.el8.x86_64 2022-04-03T21:48:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: autoconf-2.69-29.el8.noarch 2022-04-03T21:48:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.1-7.el8.noarch 2022-04-03T21:48:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.0.4-10.el8.x86_64 2022-04-03T21:48:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: cpp-8.5.0-10.el8.x86_64 2022-04-03T21:48:21.998 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-04-03T21:48:21.998 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.1-9.el8.x86_64 2022-04-03T21:48:21.998 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.7-15.el8.x86_64 2022-04-03T21:48:21.998 INFO:teuthology.orchestra.run.smithi117.stdout: gcc-8.5.0-10.el8.x86_64 2022-04-03T21:48:21.999 INFO:teuthology.orchestra.run.smithi117.stdout: glibc-devel-2.28-196.el8.x86_64 2022-04-03T21:48:21.999 INFO:teuthology.orchestra.run.smithi117.stdout: glibc-headers-2.28-196.el8.x86_64 2022-04-03T21:48:21.999 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-04-03T21:48:21.999 INFO:teuthology.orchestra.run.smithi117.stdout: isl-0.16.1-6.el8.x86_64 2022-04-03T21:48:22.000 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-3.el8.x86_64 2022-04-03T21:48:22.000 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-headers-4.18.0-373.el8.x86_64 2022-04-03T21:48:22.000 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-04-03T21:48:22.000 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-04-03T21:48:22.000 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-devel-2.2.53-1.el8.x86_64 2022-04-03T21:48:22.001 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-04-03T21:48:22.001 INFO:teuthology.orchestra.run.smithi117.stdout: libattr-devel-2.4.48-3.el8.x86_64 2022-04-03T21:48:22.001 INFO:teuthology.orchestra.run.smithi117.stdout: libbabeltrace-1.5.6-2.el8.x86_64 2022-04-03T21:48:22.001 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.002 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.002 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.002 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-04-03T21:48:22.002 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-04-03T21:48:22.003 INFO:teuthology.orchestra.run.smithi117.stdout: libmpc-1.1.0-9.1.el8.x86_64 2022-04-03T21:48:22.003 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.2-3.el8.x86_64 2022-04-03T21:48:22.003 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-04-03T21:48:22.003 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-04-03T21:48:22.003 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.004 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.004 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.004 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.004 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-04-03T21:48:22.005 INFO:teuthology.orchestra.run.smithi117.stdout: librdmacm-37.2-1.el8.x86_64 2022-04-03T21:48:22.005 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.005 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-04-03T21:48:22.005 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-04-03T21:48:22.006 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-25.el8.x86_64 2022-04-03T21:48:22.006 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.3.1-3.el8.x86_64 2022-04-03T21:48:22.006 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-04-03T21:48:22.006 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-04-03T21:48:22.006 INFO:teuthology.orchestra.run.smithi117.stdout: libxcrypt-devel-4.1.1-6.el8.x86_64 2022-04-03T21:48:22.007 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-04-03T21:48:22.007 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-04-03T21:48:22.007 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.15-3.el8.x86_64 2022-04-03T21:48:22.007 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-04-03T21:48:22.008 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:1.1.1k-6.el8.x86_64 2022-04-03T21:48:22.008 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-04-03T21:48:22.008 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-04-03T21:48:22.008 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-04-03T21:48:22.009 INFO:teuthology.orchestra.run.smithi117.stdout: platform-python-devel-3.6.8-46.el8.x86_64 2022-04-03T21:48:22.009 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-04-03T21:48:22.009 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.5.1-7.el8.noarch 2022-04-03T21:48:22.009 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-04-03T21:48:22.009 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-04-03T21:48:22.010 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-04-03T21:48:22.010 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.010 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.010 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.011 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-04-03T21:48:22.011 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-04-03T21:48:22.011 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-04-03T21:48:22.011 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-04-03T21:48:22.011 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-04-03T21:48:22.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-04-03T21:48:22.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-6.2-6.el8.noarch 2022-04-03T21:48:22.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-04-03T21:48:22.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-04-03T21:48:22.013 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-04-03T21:48:22.013 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-04-03T21:48:22.013 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-04-03T21:48:22.013 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-04-03T21:48:22.013 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-04-03T21:48:22.014 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.0.6-13.el8.noarch 2022-04-03T21:48:22.014 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-04-03T21:48:22.014 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-04-03T21:48:22.014 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-04-03T21:48:22.015 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-04-03T21:48:22.015 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-04-03T21:48:22.015 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-04-03T21:48:22.015 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-04-03T21:48:22.016 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-2.6-1.el8.noarch 2022-04-03T21:48:22.016 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-04-03T21:48:22.016 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-04-03T21:48:22.016 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-04-03T21:48:22.016 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-04-03T21:48:22.017 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.14-14.el8.noarch 2022-04-03T21:48:22.017 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2017.2-9.el8.noarch 2022-04-03T21:48:22.017 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.017 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.017 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-04-03T21:48:22.018 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-04-03T21:48:22.018 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.018 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.4.1-12.el8.noarch 2022-04-03T21:48:22.018 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rpm-generators-5-7.el8.noarch 2022-04-03T21:48:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.8-1.el8.noarch 2022-04-03T21:48:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-04-03T21:48:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-04-03T21:48:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-04-03T21:48:22.020 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-04-03T21:48:22.020 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-04-03T21:48:22.020 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-04-03T21:48:22.020 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-04-03T21:48:22.020 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-04-03T21:48:22.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-04-03T21:48:22.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-04-03T21:48:22.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-04-03T21:48:22.021 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.021 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.022 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:22.022 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-1.el8.x86_64 2022-04-03T21:48:22.022 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.13.0-2.el8.x86_64 2022-04-03T21:48:22.022 INFO:teuthology.orchestra.run.smithi117.stdout: userspace-rcu-0.10.1-4.el8.x86_64 2022-04-03T21:48:22.023 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-04-03T21:48:22.023 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-04-03T21:48:22.023 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-04-03T21:48:22.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:22.024 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2022-04-03T21:48:22.142 DEBUG:teuthology.parallel:result is None 2022-04-03T21:48:22.228 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : jq-1.6-3.el8.x86_64 110/141 2022-04-03T21:48:22.407 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : isl-0.16.1-6.el8.x86_64 111/141 2022-04-03T21:48:24.284 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: isl-0.16.1-6.el8.x86_64 111/141 2022-04-03T21:48:24.540 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gcc-8.5.0-10.el8.x86_64 112/141 2022-04-03T21:48:24.601 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: gcc-8.5.0-10.el8.x86_64 112/141 2022-04-03T21:48:27.551 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 113/141 2022-04-03T21:48:27.768 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 113/141 2022-04-03T21:48:27.924 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-11442.gcfb8f943. 114/141 2022-04-03T21:48:28.100 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-11442.gcfb8f943 115/141 2022-04-03T21:48:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.no 116/141 2022-04-03T21:48:28.582 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.no 116/141 2022-04-03T21:48:28.981 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8. 117/141 2022-04-03T21:48:30.264 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8. 117/141 2022-04-03T21:48:30.481 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-11442.gcf 118/141 2022-04-03T21:48:30.638 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-11442.gcf 118/141 2022-04-03T21:48:31.057 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-11442.gcfb8f943.e 119/141 2022-04-03T21:48:31.331 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 120/141 2022-04-03T21:48:31.419 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 120/141 2022-04-03T21:48:31.605 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarc 121/141 2022-04-03T21:48:31.651 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarc 121/141 2022-04-03T21:48:31.797 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:17.0.0-11442.gcfb8f943.el8.x86_64 122/141 2022-04-03T21:48:32.100 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : annobin-10.58-1.el8.x86_64 123/141 2022-04-03T21:48:32.322 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-25.el8.x86_64 124/141 2022-04-03T21:48:38.439 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 124/141 2022-04-03T21:48:40.451 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:17.0.0-11442.gcfb8f943.el8.x86_64 125/141 2022-04-03T21:48:40.697 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 126/141 2022-04-03T21:48:40.838 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 126/141 2022-04-03T21:48:41.046 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-11442.gcfb8 127/141 2022-04-03T21:48:41.143 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11442.gcfb8 127/141 2022-04-03T21:48:41.379 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_6 128/141 2022-04-03T21:48:41.902 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_6 128/141 2022-04-03T21:48:42.113 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 129/141 2022-04-03T21:48:42.271 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 129/141 2022-04-03T21:48:42.539 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 130/141 2022-04-03T21:48:43.990 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libacl-devel-2.2.53-1.el8.x86_64 131/141 2022-04-03T21:48:44.326 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:1.1.1k-6.el8.x86_64 132/141 2022-04-03T21:48:44.525 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 133/141 2022-04-03T21:48:44.726 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:17.0.0-11442.gcfb8f943.el8.x86 134/141 2022-04-03T21:48:44.906 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:17.0.0-11442.gcfb8f943.el8.noarch 135/141 2022-04-03T21:48:45.175 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 136/141 2022-04-03T21:48:45.385 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 137/141 2022-04-03T21:48:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 138/141 2022-04-03T21:48:45.888 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 139/141 2022-04-03T21:48:46.103 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.1-9.el8.x86_64 140/141 2022-04-03T21:48:46.259 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 140/141 2022-04-03T21:48:46.478 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.0.4-10.el8.x86_64 141/141 2022-04-03T21:48:46.732 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 141/141 2022-04-03T21:48:46.733 INFO:teuthology.orchestra.run.smithi049.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-04-03T21:48:46.733 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:47.698 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:17.0.0-11442.gcfb8f943.el8.x86_64 1/141 2022-04-03T21:48:47.699 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 2/141 2022-04-03T21:48:47.699 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 3/141 2022-04-03T21:48:47.699 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 4/141 2022-04-03T21:48:47.699 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11442.gcfb8 5/141 2022-04-03T21:48:47.700 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 6/141 2022-04-03T21:48:47.700 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 7/141 2022-04-03T21:48:47.700 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 8/141 2022-04-03T21:48:47.700 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 9/141 2022-04-03T21:48:47.701 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 10/141 2022-04-03T21:48:47.701 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 11/141 2022-04-03T21:48:47.701 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:17.0.0-11442.gcfb8f943.el8.x86_64 12/141 2022-04-03T21:48:47.701 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_6 13/141 2022-04-03T21:48:47.702 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:17.0.0-11442.gcfb8f943.el8.x86 14/141 2022-04-03T21:48:47.702 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 15/141 2022-04-03T21:48:47.702 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_6 16/141 2022-04-03T21:48:47.702 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:17.0.0-11442.gcfb8f943.el8.x86_ 17/141 2022-04-03T21:48:47.702 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 18/141 2022-04-03T21:48:47.703 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x8 19/141 2022-04-03T21:48:47.703 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 20/141 2022-04-03T21:48:47.703 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 21/141 2022-04-03T21:48:47.703 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11442.gcfb8f943.e 22/141 2022-04-03T21:48:47.704 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:17.0.0-11442.gcfb8f943.el8 23/141 2022-04-03T21:48:47.704 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:17.0.0-11442.gcfb8f943.el8.x86_ 24/141 2022-04-03T21:48:47.704 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:17.0.0-11442.gcfb8f943.el8.x86_6 25/141 2022-04-03T21:48:47.704 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 26/141 2022-04-03T21:48:47.704 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 27/141 2022-04-03T21:48:47.705 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 28/141 2022-04-03T21:48:47.705 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 29/141 2022-04-03T21:48:47.705 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 30/141 2022-04-03T21:48:47.705 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-11442.gcfb8f943 31/141 2022-04-03T21:48:47.716 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.no 32/141 2022-04-03T21:48:47.717 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8. 33/141 2022-04-03T21:48:47.717 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-11442.gcf 34/141 2022-04-03T21:48:47.717 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11442.gcfb8f943.e 35/141 2022-04-03T21:48:47.717 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarc 36/141 2022-04-03T21:48:47.718 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-11442.gcfb8f943. 37/141 2022-04-03T21:48:47.718 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 38/141 2022-04-03T21:48:47.718 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 39/141 2022-04-03T21:48:47.718 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:17.0.0-11442.gcfb8f943.el8.noarch 40/141 2022-04-03T21:48:47.718 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : annobin-10.58-1.el8.x86_64 41/141 2022-04-03T21:48:47.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : autoconf-2.69-29.el8.noarch 42/141 2022-04-03T21:48:47.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.1-7.el8.noarch 43/141 2022-04-03T21:48:47.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.0.4-10.el8.x86_64 44/141 2022-04-03T21:48:47.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cpp-8.5.0-10.el8.x86_64 45/141 2022-04-03T21:48:47.720 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.1-9.el8.x86_64 46/141 2022-04-03T21:48:47.720 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gcc-8.5.0-10.el8.x86_64 47/141 2022-04-03T21:48:47.720 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : isl-0.16.1-6.el8.x86_64 48/141 2022-04-03T21:48:47.720 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : jq-1.6-3.el8.x86_64 49/141 2022-04-03T21:48:47.721 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libmpc-1.1.0-9.1.el8.x86_64 50/141 2022-04-03T21:48:47.721 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 51/141 2022-04-03T21:48:47.721 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 52/141 2022-04-03T21:48:47.721 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 53/141 2022-04-03T21:48:47.721 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 54/141 2022-04-03T21:48:47.722 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 55/141 2022-04-03T21:48:47.722 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 56/141 2022-04-03T21:48:47.722 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : platform-python-devel-3.6.8-46.el8.x86_64 57/141 2022-04-03T21:48:47.722 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 58/141 2022-04-03T21:48:47.723 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 59/141 2022-04-03T21:48:47.723 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 60/141 2022-04-03T21:48:47.723 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 61/141 2022-04-03T21:48:47.723 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 62/141 2022-04-03T21:48:47.723 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 63/141 2022-04-03T21:48:47.724 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 64/141 2022-04-03T21:48:47.724 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 65/141 2022-04-03T21:48:47.724 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 66/141 2022-04-03T21:48:47.724 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/141 2022-04-03T21:48:47.725 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 68/141 2022-04-03T21:48:47.725 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 69/141 2022-04-03T21:48:47.725 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 70/141 2022-04-03T21:48:47.725 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rpm-generators-5-7.el8.noarch 71/141 2022-04-03T21:48:47.726 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 72/141 2022-04-03T21:48:47.726 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 73/141 2022-04-03T21:48:47.726 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/141 2022-04-03T21:48:47.726 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 75/141 2022-04-03T21:48:47.726 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 76/141 2022-04-03T21:48:47.727 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : glibc-devel-2.28-196.el8.x86_64 77/141 2022-04-03T21:48:47.727 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : glibc-headers-2.28-196.el8.x86_64 78/141 2022-04-03T21:48:47.727 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-headers-4.18.0-373.el8.x86_64 79/141 2022-04-03T21:48:47.727 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 80/141 2022-04-03T21:48:47.728 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/141 2022-04-03T21:48:47.728 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 82/141 2022-04-03T21:48:47.728 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 83/141 2022-04-03T21:48:47.728 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libattr-devel-2.4.48-3.el8.x86_64 84/141 2022-04-03T21:48:47.728 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 85/141 2022-04-03T21:48:47.729 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 86/141 2022-04-03T21:48:47.729 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 87/141 2022-04-03T21:48:47.729 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/141 2022-04-03T21:48:47.729 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdmacm-37.2-1.el8.x86_64 89/141 2022-04-03T21:48:47.730 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 90/141 2022-04-03T21:48:47.730 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 91/141 2022-04-03T21:48:47.730 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/141 2022-04-03T21:48:47.730 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 93/141 2022-04-03T21:48:47.731 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libxcrypt-devel-4.1.1-6.el8.x86_64 94/141 2022-04-03T21:48:47.731 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:1.1.1k-6.el8.x86_64 95/141 2022-04-03T21:48:47.731 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 96/141 2022-04-03T21:48:47.731 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 97/141 2022-04-03T21:48:47.731 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 98/141 2022-04-03T21:48:47.732 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 99/141 2022-04-03T21:48:47.732 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 100/141 2022-04-03T21:48:47.732 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 101/141 2022-04-03T21:48:47.732 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 102/141 2022-04-03T21:48:47.733 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/141 2022-04-03T21:48:47.733 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 104/141 2022-04-03T21:48:47.733 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : userspace-rcu-0.10.1-4.el8.x86_64 105/141 2022-04-03T21:48:47.733 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 106/141 2022-04-03T21:48:47.733 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 107/141 2022-04-03T21:48:47.734 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 108/141 2022-04-03T21:48:47.734 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 109/141 2022-04-03T21:48:47.734 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 110/141 2022-04-03T21:48:47.734 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 111/141 2022-04-03T21:48:47.735 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 112/141 2022-04-03T21:48:47.735 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 113/141 2022-04-03T21:48:47.735 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 114/141 2022-04-03T21:48:47.735 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 115/141 2022-04-03T21:48:47.735 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 116/141 2022-04-03T21:48:47.736 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 117/141 2022-04-03T21:48:47.736 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 118/141 2022-04-03T21:48:47.736 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 119/141 2022-04-03T21:48:47.736 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 120/141 2022-04-03T21:48:47.736 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 121/141 2022-04-03T21:48:47.737 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 122/141 2022-04-03T21:48:47.737 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 123/141 2022-04-03T21:48:47.737 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 124/141 2022-04-03T21:48:47.737 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 125/141 2022-04-03T21:48:47.738 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-2.6-1.el8.noarch 126/141 2022-04-03T21:48:47.738 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 127/141 2022-04-03T21:48:47.738 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 128/141 2022-04-03T21:48:47.738 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 129/141 2022-04-03T21:48:47.738 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 130/141 2022-04-03T21:48:47.739 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 131/141 2022-04-03T21:48:47.739 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 132/141 2022-04-03T21:48:47.739 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 133/141 2022-04-03T21:48:47.739 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 134/141 2022-04-03T21:48:47.740 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 135/141 2022-04-03T21:48:47.740 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 136/141 2022-04-03T21:48:47.740 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 137/141 2022-04-03T21:48:47.740 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 138/141 2022-04-03T21:48:47.740 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 139/141 2022-04-03T21:48:47.741 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 140/141 2022-04-03T21:48:49.714 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libbabeltrace-1.5.6-2.el8.x86_64 141/141 2022-04-03T21:48:49.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:49.714 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2022-04-03T21:48:49.715 INFO:teuthology.orchestra.run.smithi049.stdout: annobin-10.58-1.el8.x86_64 2022-04-03T21:48:49.715 INFO:teuthology.orchestra.run.smithi049.stdout: autoconf-2.69-29.el8.noarch 2022-04-03T21:48:49.715 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.1-7.el8.noarch 2022-04-03T21:48:49.715 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.0.4-10.el8.x86_64 2022-04-03T21:48:49.716 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.716 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.716 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.716 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.717 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.717 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.717 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.717 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.718 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.718 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.718 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.718 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.718 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.719 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.719 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.719 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.719 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.720 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.720 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.720 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.720 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.721 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.721 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:17.0.0-11442.gcfb8f943.el8.noarch 2022-04-03T21:48:49.721 INFO:teuthology.orchestra.run.smithi049.stdout: cpp-8.5.0-10.el8.x86_64 2022-04-03T21:48:49.722 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-04-03T21:48:49.722 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.1-9.el8.x86_64 2022-04-03T21:48:49.722 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.7-15.el8.x86_64 2022-04-03T21:48:49.722 INFO:teuthology.orchestra.run.smithi049.stdout: gcc-8.5.0-10.el8.x86_64 2022-04-03T21:48:49.723 INFO:teuthology.orchestra.run.smithi049.stdout: glibc-devel-2.28-196.el8.x86_64 2022-04-03T21:48:49.723 INFO:teuthology.orchestra.run.smithi049.stdout: glibc-headers-2.28-196.el8.x86_64 2022-04-03T21:48:49.723 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-04-03T21:48:49.723 INFO:teuthology.orchestra.run.smithi049.stdout: isl-0.16.1-6.el8.x86_64 2022-04-03T21:48:49.723 INFO:teuthology.orchestra.run.smithi049.stdout: jq-1.6-3.el8.x86_64 2022-04-03T21:48:49.724 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-headers-4.18.0-373.el8.x86_64 2022-04-03T21:48:49.724 INFO:teuthology.orchestra.run.smithi049.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-04-03T21:48:49.724 INFO:teuthology.orchestra.run.smithi049.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-04-03T21:48:49.724 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-devel-2.2.53-1.el8.x86_64 2022-04-03T21:48:49.725 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-04-03T21:48:49.725 INFO:teuthology.orchestra.run.smithi049.stdout: libattr-devel-2.4.48-3.el8.x86_64 2022-04-03T21:48:49.725 INFO:teuthology.orchestra.run.smithi049.stdout: libbabeltrace-1.5.6-2.el8.x86_64 2022-04-03T21:48:49.725 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.725 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.726 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.726 INFO:teuthology.orchestra.run.smithi049.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-04-03T21:48:49.726 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-04-03T21:48:49.726 INFO:teuthology.orchestra.run.smithi049.stdout: libmpc-1.1.0-9.1.el8.x86_64 2022-04-03T21:48:49.727 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.2-3.el8.x86_64 2022-04-03T21:48:49.727 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-04-03T21:48:49.727 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-04-03T21:48:49.727 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.727 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.728 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.728 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.728 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-04-03T21:48:49.728 INFO:teuthology.orchestra.run.smithi049.stdout: librdmacm-37.2-1.el8.x86_64 2022-04-03T21:48:49.729 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.729 INFO:teuthology.orchestra.run.smithi049.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-04-03T21:48:49.729 INFO:teuthology.orchestra.run.smithi049.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-04-03T21:48:49.730 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-25.el8.x86_64 2022-04-03T21:48:49.730 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.3.1-3.el8.x86_64 2022-04-03T21:48:49.730 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-04-03T21:48:49.730 INFO:teuthology.orchestra.run.smithi049.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-04-03T21:48:49.731 INFO:teuthology.orchestra.run.smithi049.stdout: libxcrypt-devel-4.1.1-6.el8.x86_64 2022-04-03T21:48:49.731 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-04-03T21:48:49.731 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-04-03T21:48:49.731 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.15-3.el8.x86_64 2022-04-03T21:48:49.731 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-04-03T21:48:49.732 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:1.1.1k-6.el8.x86_64 2022-04-03T21:48:49.732 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-04-03T21:48:49.732 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-04-03T21:48:49.732 INFO:teuthology.orchestra.run.smithi049.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-04-03T21:48:49.732 INFO:teuthology.orchestra.run.smithi049.stdout: platform-python-devel-3.6.8-46.el8.x86_64 2022-04-03T21:48:49.733 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-04-03T21:48:49.733 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.5.1-7.el8.noarch 2022-04-03T21:48:49.733 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-04-03T21:48:49.733 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-04-03T21:48:49.734 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-04-03T21:48:49.734 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.734 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.734 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.734 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-04-03T21:48:49.735 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-04-03T21:48:49.735 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-04-03T21:48:49.735 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-04-03T21:48:49.735 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-04-03T21:48:49.736 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-04-03T21:48:49.736 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-6.2-6.el8.noarch 2022-04-03T21:48:49.736 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-04-03T21:48:49.736 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-04-03T21:48:49.736 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-04-03T21:48:49.737 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-04-03T21:48:49.737 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-04-03T21:48:49.737 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-04-03T21:48:49.737 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-04-03T21:48:49.738 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.0.6-13.el8.noarch 2022-04-03T21:48:49.738 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-04-03T21:48:49.738 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-04-03T21:48:49.738 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-04-03T21:48:49.738 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-04-03T21:48:49.739 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-04-03T21:48:49.739 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-04-03T21:48:49.739 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-04-03T21:48:49.739 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-2.6-1.el8.noarch 2022-04-03T21:48:49.740 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-04-03T21:48:49.740 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-04-03T21:48:49.740 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-04-03T21:48:49.740 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-04-03T21:48:49.740 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.14-14.el8.noarch 2022-04-03T21:48:49.741 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2017.2-9.el8.noarch 2022-04-03T21:48:49.741 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.741 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.741 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-04-03T21:48:49.741 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-04-03T21:48:49.742 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.742 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.4.1-12.el8.noarch 2022-04-03T21:48:49.742 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rpm-generators-5-7.el8.noarch 2022-04-03T21:48:49.742 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.8-1.el8.noarch 2022-04-03T21:48:49.743 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-04-03T21:48:49.743 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-04-03T21:48:49.743 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-04-03T21:48:49.743 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-04-03T21:48:49.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-04-03T21:48:49.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-04-03T21:48:49.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-04-03T21:48:49.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-04-03T21:48:49.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-04-03T21:48:49.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-04-03T21:48:49.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-04-03T21:48:49.745 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.746 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.746 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:17.0.0-11442.gcfb8f943.el8.x86_64 2022-04-03T21:48:49.746 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-1.el8.x86_64 2022-04-03T21:48:49.746 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.13.0-2.el8.x86_64 2022-04-03T21:48:49.747 INFO:teuthology.orchestra.run.smithi049.stdout: userspace-rcu-0.10.1-4.el8.x86_64 2022-04-03T21:48:49.747 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-04-03T21:48:49.747 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-04-03T21:48:49.748 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-04-03T21:48:49.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:49.748 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2022-04-03T21:48:50.053 DEBUG:teuthology.parallel:result is None 2022-04-03T21:48:50.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo lsb_release -is 2022-04-03T21:48:50.195 INFO:teuthology.orchestra.run.smithi049.stdout:CentOSStream 2022-04-03T21:48:50.199 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:48:50.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:48:50.357 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-04-03T21:48:50.426 INFO:teuthology.orchestra.run.smithi049.stdout:17.0.0-11442.gcfb8f943.el8 2022-04-03T21:48:50.427 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11442.gcfb8f943.el8 2022-04-03T21:48:50.427 INFO:teuthology.task.install:The correct ceph version 17.0.0-11442.gcfb8f943 is installed. 2022-04-03T21:48:50.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2022-04-03T21:48:50.486 INFO:teuthology.orchestra.run.smithi117.stdout:CentOSStream 2022-04-03T21:48:50.488 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-03T21:48:50.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:48:50.637 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-04-03T21:48:50.662 INFO:teuthology.orchestra.run.smithi117.stdout:17.0.0-11442.gcfb8f943.el8 2022-04-03T21:48:50.662 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11442.gcfb8f943.el8 2022-04-03T21:48:50.663 INFO:teuthology.task.install:The correct ceph version 17.0.0-11442.gcfb8f943 is installed. 2022-04-03T21:48:50.663 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-04-03T21:48:50.664 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:50.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-04-03T21:48:50.757 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:50.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-04-03T21:48:50.787 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-04-03T21:48:50.788 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:50.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2022-04-03T21:48:50.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-04-03T21:48:50.956 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:50.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2022-04-03T21:48:50.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-04-03T21:48:51.053 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-04-03T21:48:51.054 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:51.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2022-04-03T21:48:51.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-04-03T21:48:51.223 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:51.224 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2022-04-03T21:48:51.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-04-03T21:48:51.318 INFO:teuthology.run_tasks:Running task ceph... 2022-04-03T21:48:51.395 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-04-03T21:48:51.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2022-04-03T21:48:51.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2022-04-03T21:48:51.479 INFO:tasks.ceph:Disabling ceph logrotate... 2022-04-03T21:48:51.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2022-04-03T21:48:51.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2022-04-03T21:48:51.566 INFO:tasks.ceph:Creating extra log directories... 2022-04-03T21:48:51.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-04-03T21:48:51.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-04-03T21:48:51.659 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-04-03T21:48:51.659 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-04-03T21:48:51.659 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-04-03T21:48:51.660 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:51.660 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-04-03T21:48:51.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-04-03T21:48:51.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-04-03T21:48:51.993 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:51.994 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-04-03T21:48:52.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-04-03T21:48:52.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-04-03T21:48:52.153 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-04-03T21:48:52.154 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-04-03T21:48:52.154 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775668', 'branch': 'wip-vshankar-testing-20220403-170344', 'description': 'fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '6775668', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '26d8230c8f919f5e2d8da795fb3fbca12f8ebd85'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20220403-170344'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20220403-170344', 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20220403-170344', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi049.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcx6FNUI1+8IhYWPjRR05YLwLbzlNwRkh+BjacmtArX8/l9VlODyae8zxqgcfE035IF/jZSJ08cifu11EDuH9Pb5bgHyZd8riLhOddNZioOXq3eswWIl3zklgt8pS2wXL//pv9L/HfUz20qJGAmzqL2e+9boYQApSn5e34pxEnJ3pYVlzsCs0XO7MeaRociyEEr0NpITMGZ65xzvjKCt+abPO1xUuQ8Vvk8+oJ8sUvFZ7qfb5ooS8v/qRlXZ9asRdjxsXQktA7Q6LbTYTnZJk0w9EfgQM3qFjkf6Mo8xw6hqLYbYZyZ7SjfxJqVqO73KQVFj40zblgLUfpYkuI3v+QgkWqHhsFFLvMCRqRC+aRqaCwwvCz1mefZGzng1fmPNTt7ohGGciS7hhQqyEkP5tqmdr/cMmzueru4IG/tsScKE0kDUP+FygdUDyc5x0Ie+HFRJY/ENit1bULESlx9OpxV1K42qN0IYGg92s9E4Etx6bHBJahtj7pYz1bAyKjpcc=', 'smithi117.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2n0KUnOcrabfO+SDulzmks2AdtqPx78dAGzF/gfk0twvbCAsea+9vnH4TVfejC8NLTQOR7UyvjDdlrVuiDPCqY1BgcLw+8IzgbgaM7UdrzSly181ASQMoBA6nMafWAkYzivZyv3VeahBcoPvev7UU/hgPPj8rqTPtnbYdjovgeXtkatBJdzxYPUae8rebYHpTnxzi4OQBoLXcBLGI04MngEIWyiB3k9vQHMbB7ZKpFvgdq7lh9qfF3085NuRt8OCjO5M3+nzYhAga9NGNOhnRUF1D5jJiq4NEf6RZWRtTPjzoa6wCK9nu4P2Qdv+M/QzeQLqwh7Q41mGj/PXYOEcY6DhMsu3V+VaMsURMGYBEzuZVTXHJRxsOyIIJiNc/lvFZMLr/La6REUJqqWgeCkpmp1CJ4036Ds6hbtYEzD8DEBG/KG4fpRkudoU+kBcQh49kg/x6Te965erwRIvy0bNUoTZZD4UnrWqiYVs6nYwxixprFvMC/5O0Hm7nTHc/cMc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '26d8230c8f919f5e2d8da795fb3fbca12f8ebd85'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'cfb8f943163b374162da0d7b0240f267dd46e4e1'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/snaps']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'd877b023166308f282187444de8e8e725ffb27d2', 'timestamp': '2022-04-03_15:22:48', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.22301'} 2022-04-03T21:48:52.155 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-04-03T21:48:52.160 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-04-03T21:48:52.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2022-04-03T21:48:52.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2022-04-03T21:48:52.295 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:52.296 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2022-04-03T21:48:52.350 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-04-03T21:48:52.351 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-04-03T21:48:52.405 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-04-03T21:48:52.405 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.406 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 450 Links: 1 2022-04-03T21:48:52.406 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.406 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.406 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2022-04-03 21:48:47.122750028 +0000 2022-04-03T21:48:52.407 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2022-04-03 21:45:51.110483577 +0000 2022-04-03T21:48:52.407 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2022-04-03 21:45:51.110483577 +0000 2022-04-03T21:48:52.407 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2022-04-03T21:48:52.433 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2022-04-03T21:48:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2022-04-03T21:48:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000376037 s, 1.4 MB/s 2022-04-03T21:48:52.444 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-04-03T21:48:52.501 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-04-03T21:48:52.501 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 456 Links: 1 2022-04-03T21:48:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2022-04-03 21:48:47.122750028 +0000 2022-04-03T21:48:52.503 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2022-04-03 21:45:51.660468423 +0000 2022-04-03T21:48:52.503 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2022-04-03 21:45:51.660468423 +0000 2022-04-03T21:48:52.503 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2022-04-03T21:48:52.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2022-04-03T21:48:52.530 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2022-04-03T21:48:52.530 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000318668 s, 1.6 MB/s 2022-04-03T21:48:52.540 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-04-03T21:48:52.594 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-04-03T21:48:52.595 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.595 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 462 Links: 1 2022-04-03T21:48:52.595 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.596 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.596 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2022-04-03 21:48:47.123750001 +0000 2022-04-03T21:48:52.596 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2022-04-03 21:45:52.191453793 +0000 2022-04-03T21:48:52.596 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2022-04-03 21:45:52.191453793 +0000 2022-04-03T21:48:52.597 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2022-04-03T21:48:52.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2022-04-03T21:48:52.623 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2022-04-03T21:48:52.624 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000317703 s, 1.6 MB/s 2022-04-03T21:48:52.633 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-04-03T21:48:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-04-03T21:48:52.688 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.688 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 468 Links: 1 2022-04-03T21:48:52.689 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.689 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.689 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2022-04-03 21:48:47.123750001 +0000 2022-04-03T21:48:52.689 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2022-04-03 21:45:52.716439327 +0000 2022-04-03T21:48:52.690 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2022-04-03 21:45:52.716439327 +0000 2022-04-03T21:48:52.690 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2022-04-03T21:48:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2022-04-03T21:48:52.715 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2022-04-03T21:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000334845 s, 1.5 MB/s 2022-04-03T21:48:52.725 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-03T21:48:52.726 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:52.726 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2022-04-03T21:48:52.744 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-04-03T21:48:52.745 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-04-03T21:48:52.801 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-04-03T21:48:52.802 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.802 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 78291 Links: 1 2022-04-03T21:48:52.802 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.802 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.803 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2022-04-03 21:48:19.790858657 +0000 2022-04-03T21:48:52.803 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2022-04-03 21:45:36.120149471 +0000 2022-04-03T21:48:52.803 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2022-04-03 21:45:36.120149471 +0000 2022-04-03T21:48:52.803 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2022-04-03T21:48:52.812 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2022-04-03T21:48:52.812 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2022-04-03T21:48:52.813 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000325366 s, 1.6 MB/s 2022-04-03T21:48:52.815 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-04-03T21:48:52.872 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-04-03T21:48:52.872 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.873 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 78400 Links: 1 2022-04-03T21:48:52.873 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.873 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.873 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2022-04-03 21:48:19.791858632 +0000 2022-04-03T21:48:52.874 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2022-04-03 21:45:36.485142330 +0000 2022-04-03T21:48:52.874 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2022-04-03 21:45:36.485142330 +0000 2022-04-03T21:48:52.874 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2022-04-03T21:48:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2022-04-03T21:48:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2022-04-03T21:48:52.883 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000252304 s, 2.0 MB/s 2022-04-03T21:48:52.885 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-04-03T21:48:52.942 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-04-03T21:48:52.942 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:52.943 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 74621 Links: 1 2022-04-03T21:48:52.943 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:52.943 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:52.943 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2022-04-03 21:48:19.791858632 +0000 2022-04-03T21:48:52.944 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2022-04-03 21:45:36.812135933 +0000 2022-04-03T21:48:52.944 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2022-04-03 21:45:36.812135933 +0000 2022-04-03T21:48:52.944 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2022-04-03T21:48:52.952 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2022-04-03T21:48:52.952 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2022-04-03T21:48:52.952 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000227524 s, 2.3 MB/s 2022-04-03T21:48:52.954 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-04-03T21:48:53.010 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-04-03T21:48:53.011 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-03T21:48:53.011 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 79521 Links: 1 2022-04-03T21:48:53.011 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:48:53.011 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2022-04-03T21:48:53.012 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2022-04-03 21:48:19.791858632 +0000 2022-04-03T21:48:53.012 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2022-04-03 21:45:37.165129027 +0000 2022-04-03T21:48:53.012 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2022-04-03 21:45:37.165129027 +0000 2022-04-03T21:48:53.012 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2022-04-03T21:48:53.020 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2022-04-03T21:48:53.021 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2022-04-03T21:48:53.021 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000174804 s, 2.9 MB/s 2022-04-03T21:48:53.023 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-04-03T21:48:53.023 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-04-03T21:48:53.023 INFO:tasks.ceph:Generating config... 2022-04-03T21:48:53.025 INFO:tasks.ceph:[client] client mount timeout = 600 2022-04-03T21:48:53.025 INFO:tasks.ceph:[client] debug client = 20 2022-04-03T21:48:53.025 INFO:tasks.ceph:[client] debug ms = 1 2022-04-03T21:48:53.026 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-04-03T21:48:53.026 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-04-03T21:48:53.026 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-04-03T21:48:53.027 INFO:tasks.ceph:[mds] debug mds = 20 2022-04-03T21:48:53.027 INFO:tasks.ceph:[mds] debug ms = 1 2022-04-03T21:48:53.027 INFO:tasks.ceph:[mds] mds debug frag = True 2022-04-03T21:48:53.027 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-04-03T21:48:53.028 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-04-03T21:48:53.028 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-04-03T21:48:53.028 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-04-03T21:48:53.029 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-04-03T21:48:53.029 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-04-03T21:48:53.029 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-04-03T21:48:53.029 INFO:tasks.ceph:[mgr] debug ms = 1 2022-04-03T21:48:53.030 INFO:tasks.ceph:[mon] debug mon = 20 2022-04-03T21:48:53.030 INFO:tasks.ceph:[mon] debug ms = 1 2022-04-03T21:48:53.030 INFO:tasks.ceph:[mon] debug paxos = 20 2022-04-03T21:48:53.030 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-04-03T21:48:53.031 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-04-03T21:48:53.031 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-04-03T21:48:53.032 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-04-03T21:48:53.032 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-04-03T21:48:53.032 INFO:tasks.ceph:[osd] debug ms = 1 2022-04-03T21:48:53.033 INFO:tasks.ceph:[osd] debug osd = 20 2022-04-03T21:48:53.033 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-04-03T21:48:53.033 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-04-03T21:48:53.033 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-04-03T21:48:53.034 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-04-03T21:48:53.034 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-04-03T21:48:53.034 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-04-03T21:48:53.035 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-04-03T21:48:53.035 INFO:tasks.ceph:Setting up mon.a... 2022-04-03T21:48:53.035 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-04-03T21:48:53.165 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2022-04-03T21:48:53.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-04-03T21:48:53.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-03T21:48:53.375 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2022-04-03T21:48:53.376 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-04-03T21:48:53.377 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:53.377 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-04-03T21:48:53.433 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:48:53.668 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:48:53.669 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid e8e9dd61-1110-4fac-b12e-1468add78161 2022-04-03T21:48:53.669 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = octopus 2022-04-03T21:48:53.669 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2022-04-03T21:48:53.669 INFO:teuthology.orchestra.run.smithi049.stdout:fsid e8e9dd61-1110-4fac-b12e-1468add78161 2022-04-03T21:48:53.669 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2022-04-03T21:48:53.667299+0000 2022-04-03T21:48:53.670 INFO:teuthology.orchestra.run.smithi049.stdout:created 2022-04-03T21:48:53.667299+0000 2022-04-03T21:48:53.670 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 15 (octopus) 2022-04-03T21:48:53.670 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2022-04-03T21:48:53.670 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2022-04-03T21:48:53.671 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2022-04-03T21:48:53.671 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2022-04-03T21:48:53.671 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-04-03T21:48:53.673 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-04-03T21:48:53.728 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e8e9dd61-1110-4fac-b12e-1468add78161... 2022-04-03T21:48:53.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-04-03T21:48:53.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-04-03T21:48:53.785 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2022-04-03T21:48:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2022-04-03T21:48:53.785 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-04-03T21:48:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2022-04-03T21:48:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2022-04-03T21:48:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.786 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2022-04-03T21:48:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2022-04-03T21:48:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2022-04-03T21:48:53.787 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2022-04-03T21:48:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2022-04-03T21:48:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2022-04-03T21:48:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2022-04-03T21:48:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2022-04-03T21:48:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2022-04-03T21:48:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2022-04-03T21:48:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2022-04-03T21:48:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2022-04-03T21:48:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2022-04-03T21:48:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2022-04-03T21:48:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2022-04-03T21:48:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2022-04-03T21:48:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2022-04-03T21:48:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-04-03T21:48:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2022-04-03T21:48:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2022-04-03T21:48:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-04-03T21:48:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2022-04-03T21:48:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.793 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2022-04-03T21:48:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2022-04-03T21:48:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2022-04-03T21:48:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2022-04-03T21:48:53.794 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.49,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2022-04-03T21:48:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2022-04-03T21:48:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = e8e9dd61-1110-4fac-b12e-1468add78161 2022-04-03T21:48:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.795 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2022-04-03T21:48:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2022-04-03T21:48:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2022-04-03T21:48:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2022-04-03T21:48:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2022-04-03T21:48:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2022-04-03T21:48:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2022-04-03T21:48:53.797 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2022-04-03T21:48:53.798 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2022-04-03T21:48:53.798 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.798 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2022-04-03T21:48:53.798 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2022-04-03T21:48:53.799 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.799 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2022-04-03T21:48:53.799 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.799 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2022-04-03T21:48:53.799 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2022-04-03T21:48:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2022-04-03T21:48:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2022-04-03T21:48:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2022-04-03T21:48:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2022-04-03T21:48:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2022-04-03T21:48:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2022-04-03T21:48:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2022-04-03T21:48:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2022-04-03T21:48:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2022-04-03T21:48:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2022-04-03T21:48:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2022-04-03T21:48:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2022-04-03T21:48:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2022-04-03T21:48:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2022-04-03T21:48:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2022-04-03T21:48:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2022-04-03T21:48:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2022-04-03T21:48:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.804 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2022-04-03T21:48:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2022-04-03T21:48:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2022-04-03T21:48:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2022-04-03T21:48:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2022-04-03T21:48:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2022-04-03T21:48:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2022-04-03T21:48:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2022-04-03T21:48:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.806 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2022-04-03T21:48:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2022-04-03T21:48:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2022-04-03T21:48:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2022-04-03T21:48:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2022-04-03T21:48:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2022-04-03T21:48:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2022-04-03T21:48:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2022-04-03T21:48:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2022-04-03T21:48:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2022-04-03T21:48:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2022-04-03T21:48:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-04-03T21:48:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2022-04-03T21:48:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2022-04-03T21:48:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2022-04-03T21:48:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-04-03T21:48:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-04-03T21:48:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2022-04-03T21:48:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2022-04-03T21:48:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2022-04-03T21:48:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2022-04-03T21:48:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: 2022-04-03T21:48:53.812 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2022-04-03T21:48:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2022-04-03T21:48:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2022-04-03T21:48:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2022-04-03T21:48:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-04-03T21:48:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-04-03T21:48:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2022-04-03T21:48:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2022-04-03T21:48:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2022-04-03T21:48:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2022-04-03T21:48:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2022-04-03T21:48:53.814 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2022-04-03T21:48:53.814 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2022-04-03T21:48:53.815 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2022-04-03T21:48:53.815 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2022-04-03T21:48:53.815 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2022-04-03T21:48:53.815 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2022-04-03T21:48:53.816 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2022-04-03T21:48:53.816 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2022-04-03T21:48:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2022-04-03T21:48:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2022-04-03T21:48:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2022-04-03T21:48:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2022-04-03T21:48:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2022-04-03T21:48:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2022-04-03T21:48:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2022-04-03T21:48:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2022-04-03T21:48:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2022-04-03T21:48:53.875 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2022-04-03T21:48:53.875 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2022-04-03T21:48:53.875 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-04-03T21:48:53.875 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2022-04-03T21:48:53.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.876 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2022-04-03T21:48:53.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.876 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2022-04-03T21:48:53.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.877 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2022-04-03T21:48:53.877 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2022-04-03T21:48:53.877 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.877 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2022-04-03T21:48:53.878 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2022-04-03T21:48:53.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.878 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2022-04-03T21:48:53.878 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2022-04-03T21:48:53.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.879 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2022-04-03T21:48:53.879 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2022-04-03T21:48:53.879 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.879 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2022-04-03T21:48:53.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.880 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2022-04-03T21:48:53.880 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2022-04-03T21:48:53.880 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2022-04-03T21:48:53.880 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2022-04-03T21:48:53.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2022-04-03T21:48:53.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2022-04-03T21:48:53.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2022-04-03T21:48:53.881 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-04-03T21:48:53.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2022-04-03T21:48:53.882 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2022-04-03T21:48:53.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.882 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-04-03T21:48:53.882 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.883 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2022-04-03T21:48:53.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.883 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2022-04-03T21:48:53.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.884 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2022-04-03T21:48:53.884 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2022-04-03T21:48:53.884 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2022-04-03T21:48:53.884 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2022-04-03T21:48:53.884 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2022-04-03T21:48:53.885 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = e8e9dd61-1110-4fac-b12e-1468add78161 2022-04-03T21:48:53.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.885 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2022-04-03T21:48:53.885 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2022-04-03T21:48:53.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.886 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2022-04-03T21:48:53.886 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2022-04-03T21:48:53.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.886 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2022-04-03T21:48:53.887 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2022-04-03T21:48:53.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.887 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2022-04-03T21:48:53.887 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2022-04-03T21:48:53.887 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2022-04-03T21:48:53.888 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.888 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2022-04-03T21:48:53.888 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2022-04-03T21:48:53.888 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.889 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2022-04-03T21:48:53.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.889 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2022-04-03T21:48:53.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.889 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2022-04-03T21:48:53.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.890 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2022-04-03T21:48:53.890 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2022-04-03T21:48:53.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.891 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2022-04-03T21:48:53.891 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2022-04-03T21:48:53.891 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2022-04-03T21:48:53.891 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2022-04-03T21:48:53.891 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2022-04-03T21:48:53.892 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2022-04-03T21:48:53.892 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2022-04-03T21:48:53.892 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2022-04-03T21:48:53.892 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2022-04-03T21:48:53.892 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2022-04-03T21:48:53.893 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2022-04-03T21:48:53.893 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2022-04-03T21:48:53.893 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2022-04-03T21:48:53.893 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2022-04-03T21:48:53.894 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2022-04-03T21:48:53.894 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.894 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2022-04-03T21:48:53.894 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2022-04-03T21:48:53.894 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2022-04-03T21:48:53.895 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2022-04-03T21:48:53.895 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2022-04-03T21:48:53.895 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2022-04-03T21:48:53.895 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2022-04-03T21:48:53.895 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2022-04-03T21:48:53.896 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.896 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2022-04-03T21:48:53.896 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2022-04-03T21:48:53.896 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2022-04-03T21:48:53.897 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2022-04-03T21:48:53.897 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2022-04-03T21:48:53.897 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2022-04-03T21:48:53.897 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2022-04-03T21:48:53.897 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2022-04-03T21:48:53.898 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2022-04-03T21:48:53.898 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2022-04-03T21:48:53.898 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2022-04-03T21:48:53.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.899 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-04-03T21:48:53.899 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2022-04-03T21:48:53.899 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2022-04-03T21:48:53.899 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.899 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2022-04-03T21:48:53.900 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-04-03T21:48:53.900 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-04-03T21:48:53.900 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.900 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2022-04-03T21:48:53.900 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2022-04-03T21:48:53.901 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.901 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2022-04-03T21:48:53.901 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2022-04-03T21:48:53.901 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:48:53.902 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2022-04-03T21:48:53.902 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2022-04-03T21:48:53.902 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2022-04-03T21:48:53.902 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2022-04-03T21:48:53.902 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-04-03T21:48:53.903 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-04-03T21:48:53.903 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2022-04-03T21:48:53.903 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2022-04-03T21:48:53.903 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2022-04-03T21:48:53.903 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2022-04-03T21:48:53.904 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2022-04-03T21:48:53.904 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2022-04-03T21:48:53.904 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2022-04-03T21:48:53.904 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2022-04-03T21:48:53.904 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2022-04-03T21:48:53.905 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2022-04-03T21:48:53.905 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2022-04-03T21:48:53.905 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2022-04-03T21:48:53.905 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2022-04-03T21:48:53.905 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2022-04-03T21:48:53.906 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2022-04-03T21:48:53.906 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2022-04-03T21:48:53.906 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2022-04-03T21:48:53.906 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2022-04-03T21:48:53.907 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2022-04-03T21:48:53.907 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2022-04-03T21:48:53.907 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2022-04-03T21:48:53.907 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2022-04-03T21:48:53.911 INFO:tasks.ceph:Creating admin key on mon.a... 2022-04-03T21:48:53.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-04-03T21:48:54.043 INFO:tasks.ceph:Copying monmap to all nodes... 2022-04-03T21:48:54.043 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:54.044 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-04-03T21:48:54.101 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:54.101 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-04-03T21:48:54.157 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:48:54.157 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:54.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2022-04-03T21:48:54.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-03T21:48:54.275 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:48:54.276 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:48:54.332 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2022-04-03T21:48:54.332 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:54.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2022-04-03T21:48:54.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-03T21:48:54.375 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:48:54.375 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:48:54.433 INFO:tasks.ceph:Setting up mon nodes... 2022-04-03T21:48:54.434 INFO:tasks.ceph:Setting up mgr nodes... 2022-04-03T21:48:54.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-04-03T21:48:54.584 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-04-03T21:48:54.593 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-04-03T21:48:54.679 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-04-03T21:48:54.681 INFO:tasks.ceph:Setting up mds nodes... 2022-04-03T21:48:54.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-04-03T21:48:54.823 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-04-03T21:48:54.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-04-03T21:48:54.918 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-04-03T21:48:55.057 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-04-03T21:48:55.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-04-03T21:48:55.169 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-04-03T21:48:55.230 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-04-03T21:48:55.232 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-04-03T21:48:55.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-04-03T21:48:55.369 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-04-03T21:48:55.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-04-03T21:48:55.402 INFO:tasks.ceph_client:Setting up client nodes... 2022-04-03T21:48:55.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-04-03T21:48:55.537 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-04-03T21:48:55.574 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-04-03T21:48:55.575 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-04-03T21:48:55.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-04-03T21:48:55.684 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-03T21:48:55.685 INFO:tasks.ceph:role: osd.0 2022-04-03T21:48:55.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:48:55.686 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-04-03T21:48:55.784 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:48:55.785 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:48:55.785 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:48:55.785 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:48:55.785 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:48:55.785 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:48:55.786 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:48:55.786 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:48:55.786 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:48:55.787 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:48:55.808 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2022-04-03T21:48:55.817 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2022-04-03T21:48:55.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-04-03T21:48:55.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-04-03T21:48:56.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-04-03T21:48:56.141 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-03T21:48:56.141 INFO:tasks.ceph:role: osd.1 2022-04-03T21:48:56.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:48:56.142 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-04-03T21:48:56.226 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:48:56.227 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:48:56.227 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:48:56.227 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:48:56.228 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:48:56.228 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:48:56.228 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:48:56.228 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:48:56.228 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:48:56.229 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:48:56.251 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2022-04-03T21:48:56.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2022-04-03T21:48:56.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-04-03T21:48:56.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-04-03T21:48:56.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-04-03T21:48:56.559 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-03T21:48:56.559 INFO:tasks.ceph:role: osd.2 2022-04-03T21:48:56.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:48:56.560 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-04-03T21:48:56.646 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:48:56.646 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:48:56.646 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:48:56.647 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:48:56.647 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:48:56.647 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:48:56.647 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:48:56.648 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:48:56.648 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:48:56.648 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:48:56.670 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2022-04-03T21:48:56.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2022-04-03T21:48:56.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-04-03T21:48:56.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-04-03T21:48:56.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-04-03T21:48:56.965 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-03T21:48:56.966 INFO:tasks.ceph:role: osd.3 2022-04-03T21:48:56.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:48:56.966 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-04-03T21:48:57.048 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:48:57.049 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:48:57.049 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:48:57.049 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:48:57.049 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:48:57.049 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:48:57.050 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:48:57.050 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:48:57.050 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:48:57.050 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:48:57.072 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2022-04-03T21:48:57.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2022-04-03T21:48:57.078 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-04-03T21:48:57.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-04-03T21:48:57.281 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:48:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:48:57.425+0000 7f92021e63c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-04-03T21:48:57.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:48:57.425+0000 7f92021e63c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-04-03T21:48:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:48:57.425+0000 7f92021e63c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-04-03T21:48:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:48:57.426+0000 7f92021e63c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-04-03T21:48:57.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:48:57.426+0000 7f92021e63c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-04-03T21:48:57.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:48:57.428+0000 7f92021e63c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-04-03T21:49:00.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-04-03T21:49:00.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:01.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:01.093+0000 7fb47753f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-04-03T21:49:01.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:01.093+0000 7fb47753f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-04-03T21:49:01.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:01.093+0000 7fb47753f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-04-03T21:49:01.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:01.093+0000 7fb47753f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-04-03T21:49:01.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:01.093+0000 7fb47753f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-04-03T21:49:01.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:01.095+0000 7fb47753f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-04-03T21:49:04.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-04-03T21:49:04.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:04.719+0000 7f006d9db3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-04-03T21:49:04.722 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:04.719+0000 7f006d9db3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-04-03T21:49:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:04.719+0000 7f006d9db3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-04-03T21:49:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:04.719+0000 7f006d9db3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-04-03T21:49:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:04.719+0000 7f006d9db3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-04-03T21:49:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:04.721+0000 7f006d9db3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-04-03T21:49:08.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-04-03T21:49:08.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:08.364 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:08.362+0000 7f8b16d243c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-04-03T21:49:08.365 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:08.363+0000 7f8b16d243c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-04-03T21:49:08.365 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:08.363+0000 7f8b16d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-04-03T21:49:08.365 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:08.363+0000 7f8b16d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-04-03T21:49:08.366 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:08.363+0000 7f8b16d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-04-03T21:49:08.366 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:08.364+0000 7f8b16d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-04-03T21:49:11.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-04-03T21:49:11.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-04-03T21:49:11.898 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-04-03T21:49:11.898 INFO:tasks.ceph:role: osd.4 2022-04-03T21:49:11.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2022-04-03T21:49:11.899 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-04-03T21:49:11.975 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:49:11.975 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:49:11.976 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:49:11.976 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:49:11.976 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:49:11.976 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:49:11.977 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:49:11.977 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:49:11.977 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:49:11.977 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:49:12.407 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2022-04-03T21:49:12.409 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2022-04-03T21:49:12.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-04-03T21:49:12.607 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-04-03T21:49:12.646 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-04-03T21:49:12.715 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-04-03T21:49:12.715 INFO:tasks.ceph:role: osd.5 2022-04-03T21:49:12.716 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2022-04-03T21:49:12.716 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-04-03T21:49:12.791 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:49:12.791 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:49:12.791 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:49:12.791 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:49:12.792 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:49:12.792 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:49:12.792 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:49:12.792 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:49:12.793 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:49:12.793 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:49:13.202 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2022-04-03T21:49:13.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2022-04-03T21:49:13.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-04-03T21:49:13.313 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-04-03T21:49:13.345 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-04-03T21:49:13.411 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-04-03T21:49:13.412 INFO:tasks.ceph:role: osd.6 2022-04-03T21:49:13.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2022-04-03T21:49:13.413 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-04-03T21:49:13.487 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:49:13.488 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:49:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:49:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:49:13.489 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:49:13.489 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:49:13.490 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:49:13.490 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:49:13.490 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:49:13.490 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:49:13.938 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2022-04-03T21:49:13.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2022-04-03T21:49:13.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-04-03T21:49:14.125 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-04-03T21:49:14.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-04-03T21:49:14.229 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-04-03T21:49:14.229 INFO:tasks.ceph:role: osd.7 2022-04-03T21:49:14.230 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2022-04-03T21:49:14.230 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-04-03T21:49:14.305 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-04-03T21:49:14.306 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-03T21:49:14.306 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-03T21:49:14.306 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-03T21:49:14.306 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-03T21:49:14.307 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2022-04-03T21:49:14.307 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-03T21:49:14.307 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-03T21:49:14.307 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-03T21:49:14.308 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-03T21:49:14.741 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2022-04-03T21:49:14.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2022-04-03T21:49:14.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-04-03T21:49:14.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-04-03T21:49:14.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:15.041 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:15.038+0000 7f3a3b9943c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-04-03T21:49:15.041 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:15.038+0000 7f3a3b9943c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-04-03T21:49:15.041 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:15.038+0000 7f3a3b9943c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-04-03T21:49:15.042 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:15.038+0000 7f3a3b9943c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-04-03T21:49:15.042 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:15.038+0000 7f3a3b9943c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-04-03T21:49:15.042 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:15.039+0000 7f3a3b9943c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-04-03T21:49:17.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-04-03T21:49:17.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:18.029 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:18.024+0000 7f709d2213c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-04-03T21:49:18.029 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:18.025+0000 7f709d2213c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-04-03T21:49:18.029 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:18.025+0000 7f709d2213c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-04-03T21:49:18.030 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:18.025+0000 7f709d2213c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-04-03T21:49:18.030 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:18.025+0000 7f709d2213c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-04-03T21:49:18.031 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:18.025+0000 7f709d2213c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-04-03T21:49:20.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-04-03T21:49:20.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:21.045 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:21.042+0000 7f07e4c243c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-04-03T21:49:21.046 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:21.042+0000 7f07e4c243c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-04-03T21:49:21.046 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:21.042+0000 7f07e4c243c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-04-03T21:49:21.046 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:21.042+0000 7f07e4c243c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-04-03T21:49:21.046 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:21.042+0000 7f07e4c243c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-04-03T21:49:21.047 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:21.043+0000 7f07e4c243c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-04-03T21:49:22.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:49:22.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:49:23.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-04-03T21:49:23.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:24.032 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:24.029+0000 7f08e92f93c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-04-03T21:49:24.032 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:24.029+0000 7f08e92f93c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-04-03T21:49:24.032 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:24.029+0000 7f08e92f93c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-04-03T21:49:24.033 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:24.029+0000 7f08e92f93c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-04-03T21:49:24.033 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:24.029+0000 7f08e92f93c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-04-03T21:49:24.033 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:24.030+0000 7f08e92f93c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-04-03T21:49:26.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-04-03T21:49:26.915 INFO:tasks.ceph:Reading keys from all nodes... 2022-04-03T21:49:26.916 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:26.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-04-03T21:49:27.003 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-04-03T21:49:27.086 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-04-03T21:49:27.168 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-04-03T21:49:27.250 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-04-03T21:49:27.331 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-04-03T21:49:27.413 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-04-03T21:49:27.494 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-04-03T21:49:27.526 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-04-03T21:49:27.596 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-04-03T21:49:27.666 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-04-03T21:49:27.735 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-04-03T21:49:27.803 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-04-03T21:49:27.870 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:27.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-04-03T21:49:27.936 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:27.937 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-04-03T21:49:27.992 INFO:tasks.ceph:Adding keys to all mons... 2022-04-03T21:49:27.992 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2022-04-03T21:49:27.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2022-04-03T21:49:28.021 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2022-04-03T21:49:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGFkpiypu+IhAAqnI7C0Z1GX52VbThxIOaEg== 2022-04-03T21:49:28.022 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2022-04-03T21:49:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGFkpis3YGMRAAOxY/H6Dos7hBysPvyNgfRw== 2022-04-03T21:49:28.023 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2022-04-03T21:49:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBHFkpiyJpdAxAACCoZDVwewWjFGc7Q2Jwfog== 2022-04-03T21:49:28.023 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2022-04-03T21:49:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBJFkpiUMZtGRAA/bhcDSzSin0nY5yuEqR5sQ== 2022-04-03T21:49:28.023 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2022-04-03T21:49:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBNFkpi56yhBRAApV74ueyqAjzMi/BHVtHf0g== 2022-04-03T21:49:28.024 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2022-04-03T21:49:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBQFkpihlnzKhAAAhHMdIRbQhr+v456RdaLiw== 2022-04-03T21:49:28.024 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2022-04-03T21:49:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBUFkpiJ8ukFRAAJ2+FrcFhJtBR7CSS0l2voA== 2022-04-03T21:49:28.025 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2022-04-03T21:49:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBGFkpiGGFrKBAASPcOx933utW9m+MsHNyiFQ== 2022-04-03T21:49:28.025 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2022-04-03T21:49:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBHFkpiaMOlDRAA4/vQFn+tIa6eVy6OxOJsvg== 2022-04-03T21:49:28.025 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2022-04-03T21:49:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBHFkpivqrtFRAAxv3Yzg219efHUW2MQUutgg== 2022-04-03T21:49:28.026 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2022-04-03T21:49:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBbFkpi/BRcAhAAP0xHqeQSX+td6r3O9lk7sQ== 2022-04-03T21:49:28.026 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2022-04-03T21:49:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBeFkpiTfeOARAA7+yjTvrJUHpWQiiIaW0fPg== 2022-04-03T21:49:28.027 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2022-04-03T21:49:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBhFkpiB9CdAhAAkO5wWxHMVJroo5P/34ugnA== 2022-04-03T21:49:28.027 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2022-04-03T21:49:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBkFkpiu+jSARAAe2M7c2U/YZ1Yo6YPYUATbg== 2022-04-03T21:49:28.027 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2022-04-03T21:49:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBHFkpi8svyHxAAU9FEygpObHRz/OEp+/3seg== 2022-04-03T21:49:28.069 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2022-04-03T21:49:28.069 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBGFkpiypu+IhAAqnI7C0Z1GX52VbThxIOaEg== 2022-04-03T21:49:28.070 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2022-04-03T21:49:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBGFkpis3YGMRAAOxY/H6Dos7hBysPvyNgfRw== 2022-04-03T21:49:28.070 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2022-04-03T21:49:28.070 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBHFkpiyJpdAxAACCoZDVwewWjFGc7Q2Jwfog== 2022-04-03T21:49:28.071 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2022-04-03T21:49:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBJFkpiUMZtGRAA/bhcDSzSin0nY5yuEqR5sQ== 2022-04-03T21:49:28.071 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2022-04-03T21:49:28.071 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBNFkpi56yhBRAApV74ueyqAjzMi/BHVtHf0g== 2022-04-03T21:49:28.071 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2022-04-03T21:49:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBQFkpihlnzKhAAAhHMdIRbQhr+v456RdaLiw== 2022-04-03T21:49:28.072 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2022-04-03T21:49:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBUFkpiJ8ukFRAAJ2+FrcFhJtBR7CSS0l2voA== 2022-04-03T21:49:28.072 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2022-04-03T21:49:28.072 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBGFkpiGGFrKBAASPcOx933utW9m+MsHNyiFQ== 2022-04-03T21:49:28.073 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2022-04-03T21:49:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBHFkpiaMOlDRAA4/vQFn+tIa6eVy6OxOJsvg== 2022-04-03T21:49:28.073 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2022-04-03T21:49:28.073 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBHFkpivqrtFRAAxv3Yzg219efHUW2MQUutgg== 2022-04-03T21:49:28.073 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2022-04-03T21:49:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBbFkpi/BRcAhAAP0xHqeQSX+td6r3O9lk7sQ== 2022-04-03T21:49:28.074 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2022-04-03T21:49:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBeFkpiTfeOARAA7+yjTvrJUHpWQiiIaW0fPg== 2022-04-03T21:49:28.074 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2022-04-03T21:49:28.074 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBhFkpiB9CdAhAAkO5wWxHMVJroo5P/34ugnA== 2022-04-03T21:49:28.075 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2022-04-03T21:49:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBkFkpiu+jSARAAe2M7c2U/YZ1Yo6YPYUATbg== 2022-04-03T21:49:28.075 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2022-04-03T21:49:28.075 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBHFkpi8svyHxAAU9FEygpObHRz/OEp+/3seg== 2022-04-03T21:49:28.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-04-03T21:49:28.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-04-03T21:49:28.197 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:28.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:28.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:28.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:28.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.687 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:28.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-04-03T21:49:28.933 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-04-03T21:49:29.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:29.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:29.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:29.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-03T21:49:29.300 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.426 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-03T21:49:29.784 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-04-03T21:49:29.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-04-03T21:49:29.908 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-04-03T21:49:29.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-04-03T21:49:29.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-04-03T21:49:30.130 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-04-03T21:49:30.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-04-03T21:49:30.239 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-04-03T21:49:30.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-04-03T21:49:30.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-04-03T21:49:30.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-04-03T21:49:30.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-04-03T21:49:30.544 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:30.549 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-04-03T21:49:30.601 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-04-03T21:49:30.601 INFO:tasks.ceph.mon.a:Restarting daemon 2022-04-03T21:49:30.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-04-03T21:49:30.606 INFO:tasks.ceph.mon.a:Started 2022-04-03T21:49:30.606 INFO:tasks.ceph.mon.b:Restarting daemon 2022-04-03T21:49:30.607 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-04-03T21:49:30.643 INFO:tasks.ceph.mon.b:Started 2022-04-03T21:49:30.644 INFO:tasks.ceph.mon.c:Restarting daemon 2022-04-03T21:49:30.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-04-03T21:49:30.646 INFO:tasks.ceph.mon.c:Started 2022-04-03T21:49:30.647 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-04-03T21:49:30.647 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-04-03T21:49:30.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-04-03T21:49:30.652 INFO:tasks.ceph.mgr.y:Started 2022-04-03T21:49:30.652 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-04-03T21:49:30.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-04-03T21:49:30.655 INFO:tasks.ceph.mgr.x:Started 2022-04-03T21:49:30.655 INFO:tasks.ceph:Setting crush tunables to default 2022-04-03T21:49:30.656 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2022-04-03T21:49:30.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.880+0000 7f1761084700 1 Processor -- start 2022-04-03T21:49:30.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.880+0000 7f1761084700 1 -- start start 2022-04-03T21:49:30.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f1761084700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f175c0bd650 0x7f175c14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:30.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f1761084700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f175c14f050 0x7f175c0a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:30.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f1761084700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0a2030 con 0x7f175c069080 2022-04-03T21:49:30.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f1761084700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0bda20 con 0x7f175c14f050 2022-04-03T21:49:30.888 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f1761084700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0a4170 con 0x7f175c0bd650 2022-04-03T21:49:30.888 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f175ad9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f175c0bd650 0x7f175c14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:30.888 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f175a59c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f175c069080 0x7f175c0a3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47352/0 (socket says 172.21.15.49:47352) 2022-04-03T21:49:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f175a59c700 1 -- 172.21.15.49:0/2763104828 learned_addr learned my addr 172.21.15.49:0/2763104828 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.881+0000 7f175b59e700 1 --2- 172.21.15.49:0/2763104828 >> v2:172.21.15.49:3300/0 conn(0x7f175c14f050 0x7f175c0a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f175ad9d700 1 -- 172.21.15.49:0/2763104828 >> v2:172.21.15.49:3300/0 conn(0x7f175c14f050 msgr2=0x7f175c0a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f175ad9d700 1 --2- 172.21.15.49:0/2763104828 >> v2:172.21.15.49:3300/0 conn(0x7f175c14f050 0x7f175c0a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f175ad9d700 1 -- 172.21.15.49:0/2763104828 >> v1:172.21.15.117:6789/0 conn(0x7f175c069080 legacy=0x7f175c0a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:30.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f1759d9b700 1 -- 172.21.15.49:0/2763104828 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612482538 0 0) 0x7f175c0a2030 con 0x7f175c069080 2022-04-03T21:49:30.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f175ad9d700 1 -- 172.21.15.49:0/2763104828 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c14f4b0 con 0x7f175c0bd650 2022-04-03T21:49:30.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f175ad9d700 1 --2- 172.21.15.49:0/2763104828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c0bd650 0x7f175c14eb10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f175c087650 tx=0x7f174c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=328e8d320f761d9c server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:30.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f1759d9b700 1 -- 172.21.15.49:0/2763104828 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011630 con 0x7f175c0bd650 2022-04-03T21:49:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f1759d9b700 1 -- 172.21.15.49:0/2763104828 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c011790 con 0x7f175c0bd650 2022-04-03T21:49:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.882+0000 7f1759d9b700 1 -- 172.21.15.49:0/2763104828 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011b50 con 0x7f175c0bd650 2022-04-03T21:49:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 -- 172.21.15.49:0/2763104828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c0bd650 msgr2=0x7f175c14eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 --2- 172.21.15.49:0/2763104828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c0bd650 0x7f175c14eb10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f175c087650 tx=0x7f174c009060 comp rx=0 tx=0).stop 2022-04-03T21:49:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 -- 172.21.15.49:0/2763104828 shutdown_connections 2022-04-03T21:49:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 --2- 172.21.15.49:0/2763104828 >> v2:172.21.15.49:3300/0 conn(0x7f175c14f050 0x7f175c0a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 --2- 172.21.15.49:0/2763104828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c0bd650 0x7f175c14eb10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 -- 172.21.15.49:0/2763104828 >> 172.21.15.49:0/2763104828 conn(0x7f175c0c1680 msgr2=0x7f175c0c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 -- 172.21.15.49:0/2763104828 shutdown_connections 2022-04-03T21:49:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.883+0000 7f1761084700 1 -- 172.21.15.49:0/2763104828 wait complete. 2022-04-03T21:49:30.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.885+0000 7f1761084700 1 Processor -- start 2022-04-03T21:49:30.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.885+0000 7f1761084700 1 -- start start 2022-04-03T21:49:30.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f1761084700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c069080 0x7f175c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:30.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f1761084700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 0x7f175c14aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:30.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f1761084700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c14f050 0x7f175c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:30.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f1761084700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c15f030 con 0x7f175c069080 2022-04-03T21:49:30.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f1761084700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0a53e0 con 0x7f175c14f050 2022-04-03T21:49:30.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f1761084700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0b5650 con 0x7f175c0bd650 2022-04-03T21:49:30.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175a59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 0x7f175c14aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:30.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175b59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c14f050 0x7f175c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:30.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175a59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 0x7f175c14aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45642/0 (socket says 172.21.15.49:45642) 2022-04-03T21:49:30.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175a59c700 1 -- 172.21.15.49:0/1138927870 learned_addr learned my addr 172.21.15.49:0/1138927870 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:30.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175ad9d700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c069080 0x7f175c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:30.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175b59e700 1 -- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 msgr2=0x7f175c14aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:30.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175b59e700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 0x7f175c14aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175b59e700 1 -- 172.21.15.49:0/1138927870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c069080 msgr2=0x7f175c14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:30.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175b59e700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c069080 0x7f175c14a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175b59e700 1 -- 172.21.15.49:0/1138927870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0092a0 con 0x7f175c14f050 2022-04-03T21:49:30.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.886+0000 7f175a59c700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 0x7f175c14aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:30.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f175b59e700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c14f050 0x7f175c15e3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1754007e70 tx=0x7f17540097b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:30.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754018070 con 0x7f175c14f050 2022-04-03T21:49:30.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400eac0 con 0x7f175c14f050 2022-04-03T21:49:30.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c0b5930 con 0x7f175c14f050 2022-04-03T21:49:30.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400ee60 con 0x7f175c14f050 2022-04-03T21:49:30.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c0a76c0 con 0x7f175c14f050 2022-04-03T21:49:30.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.887+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1754012050 con 0x7f175c14f050 2022-04-03T21:49:30.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.888+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1754004020 con 0x7f175c14f050 2022-04-03T21:49:30.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.889+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c066ae0 con 0x7f175c14f050 2022-04-03T21:49:30.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.891+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f1754003cf0 con 0x7f175c14f050 2022-04-03T21:49:30.972 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.970+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f175c070a20 con 0x7f175c14f050 2022-04-03T21:49:30.975 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.973+0000 7f1742ffd700 1 -- 172.21.15.49:0/1138927870 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1754027490 con 0x7f175c14f050 2022-04-03T21:49:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.974+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c14f050 msgr2=0x7f175c15e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.974+0000 7f1761084700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c14f050 0x7f175c15e3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1754007e70 tx=0x7f17540097b0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.974+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 shutdown_connections 2022-04-03T21:49:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.974+0000 7f1761084700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f175c14f050 0x7f175c15e3d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.975+0000 7f1761084700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f175c069080 0x7f175c14a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.975+0000 7f1761084700 1 --2- 172.21.15.49:0/1138927870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f175c0bd650 0x7f175c14aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.975+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 >> 172.21.15.49:0/1138927870 conn(0x7f175c0c1680 msgr2=0x7f175c14cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.975+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 shutdown_connections 2022-04-03T21:49:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:30.975+0000 7f1761084700 1 -- 172.21.15.49:0/1138927870 wait complete. 2022-04-03T21:49:30.980 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2022-04-03T21:49:31.000 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-04-03T21:49:31.001 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:31.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-04-03T21:49:31.026 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.024+0000 7fa042299000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-04-03T21:49:31.084 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:31.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-04-03T21:49:31.106 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:31.104+0000 7ff9f6632000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-04-03T21:49:31.164 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.161+0000 7fa042299000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-04-03T21:49:31.166 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:31.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-04-03T21:49:31.229 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.227+0000 7fa042299000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-04-03T21:49:31.288 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:49:31.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-04-03T21:49:31.310 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:31.308+0000 7ff9f6632000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-04-03T21:49:31.370 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:31.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-04-03T21:49:31.396 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:31.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-04-03T21:49:31.409 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:31.407+0000 7ff9f6632000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-04-03T21:49:31.462 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:31.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-04-03T21:49:31.464 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.462+0000 7fa042299000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-04-03T21:49:31.489 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2022-04-03T21:49:31.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-04-03T21:49:31.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new d86d6bda-58f6-46b7-aa79-fb9547242948 0 2022-04-03T21:49:31.557 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.554+0000 7fa042299000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-04-03T21:49:31.672 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.669+0000 7efee0581700 1 Processor -- start 2022-04-03T21:49:31.672 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.669+0000 7efee0581700 1 -- start start 2022-04-03T21:49:31.675 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efee0581700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efed814b790 0x7efed806afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.676 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efee0581700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 0x7efed806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.676 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efee0581700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed814bf80 con 0x7efed80b1060 2022-04-03T21:49:31.676 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efee0581700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80ba3f0 con 0x7efed814b790 2022-04-03T21:49:31.676 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efee0581700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed814bca0 con 0x7efed80b8340 2022-04-03T21:49:31.677 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efedeb1e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 0x7efed806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.677 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efeddb1c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efed814b790 0x7efed806afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.677 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efeddb1c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efed814b790 0x7efed806afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54342/0 (socket says 172.21.15.117:54342) 2022-04-03T21:49:31.677 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efedeb1e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 0x7efed806c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48280/0 (socket says 172.21.15.117:48280) 2022-04-03T21:49:31.678 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.670+0000 7efeddb1c700 1 -- 172.21.15.117:0/638400316 learned_addr learned my addr 172.21.15.117:0/638400316 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:31.678 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efeddb1c700 1 -- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 msgr2=0x7efed806c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:31.678 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efeddb1c700 1 --2- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 0x7efed806c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.678 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efeddb1c700 1 -- 172.21.15.117:0/638400316 >> v1:172.21.15.117:6789/0 conn(0x7efed80b1060 legacy=0x7efed814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.679 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efeddb1c700 1 -- 172.21.15.117:0/638400316 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80b9da0 con 0x7efed814b790 2022-04-03T21:49:31.679 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efedeb1e700 1 --2- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 0x7efed806c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:31.679 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efeddb1c700 1 --2- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed814b790 0x7efed806afa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efec8006fd0 tx=0x7efec80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5daec74184a7d42 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:31.679 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efedd31b700 1 -- 172.21.15.117:0/638400316 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8004030 con 0x7efed814b790 2022-04-03T21:49:31.679 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efedd31b700 1 -- 172.21.15.117:0/638400316 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80041d0 con 0x7efed814b790 2022-04-03T21:49:31.680 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.671+0000 7efedd31b700 1 -- 172.21.15.117:0/638400316 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8011630 con 0x7efed814b790 2022-04-03T21:49:31.680 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 -- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed814b790 msgr2=0x7efed806afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.680 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 --2- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed814b790 0x7efed806afa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efec8006fd0 tx=0x7efec80090f0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.680 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 -- 172.21.15.117:0/638400316 shutdown_connections 2022-04-03T21:49:31.680 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 --2- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b8340 0x7efed806c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.681 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 --2- 172.21.15.117:0/638400316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed814b790 0x7efed806afa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.681 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 -- 172.21.15.117:0/638400316 >> 172.21.15.117:0/638400316 conn(0x7efed80bb000 msgr2=0x7efed8066ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:31.681 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 -- 172.21.15.117:0/638400316 shutdown_connections 2022-04-03T21:49:31.681 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.672+0000 7efee0581700 1 -- 172.21.15.117:0/638400316 wait complete. 2022-04-03T21:49:31.682 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.673+0000 7efee0581700 1 Processor -- start 2022-04-03T21:49:31.682 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.673+0000 7efee0581700 1 -- start start 2022-04-03T21:49:31.684 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.673+0000 7efee0581700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 0x7efed815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.685 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.673+0000 7efee0581700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 0x7efed80b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.685 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.673+0000 7efee0581700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efed814b790 0x7efed80b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.685 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efee0581700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80b1c10 con 0x7efed814b790 2022-04-03T21:49:31.685 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efee0581700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed814d5c0 con 0x7efed80b8340 2022-04-03T21:49:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efee0581700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a88f0 con 0x7efed80b1060 2022-04-03T21:49:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 0x7efed815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efeddb1c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 0x7efed80b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 0x7efed815b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48282/0 (socket says 172.21.15.117:48282) 2022-04-03T21:49:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efeddb1c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 0x7efed80b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54348/0 (socket says 172.21.15.117:54348) 2022-04-03T21:49:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 -- 172.21.15.117:0/1417646571 learned_addr learned my addr 172.21.15.117:0/1417646571 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 -- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 msgr2=0x7efed80b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efedeb1e700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efed814b790 0x7efed80b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 0x7efed80b6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 -- 172.21.15.117:0/1417646571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efed814b790 msgr2=0x7efed80b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efed814b790 0x7efed80b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 -- 172.21.15.117:0/1417646571 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009a20 con 0x7efed80b1060 2022-04-03T21:49:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efeddb1c700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 0x7efed80b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efede31d700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 0x7efed815b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efed400c440 tx=0x7efed4007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400ce40 con 0x7efed80b1060 2022-04-03T21:49:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed40050d0 con 0x7efed80b1060 2022-04-03T21:49:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec8009370 con 0x7efed80b1060 2022-04-03T21:49:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4011590 con 0x7efed80b1060 2022-04-03T21:49:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80a8e90 con 0x7efed80b1060 2022-04-03T21:49:31.690 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7efed4010050 con 0x7efed80b1060 2022-04-03T21:49:31.690 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.674+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7efed40066a0 con 0x7efed80b1060 2022-04-03T21:49:31.690 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.675+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed80b1ef0 con 0x7efed80b1060 2022-04-03T21:49:31.690 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.677+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7efed4017070 con 0x7efed80b1060 2022-04-03T21:49:31.725 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.723+0000 7fa042299000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-04-03T21:49:31.743 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:31.740+0000 7ff9f6632000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-04-03T21:49:31.760 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.757+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d86d6bda-58f6-46b7-aa79-fb9547242948", "id": 0} v 0) v1 -- 0x7efed806f170 con 0x7efed80b1060 2022-04-03T21:49:31.763 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.761+0000 7efec67fc700 1 -- 172.21.15.117:0/1417646571 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d86d6bda-58f6-46b7-aa79-fb9547242948", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7efed4011e30 con 0x7efed80b1060 2022-04-03T21:49:31.763 INFO:teuthology.orchestra.run.smithi117.stdout:0 2022-04-03T21:49:31.765 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 msgr2=0x7efed815b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.765 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 0x7efed815b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efed400c440 tx=0x7efed4007e00 comp rx=0 tx=0).stop 2022-04-03T21:49:31.765 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 shutdown_connections 2022-04-03T21:49:31.765 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efed814b790 0x7efed80b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.766 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efed80b1060 0x7efed815b9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.766 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 --2- 172.21.15.117:0/1417646571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efed80b8340 0x7efed80b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.766 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 >> 172.21.15.117:0/1417646571 conn(0x7efed80bb000 msgr2=0x7efed814ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:31.766 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 shutdown_connections 2022-04-03T21:49:31.767 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.762+0000 7efee0581700 1 -- 172.21.15.117:0/1417646571 wait complete. 2022-04-03T21:49:31.775 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 61b0ad4d-6f29-4e48-8334-5d0ab077123e 1 2022-04-03T21:49:31.793 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.791+0000 7fa042299000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-04-03T21:49:31.858 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:31.855+0000 7ff9f6632000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-04-03T21:49:31.894 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.891+0000 7fbab9ddd700 1 Processor -- start 2022-04-03T21:49:31.894 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.891+0000 7fbab9ddd700 1 -- start start 2022-04-03T21:49:31.897 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbab9ddd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.898 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbab9ddd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbab414e470 0x7fbab414e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.898 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbab9ddd700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab40a50a0 con 0x7fbab40c2360 2022-04-03T21:49:31.898 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbab9ddd700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab40a6750 con 0x7fbab414e470 2022-04-03T21:49:31.899 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbab9ddd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40a6a30 con 0x7fbab40c1f90 2022-04-03T21:49:31.899 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbaabfff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbab40c2360 0x7fbab40bd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:44842/0 (socket says 172.21.15.117:44842) 2022-04-03T21:49:31.899 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.900 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.892+0000 7fbaabfff700 1 -- 172.21.15.117:0/3319269322 learned_addr learned my addr 172.21.15.117:0/3319269322 (peer_addr_for_me v1:172.21.15.117:0/0) 2022-04-03T21:49:31.900 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab3fff700 1 --2- 172.21.15.117:0/3319269322 >> v2:172.21.15.49:3300/0 conn(0x7fbab414e470 0x7fbab414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.900 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab2ffd700 1 -- 172.21.15.117:0/3319269322 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394837982 0 0) 0x7fbab40a50a0 con 0x7fbab40c2360 2022-04-03T21:49:31.900 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab2ffd700 1 -- 172.21.15.117:0/3319269322 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba940033f0 con 0x7fbab40c2360 2022-04-03T21:49:31.900 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab37fe700 1 -- 172.21.15.117:0/3319269322 >> v2:172.21.15.49:3300/0 conn(0x7fbab414e470 msgr2=0x7fbab414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:31.901 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab37fe700 1 --2- 172.21.15.117:0/3319269322 >> v2:172.21.15.49:3300/0 conn(0x7fbab414e470 0x7fbab414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.901 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab37fe700 1 -- 172.21.15.117:0/3319269322 >> v1:172.21.15.117:6789/0 conn(0x7fbab40c2360 legacy=0x7fbab40bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.901 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab37fe700 1 -- 172.21.15.117:0/3319269322 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40a6d10 con 0x7fbab40c1f90 2022-04-03T21:49:31.901 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab37fe700 1 --2- 172.21.15.117:0/3319269322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40bbf90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009760 tx=0x7fbaa4009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2bf4224ca59c6b server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:31.901 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab2ffd700 1 -- 172.21.15.117:0/3319269322 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4011630 con 0x7fbab40c1f90 2022-04-03T21:49:31.902 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab2ffd700 1 -- 172.21.15.117:0/3319269322 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa4011790 con 0x7fbab40c1f90 2022-04-03T21:49:31.902 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.893+0000 7fbab2ffd700 1 -- 172.21.15.117:0/3319269322 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4011b50 con 0x7fbab40c1f90 2022-04-03T21:49:31.902 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 -- 172.21.15.117:0/3319269322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 msgr2=0x7fbab40bbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.902 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/3319269322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40bbf90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009760 tx=0x7fbaa4009060 comp rx=0 tx=0).stop 2022-04-03T21:49:31.903 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 -- 172.21.15.117:0/3319269322 shutdown_connections 2022-04-03T21:49:31.903 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/3319269322 >> v2:172.21.15.49:3300/0 conn(0x7fbab414e470 0x7fbab414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.903 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/3319269322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40bbf90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.903 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 -- 172.21.15.117:0/3319269322 >> 172.21.15.117:0/3319269322 conn(0x7fbab405e010 msgr2=0x7fbab40c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:31.903 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 -- 172.21.15.117:0/3319269322 shutdown_connections 2022-04-03T21:49:31.904 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.894+0000 7fbab9ddd700 1 -- 172.21.15.117:0/3319269322 wait complete. 2022-04-03T21:49:31.904 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 Processor -- start 2022-04-03T21:49:31.904 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 -- start start 2022-04-03T21:49:31.907 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.907 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 0x7fbab40b9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.908 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbab414e470 0x7fbab415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:31.908 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab415ec40 con 0x7fbab414e470 2022-04-03T21:49:31.908 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40bafc0 con 0x7fbab40c2360 2022-04-03T21:49:31.908 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab9ddd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40bba00 con 0x7fbab40c1f90 2022-04-03T21:49:31.908 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbaabfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 0x7fbab40b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.909 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.895+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.909 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaabfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 0x7fbab40b9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54360/0 (socket says 172.21.15.117:54360) 2022-04-03T21:49:31.909 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48294/0 (socket says 172.21.15.117:48294) 2022-04-03T21:49:31.909 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaabfff700 1 -- 172.21.15.117:0/4130523703 learned_addr learned my addr 172.21.15.117:0/4130523703 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:31.910 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab3fff700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbab414e470 0x7fbab415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:31.910 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 -- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 msgr2=0x7fbab40b9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.910 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 0x7fbab40b9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.910 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 -- 172.21.15.117:0/4130523703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbab414e470 msgr2=0x7fbab415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.910 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbab414e470 0x7fbab415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.911 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 -- 172.21.15.117:0/4130523703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40092a0 con 0x7fbab40c1f90 2022-04-03T21:49:31.911 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab3fff700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbab414e470 0x7fbab415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-03T21:49:31.911 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaabfff700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 0x7fbab40b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:31.911 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab37fe700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40aa5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4016000 tx=0x7fbaa4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:31.912 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4000bc0 con 0x7fbab40c1f90 2022-04-03T21:49:31.912 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa4011900 con 0x7fbab40c1f90 2022-04-03T21:49:31.912 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab415e960 con 0x7fbab40c1f90 2022-04-03T21:49:31.912 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4025420 con 0x7fbab40c1f90 2022-04-03T21:49:31.912 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab40a9880 con 0x7fbab40c1f90 2022-04-03T21:49:31.913 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fbaa402c030 con 0x7fbab40c1f90 2022-04-03T21:49:31.913 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.896+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fbaa402f800 con 0x7fbab40c1f90 2022-04-03T21:49:31.913 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.897+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab4070a20 con 0x7fbab40c1f90 2022-04-03T21:49:31.913 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.899+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fbaa402a070 con 0x7fbab40c1f90 2022-04-03T21:49:31.918 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.915+0000 7fa042299000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-04-03T21:49:31.983 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.981+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "61b0ad4d-6f29-4e48-8334-5d0ab077123e", "id": 1} v 0) v1 -- 0x7fbab40a59f0 con 0x7fbab40c1f90 2022-04-03T21:49:31.987 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.984+0000 7fbaab7fe700 1 -- 172.21.15.117:0/4130523703 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61b0ad4d-6f29-4e48-8334-5d0ab077123e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbaa4015020 con 0x7fbab40c1f90 2022-04-03T21:49:31.987 INFO:teuthology.orchestra.run.smithi117.stdout:1 2022-04-03T21:49:31.988 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 msgr2=0x7fbab40aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:31.989 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40aa5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4016000 tx=0x7fbaa4017000 comp rx=0 tx=0).stop 2022-04-03T21:49:31.989 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 shutdown_connections 2022-04-03T21:49:31.989 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbab414e470 0x7fbab415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.989 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbab40c1f90 0x7fbab40aa5a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.990 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 --2- 172.21.15.117:0/4130523703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbab40c2360 0x7fbab40b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:31.990 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 >> 172.21.15.117:0/4130523703 conn(0x7fbab405e010 msgr2=0x7fbab414a710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:31.990 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 shutdown_connections 2022-04-03T21:49:31.990 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:31.985+0000 7fbab9ddd700 1 -- 172.21.15.117:0/4130523703 wait complete. 2022-04-03T21:49:31.993 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:31.990+0000 7fa042299000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-04-03T21:49:31.999 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 86214e8b-dafc-4fa7-94db-f5af7687736a 2 2022-04-03T21:49:32.095 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:32.092+0000 7ff9f6632000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-04-03T21:49:32.157 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.154+0000 7f351e1ee700 1 Processor -- start 2022-04-03T21:49:32.157 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.154+0000 7f351e1ee700 1 -- start start 2022-04-03T21:49:32.160 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f351e1ee700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 0x7f35181489c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.160 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f351e1ee700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f351806a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.160 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f351e1ee700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180b8ef0 con 0x7f351806d710 2022-04-03T21:49:32.161 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f351e1ee700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518148530 con 0x7f351806d340 2022-04-03T21:49:32.161 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f351e1ee700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b9140 con 0x7f35180b94c0 2022-04-03T21:49:32.161 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f35177fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 0x7f35181489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.161 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f351806a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.161 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f35177fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 0x7f35181489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54364/0 (socket says 172.21.15.117:54364) 2022-04-03T21:49:32.162 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f35177fe700 1 -- 172.21.15.117:0/678259637 learned_addr learned my addr 172.21.15.117:0/678259637 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:32.162 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f3517fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f351806d710 0x7f35180a3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:44858/0 (socket says 172.21.15.117:44858) 2022-04-03T21:49:32.162 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.155+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f351806a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48300/0 (socket says 172.21.15.117:48300) 2022-04-03T21:49:32.162 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f3516ffd700 1 -- 172.21.15.117:0/678259637 >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 msgr2=0x7f35181489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.162 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f3516ffd700 1 --2- 172.21.15.117:0/678259637 >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 0x7f35181489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.163 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f3516ffd700 1 -- 172.21.15.117:0/678259637 >> v1:172.21.15.117:6789/0 conn(0x7f351806d710 legacy=0x7f35180a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.163 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f3516ffd700 1 -- 172.21.15.117:0/678259637 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35181481c0 con 0x7f35180b94c0 2022-04-03T21:49:32.163 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f35177fe700 1 --2- 172.21.15.117:0/678259637 >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 0x7f35181489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:32.163 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f3516ffd700 1 --2- 172.21.15.117:0/678259637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f351806a420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f350c009760 tx=0x7f350c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3cce27df1234bc1 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.164 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f35167fc700 1 -- 172.21.15.117:0/678259637 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c011630 con 0x7f35180b94c0 2022-04-03T21:49:32.164 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f35167fc700 1 -- 172.21.15.117:0/678259637 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c011790 con 0x7f35180b94c0 2022-04-03T21:49:32.164 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f35167fc700 1 -- 172.21.15.117:0/678259637 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c011b50 con 0x7f35180b94c0 2022-04-03T21:49:32.164 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f351e1ee700 1 -- 172.21.15.117:0/678259637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 msgr2=0x7f351806a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.164 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.156+0000 7f351e1ee700 1 --2- 172.21.15.117:0/678259637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f351806a420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f350c009760 tx=0x7f350c009060 comp rx=0 tx=0).stop 2022-04-03T21:49:32.165 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.157+0000 7f351e1ee700 1 -- 172.21.15.117:0/678259637 shutdown_connections 2022-04-03T21:49:32.165 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.157+0000 7f351e1ee700 1 --2- 172.21.15.117:0/678259637 >> v2:172.21.15.117:3300/0 conn(0x7f351806d340 0x7f35181489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.165 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.157+0000 7f351e1ee700 1 --2- 172.21.15.117:0/678259637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f351806a420 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.165 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.157+0000 7f351e1ee700 1 -- 172.21.15.117:0/678259637 >> 172.21.15.117:0/678259637 conn(0x7f35180be350 msgr2=0x7f35180be750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.165 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.157+0000 7f351e1ee700 1 -- 172.21.15.117:0/678259637 shutdown_connections 2022-04-03T21:49:32.166 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.157+0000 7f351e1ee700 1 -- 172.21.15.117:0/678259637 wait complete. 2022-04-03T21:49:32.168 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.158+0000 7f351e1ee700 1 Processor -- start 2022-04-03T21:49:32.168 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.159+0000 7f351e1ee700 1 -- start start 2022-04-03T21:49:32.169 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351806d340 0x7f35180b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.169 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f351806d710 0x7f35180b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.169 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f3518145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.169 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518142410 con 0x7f351806d340 2022-04-03T21:49:32.170 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b3c10 con 0x7f351806d710 2022-04-03T21:49:32.170 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b82d0 con 0x7f35180b94c0 2022-04-03T21:49:32.170 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3517fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f3518145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.170 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f351806d710 0x7f35180b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.170 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3517fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f3518145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48310/0 (socket says 172.21.15.117:48310) 2022-04-03T21:49:32.171 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3517fff700 1 -- 172.21.15.117:0/1603791006 learned_addr learned my addr 172.21.15.117:0/1603791006 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:32.171 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f35177fe700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351806d340 0x7f35180b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.171 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 -- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 msgr2=0x7f3518145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.171 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f3518145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.172 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 -- 172.21.15.117:0/1603791006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351806d340 msgr2=0x7f35180b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.172 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351806d340 0x7f35180b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.172 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 -- 172.21.15.117:0/1603791006 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508009370 con 0x7f351806d710 2022-04-03T21:49:32.172 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3517fff700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f3518145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:32.172 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f3516ffd700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f351806d710 0x7f35180b2e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f351806f020 tx=0x7f350c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.173 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c011900 con 0x7f351806d710 2022-04-03T21:49:32.173 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c011a60 con 0x7f351806d710 2022-04-03T21:49:32.173 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c01a680 con 0x7f351806d710 2022-04-03T21:49:32.173 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.160+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c0092a0 con 0x7f351806d710 2022-04-03T21:49:32.173 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.161+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35180b8520 con 0x7f351806d710 2022-04-03T21:49:32.174 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.161+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f350c00f050 con 0x7f351806d710 2022-04-03T21:49:32.174 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.161+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3518070a20 con 0x7f351806d710 2022-04-03T21:49:32.174 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.161+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f350c02f870 con 0x7f351806d710 2022-04-03T21:49:32.174 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.163+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f350c034060 con 0x7f351806d710 2022-04-03T21:49:32.190 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:32.188+0000 7ff9f6632000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-04-03T21:49:32.247 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.244+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86214e8b-dafc-4fa7-94db-f5af7687736a", "id": 2} v 0) v1 -- 0x7f351814c240 con 0x7f351806d710 2022-04-03T21:49:32.250 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.247+0000 7f34ff7fe700 1 -- 172.21.15.117:0/1603791006 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86214e8b-dafc-4fa7-94db-f5af7687736a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f350c015020 con 0x7f351806d710 2022-04-03T21:49:32.251 INFO:teuthology.orchestra.run.smithi117.stdout:2 2022-04-03T21:49:32.252 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f351806d710 msgr2=0x7f35180b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.252 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f351806d710 0x7f35180b2e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f351806f020 tx=0x7f350c017000 comp rx=0 tx=0).stop 2022-04-03T21:49:32.252 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 shutdown_connections 2022-04-03T21:49:32.252 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35180b94c0 0x7f3518145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.253 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351806d340 0x7f35180b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.253 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 --2- 172.21.15.117:0/1603791006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f351806d710 0x7f35180b2e90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.253 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 >> 172.21.15.117:0/1603791006 conn(0x7f35180be350 msgr2=0x7f351806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.253 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 shutdown_connections 2022-04-03T21:49:32.253 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.248+0000 7f351e1ee700 1 -- 172.21.15.117:0/1603791006 wait complete. 2022-04-03T21:49:32.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new e9945fc7-d7bd-485b-98d7-166981f702e8 3 2022-04-03T21:49:32.359 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:32.357+0000 7ff9f6632000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-04-03T21:49:32.378 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.375+0000 7fe67817d700 1 Processor -- start 2022-04-03T21:49:32.378 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.375+0000 7fe67817d700 1 -- start start 2022-04-03T21:49:32.381 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe67817d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe6700bec30 0x7fe67014e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.381 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe67817d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bdae0 0x7fe670155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.381 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe67817d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700ba700 con 0x7fe6700bf000 2022-04-03T21:49:32.382 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe67817d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67006bd10 con 0x7fe6700bec30 2022-04-03T21:49:32.382 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe67817d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700a3cb0 con 0x7fe6700bdae0 2022-04-03T21:49:32.382 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe675718700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe6700bf000 0x7fe6700bd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:44866/0 (socket says 172.21.15.117:44866) 2022-04-03T21:49:32.382 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe675718700 1 -- 172.21.15.117:0/2292117888 learned_addr learned my addr 172.21.15.117:0/2292117888 (peer_addr_for_me v1:172.21.15.117:0/0) 2022-04-03T21:49:32.383 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe67671a700 1 --2- 172.21.15.117:0/2292117888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bdae0 0x7fe670155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.383 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe675f19700 1 --2- 172.21.15.117:0/2292117888 >> v2:172.21.15.49:3300/0 conn(0x7fe6700bec30 0x7fe67014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.383 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.376+0000 7fe674f17700 1 -- 172.21.15.117:0/2292117888 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262538326 0 0) 0x7fe6700ba700 con 0x7fe6700bf000 2022-04-03T21:49:32.383 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe674f17700 1 -- 172.21.15.117:0/2292117888 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6580033f0 con 0x7fe6700bf000 2022-04-03T21:49:32.384 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67671a700 1 -- 172.21.15.117:0/2292117888 >> v2:172.21.15.49:3300/0 conn(0x7fe6700bec30 msgr2=0x7fe67014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.384 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67671a700 1 --2- 172.21.15.117:0/2292117888 >> v2:172.21.15.49:3300/0 conn(0x7fe6700bec30 0x7fe67014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.384 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67671a700 1 -- 172.21.15.117:0/2292117888 >> v1:172.21.15.117:6789/0 conn(0x7fe6700bf000 legacy=0x7fe6700bd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.384 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67671a700 1 -- 172.21.15.117:0/2292117888 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67006b880 con 0x7fe6700bdae0 2022-04-03T21:49:32.385 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67671a700 1 --2- 172.21.15.117:0/2292117888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bdae0 0x7fe670155800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe668009e60 tx=0x7fe668009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47ca814960b59ae server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.385 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe674f17700 1 -- 172.21.15.117:0/2292117888 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800e070 con 0x7fe6700bdae0 2022-04-03T21:49:32.385 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe674f17700 1 -- 172.21.15.117:0/2292117888 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800bb60 con 0x7fe6700bdae0 2022-04-03T21:49:32.385 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe674f17700 1 -- 172.21.15.117:0/2292117888 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668012430 con 0x7fe6700bdae0 2022-04-03T21:49:32.385 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 -- 172.21.15.117:0/2292117888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bdae0 msgr2=0x7fe670155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.386 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 --2- 172.21.15.117:0/2292117888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bdae0 0x7fe670155800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe668009e60 tx=0x7fe668009780 comp rx=0 tx=0).stop 2022-04-03T21:49:32.386 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 -- 172.21.15.117:0/2292117888 shutdown_connections 2022-04-03T21:49:32.386 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 --2- 172.21.15.117:0/2292117888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bdae0 0x7fe670155800 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.386 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 --2- 172.21.15.117:0/2292117888 >> v2:172.21.15.49:3300/0 conn(0x7fe6700bec30 0x7fe67014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.386 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 -- 172.21.15.117:0/2292117888 >> 172.21.15.117:0/2292117888 conn(0x7fe6700686c0 msgr2=0x7fe6700be360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.387 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.377+0000 7fe67817d700 1 -- 172.21.15.117:0/2292117888 shutdown_connections 2022-04-03T21:49:32.387 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.378+0000 7fe67817d700 1 -- 172.21.15.117:0/2292117888 wait complete. 2022-04-03T21:49:32.387 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.378+0000 7fe67817d700 1 Processor -- start 2022-04-03T21:49:32.387 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.378+0000 7fe67817d700 1 -- start start 2022-04-03T21:49:32.390 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67817d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6700bdae0 0x7fe6700a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.390 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67817d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bec30 0x7fe670144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.390 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67817d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 0x7fe67006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.390 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67817d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700b1a00 con 0x7fe6700bdae0 2022-04-03T21:49:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67817d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701457b0 con 0x7fe6700bf000 2022-04-03T21:49:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67817d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700a15e0 con 0x7fe6700bec30 2022-04-03T21:49:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe675718700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bec30 0x7fe670144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67671a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 0x7fe67006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.392 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe675718700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bec30 0x7fe670144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48320/0 (socket says 172.21.15.117:48320) 2022-04-03T21:49:32.392 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67671a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 0x7fe67006e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54386/0 (socket says 172.21.15.117:54386) 2022-04-03T21:49:32.392 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe675718700 1 -- 172.21.15.117:0/1487700604 learned_addr learned my addr 172.21.15.117:0/1487700604 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:32.392 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe675f19700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6700bdae0 0x7fe6700a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.392 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67671a700 1 -- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bec30 msgr2=0x7fe670144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.393 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.379+0000 7fe67671a700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bec30 0x7fe670144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.393 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe67671a700 1 -- 172.21.15.117:0/1487700604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6700bdae0 msgr2=0x7fe6700a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.393 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe67671a700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6700bdae0 0x7fe6700a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.393 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe67671a700 1 -- 172.21.15.117:0/1487700604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009a20 con 0x7fe6700bf000 2022-04-03T21:49:32.393 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe675f19700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6700bdae0 0x7fe6700a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-03T21:49:32.394 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe67671a700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 0x7fe67006e550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe668016000 tx=0x7fe668019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.394 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668003e90 con 0x7fe6700bf000 2022-04-03T21:49:32.394 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6680129b0 con 0x7fe6700bf000 2022-04-03T21:49:32.394 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe670148740 con 0x7fe6700bf000 2022-04-03T21:49:32.394 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668012d50 con 0x7fe6700bf000 2022-04-03T21:49:32.395 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe670145a00 con 0x7fe6700bf000 2022-04-03T21:49:32.395 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fe668004250 con 0x7fe6700bf000 2022-04-03T21:49:32.395 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.380+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fe668027910 con 0x7fe6700bf000 2022-04-03T21:49:32.395 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.381+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6700a1410 con 0x7fe6700bf000 2022-04-03T21:49:32.395 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.385+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fe66802c020 con 0x7fe6700bf000 2022-04-03T21:49:32.396 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:32.393+0000 7fa042299000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-04-03T21:49:32.467 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.465+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e9945fc7-d7bd-485b-98d7-166981f702e8", "id": 3} v 0) v1 -- 0x7fe670070a20 con 0x7fe6700bf000 2022-04-03T21:49:32.469 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:32.467+0000 7ff9f6632000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-04-03T21:49:32.471 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.468+0000 7fe65dffb700 1 -- 172.21.15.117:0/1487700604 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9945fc7-d7bd-485b-98d7-166981f702e8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6680046c0 con 0x7fe6700bf000 2022-04-03T21:49:32.471 INFO:teuthology.orchestra.run.smithi117.stdout:3 2022-04-03T21:49:32.472 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 msgr2=0x7fe67006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.473 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 0x7fe67006e550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe668016000 tx=0x7fe668019000 comp rx=0 tx=0).stop 2022-04-03T21:49:32.473 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 shutdown_connections 2022-04-03T21:49:32.473 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6700bf000 0x7fe67006e550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.473 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6700bdae0 0x7fe6700a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.473 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 --2- 172.21.15.117:0/1487700604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6700bec30 0x7fe670144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.474 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 >> 172.21.15.117:0/1487700604 conn(0x7fe6700686c0 msgr2=0x7fe6700bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.474 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 shutdown_connections 2022-04-03T21:49:32.474 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.469+0000 7fe67817d700 1 -- 172.21.15.117:0/1487700604 wait complete. 2022-04-03T21:49:32.475 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:32.472+0000 7fa042299000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-04-03T21:49:32.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 553e3f8d-bda8-477d-ac51-159398e6c430 4 2022-04-03T21:49:32.603 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.600+0000 7fc2a92fc700 1 Processor -- start 2022-04-03T21:49:32.603 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.600+0000 7fc2a92fc700 1 -- start start 2022-04-03T21:49:32.606 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a92fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 0x7fc2a40b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.607 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a92fc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2a4068290 0x7fc2a4066ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.607 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a92fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 0x7fc2a4067480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.607 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a92fc700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a406c9d0 con 0x7fc2a4068290 2022-04-03T21:49:32.607 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a92fc700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a406cbe0 con 0x7fc2a4067ec0 2022-04-03T21:49:32.607 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a92fc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a406cec0 con 0x7fc2a4067020 2022-04-03T21:49:32.608 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a2ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 0x7fc2a40b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.608 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 0x7fc2a4067480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.608 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 0x7fc2a4067480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48328/0 (socket says 172.21.15.117:48328) 2022-04-03T21:49:32.608 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a2ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 0x7fc2a40b8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54388/0 (socket says 172.21.15.117:54388) 2022-04-03T21:49:32.609 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.601+0000 7fc2a37fe700 1 -- 172.21.15.117:0/3772774328 learned_addr learned my addr 172.21.15.117:0/3772774328 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:32.609 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a27fc700 1 --2- 172.21.15.117:0/3772774328 >> v2:172.21.15.49:3300/0 conn(0x7fc2a4068290 0x7fc2a4066ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.609 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a37fe700 1 -- 172.21.15.117:0/3772774328 >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 msgr2=0x7fc2a40b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.609 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a37fe700 1 --2- 172.21.15.117:0/3772774328 >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 0x7fc2a40b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.609 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a37fe700 1 -- 172.21.15.117:0/3772774328 >> v2:172.21.15.49:3300/0 conn(0x7fc2a4068290 msgr2=0x7fc2a4066ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.610 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a37fe700 1 --2- 172.21.15.117:0/3772774328 >> v2:172.21.15.49:3300/0 conn(0x7fc2a4068290 0x7fc2a4066ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.610 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a37fe700 1 -- 172.21.15.117:0/3772774328 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40b72c0 con 0x7fc2a4067020 2022-04-03T21:49:32.610 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a2ffd700 1 --2- 172.21.15.117:0/3772774328 >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 0x7fc2a40b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:32.610 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a37fe700 1 --2- 172.21.15.117:0/3772774328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 0x7fc2a4067480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2a406bca0 tx=0x7fc29c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd8154cf15cbd41f server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.610 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a1ffb700 1 -- 172.21.15.117:0/3772774328 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00e070 con 0x7fc2a4067020 2022-04-03T21:49:32.611 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a1ffb700 1 -- 172.21.15.117:0/3772774328 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00ba20 con 0x7fc2a4067020 2022-04-03T21:49:32.611 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.602+0000 7fc2a1ffb700 1 -- 172.21.15.117:0/3772774328 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0092e0 con 0x7fc2a4067020 2022-04-03T21:49:32.611 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 -- 172.21.15.117:0/3772774328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 msgr2=0x7fc2a4067480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.611 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/3772774328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 0x7fc2a4067480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2a406bca0 tx=0x7fc29c009840 comp rx=0 tx=0).stop 2022-04-03T21:49:32.611 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 -- 172.21.15.117:0/3772774328 shutdown_connections 2022-04-03T21:49:32.612 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/3772774328 >> v2:172.21.15.117:3300/0 conn(0x7fc2a4067ec0 0x7fc2a40b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.612 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/3772774328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4067020 0x7fc2a4067480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.612 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/3772774328 >> v2:172.21.15.49:3300/0 conn(0x7fc2a4068290 0x7fc2a4066ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.612 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 -- 172.21.15.117:0/3772774328 >> 172.21.15.117:0/3772774328 conn(0x7fc2a40ba570 msgr2=0x7fc2a40ba970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.612 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 -- 172.21.15.117:0/3772774328 shutdown_connections 2022-04-03T21:49:32.613 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.603+0000 7fc2a92fc700 1 -- 172.21.15.117:0/3772774328 wait complete. 2022-04-03T21:49:32.613 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.604+0000 7fc2a92fc700 1 Processor -- start 2022-04-03T21:49:32.613 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.604+0000 7fc2a92fc700 1 -- start start 2022-04-03T21:49:32.615 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.604+0000 7fc2a92fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 0x7fc2a4147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.615 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.604+0000 7fc2a92fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a4067ec0 0x7fc2a414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.616 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a92fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4068290 0x7fc2a414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.616 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a92fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a414c3d0 con 0x7fc2a4067ec0 2022-04-03T21:49:32.616 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a92fc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4140a70 con 0x7fc2a4067020 2022-04-03T21:49:32.616 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a92fc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a414c030 con 0x7fc2a4068290 2022-04-03T21:49:32.616 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 0x7fc2a4147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.617 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 0x7fc2a4147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54394/0 (socket says 172.21.15.117:54394) 2022-04-03T21:49:32.617 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 -- 172.21.15.117:0/737682409 learned_addr learned my addr 172.21.15.117:0/737682409 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:32.617 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a37fe700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4068290 0x7fc2a414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.617 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a27fc700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a4067ec0 0x7fc2a414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.617 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 -- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4068290 msgr2=0x7fc2a414d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4068290 0x7fc2a414d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 -- 172.21.15.117:0/737682409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a4067ec0 msgr2=0x7fc2a414d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a4067ec0 0x7fc2a414d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 -- 172.21.15.117:0/737682409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940092a0 con 0x7fc2a4067020 2022-04-03T21:49:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a37fe700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4068290 0x7fc2a414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a2ffd700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 0x7fc2a4147490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc29400ea20 tx=0x7fc294009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400ee60 con 0x7fc2a4067020 2022-04-03T21:49:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400c850 con 0x7fc2a4067020 2022-04-03T21:49:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c009ae0 con 0x7fc2a4067020 2022-04-03T21:49:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400cbd0 con 0x7fc2a4067020 2022-04-03T21:49:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.605+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a415d430 con 0x7fc2a4067020 2022-04-03T21:49:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.606+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fc294019030 con 0x7fc2a4067020 2022-04-03T21:49:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.606+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc294006710 con 0x7fc2a4067020 2022-04-03T21:49:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.606+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a4070a20 con 0x7fc2a4067020 2022-04-03T21:49:32.621 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.610+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fc294021060 con 0x7fc2a4067020 2022-04-03T21:49:32.629 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:32.626+0000 7fa042299000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-04-03T21:49:32.693 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.690+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "553e3f8d-bda8-477d-ac51-159398e6c430", "id": 4} v 0) v1 -- 0x7fc2a40bd3a0 con 0x7fc2a4067020 2022-04-03T21:49:32.696 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.694+0000 7fc28affd700 1 -- 172.21.15.117:0/737682409 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "553e3f8d-bda8-477d-ac51-159398e6c430", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc294029020 con 0x7fc2a4067020 2022-04-03T21:49:32.696 INFO:teuthology.orchestra.run.smithi117.stdout:4 2022-04-03T21:49:32.698 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 msgr2=0x7fc2a4147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.698 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 0x7fc2a4147490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc29400ea20 tx=0x7fc294009060 comp rx=0 tx=0).stop 2022-04-03T21:49:32.698 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 shutdown_connections 2022-04-03T21:49:32.699 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2a4068290 0x7fc2a414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.699 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2a4067020 0x7fc2a4147490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.699 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 --2- 172.21.15.117:0/737682409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2a4067ec0 0x7fc2a414d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.699 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 >> 172.21.15.117:0/737682409 conn(0x7fc2a40ba570 msgr2=0x7fc2a4148210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.700 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 shutdown_connections 2022-04-03T21:49:32.700 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.695+0000 7fc2a92fc700 1 -- 172.21.15.117:0/737682409 wait complete. 2022-04-03T21:49:32.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 08f81712-b1cb-46fd-b019-93ac50a2a4f3 5 2022-04-03T21:49:32.823 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.821+0000 7f274e7b6700 1 Processor -- start 2022-04-03T21:49:32.824 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.821+0000 7f274e7b6700 1 -- start start 2022-04-03T21:49:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.821+0000 7f274e7b6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f27480a3850 0x7f274806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f274e7b6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274814d400 con 0x7f27480a3c20 2022-04-03T21:49:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f274e7b6700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274806a580 con 0x7f274806a990 2022-04-03T21:49:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f274e7b6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480b1b70 con 0x7f27480a3850 2022-04-03T21:49:32.831 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f274cd53700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f274806a990 0x7f274814ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:44892/0 (socket says 172.21.15.117:44892) 2022-04-03T21:49:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f274cd53700 1 -- 172.21.15.117:0/1922407509 learned_addr learned my addr 172.21.15.117:0/1922407509 (peer_addr_for_me v1:172.21.15.117:0/0) 2022-04-03T21:49:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2747fff700 1 --2- 172.21.15.117:0/1922407509 >> v2:172.21.15.49:3300/0 conn(0x7f27480a3850 0x7f274806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700372930 0 0) 0x7f274806a580 con 0x7f274806a990 2022-04-03T21:49:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27340033f0 con 0x7f274806a990 2022-04-03T21:49:32.832 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882532190 0 0) 0x7f27340033f0 con 0x7f274806a990 2022-04-03T21:49:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 >> v2:172.21.15.49:3300/0 conn(0x7f27480a3850 msgr2=0x7f274806d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 --2- 172.21.15.117:0/1922407509 >> v2:172.21.15.49:3300/0 conn(0x7f27480a3850 0x7f274806d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 >> v1:172.21.15.49:6789/0 conn(0x7f27480a3c20 legacy=0x7f274814c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480b1d80 con 0x7f274806a990 2022-04-03T21:49:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 18272773 0 0) 0x7f27400017f0 con 0x7f274806a990 2022-04-03T21:49:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 >> v1:172.21.15.117:6789/0 conn(0x7f274806a990 legacy=0x7f274814ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27340038e0 0x7f2734003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2734004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2734005040 0x7f273400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480b1b70 con 0x7f2734005040 2022-04-03T21:49:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273400bfe0 con 0x7f2734004690 2022-04-03T21:49:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273400c1a0 con 0x7f27340038e0 2022-04-03T21:49:32.836 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f27477fe700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2734004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.836 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.822+0000 7f2747fff700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27340038e0 0x7f2734003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.836 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274cd53700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2734005040 0x7f273400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.836 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f27477fe700 1 -- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27340038e0 msgr2=0x7f2734003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.836 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f27477fe700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27340038e0 0x7f2734003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.837 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f27477fe700 1 -- 172.21.15.117:0/1922407509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2734005040 msgr2=0x7f273400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:32.837 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f27477fe700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2734005040 0x7f273400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.837 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274cd53700 1 -- 172.21.15.117:0/1922407509 reap_dead start 2022-04-03T21:49:32.837 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f27477fe700 1 -- 172.21.15.117:0/1922407509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340033f0 con 0x7f2734004690 2022-04-03T21:49:32.838 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f27477fe700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2734004b00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f273c001740 tx=0x7f273c007b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5c5d180c56659ef server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.838 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0050d0 con 0x7f2734004690 2022-04-03T21:49:32.838 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c005250 con 0x7f2734004690 2022-04-03T21:49:32.838 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f2746ffd700 1 -- 172.21.15.117:0/1922407509 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0053c0 con 0x7f2734004690 2022-04-03T21:49:32.839 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 -- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 msgr2=0x7f2734004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.839 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2734004b00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f273c001740 tx=0x7f273c007b70 comp rx=0 tx=0).stop 2022-04-03T21:49:32.839 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 -- 172.21.15.117:0/1922407509 shutdown_connections 2022-04-03T21:49:32.839 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 --2- 172.21.15.117:0/1922407509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2734004b00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.840 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 -- 172.21.15.117:0/1922407509 >> 172.21.15.117:0/1922407509 conn(0x7f2748067bf0 msgr2=0x7f2748067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.840 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 -- 172.21.15.117:0/1922407509 shutdown_connections 2022-04-03T21:49:32.840 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.823+0000 7f274e7b6700 1 -- 172.21.15.117:0/1922407509 wait complete. 2022-04-03T21:49:32.840 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.824+0000 7f274e7b6700 1 Processor -- start 2022-04-03T21:49:32.840 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 -- start start 2022-04-03T21:49:32.841 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2748159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.841 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 0x7f2748143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.841 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f274815c130 0x7f274815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:32.841 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480b19e0 con 0x7f274815c130 2022-04-03T21:49:32.841 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27481473f0 con 0x7f2734004690 2022-04-03T21:49:32.842 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f274e7b6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274815a610 con 0x7f274813f2b0 2022-04-03T21:49:32.842 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f2747fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2748159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.842 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f27477fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 0x7f2748143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.842 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f2747fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2748159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54410/0 (socket says 172.21.15.117:54410) 2022-04-03T21:49:32.843 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f2747fff700 1 -- 172.21.15.117:0/2473983037 learned_addr learned my addr 172.21.15.117:0/2473983037 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:32.843 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.825+0000 7f27477fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 0x7f2748143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48348/0 (socket says 172.21.15.117:48348) 2022-04-03T21:49:32.843 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f274cd53700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f274815c130 0x7f274815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:32.843 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f2747fff700 1 -- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 msgr2=0x7f2748143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.843 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f2747fff700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 0x7f2748143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.844 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f2747fff700 1 -- 172.21.15.117:0/2473983037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f274815c130 msgr2=0x7f274815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.844 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f2747fff700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f274815c130 0x7f274815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.844 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f2747fff700 1 -- 172.21.15.117:0/2473983037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27481429c0 con 0x7f2734004690 2022-04-03T21:49:32.844 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f27477fe700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 0x7f2748143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:32.844 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f2747fff700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2748159680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2738011a20 tx=0x7f2738006f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800f940 con 0x7f2734004690 2022-04-03T21:49:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800faa0 con 0x7f2734004690 2022-04-03T21:49:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2748142ca0 con 0x7f2734004690 2022-04-03T21:49:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800fe60 con 0x7f2734004690 2022-04-03T21:49:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.826+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2748143260 con 0x7f2734004690 2022-04-03T21:49:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.827+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f273801d910 con 0x7f2734004690 2022-04-03T21:49:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.827+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2748070a20 con 0x7f2734004690 2022-04-03T21:49:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.827+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f2738018070 con 0x7f2734004690 2022-04-03T21:49:32.847 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.831+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f273801dba0 con 0x7f2734004690 2022-04-03T21:49:32.915 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.913+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08f81712-b1cb-46fd-b019-93ac50a2a4f3", "id": 5} v 0) v1 -- 0x7f274814c2e0 con 0x7f2734004690 2022-04-03T21:49:32.919 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.916+0000 7f272ffff700 1 -- 172.21.15.117:0/2473983037 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08f81712-b1cb-46fd-b019-93ac50a2a4f3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f273801dd40 con 0x7f2734004690 2022-04-03T21:49:32.919 INFO:teuthology.orchestra.run.smithi117.stdout:5 2022-04-03T21:49:32.920 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 msgr2=0x7f2748159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:32.920 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2748159680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2738011a20 tx=0x7f2738006f40 comp rx=0 tx=0).stop 2022-04-03T21:49:32.921 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 shutdown_connections 2022-04-03T21:49:32.921 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f274815c130 0x7f274815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.921 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2734004690 0x7f2748159680 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.921 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 --2- 172.21.15.117:0/2473983037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f274813f2b0 0x7f2748143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:32.922 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 >> 172.21.15.117:0/2473983037 conn(0x7f2748067bf0 msgr2=0x7f2748144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:32.922 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 shutdown_connections 2022-04-03T21:49:32.922 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:32.917+0000 7f274e7b6700 1 -- 172.21.15.117:0/2473983037 wait complete. 2022-04-03T21:49:32.922 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:32.920+0000 7fa042299000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-04-03T21:49:32.931 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 15d9cad0-7acd-4283-b7fb-2480d7bf83d6 6 2022-04-03T21:49:32.976 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:32.974+0000 7ff9f6632000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-04-03T21:49:32.994 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:32.992+0000 7fa042299000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-04-03T21:49:33.046 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.044+0000 7f3050980700 1 Processor -- start 2022-04-03T21:49:33.047 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.044+0000 7f3050980700 1 -- start start 2022-04-03T21:49:33.050 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3050980700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f304c0c1f90 0x7f304c0bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.050 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3050980700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 0x7f304c0bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.050 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3050980700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 0x7f304c0681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.051 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3050980700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0a50a0 con 0x7f304c0c1f90 2022-04-03T21:49:33.051 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3050980700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0a6750 con 0x7f304c0c2360 2022-04-03T21:49:33.051 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3050980700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0a6a30 con 0x7f304c067d80 2022-04-03T21:49:33.051 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 0x7f304c0681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.051 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3049d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 0x7f304c0bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.052 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3049d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 0x7f304c0bd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54418/0 (socket says 172.21.15.117:54418) 2022-04-03T21:49:33.052 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 0x7f304c0681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48356/0 (socket says 172.21.15.117:48356) 2022-04-03T21:49:33.052 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3049d9b700 1 -- 172.21.15.117:0/1465424130 learned_addr learned my addr 172.21.15.117:0/1465424130 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:33.052 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304a59c700 1 --2- 172.21.15.117:0/1465424130 >> v2:172.21.15.49:3300/0 conn(0x7f304c0c1f90 0x7f304c0bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.053 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 -- 172.21.15.117:0/1465424130 >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 msgr2=0x7f304c0bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:33.053 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 --2- 172.21.15.117:0/1465424130 >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 0x7f304c0bd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.053 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 -- 172.21.15.117:0/1465424130 >> v2:172.21.15.49:3300/0 conn(0x7f304c0c1f90 msgr2=0x7f304c0bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:33.053 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 --2- 172.21.15.117:0/1465424130 >> v2:172.21.15.49:3300/0 conn(0x7f304c0c1f90 0x7f304c0bbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.053 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 -- 172.21.15.117:0/1465424130 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0a6d10 con 0x7f304c067d80 2022-04-03T21:49:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f3049d9b700 1 --2- 172.21.15.117:0/1465424130 >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 0x7f304c0bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304ad9d700 1 --2- 172.21.15.117:0/1465424130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 0x7f304c0681c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f304c0a6220 tx=0x7f3044009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe6c1ba6dda37a0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.045+0000 7f304959a700 1 -- 172.21.15.117:0/1465424130 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400e070 con 0x7f304c067d80 2022-04-03T21:49:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f304959a700 1 -- 172.21.15.117:0/1465424130 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400bb60 con 0x7f304c067d80 2022-04-03T21:49:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f304959a700 1 -- 172.21.15.117:0/1465424130 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044012430 con 0x7f304c067d80 2022-04-03T21:49:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 -- 172.21.15.117:0/1465424130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 msgr2=0x7f304c0681c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 --2- 172.21.15.117:0/1465424130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 0x7f304c0681c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f304c0a6220 tx=0x7f3044009780 comp rx=0 tx=0).stop 2022-04-03T21:49:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 -- 172.21.15.117:0/1465424130 shutdown_connections 2022-04-03T21:49:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 --2- 172.21.15.117:0/1465424130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c067d80 0x7f304c0681c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.056 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 --2- 172.21.15.117:0/1465424130 >> v2:172.21.15.49:3300/0 conn(0x7f304c0c1f90 0x7f304c0bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.056 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 --2- 172.21.15.117:0/1465424130 >> v2:172.21.15.117:3300/0 conn(0x7f304c0c2360 0x7f304c0bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.056 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 -- 172.21.15.117:0/1465424130 >> 172.21.15.117:0/1465424130 conn(0x7f304c05e010 msgr2=0x7f304c0c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:33.056 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 -- 172.21.15.117:0/1465424130 shutdown_connections 2022-04-03T21:49:33.057 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.046+0000 7f3050980700 1 -- 172.21.15.117:0/1465424130 wait complete. 2022-04-03T21:49:33.057 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.047+0000 7f3050980700 1 Processor -- start 2022-04-03T21:49:33.057 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.047+0000 7f3050980700 1 -- start start 2022-04-03T21:49:33.060 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3050980700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 0x7f304c0be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.060 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3050980700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c0c1f90 0x7f304c0b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.060 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3050980700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f304c0c2360 0x7f304c0b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.061 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3050980700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0bb2a0 con 0x7f304c0c2360 2022-04-03T21:49:33.061 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3050980700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0b6e50 con 0x7f304c067d80 2022-04-03T21:49:33.061 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3050980700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c096ce0 con 0x7f304c0c1f90 2022-04-03T21:49:33.061 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 0x7f304c0be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.061 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f3049d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c0c1f90 0x7f304c0b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.062 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 0x7f304c0be1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54422/0 (socket says 172.21.15.117:54422) 2022-04-03T21:49:33.062 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 -- 172.21.15.117:0/3461290531 learned_addr learned my addr 172.21.15.117:0/3461290531 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:33.062 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304ad9d700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f304c0c2360 0x7f304c0b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.062 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 -- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c0c1f90 msgr2=0x7f304c0b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.063 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c0c1f90 0x7f304c0b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.063 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 -- 172.21.15.117:0/3461290531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f304c0c2360 msgr2=0x7f304c0b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.063 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f304c0c2360 0x7f304c0b9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.063 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 -- 172.21.15.117:0/3461290531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040009370 con 0x7f304c067d80 2022-04-03T21:49:33.063 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.048+0000 7f304a59c700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 0x7f304c0be1f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f303c00d890 tx=0x7f303c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:33.064 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c014620 con 0x7f304c067d80 2022-04-03T21:49:33.064 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c014780 con 0x7f304c067d80 2022-04-03T21:49:33.064 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3044009a20 con 0x7f304c067d80 2022-04-03T21:49:33.064 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c014b40 con 0x7f304c067d80 2022-04-03T21:49:33.064 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c0b70a0 con 0x7f304c067d80 2022-04-03T21:49:33.065 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f303c01d680 con 0x7f304c067d80 2022-04-03T21:49:33.065 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.049+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f303c0129e0 con 0x7f304c067d80 2022-04-03T21:49:33.065 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.050+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c0c1c10 con 0x7f304c067d80 2022-04-03T21:49:33.065 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.052+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f303c03b470 con 0x7f304c067d80 2022-04-03T21:49:33.095 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:33.093+0000 7ff9f6632000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-04-03T21:49:33.134 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.131+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15d9cad0-7acd-4283-b7fb-2480d7bf83d6", "id": 6} v 0) v1 -- 0x7f304c070a20 con 0x7f304c067d80 2022-04-03T21:49:33.137 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.135+0000 7f303a7fc700 1 -- 172.21.15.117:0/3461290531 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15d9cad0-7acd-4283-b7fb-2480d7bf83d6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f303c02a070 con 0x7f304c067d80 2022-04-03T21:49:33.138 INFO:teuthology.orchestra.run.smithi117.stdout:6 2022-04-03T21:49:33.139 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 msgr2=0x7f304c0be1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.139 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 0x7f304c0be1f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f303c00d890 tx=0x7f303c008040 comp rx=0 tx=0).stop 2022-04-03T21:49:33.140 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 shutdown_connections 2022-04-03T21:49:33.140 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f304c0c2360 0x7f304c0b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.140 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f304c067d80 0x7f304c0be1f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.140 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 --2- 172.21.15.117:0/3461290531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f304c0c1f90 0x7f304c0b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.141 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 >> 172.21.15.117:0/3461290531 conn(0x7f304c05e010 msgr2=0x7f304c068150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:33.141 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 shutdown_connections 2022-04-03T21:49:33.141 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.136+0000 7f3050980700 1 -- 172.21.15.117:0/3461290531 wait complete. 2022-04-03T21:49:33.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 48066a46-9f55-4ba8-8aba-f86d6ea0657f 7 2022-04-03T21:49:33.265 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.262+0000 7f7e23016700 1 Processor -- start 2022-04-03T21:49:33.265 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e23016700 1 -- start start 2022-04-03T21:49:33.271 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e23016700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e1c14c6d0 0x7f7e1c0bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.271 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e23016700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 0x7f7e1c14caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.272 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e23016700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c0bbef0 con 0x7f7e1c142c10 2022-04-03T21:49:33.272 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e23016700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c143770 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.272 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e23016700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0bb2d0 con 0x7f7e1c0bae00 2022-04-03T21:49:33.272 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e1bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 0x7f7e1c14caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.273 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e1bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 0x7f7e1c14caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48366/0 (socket says 172.21.15.117:48366) 2022-04-03T21:49:33.273 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e1bfff700 1 -- 172.21.15.117:0/492710143 learned_addr learned my addr 172.21.15.117:0/492710143 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:33.273 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.263+0000 7f7e20db2700 1 --2- 172.21.15.117:0/492710143 >> v2:172.21.15.49:3300/0 conn(0x7f7e1c14c6d0 0x7f7e1c0bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.273 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1bfff700 1 -- 172.21.15.117:0/492710143 >> v2:172.21.15.49:3300/0 conn(0x7f7e1c14c6d0 msgr2=0x7f7e1c0bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:33.273 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1bfff700 1 --2- 172.21.15.117:0/492710143 >> v2:172.21.15.49:3300/0 conn(0x7f7e1c14c6d0 0x7f7e1c0bc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.274 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1bfff700 1 -- 172.21.15.117:0/492710143 >> v1:172.21.15.49:6789/0 conn(0x7f7e1c142c10 legacy=0x7f7e1c143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:33.274 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1bfff700 1 -- 172.21.15.117:0/492710143 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0bb8a0 con 0x7f7e1c0bae00 2022-04-03T21:49:33.274 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e20db2700 1 --2- 172.21.15.117:0/492710143 >> v2:172.21.15.49:3300/0 conn(0x7f7e1c14c6d0 0x7f7e1c0bc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-04-03T21:49:33.275 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1bfff700 1 --2- 172.21.15.117:0/492710143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 0x7f7e1c14caa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009810 tx=0x7f7e08009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b988785077d2a3 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:33.275 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1b7fe700 1 -- 172.21.15.117:0/492710143 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004030 con 0x7f7e1c0bae00 2022-04-03T21:49:33.275 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1b7fe700 1 -- 172.21.15.117:0/492710143 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08004190 con 0x7f7e1c0bae00 2022-04-03T21:49:33.275 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e1b7fe700 1 -- 172.21.15.117:0/492710143 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08005a90 con 0x7f7e1c0bae00 2022-04-03T21:49:33.276 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 -- 172.21.15.117:0/492710143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 msgr2=0x7f7e1c14caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.276 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 --2- 172.21.15.117:0/492710143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 0x7f7e1c14caa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009810 tx=0x7f7e08009060 comp rx=0 tx=0).stop 2022-04-03T21:49:33.276 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 -- 172.21.15.117:0/492710143 shutdown_connections 2022-04-03T21:49:33.276 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 --2- 172.21.15.117:0/492710143 >> v2:172.21.15.49:3300/0 conn(0x7f7e1c14c6d0 0x7f7e1c0bc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.277 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 --2- 172.21.15.117:0/492710143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c0bae00 0x7f7e1c14caa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.278 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 -- 172.21.15.117:0/492710143 >> 172.21.15.117:0/492710143 conn(0x7f7e1c06edf0 msgr2=0x7f7e1c05d540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:33.278 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 -- 172.21.15.117:0/492710143 shutdown_connections 2022-04-03T21:49:33.278 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.264+0000 7f7e23016700 1 -- 172.21.15.117:0/492710143 wait complete. 2022-04-03T21:49:33.278 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.265+0000 7f7e23016700 1 Processor -- start 2022-04-03T21:49:33.279 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 -- start start 2022-04-03T21:49:33.279 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 0x7f7e1c15e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.279 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1c142c10 0x7f7e1c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.279 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 0x7f7e1c1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.279 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c144dc0 con 0x7f7e1c142c10 2022-04-03T21:49:33.280 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0699f0 con 0x7f7e1c0bae00 2022-04-03T21:49:33.280 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e23016700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0685c0 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.280 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e215b3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 0x7f7e1c1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.280 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e20db2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 0x7f7e1c15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.281 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e215b3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 0x7f7e1c1491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:48374/0 (socket says 172.21.15.117:48374) 2022-04-03T21:49:33.281 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e215b3700 1 -- 172.21.15.117:0/1180746643 learned_addr learned my addr 172.21.15.117:0/1180746643 (peer_addr_for_me v2:172.21.15.117:0/0) 2022-04-03T21:49:33.281 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.266+0000 7f7e20db2700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 0x7f7e1c15e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54434/0 (socket says 172.21.15.117:54434) 2022-04-03T21:49:33.281 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e1bfff700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1c142c10 0x7f7e1c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.282 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e215b3700 1 -- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 msgr2=0x7f7e1c15e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.282 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e215b3700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 0x7f7e1c15e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.282 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e215b3700 1 -- 172.21.15.117:0/1180746643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1c142c10 msgr2=0x7f7e1c068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.282 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e215b3700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1c142c10 0x7f7e1c068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.282 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e215b3700 1 -- 172.21.15.117:0/1180746643 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009300 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.283 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e20db2700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 0x7f7e1c15e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:33.283 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e1bfff700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1c142c10 0x7f7e1c068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-03T21:49:33.283 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e215b3700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 0x7f7e1c1491f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c810 tx=0x7f7e14003b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:33.283 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14012630 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.284 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140127d0 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.284 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c149db0 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.284 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14012b90 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.284 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c15f170 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.284 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f7e14022070 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.285 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.267+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f7e1401a3b0 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.285 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.268+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c0be840 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.285 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.270+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f7e1403a470 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.295 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:33.293+0000 7ff9f6632000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-04-03T21:49:33.373 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.370+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48066a46-9f55-4ba8-8aba-f86d6ea0657f", "id": 7} v 0) v1 -- 0x7f7e1c069de0 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.376 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.374+0000 7f7e18ff9700 1 -- 172.21.15.117:0/1180746643 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48066a46-9f55-4ba8-8aba-f86d6ea0657f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e14029020 con 0x7f7e1c14c6d0 2022-04-03T21:49:33.377 INFO:teuthology.orchestra.run.smithi117.stdout:7 2022-04-03T21:49:33.378 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 msgr2=0x7f7e1c1491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.378 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 0x7f7e1c1491f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c810 tx=0x7f7e14003b40 comp rx=0 tx=0).stop 2022-04-03T21:49:33.378 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 shutdown_connections 2022-04-03T21:49:33.379 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1c14c6d0 0x7f7e1c1491f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.379 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e1c0bae00 0x7f7e1c15e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.379 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 --2- 172.21.15.117:0/1180746643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e1c142c10 0x7f7e1c068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.379 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 >> 172.21.15.117:0/1180746643 conn(0x7f7e1c06edf0 msgr2=0x7f7e1c14bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:33.380 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 shutdown_connections 2022-04-03T21:49:33.380 INFO:teuthology.orchestra.run.smithi117.stderr:2022-04-03T21:49:33.375+0000 7f7e23016700 1 -- 172.21.15.117:0/1180746643 wait complete. 2022-04-03T21:49:33.389 INFO:tasks.ceph.osd.0:Restarting daemon 2022-04-03T21:49:33.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-04-03T21:49:33.394 INFO:tasks.ceph.osd.0:Started 2022-04-03T21:49:33.395 INFO:tasks.ceph.osd.1:Restarting daemon 2022-04-03T21:49:33.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-04-03T21:49:33.399 INFO:tasks.ceph.osd.1:Started 2022-04-03T21:49:33.400 INFO:tasks.ceph.osd.2:Restarting daemon 2022-04-03T21:49:33.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-04-03T21:49:33.405 INFO:tasks.ceph.osd.2:Started 2022-04-03T21:49:33.406 INFO:tasks.ceph.osd.3:Restarting daemon 2022-04-03T21:49:33.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-04-03T21:49:33.413 INFO:tasks.ceph.osd.3:Started 2022-04-03T21:49:33.413 INFO:tasks.ceph.osd.4:Restarting daemon 2022-04-03T21:49:33.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-04-03T21:49:33.416 INFO:tasks.ceph.osd.4:Started 2022-04-03T21:49:33.416 INFO:tasks.ceph.osd.5:Restarting daemon 2022-04-03T21:49:33.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-04-03T21:49:33.419 INFO:tasks.ceph.osd.5:Started 2022-04-03T21:49:33.419 INFO:tasks.ceph.osd.6:Restarting daemon 2022-04-03T21:49:33.420 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-04-03T21:49:33.422 INFO:tasks.ceph.osd.6:Started 2022-04-03T21:49:33.422 INFO:tasks.ceph.osd.7:Restarting daemon 2022-04-03T21:49:33.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-04-03T21:49:33.424 INFO:tasks.ceph.osd.7:Started 2022-04-03T21:49:33.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:49:33.622 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:33.620+0000 7fa042299000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-04-03T21:49:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.720+0000 7ffaca2e5700 1 Processor -- start 2022-04-03T21:49:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.721+0000 7ffaca2e5700 1 -- start start 2022-04-03T21:49:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffaca2e5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac40bd8d0 0x7ffac40bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.725 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffaca2e5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac4148c40 con 0x7ffac4149140 2022-04-03T21:49:33.726 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffaca2e5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac414cc00 con 0x7ffac406e7b0 2022-04-03T21:49:33.726 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffaca2e5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40a06c0 con 0x7ffac40bd8d0 2022-04-03T21:49:33.727 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffac37fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffac406e7b0 0x7ffac4142ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47358/0 (socket says 172.21.15.49:47358) 2022-04-03T21:49:33.728 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffac37fe700 1 -- 172.21.15.49:0/1718608318 learned_addr learned my addr 172.21.15.49:0/1718608318 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:33.728 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.722+0000 7ffac3fff700 1 --2- 172.21.15.49:0/1718608318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac40bd8d0 0x7ffac40bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.733 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac2ffd700 1 -- 172.21.15.49:0/1718608318 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231082162 0 0) 0x7ffac414cc00 con 0x7ffac406e7b0 2022-04-03T21:49:33.733 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac2ffd700 1 -- 172.21.15.49:0/1718608318 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab00033f0 con 0x7ffac406e7b0 2022-04-03T21:49:33.733 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac3fff700 1 -- 172.21.15.49:0/1718608318 >> v1:172.21.15.117:6789/0 conn(0x7ffac406e7b0 legacy=0x7ffac4142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.733 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac2ffd700 1 -- 172.21.15.49:0/1718608318 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741600348 0 0) 0x7ffac4148c40 con 0x7ffac4149140 2022-04-03T21:49:33.734 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac3fff700 1 -- 172.21.15.49:0/1718608318 >> v1:172.21.15.49:6789/0 conn(0x7ffac4149140 legacy=0x7ffac41495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.734 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac3fff700 1 -- 172.21.15.49:0/1718608318 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac414cec0 con 0x7ffac40bd8d0 2022-04-03T21:49:33.734 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.723+0000 7ffac3fff700 1 --2- 172.21.15.49:0/1718608318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac40bd8d0 0x7ffac40bdca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009790 tx=0x7ffab4009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee2458116fc7efd server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:33.734 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffac2ffd700 1 -- 172.21.15.49:0/1718608318 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011630 con 0x7ffac40bd8d0 2022-04-03T21:49:33.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffac2ffd700 1 -- 172.21.15.49:0/1718608318 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4011790 con 0x7ffac40bd8d0 2022-04-03T21:49:33.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffac2ffd700 1 -- 172.21.15.49:0/1718608318 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011b30 con 0x7ffac40bd8d0 2022-04-03T21:49:33.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 -- 172.21.15.49:0/1718608318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac40bd8d0 msgr2=0x7ffac40bdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 --2- 172.21.15.49:0/1718608318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac40bd8d0 0x7ffac40bdca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009790 tx=0x7ffab4009060 comp rx=0 tx=0).stop 2022-04-03T21:49:33.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 -- 172.21.15.49:0/1718608318 shutdown_connections 2022-04-03T21:49:33.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 --2- 172.21.15.49:0/1718608318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac40bd8d0 0x7ffac40bdca0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 -- 172.21.15.49:0/1718608318 >> 172.21.15.49:0/1718608318 conn(0x7ffac4067560 msgr2=0x7ffac40bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:33.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 -- 172.21.15.49:0/1718608318 shutdown_connections 2022-04-03T21:49:33.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.724+0000 7ffaca2e5700 1 -- 172.21.15.49:0/1718608318 wait complete. 2022-04-03T21:49:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.726+0000 7ffaca2e5700 1 Processor -- start 2022-04-03T21:49:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.726+0000 7ffaca2e5700 1 -- start start 2022-04-03T21:49:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffaca2e5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 0x7ffac4159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffaca2e5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffac40bd8d0 0x7ffac40b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffaca2e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4149140 0x7ffac406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:33.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffaca2e5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4143ce0 con 0x7ffac4149140 2022-04-03T21:49:33.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffaca2e5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4143e40 con 0x7ffac40bd8d0 2022-04-03T21:49:33.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffaca2e5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac415a9c0 con 0x7ffac406e7b0 2022-04-03T21:49:33.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffac40bd8d0 0x7ffac40b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 0x7ffac4159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 0x7ffac4159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45652/0 (socket says 172.21.15.49:45652) 2022-04-03T21:49:33.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffac40bd8d0 0x7ffac40b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35246/0 (socket says 172.21.15.49:35246) 2022-04-03T21:49:33.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffac3fff700 1 -- 172.21.15.49:0/581924296 learned_addr learned my addr 172.21.15.49:0/581924296 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:33.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.727+0000 7ffac8882700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4149140 0x7ffac406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:33.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffac3fff700 1 -- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffac40bd8d0 msgr2=0x7ffac40b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffac3fff700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffac40bd8d0 0x7ffac40b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffac3fff700 1 -- 172.21.15.49:0/581924296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4149140 msgr2=0x7ffac406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffac3fff700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4149140 0x7ffac406d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffac3fff700 1 -- 172.21.15.49:0/581924296 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40092a0 con 0x7ffac406e7b0 2022-04-03T21:49:33.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffac3fff700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 0x7ffac4159cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffac406bf20 tx=0x7ffab4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:33.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4009130 con 0x7ffac406e7b0 2022-04-03T21:49:33.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4000bc0 con 0x7ffac406e7b0 2022-04-03T21:49:33.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011b30 con 0x7ffac406e7b0 2022-04-03T21:49:33.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.728+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac415a6e0 con 0x7ffac406e7b0 2022-04-03T21:49:33.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.729+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac40b3790 con 0x7ffac406e7b0 2022-04-03T21:49:33.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.729+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ffab400f050 con 0x7ffac406e7b0 2022-04-03T21:49:33.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.729+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7ffab402ead0 con 0x7ffac406e7b0 2022-04-03T21:49:33.743 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.730+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac40b2780 con 0x7ffac406e7b0 2022-04-03T21:49:33.743 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.734+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7ffab4033060 con 0x7ffac406e7b0 2022-04-03T21:49:33.788 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:33.786+0000 7ff9f6632000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-04-03T21:49:33.789 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:33.788+0000 7fa042299000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-04-03T21:49:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.808+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffac4070a20 con 0x7ffac406e7b0 2022-04-03T21:49:33.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.809+0000 7ffaabfff700 1 -- 172.21.15.49:0/581924296 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6992 (secure 0 0 0) 0x7ffab4015020 con 0x7ffac406e7b0 2022-04-03T21:49:33.812 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:49:33.812 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:49:33.372871+0000","last_up_change":"0.000000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:49:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 msgr2=0x7ffac4159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 0x7ffac4159cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffac406bf20 tx=0x7ffab4017000 comp rx=0 tx=0).stop 2022-04-03T21:49:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 shutdown_connections 2022-04-03T21:49:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4149140 0x7ffac406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffac406e7b0 0x7ffac4159cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 --2- 172.21.15.49:0/581924296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffac40bd8d0 0x7ffac40b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 >> 172.21.15.49:0/581924296 conn(0x7ffac4067560 msgr2=0x7ffac4069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.810+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 shutdown_connections 2022-04-03T21:49:33.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:33.811+0000 7ffaca2e5700 1 -- 172.21.15.49:0/581924296 wait complete. 2022-04-03T21:49:33.837 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-04-03T21:49:33.838 INFO:tasks.ceph:Waiting for OSDs to come up 2022-04-03T21:49:33.899 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:33.896+0000 7ff9f6632000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-04-03T21:49:34.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:49:34.016+0000 7f38ad3de3c0 -1 Falling back to public interface 2022-04-03T21:49:34.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:49:34.021+0000 7f597cb7c3c0 -1 Falling back to public interface 2022-04-03T21:49:34.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:49:34.026+0000 7f6e53eef3c0 -1 Falling back to public interface 2022-04-03T21:49:34.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:49:34.036+0000 7f72d34ad3c0 -1 Falling back to public interface 2022-04-03T21:49:34.051 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:34.049+0000 7fa042299000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-04-03T21:49:34.122 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:49:34.120+0000 7fd4b944d3c0 -1 Falling back to public interface 2022-04-03T21:49:34.146 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:34.143+0000 7fa042299000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-04-03T21:49:34.160 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:49:34.158+0000 7fcc5b1da3c0 -1 Falling back to public interface 2022-04-03T21:49:34.161 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:49:34.158+0000 7f027f58d3c0 -1 Falling back to public interface 2022-04-03T21:49:34.171 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:49:34.169+0000 7fc0737583c0 -1 Falling back to public interface 2022-04-03T21:49:34.300 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:34.297+0000 7fa042299000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-04-03T21:49:34.448 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:34.446+0000 7fa042299000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-04-03T21:49:34.645 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-04-03T21:49:34.704 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:34.702+0000 7ff9f6632000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-04-03T21:49:34.835 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.832+0000 7f48c7fff700 1 Processor -- start 2022-04-03T21:49:34.835 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.832+0000 7f48c7fff700 1 -- start start 2022-04-03T21:49:34.838 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a4b70 0x7f48c80a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:34.838 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c7fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48c80b4c30 0x7f48c814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:34.839 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c7fff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c80bc290 con 0x7f48c80a47a0 2022-04-03T21:49:34.839 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c7fff700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c80a5d80 con 0x7f48c80b4c30 2022-04-03T21:49:34.839 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c7fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80a66d0 con 0x7f48c80a4b70 2022-04-03T21:49:34.840 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c77fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f48c80b4c30 0x7f48c814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:34.840 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c67fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a4b70 0x7f48c80a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:34.840 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f48c80a47a0 0x7f48c814e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50442/0 (socket says 172.21.15.49:50442) 2022-04-03T21:49:34.841 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.833+0000 7f48c6ffd700 1 -- 172.21.15.49:0/931985184 learned_addr learned my addr 172.21.15.49:0/931985184 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:34.841 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.834+0000 7f48c67fc700 1 -- 172.21.15.49:0/931985184 >> v2:172.21.15.49:3300/0 conn(0x7f48c80b4c30 msgr2=0x7f48c814ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:34.841 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.834+0000 7f48c67fc700 1 --2- 172.21.15.49:0/931985184 >> v2:172.21.15.49:3300/0 conn(0x7f48c80b4c30 0x7f48c814ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.841 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.834+0000 7f48c67fc700 1 -- 172.21.15.49:0/931985184 >> v1:172.21.15.49:6789/0 conn(0x7f48c80a47a0 legacy=0x7f48c814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:34.842 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.834+0000 7f48c5ffb700 1 -- 172.21.15.49:0/931985184 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115832105 0 0) 0x7f48c80bc290 con 0x7f48c80a47a0 2022-04-03T21:49:34.842 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.834+0000 7f48c67fc700 1 -- 172.21.15.49:0/931985184 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c80bc5f0 con 0x7f48c80a4b70 2022-04-03T21:49:34.842 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.834+0000 7f48c67fc700 1 --2- 172.21.15.49:0/931985184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a4b70 0x7f48c80a6b60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009760 tx=0x7f48bc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f091dd7a2ece60 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:34.843 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c5ffb700 1 -- 172.21.15.49:0/931985184 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc011630 con 0x7f48c80a4b70 2022-04-03T21:49:34.843 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c5ffb700 1 -- 172.21.15.49:0/931985184 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc011790 con 0x7f48c80a4b70 2022-04-03T21:49:34.843 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c5ffb700 1 -- 172.21.15.49:0/931985184 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc011b50 con 0x7f48c80a4b70 2022-04-03T21:49:34.843 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 -- 172.21.15.49:0/931985184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a4b70 msgr2=0x7f48c80a6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:34.843 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 --2- 172.21.15.49:0/931985184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a4b70 0x7f48c80a6b60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009760 tx=0x7f48bc009060 comp rx=0 tx=0).stop 2022-04-03T21:49:34.844 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 -- 172.21.15.49:0/931985184 shutdown_connections 2022-04-03T21:49:34.844 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 --2- 172.21.15.49:0/931985184 >> v2:172.21.15.49:3300/0 conn(0x7f48c80b4c30 0x7f48c814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.844 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 --2- 172.21.15.49:0/931985184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a4b70 0x7f48c80a6b60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.844 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 -- 172.21.15.49:0/931985184 >> 172.21.15.49:0/931985184 conn(0x7f48c80c1540 msgr2=0x7f48c80c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:34.845 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 -- 172.21.15.49:0/931985184 shutdown_connections 2022-04-03T21:49:34.845 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.835+0000 7f48c7fff700 1 -- 172.21.15.49:0/931985184 wait complete. 2022-04-03T21:49:34.848 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.837+0000 7f48c7fff700 1 Processor -- start 2022-04-03T21:49:34.848 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.837+0000 7f48c7fff700 1 -- start start 2022-04-03T21:49:34.848 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a47a0 0x7f48c815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:34.849 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 0x7f48c81470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:34.849 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48c80b4c30 0x7f48c8147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:34.849 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c7fff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80b5f00 con 0x7f48c80b4c30 2022-04-03T21:49:34.849 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c7fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80b89d0 con 0x7f48c80a4b70 2022-04-03T21:49:34.850 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c7fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80b86f0 con 0x7f48c80a47a0 2022-04-03T21:49:34.850 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c6ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a47a0 0x7f48c815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:34.850 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c67fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 0x7f48c81470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:34.851 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c67fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 0x7f48c81470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35248/0 (socket says 172.21.15.49:35248) 2022-04-03T21:49:34.851 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c67fc700 1 -- 172.21.15.49:0/3706785875 learned_addr learned my addr 172.21.15.49:0/3706785875 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:34.851 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.838+0000 7f48c77fe700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48c80b4c30 0x7f48c8147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:34.851 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c6ffd700 1 -- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 msgr2=0x7f48c81470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:34.852 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c6ffd700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 0x7f48c81470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.852 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c6ffd700 1 -- 172.21.15.49:0/3706785875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48c80b4c30 msgr2=0x7f48c8147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:34.852 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c6ffd700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48c80b4c30 0x7f48c8147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.852 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c6ffd700 1 -- 172.21.15.49:0/3706785875 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0092a0 con 0x7f48c80a47a0 2022-04-03T21:49:34.853 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c67fc700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 0x7f48c81470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:34.853 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c6ffd700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a47a0 0x7f48c815dd50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c440 tx=0x7f48b8007cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:34.853 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8007150 con 0x7f48c80a47a0 2022-04-03T21:49:34.853 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b80072b0 con 0x7f48c80a47a0 2022-04-03T21:49:34.854 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b80046b0 con 0x7f48c80a47a0 2022-04-03T21:49:34.854 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.839+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c815e760 con 0x7f48c80a47a0 2022-04-03T21:49:34.854 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.840+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c8149220 con 0x7f48c80a47a0 2022-04-03T21:49:34.854 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.840+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f48b8010030 con 0x7f48c80a47a0 2022-04-03T21:49:34.855 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.840+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f48b8004ce0 con 0x7f48c80a47a0 2022-04-03T21:49:34.855 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.841+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c804b890 con 0x7f48c80a47a0 2022-04-03T21:49:34.855 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.843+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f48b8014420 con 0x7f48c80a47a0 2022-04-03T21:49:34.957 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:34.954+0000 7ff9f6632000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-04-03T21:49:34.957 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.955+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c80bbfb0 con 0x7f48c80a47a0 2022-04-03T21:49:34.958 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.955+0000 7f48aeffd700 1 -- 172.21.15.49:0/3706785875 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6992 (secure 0 0 0) 0x7f48b80145c0 con 0x7f48c80a47a0 2022-04-03T21:49:34.958 INFO:teuthology.misc.health.smithi049.stdout: 2022-04-03T21:49:34.959 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":10,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:49:33.372871+0000","last_up_change":"0.000000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:49:34.960 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a47a0 msgr2=0x7f48c815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:34.960 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a47a0 0x7f48c815dd50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c440 tx=0x7f48b8007cd0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.960 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 shutdown_connections 2022-04-03T21:49:34.961 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48c80b4c30 0x7f48c8147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.961 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48c80a47a0 0x7f48c815dd50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.961 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 --2- 172.21.15.49:0/3706785875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c80a4b70 0x7f48c81470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:34.961 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 >> 172.21.15.49:0/3706785875 conn(0x7f48c80c1540 msgr2=0x7f48c81517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:34.962 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 shutdown_connections 2022-04-03T21:49:34.962 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:34.957+0000 7f48c7fff700 1 -- 172.21.15.49:0/3706785875 wait complete. 2022-04-03T21:49:34.979 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-04-03T21:49:35.336 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:35.334+0000 7ff9f6632000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-04-03T21:49:35.453 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:35.451+0000 7fa042299000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-04-03T21:49:35.489 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:35.486+0000 7ff9f6632000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-04-03T21:49:35.766 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:35.763+0000 7ff9f6632000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-04-03T21:49:35.854 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:35.853+0000 7fa042299000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-04-03T21:49:35.991 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:35.989+0000 7fa042299000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-04-03T21:49:36.024 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:36.021+0000 7ff9f6632000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-04-03T21:49:36.064 INFO:tasks.ceph.mgr.x.smithi117.stderr:2022-04-03T21:49:36.062+0000 7fa042299000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-04-03T21:49:37.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:49:37.514+0000 7f38ad3de3c0 -1 osd.4 0 log_to_monitors true 2022-04-03T21:49:37.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:49:37.542+0000 7f597cb7c3c0 -1 osd.6 0 log_to_monitors true 2022-04-03T21:49:37.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:49:37.568+0000 7f6e53eef3c0 -1 osd.7 0 log_to_monitors true 2022-04-03T21:49:37.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:49:37.597+0000 7f72d34ad3c0 -1 osd.5 0 log_to_monitors true 2022-04-03T21:49:37.687 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:37.685+0000 7ff9f6632000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-04-03T21:49:37.961 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:49:37.958+0000 7fd4b944d3c0 -1 osd.1 0 log_to_monitors true 2022-04-03T21:49:38.132 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:49:38.130+0000 7fc0737583c0 -1 osd.0 0 log_to_monitors true 2022-04-03T21:49:38.145 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:49:38.143+0000 7fcc5b1da3c0 -1 osd.3 0 log_to_monitors true 2022-04-03T21:49:38.154 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:49:38.152+0000 7f027f58d3c0 -1 osd.2 0 log_to_monitors true 2022-04-03T21:49:38.355 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:38.352+0000 7ff9f6632000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-04-03T21:49:38.615 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:38.612+0000 7ff9f6632000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-04-03T21:49:38.755 INFO:tasks.ceph.mgr.y.smithi049.stderr:2022-04-03T21:49:38.752+0000 7ff9f6632000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-04-03T21:49:40.708 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:49:40.706+0000 7fd4b0068700 -1 osd.1 0 waiting for initial osdmap 2022-04-03T21:49:40.716 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:49:40.714+0000 7fd4a89fa700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:49:41.039+0000 7f38a3ff9700 -1 osd.4 0 waiting for initial osdmap 2022-04-03T21:49:41.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:49:41.043+0000 7f389c98b700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:49:41.119+0000 7f5973797700 -1 osd.6 0 waiting for initial osdmap 2022-04-03T21:49:41.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:49:41.122+0000 7f596c129700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:49:41.125+0000 7f72ca0c8700 -1 osd.5 0 waiting for initial osdmap 2022-04-03T21:49:41.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:49:41.129+0000 7f72c2a5a700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:49:41.150+0000 7f6e4ab0a700 -1 osd.7 0 waiting for initial osdmap 2022-04-03T21:49:41.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:49:41.153+0000 7f6e4349c700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.741 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:49:41.739+0000 7fcc51df5700 -1 osd.3 0 waiting for initial osdmap 2022-04-03T21:49:41.748 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:49:41.746+0000 7fcc4a787700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.786 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-04-03T21:49:41.869 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:49:41.866+0000 7fc06a373700 -1 osd.0 0 waiting for initial osdmap 2022-04-03T21:49:41.874 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:49:41.872+0000 7fc062d05700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:41.993 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.990+0000 7f0f4eea4700 1 Processor -- start 2022-04-03T21:49:41.993 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.990+0000 7f0f4eea4700 1 -- start start 2022-04-03T21:49:41.996 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.991+0000 7f0f4eea4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f480a48f0 0x7f0f480c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:41.996 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.991+0000 7f0f4eea4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a4cc0 0x7f0f480c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:41.997 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.991+0000 7f0f4eea4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f480bc4e0 con 0x7f0f480a7260 2022-04-03T21:49:41.997 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.991+0000 7f0f4eea4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4814b2e0 con 0x7f0f480a48f0 2022-04-03T21:49:41.997 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.991+0000 7f0f4eea4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480bc7c0 con 0x7f0f480a4cc0 2022-04-03T21:49:41.997 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a4cc0 0x7f0f480c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:41.998 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f4d441700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0f480a7260 0x7f0f4814b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47360/0 (socket says 172.21.15.49:47360) 2022-04-03T21:49:41.998 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f4d441700 1 -- 172.21.15.49:0/2927241850 learned_addr learned my addr 172.21.15.49:0/2927241850 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:41.998 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f4cc40700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f480a48f0 0x7f0f480c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:41.998 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f477fe700 1 -- 172.21.15.49:0/2927241850 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538551495 0 0) 0x7f0f480bc4e0 con 0x7f0f480a7260 2022-04-03T21:49:41.999 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f477fe700 1 -- 172.21.15.49:0/2927241850 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f2c0033f0 con 0x7f0f480a7260 2022-04-03T21:49:41.999 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f47fff700 1 -- 172.21.15.49:0/2927241850 >> v2:172.21.15.117:3300/0 conn(0x7f0f480a48f0 msgr2=0x7f0f480c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:41.999 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f47fff700 1 --2- 172.21.15.49:0/2927241850 >> v2:172.21.15.117:3300/0 conn(0x7f0f480a48f0 0x7f0f480c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:41.999 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f47fff700 1 -- 172.21.15.49:0/2927241850 >> v1:172.21.15.117:6789/0 conn(0x7f0f480a7260 legacy=0x7f0f4814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:42.000 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f47fff700 1 -- 172.21.15.49:0/2927241850 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f480bcaa0 con 0x7f0f480a4cc0 2022-04-03T21:49:42.000 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.992+0000 7f0f4cc40700 1 --2- 172.21.15.49:0/2927241850 >> v2:172.21.15.117:3300/0 conn(0x7f0f480a48f0 0x7f0f480c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:42.000 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f47fff700 1 --2- 172.21.15.49:0/2927241850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a4cc0 0x7f0f480c0c40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009760 tx=0x7f0f34009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d1557b0340cc522 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:42.000 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f477fe700 1 -- 172.21.15.49:0/2927241850 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340105b0 con 0x7f0f480a4cc0 2022-04-03T21:49:42.000 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f477fe700 1 -- 172.21.15.49:0/2927241850 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34010710 con 0x7f0f480a4cc0 2022-04-03T21:49:42.001 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f477fe700 1 -- 172.21.15.49:0/2927241850 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34010ab0 con 0x7f0f480a4cc0 2022-04-03T21:49:42.001 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f4eea4700 1 -- 172.21.15.49:0/2927241850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a4cc0 msgr2=0x7f0f480c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:42.001 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/2927241850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a4cc0 0x7f0f480c0c40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009760 tx=0x7f0f34009060 comp rx=0 tx=0).stop 2022-04-03T21:49:42.001 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f4eea4700 1 -- 172.21.15.49:0/2927241850 shutdown_connections 2022-04-03T21:49:42.002 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/2927241850 >> v2:172.21.15.117:3300/0 conn(0x7f0f480a48f0 0x7f0f480c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.002 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/2927241850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a4cc0 0x7f0f480c0c40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.002 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.993+0000 7f0f4eea4700 1 -- 172.21.15.49:0/2927241850 >> 172.21.15.49:0/2927241850 conn(0x7f0f480c16b0 msgr2=0x7f0f480c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:42.002 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.994+0000 7f0f4eea4700 1 -- 172.21.15.49:0/2927241850 shutdown_connections 2022-04-03T21:49:42.002 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.994+0000 7f0f4eea4700 1 -- 172.21.15.49:0/2927241850 wait complete. 2022-04-03T21:49:42.006 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.995+0000 7f0f4eea4700 1 Processor -- start 2022-04-03T21:49:42.006 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.995+0000 7f0f4eea4700 1 -- start start 2022-04-03T21:49:42.006 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f4eea4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a48f0 0x7f0f480b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:42.007 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f4eea4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 0x7f0f4814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:42.007 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f4eea4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f480a7260 0x7f0f4815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:42.007 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f4eea4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480b5400 con 0x7f0f480a4cc0 2022-04-03T21:49:42.007 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f4eea4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480b59c0 con 0x7f0f480a7260 2022-04-03T21:49:42.008 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f4eea4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4814a110 con 0x7f0f480a48f0 2022-04-03T21:49:42.008 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.996+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 0x7f0f4814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:42.008 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 0x7f0f4814fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34440/0 (socket says 172.21.15.49:34440) 2022-04-03T21:49:42.008 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f47fff700 1 -- 172.21.15.49:0/4129176988 learned_addr learned my addr 172.21.15.49:0/4129176988 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:42.008 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4d441700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f480a7260 0x7f0f4815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:42.009 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4cc40700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a48f0 0x7f0f480b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:42.009 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4d441700 1 -- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a48f0 msgr2=0x7f0f480b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:42.009 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4d441700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a48f0 0x7f0f480b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.009 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4d441700 1 -- 172.21.15.49:0/4129176988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 msgr2=0x7f0f4814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:42.010 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4d441700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 0x7f0f4814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.010 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4d441700 1 -- 172.21.15.49:0/4129176988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0092a0 con 0x7f0f480a7260 2022-04-03T21:49:42.010 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f4cc40700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a48f0 0x7f0f480b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:42.010 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.997+0000 7f0f47fff700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 0x7f0f4814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:42.011 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.998+0000 7f0f4d441700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f480a7260 0x7f0f4815b2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f480a76a0 tx=0x7f0f40007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:42.011 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.998+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005d30 con 0x7f0f480a7260 2022-04-03T21:49:42.011 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.998+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f40005e90 con 0x7f0f480a7260 2022-04-03T21:49:42.011 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.998+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f340092a0 con 0x7f0f480a7260 2022-04-03T21:49:42.011 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.998+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400072e0 con 0x7f0f480a7260 2022-04-03T21:49:42.012 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.998+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f480b66b0 con 0x7f0f480a7260 2022-04-03T21:49:42.012 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:41.999+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f480b5b50 con 0x7f0f480a7260 2022-04-03T21:49:42.012 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.000+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 81882+0+0 (secure 0 0 0) 0x7f0f40019030 con 0x7f0f480a7260 2022-04-03T21:49:42.012 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.001+0000 7f0f44ff9700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0f30063c90 0x7f0f30066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:42.013 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.001+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3627+0+0 (secure 0 0 0) 0x7f0f4007f160 con 0x7f0f480a7260 2022-04-03T21:49:42.013 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.001+0000 7f0f4cc40700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0f30063c90 0x7f0f30066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:42.013 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.002+0000 7f0f4cc40700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0f30063c90 0x7f0f30066140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0113e0 tx=0x7f0f3c009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:42.014 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.005+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f0f40048ae0 con 0x7f0f480a7260 2022-04-03T21:49:42.218 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.215+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f4804b890 con 0x7f0f480a7260 2022-04-03T21:49:42.219 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.216+0000 7f0f44ff9700 1 -- 172.21.15.49:0/4129176988 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9133 (secure 0 0 0) 0x7f0f40017030 con 0x7f0f480a7260 2022-04-03T21:49:42.219 INFO:teuthology.misc.health.smithi049.stdout: 2022-04-03T21:49:42.219 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":14,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:49:41.698548+0000","last_up_change":"2022-04-03T21:49:41.698548+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:49:42.221 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.218+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0f30063c90 msgr2=0x7f0f30066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:42.222 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.218+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0f30063c90 0x7f0f30066140 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0113e0 tx=0x7f0f3c009060 comp rx=0 tx=0).stop 2022-04-03T21:49:42.222 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.218+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f480a7260 msgr2=0x7f0f4815b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:42.222 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.218+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f480a7260 0x7f0f4815b2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f480a76a0 tx=0x7f0f40007ef0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.222 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 shutdown_connections 2022-04-03T21:49:42.223 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0f30063c90 0x7f0f30066140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.223 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f480a7260 0x7f0f4815b2e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.223 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f480a48f0 0x7f0f480b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.224 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 --2- 172.21.15.49:0/4129176988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f480a4cc0 0x7f0f4814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:42.224 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 >> 172.21.15.49:0/4129176988 conn(0x7f0f480c16b0 msgr2=0x7f0f480c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:42.224 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 shutdown_connections 2022-04-03T21:49:42.224 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:42.219+0000 7f0f4eea4700 1 -- 172.21.15.49:0/4129176988 wait complete. 2022-04-03T21:49:42.242 DEBUG:teuthology.misc:5 of 8 OSDs are up 2022-04-03T21:49:43.096 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:49:43.094+0000 7f02761a8700 -1 osd.2 0 waiting for initial osdmap 2022-04-03T21:49:43.101 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:49:43.100+0000 7f026eb3a700 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-03T21:49:49.050 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-04-03T21:49:49.246 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.244+0000 7fa37b78b700 1 Processor -- start 2022-04-03T21:49:49.246 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.245+0000 7fa37b78b700 1 -- start start 2022-04-03T21:49:49.249 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.245+0000 7fa37b78b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a48f0 0x7fa3740bd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.249 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa37b78b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa37414b1f0 0x7fa37414b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.249 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa37b78b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740a7240 con 0x7fa3740a4cc0 2022-04-03T21:49:49.249 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa37b78b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740bdd70 con 0x7fa37414b1f0 2022-04-03T21:49:49.250 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa37b78b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740bdf60 con 0x7fa3740a48f0 2022-04-03T21:49:49.250 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa378d26700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3740a4cc0 0x7fa3740c0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50446/0 (socket says 172.21.15.49:50446) 2022-04-03T21:49:49.250 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa378d26700 1 -- 172.21.15.49:0/1288255067 learned_addr learned my addr 172.21.15.49:0/1288255067 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:49.250 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa379527700 1 --2- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a48f0 0x7fa3740bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.250 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa379d28700 1 --2- 172.21.15.49:0/1288255067 >> v2:172.21.15.117:3300/0 conn(0x7fa37414b1f0 0x7fa37414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.251 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.246+0000 7fa363fff700 1 -- 172.21.15.49:0/1288255067 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491088842 0 0) 0x7fa3740a7240 con 0x7fa3740a4cc0 2022-04-03T21:49:49.251 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa363fff700 1 -- 172.21.15.49:0/1288255067 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c0033f0 con 0x7fa3740a4cc0 2022-04-03T21:49:49.251 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa379d28700 1 -- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a48f0 msgr2=0x7fa3740bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:49.251 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa379d28700 1 --2- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a48f0 0x7fa3740bd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.252 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa379d28700 1 -- 172.21.15.49:0/1288255067 >> v1:172.21.15.49:6789/0 conn(0x7fa3740a4cc0 legacy=0x7fa3740c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.252 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa379d28700 1 -- 172.21.15.49:0/1288255067 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740a6950 con 0x7fa37414b1f0 2022-04-03T21:49:49.252 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa379d28700 1 --2- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa37414b690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009e60 tx=0x7fa36c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01907ce963d9e9a server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:49.252 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa363fff700 1 -- 172.21.15.49:0/1288255067 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00e070 con 0x7fa37414b1f0 2022-04-03T21:49:49.252 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa363fff700 1 -- 172.21.15.49:0/1288255067 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00bab0 con 0x7fa37414b1f0 2022-04-03T21:49:49.253 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.247+0000 7fa363fff700 1 -- 172.21.15.49:0/1288255067 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00be30 con 0x7fa37414b1f0 2022-04-03T21:49:49.256 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 -- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 msgr2=0x7fa37414b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.257 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 --2- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa37414b690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009e60 tx=0x7fa36c009780 comp rx=0 tx=0).stop 2022-04-03T21:49:49.257 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 -- 172.21.15.49:0/1288255067 shutdown_connections 2022-04-03T21:49:49.257 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 --2- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa37414b690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.257 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 --2- 172.21.15.49:0/1288255067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a48f0 0x7fa3740bd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.258 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 -- 172.21.15.49:0/1288255067 >> 172.21.15.49:0/1288255067 conn(0x7fa3740c16b0 msgr2=0x7fa3740c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:49.258 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 -- 172.21.15.49:0/1288255067 shutdown_connections 2022-04-03T21:49:49.258 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.248+0000 7fa37b78b700 1 -- 172.21.15.49:0/1288255067 wait complete. 2022-04-03T21:49:49.258 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.249+0000 7fa37b78b700 1 Processor -- start 2022-04-03T21:49:49.258 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 -- start start 2022-04-03T21:49:49.259 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 0x7fa3740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.259 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a4cc0 0x7fa374146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.259 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa3740b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.259 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740c02e0 con 0x7fa3740a48f0 2022-04-03T21:49:49.260 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740b7aa0 con 0x7fa37414b1f0 2022-04-03T21:49:49.260 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.250+0000 7fa37b78b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740b7d80 con 0x7fa3740a4cc0 2022-04-03T21:49:49.260 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 0x7fa3740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.260 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa378d26700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a4cc0 0x7fa374146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.261 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379d28700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa3740b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.261 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 0x7fa3740b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34442/0 (socket says 172.21.15.49:34442) 2022-04-03T21:49:49.261 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 -- 172.21.15.49:0/3561087470 learned_addr learned my addr 172.21.15.49:0/3561087470 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:49.261 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 -- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a4cc0 msgr2=0x7fa374146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.261 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a4cc0 0x7fa374146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.262 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 -- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 msgr2=0x7fa3740b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.262 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa3740b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.262 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.251+0000 7fa379527700 1 -- 172.21.15.49:0/3561087470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c009a20 con 0x7fa3740a48f0 2022-04-03T21:49:49.262 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.252+0000 7fa379527700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 0x7fa3740b7230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e930 tx=0x7fa370009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:49.262 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.252+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370013680 con 0x7fa3740a48f0 2022-04-03T21:49:49.263 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.252+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3700137e0 con 0x7fa3740a48f0 2022-04-03T21:49:49.263 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.252+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370013b60 con 0x7fa3740a48f0 2022-04-03T21:49:49.263 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.252+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3740b8060 con 0x7fa3740a48f0 2022-04-03T21:49:49.263 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.252+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa374146b60 con 0x7fa3740a48f0 2022-04-03T21:49:49.263 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.253+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37404b890 con 0x7fa3740a48f0 2022-04-03T21:49:49.264 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.254+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fa370019030 con 0x7fa3740a48f0 2022-04-03T21:49:49.264 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.255+0000 7fa3617fa700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa354063ce0 0x7fa354066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.264 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.255+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa370080380 con 0x7fa3740a48f0 2022-04-03T21:49:49.264 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.255+0000 7fa378d26700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa354063ce0 0x7fa354066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.265 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.256+0000 7fa378d26700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa354063ce0 0x7fa354066190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa374146f20 tx=0x7fa364009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:49.265 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.260+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fa37004f320 con 0x7fa3740a48f0 2022-04-03T21:49:49.472 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.471+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3740b54c0 con 0x7fa3740a48f0 2022-04-03T21:49:49.473 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.472+0000 7fa3617fa700 1 -- 172.21.15.49:0/3561087470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12106 (secure 0 0 0) 0x7fa370017090 con 0x7fa3740a48f0 2022-04-03T21:49:49.473 INFO:teuthology.misc.health.smithi049.stdout: 2022-04-03T21:49:49.474 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":17,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:49:44.740979+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:49:49.476 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa354063ce0 msgr2=0x7fa354066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.476 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa354063ce0 0x7fa354066190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa374146f20 tx=0x7fa364009040 comp rx=0 tx=0).stop 2022-04-03T21:49:49.476 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 msgr2=0x7fa3740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.477 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 0x7fa3740b7230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e930 tx=0x7fa370009060 comp rx=0 tx=0).stop 2022-04-03T21:49:49.477 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 shutdown_connections 2022-04-03T21:49:49.477 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa354063ce0 0x7fa354066190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.477 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa37414b1f0 0x7fa3740b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.477 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740a48f0 0x7fa3740b7230 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.478 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 --2- 172.21.15.49:0/3561087470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3740a4cc0 0x7fa374146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.478 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 >> 172.21.15.49:0/3561087470 conn(0x7fa3740c16b0 msgr2=0x7fa3741487e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:49.478 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 shutdown_connections 2022-04-03T21:49:49.478 INFO:teuthology.misc.health.smithi049.stderr:2022-04-03T21:49:49.474+0000 7fa37b78b700 1 -- 172.21.15.49:0/3561087470 wait complete. 2022-04-03T21:49:49.497 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-04-03T21:49:49.497 INFO:tasks.ceph:Creating RBD pool 2022-04-03T21:49:49.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool create rbd 8 2022-04-03T21:49:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.701+0000 7fbc0c37e700 1 Processor -- start 2022-04-03T21:49:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.701+0000 7fbc0c37e700 1 -- start start 2022-04-03T21:49:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.702+0000 7fbc0c37e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc04069af0 0x7fbc04152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0c37e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc040b84a0 con 0x7fbc0406c220 2022-04-03T21:49:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0c37e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0406eae0 con 0x7fbc0406c5f0 2022-04-03T21:49:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0c37e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0406d4f0 con 0x7fbc04069af0 2022-04-03T21:49:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0a91b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc04069af0 0x7fbc04152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0a11a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbc0406c220 0x7fbc040693e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50448/0 (socket says 172.21.15.49:50448) 2022-04-03T21:49:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0a11a700 1 -- 172.21.15.49:0/4268417603 learned_addr learned my addr 172.21.15.49:0/4268417603 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc09919700 1 --1- 172.21.15.49:0/4268417603 >> v1:172.21.15.117:6789/0 conn(0x7fbc0406c5f0 0x7fbc0406a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47362/0 (socket says 172.21.15.49:47362) 2022-04-03T21:49:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0a91b700 1 -- 172.21.15.49:0/4268417603 >> v1:172.21.15.117:6789/0 conn(0x7fbc0406c5f0 legacy=0x7fbc0406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0a91b700 1 -- 172.21.15.49:0/4268417603 >> v1:172.21.15.49:6789/0 conn(0x7fbc0406c220 legacy=0x7fbc040693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc09118700 1 -- 172.21.15.49:0/4268417603 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032922479 0 0) 0x7fbc0406eae0 con 0x7fbc0406c5f0 2022-04-03T21:49:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.703+0000 7fbc0a91b700 1 -- 172.21.15.49:0/4268417603 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0406ce70 con 0x7fbc04069af0 2022-04-03T21:49:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.704+0000 7fbc0a91b700 1 --2- 172.21.15.49:0/4268417603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc04069af0 0x7fbc04152ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009e90 tx=0x7fbbfc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc8997b168754ed server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.704+0000 7fbc09118700 1 -- 172.21.15.49:0/4268417603 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00e070 con 0x7fbc04069af0 2022-04-03T21:49:49.709 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.704+0000 7fbc09118700 1 -- 172.21.15.49:0/4268417603 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc00bc30 con 0x7fbc04069af0 2022-04-03T21:49:49.709 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.704+0000 7fbc09118700 1 -- 172.21.15.49:0/4268417603 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc012430 con 0x7fbc04069af0 2022-04-03T21:49:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 -- 172.21.15.49:0/4268417603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc04069af0 msgr2=0x7fbc04152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/4268417603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc04069af0 0x7fbc04152ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009e90 tx=0x7fbbfc009780 comp rx=0 tx=0).stop 2022-04-03T21:49:49.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 -- 172.21.15.49:0/4268417603 shutdown_connections 2022-04-03T21:49:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/4268417603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc04069af0 0x7fbc04152ff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 -- 172.21.15.49:0/4268417603 >> 172.21.15.49:0/4268417603 conn(0x7fbc040675b0 msgr2=0x7fbc040bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 -- 172.21.15.49:0/4268417603 shutdown_connections 2022-04-03T21:49:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.705+0000 7fbc0c37e700 1 -- 172.21.15.49:0/4268417603 wait complete. 2022-04-03T21:49:49.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.706+0000 7fbc0c37e700 1 Processor -- start 2022-04-03T21:49:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.707+0000 7fbc0c37e700 1 -- start start 2022-04-03T21:49:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.707+0000 7fbc0c37e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 0x7fbc04158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.707+0000 7fbc0c37e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0406c220 0x7fbc041590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0c37e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0406c5f0 0x7fbc040b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0c37e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0409e700 con 0x7fbc04069af0 2022-04-03T21:49:49.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0c37e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040bceb0 con 0x7fbc0406c5f0 2022-04-03T21:49:49.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0c37e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040b5e50 con 0x7fbc0406c220 2022-04-03T21:49:49.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 0x7fbc04158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 0x7fbc04158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34444/0 (socket says 172.21.15.49:34444) 2022-04-03T21:49:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 -- 172.21.15.49:0/1908101867 learned_addr learned my addr 172.21.15.49:0/1908101867 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc09919700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0406c220 0x7fbc041590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a91b700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0406c5f0 0x7fbc040b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 -- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0406c220 msgr2=0x7fbc041590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0406c220 0x7fbc041590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 -- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0406c5f0 msgr2=0x7fbc040b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0406c5f0 0x7fbc040b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.708+0000 7fbc0a11a700 1 -- 172.21.15.49:0/1908101867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc009a20 con 0x7fbc04069af0 2022-04-03T21:49:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.709+0000 7fbc0a11a700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 0x7fbc04158bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc00007fd0 tx=0x7fbc00007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.709+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000ce10 con 0x7fbc04069af0 2022-04-03T21:49:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.709+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc000072e0 con 0x7fbc04069af0 2022-04-03T21:49:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.709+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc040b6c70 con 0x7fbc04069af0 2022-04-03T21:49:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.709+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00007660 con 0x7fbc04069af0 2022-04-03T21:49:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.709+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc040b63d0 con 0x7fbc04069af0 2022-04-03T21:49:49.719 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.710+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc04070a20 con 0x7fbc04069af0 2022-04-03T21:49:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.711+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fbc00019030 con 0x7fbc04069af0 2022-04-03T21:49:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.712+0000 7fbbf27fc700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fbbe4063ce0 0x7fbbe4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.713+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbc0007f440 con 0x7fbc04069af0 2022-04-03T21:49:49.720 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.713+0000 7fbc09919700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fbbe4063ce0 0x7fbbe4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:49.721 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.713+0000 7fbc09919700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fbbe4063ce0 0x7fbbe4066190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc040b75a0 tx=0x7fbbf4007d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:49.721 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.717+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fbc00048ae0 con 0x7fbc04069af0 2022-04-03T21:49:49.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:49.920+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbc04068460 con 0x7fbc04069af0 2022-04-03T21:49:50.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.812+0000 7fbbf27fc700 1 -- 172.21.15.49:0/1908101867 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbc00017070 con 0x7fbc04069af0 2022-04-03T21:49:50.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fbbe4063ce0 msgr2=0x7fbbe4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:50.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fbbe4063ce0 0x7fbbe4066190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc040b75a0 tx=0x7fbbf4007d10 comp rx=0 tx=0).stop 2022-04-03T21:49:50.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 msgr2=0x7fbc04158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:50.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 0x7fbc04158bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc00007fd0 tx=0x7fbc00007df0 comp rx=0 tx=0).stop 2022-04-03T21:49:50.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 shutdown_connections 2022-04-03T21:49:50.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fbbe4063ce0 0x7fbbe4066190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0406c5f0 0x7fbc040b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc04069af0 0x7fbc04158bb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 --2- 172.21.15.49:0/1908101867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0406c220 0x7fbc041590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 >> 172.21.15.49:0/1908101867 conn(0x7fbc040675b0 msgr2=0x7fbc040ba270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 shutdown_connections 2022-04-03T21:49:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:50.816+0000 7fbc0c37e700 1 -- 172.21.15.49:0/1908101867 wait complete. 2022-04-03T21:49:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'rbd' created 2022-04-03T21:49:50.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-04-03T21:49:51.057 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.054+0000 7f26560f9700 1 Processor -- start 2022-04-03T21:49:51.057 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.054+0000 7f26560f9700 1 -- start start 2022-04-03T21:49:51.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f26560f9700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f265006e520 0x7f265014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f26560f9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f2650142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:51.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f26560f9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2650149100 con 0x7f2650069dd0 2022-04-03T21:49:51.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f26560f9700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26500a0910 con 0x7f265006e520 2022-04-03T21:49:51.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f26560f9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265014d160 con 0x7f265006e8f0 2022-04-03T21:49:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f264f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f265006e520 0x7f265014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f264f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f265006e520 0x7f265014cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34446/0 (socket says 172.21.15.49:34446) 2022-04-03T21:49:51.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f264f7fe700 1 -- 172.21.15.49:0/2183375130 learned_addr learned my addr 172.21.15.49:0/2183375130 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:51.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.055+0000 7f264ffff700 1 --2- 172.21.15.49:0/2183375130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f2650142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:51.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264f7fe700 1 -- 172.21.15.49:0/2183375130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 msgr2=0x7f2650142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264f7fe700 1 --2- 172.21.15.49:0/2183375130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f2650142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264e7fc700 1 -- 172.21.15.49:0/2183375130 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181375926 0 0) 0x7f2650149100 con 0x7f2650069dd0 2022-04-03T21:49:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264f7fe700 1 -- 172.21.15.49:0/2183375130 >> v1:172.21.15.117:6789/0 conn(0x7f2650069dd0 legacy=0x7f2650149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264f7fe700 1 -- 172.21.15.49:0/2183375130 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650148dd0 con 0x7f265006e520 2022-04-03T21:49:51.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264f7fe700 1 --2- 172.21.15.49:0/2183375130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f265006e520 0x7f265014cc20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2640006fd0 tx=0x7f26400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a0a41d2a6a9e31 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:51.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264e7fc700 1 -- 172.21.15.49:0/2183375130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640004030 con 0x7f265006e520 2022-04-03T21:49:51.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264e7fc700 1 -- 172.21.15.49:0/2183375130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26400041d0 con 0x7f265006e520 2022-04-03T21:49:51.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.056+0000 7f264e7fc700 1 -- 172.21.15.49:0/2183375130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011630 con 0x7f265006e520 2022-04-03T21:49:51.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 -- 172.21.15.49:0/2183375130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f265006e520 msgr2=0x7f265014cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:51.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 --2- 172.21.15.49:0/2183375130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f265006e520 0x7f265014cc20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2640006fd0 tx=0x7f26400090f0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 -- 172.21.15.49:0/2183375130 shutdown_connections 2022-04-03T21:49:51.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 --2- 172.21.15.49:0/2183375130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f2650142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 --2- 172.21.15.49:0/2183375130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f265006e520 0x7f265014cc20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 -- 172.21.15.49:0/2183375130 >> 172.21.15.49:0/2183375130 conn(0x7f2650066ae0 msgr2=0x7f2650066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:51.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 -- 172.21.15.49:0/2183375130 shutdown_connections 2022-04-03T21:49:51.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.057+0000 7f26560f9700 1 -- 172.21.15.49:0/2183375130 wait complete. 2022-04-03T21:49:51.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.059+0000 7f26560f9700 1 Processor -- start 2022-04-03T21:49:51.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.059+0000 7f26560f9700 1 -- start start 2022-04-03T21:49:51.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f26560f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 0x7f2650144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:51.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f26560f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f265006e520 0x7f26501450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:51.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f26560f9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f265015de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f26560f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26500be0f0 con 0x7f2650069dd0 2022-04-03T21:49:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f26560f9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26500bb910 con 0x7f265006e520 2022-04-03T21:49:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f26560f9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26500bb5e0 con 0x7f265006e8f0 2022-04-03T21:49:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 0x7f2650144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 0x7f2650144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34448/0 (socket says 172.21.15.49:34448) 2022-04-03T21:49:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 -- 172.21.15.49:0/2239053705 learned_addr learned my addr 172.21.15.49:0/2239053705 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264ffff700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f265015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264effd700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f265006e520 0x7f26501450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 -- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 msgr2=0x7f265015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f265015de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 -- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f265006e520 msgr2=0x7f26501450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f265006e520 0x7f26501450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.060+0000 7f264f7fe700 1 -- 172.21.15.49:0/2239053705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2640009370 con 0x7f2650069dd0 2022-04-03T21:49:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.061+0000 7f264f7fe700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 0x7f2650144ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2640004000 tx=0x7f2640016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.061+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400036f0 con 0x7f2650069dd0 2022-04-03T21:49:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.061+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640003850 con 0x7f2650069dd0 2022-04-03T21:49:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.061+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26500bdb30 con 0x7f2650069dd0 2022-04-03T21:49:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.061+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640003bf0 con 0x7f2650069dd0 2022-04-03T21:49:51.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.061+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26500b1be0 con 0x7f2650069dd0 2022-04-03T21:49:51.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.062+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26500bb440 con 0x7f2650069dd0 2022-04-03T21:49:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.063+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f264002b020 con 0x7f2650069dd0 2022-04-03T21:49:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.064+0000 7f26377fe700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f2630063d10 0x7f26300661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.064+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f2640082650 con 0x7f2650069dd0 2022-04-03T21:49:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.065+0000 7f264effd700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f2630063d10 0x7f26300661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.065+0000 7f264effd700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f2630063d10 0x7f26300661c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f265014c9c0 tx=0x7f2644009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:51.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.070+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f26500bb440 con 0x7f2650069dd0 2022-04-03T21:49:51.285 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.282+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2650070a20 con 0x7f2650069dd0 2022-04-03T21:49:51.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.815+0000 7f26377fe700 1 -- 172.21.15.49:0/2239053705 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f26400514a0 con 0x7f2650069dd0 2022-04-03T21:49:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f2630063d10 msgr2=0x7f26300661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f2630063d10 0x7f26300661c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f265014c9c0 tx=0x7f2644009040 comp rx=0 tx=0).stop 2022-04-03T21:49:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 msgr2=0x7f2650144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 0x7f2650144ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2640004000 tx=0x7f2640016000 comp rx=0 tx=0).stop 2022-04-03T21:49:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 shutdown_connections 2022-04-03T21:49:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f2630063d10 0x7f26300661c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f265006e8f0 0x7f265015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2650069dd0 0x7f2650144ba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 --2- 172.21.15.49:0/2239053705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f265006e520 0x7f26501450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 >> 172.21.15.49:0/2239053705 conn(0x7f2650066ae0 msgr2=0x7f26501463c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 shutdown_connections 2022-04-03T21:49:51.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:51.820+0000 7f26560f9700 1 -- 172.21.15.49:0/2239053705 wait complete. 2022-04-03T21:49:51.826 INFO:teuthology.orchestra.run.smithi049.stderr:enabled application 'rbd' on pool 'rbd' 2022-04-03T21:49:51.853 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-04-03T21:49:51.853 INFO:tasks.ceph.mds.a:Restarting daemon 2022-04-03T21:49:51.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-04-03T21:49:51.859 INFO:tasks.ceph.mds.a:Started 2022-04-03T21:49:51.859 INFO:tasks.ceph.mds.c:Restarting daemon 2022-04-03T21:49:51.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-04-03T21:49:51.864 INFO:tasks.ceph.mds.c:Started 2022-04-03T21:49:51.864 INFO:tasks.ceph.mds.b:Restarting daemon 2022-04-03T21:49:51.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-04-03T21:49:51.867 INFO:tasks.ceph.mds.b:Started 2022-04-03T21:49:51.867 INFO:tasks.ceph.mds.d:Restarting daemon 2022-04-03T21:49:51.868 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-04-03T21:49:51.870 INFO:tasks.ceph.mds.d:Started 2022-04-03T21:49:51.870 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-04-03T21:49:51.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:49:51.950 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-03T21:49:51.951 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2022-04-03T21:49:52.035 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2022-04-03T21:49:52.035 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2022-04-03T21:49:52.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.106+0000 7fda84d59700 1 Processor -- start 2022-04-03T21:49:52.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.106+0000 7fda84d59700 1 -- start start 2022-04-03T21:49:52.112 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.107+0000 7fda84d59700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda8014b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.112 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.107+0000 7fda84d59700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fda800c2300 0x7fda800a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.112 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.107+0000 7fda84d59700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8014b1a0 con 0x7fda8014be70 2022-04-03T21:49:52.112 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.107+0000 7fda84d59700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800a5ad0 con 0x7fda800c2300 2022-04-03T21:49:52.113 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.107+0000 7fda84d59700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda800bdd60 con 0x7fda800c1f30 2022-04-03T21:49:52.113 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.107+0000 7fda7e59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda8014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.113 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7dd9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fda800c2300 0x7fda800a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.113 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda8014b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45688/0 (socket says 172.21.15.49:45688) 2022-04-03T21:49:52.114 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 -- 172.21.15.49:0/690352424 learned_addr learned my addr 172.21.15.49:0/690352424 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:52.114 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7ed9d700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fda8014be70 0x7fda8014e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47370/0 (socket says 172.21.15.49:47370) 2022-04-03T21:49:52.114 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 -- 172.21.15.49:0/690352424 >> v2:172.21.15.49:3300/0 conn(0x7fda800c2300 msgr2=0x7fda800a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:52.114 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 --2- 172.21.15.49:0/690352424 >> v2:172.21.15.49:3300/0 conn(0x7fda800c2300 0x7fda800a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.115 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 -- 172.21.15.49:0/690352424 >> v1:172.21.15.117:6789/0 conn(0x7fda8014be70 legacy=0x7fda8014e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.115 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 -- 172.21.15.49:0/690352424 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800bdac0 con 0x7fda800c1f30 2022-04-03T21:49:52.115 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7dd9b700 1 --2- 172.21.15.49:0/690352424 >> v2:172.21.15.49:3300/0 conn(0x7fda800c2300 0x7fda800a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:52.115 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7d59a700 1 -- 172.21.15.49:0/690352424 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097281421 0 0) 0x7fda8014b1a0 con 0x7fda8014be70 2022-04-03T21:49:52.115 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.108+0000 7fda7e59c700 1 --2- 172.21.15.49:0/690352424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda8014b930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda70006fd0 tx=0x7fda700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c64e54e36838e19 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda7d59a700 1 -- 172.21.15.49:0/690352424 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70004030 con 0x7fda800c1f30 2022-04-03T21:49:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda7d59a700 1 -- 172.21.15.49:0/690352424 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda700041d0 con 0x7fda800c1f30 2022-04-03T21:49:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda7d59a700 1 -- 172.21.15.49:0/690352424 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70011630 con 0x7fda800c1f30 2022-04-03T21:49:52.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 -- 172.21.15.49:0/690352424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 msgr2=0x7fda8014b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 --2- 172.21.15.49:0/690352424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda8014b930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda70006fd0 tx=0x7fda700090f0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 -- 172.21.15.49:0/690352424 shutdown_connections 2022-04-03T21:49:52.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 --2- 172.21.15.49:0/690352424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda8014b930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 --2- 172.21.15.49:0/690352424 >> v2:172.21.15.49:3300/0 conn(0x7fda800c2300 0x7fda800a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 -- 172.21.15.49:0/690352424 >> 172.21.15.49:0/690352424 conn(0x7fda8005dfc0 msgr2=0x7fda800c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:52.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 -- 172.21.15.49:0/690352424 shutdown_connections 2022-04-03T21:49:52.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.109+0000 7fda84d59700 1 -- 172.21.15.49:0/690352424 wait complete. 2022-04-03T21:49:52.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.111+0000 7fda84d59700 1 Processor -- start 2022-04-03T21:49:52.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.111+0000 7fda84d59700 1 -- start start 2022-04-03T21:49:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda84d59700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda800bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda84d59700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 0x7fda8015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda84d59700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda8014be70 0x7fda8015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda84d59700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8014f440 con 0x7fda800c2300 2022-04-03T21:49:52.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda84d59700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8015c260 con 0x7fda8014be70 2022-04-03T21:49:52.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda84d59700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8014f1a0 con 0x7fda800c1f30 2022-04-03T21:49:52.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda7dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 0x7fda8015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda7e59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda800bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda7ed9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda8014be70 0x7fda8015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda7dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 0x7fda8015e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34458/0 (socket says 172.21.15.49:34458) 2022-04-03T21:49:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.112+0000 7fda7dd9b700 1 -- 172.21.15.49:0/447941406 learned_addr learned my addr 172.21.15.49:0/447941406 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7e59c700 1 -- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda8014be70 msgr2=0x7fda8015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7e59c700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda8014be70 0x7fda8015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7e59c700 1 -- 172.21.15.49:0/447941406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 msgr2=0x7fda8015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7e59c700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 0x7fda8015e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7e59c700 1 -- 172.21.15.49:0/447941406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740092a0 con 0x7fda800c1f30 2022-04-03T21:49:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7dd9b700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 0x7fda8015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda7e59c700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda800bab00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda800b5420 tx=0x7fda70016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.113+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda700036f0 con 0x7fda800c1f30 2022-04-03T21:49:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.114+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70003890 con 0x7fda800c1f30 2022-04-03T21:49:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.114+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda70009370 con 0x7fda800c1f30 2022-04-03T21:49:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.114+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70003c50 con 0x7fda800c1f30 2022-04-03T21:49:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.114+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8015f160 con 0x7fda800c1f30 2022-04-03T21:49:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.115+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda80070a20 con 0x7fda800c1f30 2022-04-03T21:49:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.115+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fda70017020 con 0x7fda800c1f30 2022-04-03T21:49:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.116+0000 7fda6e7fc700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fda5c063ce0 0x7fda5c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.116+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fda70081cb0 con 0x7fda800c1f30 2022-04-03T21:49:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.117+0000 7fda7dd9b700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fda5c063ce0 0x7fda5c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.117+0000 7fda7dd9b700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fda5c063ce0 0x7fda5c066190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda8014c700 tx=0x7fda74009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:52.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.121+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fda70050be0 con 0x7fda800c1f30 2022-04-03T21:49:52.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.326+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda80068100 con 0x7fda800c1f30 2022-04-03T21:49:52.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.327+0000 7fda6e7fc700 1 -- 172.21.15.49:0/447941406 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13639 (secure 0 0 0) 0x7fda70054200 con 0x7fda800c1f30 2022-04-03T21:49:52.330 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:49:52.330 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:49:51.811664+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:49:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fda5c063ce0 msgr2=0x7fda5c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fda5c063ce0 0x7fda5c066190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda8014c700 tx=0x7fda74009060 comp rx=0 tx=0).stop 2022-04-03T21:49:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 msgr2=0x7fda800bab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda800bab00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda800b5420 tx=0x7fda70016000 comp rx=0 tx=0).stop 2022-04-03T21:49:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 shutdown_connections 2022-04-03T21:49:52.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fda5c063ce0 0x7fda5c066190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda8014be70 0x7fda8015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda800c1f30 0x7fda800bab00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 --2- 172.21.15.49:0/447941406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda800c2300 0x7fda8015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.329+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 >> 172.21.15.49:0/447941406 conn(0x7fda8005dfc0 msgr2=0x7fda80149110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.330+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 shutdown_connections 2022-04-03T21:49:52.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.330+0000 7fda84d59700 1 -- 172.21.15.49:0/447941406 wait complete. 2022-04-03T21:49:52.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-04-03T21:49:42.179170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-04-03T21:49:49.988392+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-04-03T21:49:52.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-04-03T21:49:52.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:49:52.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:49:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.575+0000 7f5028978700 1 Processor -- start 2022-04-03T21:49:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.575+0000 7f5028978700 1 -- start start 2022-04-03T21:49:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5028978700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5024153940 0x7f5024155d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5028978700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5024087e60 con 0x7f50240c1f90 2022-04-03T21:49:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5028978700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50240a4e90 con 0x7f50240c2360 2022-04-03T21:49:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5028978700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240a5440 con 0x7f5024153940 2022-04-03T21:49:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5022d9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5024153940 0x7f5024155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5021d9b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f50240c2360 0x7f50240bd720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47372/0 (socket says 172.21.15.49:47372) 2022-04-03T21:49:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f5021d9b700 1 -- 172.21.15.49:0/1935033803 learned_addr learned my addr 172.21.15.49:0/1935033803 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.576+0000 7f502259c700 1 --1- 172.21.15.49:0/1935033803 >> v1:172.21.15.49:6789/0 conn(0x7f50240c1f90 0x7f50240a4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50450/0 (socket says 172.21.15.49:50450) 2022-04-03T21:49:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f502159a700 1 -- 172.21.15.49:0/1935033803 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787695817 0 0) 0x7f50240a4e90 con 0x7f50240c2360 2022-04-03T21:49:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f502159a700 1 -- 172.21.15.49:0/1935033803 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50080033f0 con 0x7f50240c2360 2022-04-03T21:49:52.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f5022d9d700 1 -- 172.21.15.49:0/1935033803 >> v1:172.21.15.117:6789/0 conn(0x7f50240c2360 legacy=0x7f50240bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f502159a700 1 -- 172.21.15.49:0/1935033803 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709696706 0 0) 0x7f5024087e60 con 0x7f50240c1f90 2022-04-03T21:49:52.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f5022d9d700 1 -- 172.21.15.49:0/1935033803 >> v1:172.21.15.49:6789/0 conn(0x7f50240c1f90 legacy=0x7f50240a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f5022d9d700 1 -- 172.21.15.49:0/1935033803 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240a6890 con 0x7f5024153940 2022-04-03T21:49:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.577+0000 7f5022d9d700 1 --2- 172.21.15.49:0/1935033803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5024153940 0x7f5024155d20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f501c009e60 tx=0x7f501c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71d0c552bb543ffc server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f502159a700 1 -- 172.21.15.49:0/1935033803 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c00e070 con 0x7f5024153940 2022-04-03T21:49:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f502159a700 1 -- 172.21.15.49:0/1935033803 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c00bb60 con 0x7f5024153940 2022-04-03T21:49:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f502159a700 1 -- 172.21.15.49:0/1935033803 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c012430 con 0x7f5024153940 2022-04-03T21:49:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 -- 172.21.15.49:0/1935033803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5024153940 msgr2=0x7f5024155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 --2- 172.21.15.49:0/1935033803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5024153940 0x7f5024155d20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f501c009e60 tx=0x7f501c009780 comp rx=0 tx=0).stop 2022-04-03T21:49:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 -- 172.21.15.49:0/1935033803 shutdown_connections 2022-04-03T21:49:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 --2- 172.21.15.49:0/1935033803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5024153940 0x7f5024155d20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 -- 172.21.15.49:0/1935033803 >> 172.21.15.49:0/1935033803 conn(0x7f502405e010 msgr2=0x7f50240c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:52.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 -- 172.21.15.49:0/1935033803 shutdown_connections 2022-04-03T21:49:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.578+0000 7f5028978700 1 -- 172.21.15.49:0/1935033803 wait complete. 2022-04-03T21:49:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.580+0000 7f5028978700 1 Processor -- start 2022-04-03T21:49:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.580+0000 7f5028978700 1 -- start start 2022-04-03T21:49:52.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5028978700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 0x7f50240bb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5028978700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2360 0x7f5024153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5028978700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5024153940 0x7f50240ba620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5028978700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240ba1d0 con 0x7f5024153940 2022-04-03T21:49:52.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5028978700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240bbb00 con 0x7f50240c1f90 2022-04-03T21:49:52.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5028978700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240a36e0 con 0x7f50240c2360 2022-04-03T21:49:52.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5022d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5024153940 0x7f50240ba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f502259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 0x7f50240bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5021d9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2360 0x7f5024153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f502259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 0x7f50240bb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35284/0 (socket says 172.21.15.49:35284) 2022-04-03T21:49:52.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f5022d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5024153940 0x7f50240ba620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34460/0 (socket says 172.21.15.49:34460) 2022-04-03T21:49:52.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.581+0000 7f502259c700 1 -- 172.21.15.49:0/1327235594 learned_addr learned my addr 172.21.15.49:0/1327235594 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:52.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f502259c700 1 -- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2360 msgr2=0x7f5024153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f502259c700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2360 0x7f5024153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f502259c700 1 -- 172.21.15.49:0/1327235594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5024153940 msgr2=0x7f50240ba620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f502259c700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5024153940 0x7f50240ba620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f502259c700 1 -- 172.21.15.49:0/1327235594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009a20 con 0x7f50240c1f90 2022-04-03T21:49:52.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f502259c700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 0x7f50240bb420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f501400c4e0 tx=0x7f5014007c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400ce90 con 0x7f50240c1f90 2022-04-03T21:49:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5014007360 con 0x7f50240c1f90 2022-04-03T21:49:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50240a39c0 con 0x7f50240c1f90 2022-04-03T21:49:52.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.582+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140046b0 con 0x7f50240c1f90 2022-04-03T21:49:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.583+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5024153590 con 0x7f50240c1f90 2022-04-03T21:49:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.584+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024070a20 con 0x7f50240c1f90 2022-04-03T21:49:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.584+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f5014010030 con 0x7f50240c1f90 2022-04-03T21:49:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.585+0000 7f50127fc700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5000063ce0 0x7f5000066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:52.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.585+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f501407fff0 con 0x7f50240c1f90 2022-04-03T21:49:52.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.586+0000 7f5021d9b700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5000063ce0 0x7f5000066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:52.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.586+0000 7f5021d9b700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5000063ce0 0x7f5000066190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5024152b80 tx=0x7f5018009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:52.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.590+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f501404efa0 con 0x7f50240c1f90 2022-04-03T21:49:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.795+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50240a6b70 con 0x7f50240c1f90 2022-04-03T21:49:52.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.796+0000 7f50127fc700 1 -- 172.21.15.49:0/1327235594 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50140525c0 con 0x7f50240c1f90 2022-04-03T21:49:52.799 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2022-04-03T21:49:52.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5000063ce0 msgr2=0x7f5000066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5000063ce0 0x7f5000066190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5024152b80 tx=0x7f5018009040 comp rx=0 tx=0).stop 2022-04-03T21:49:52.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 msgr2=0x7f50240bb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:52.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 0x7f50240bb420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f501400c4e0 tx=0x7f5014007c70 comp rx=0 tx=0).stop 2022-04-03T21:49:52.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 shutdown_connections 2022-04-03T21:49:52.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5000063ce0 0x7f5000066190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5024153940 0x7f50240ba620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c1f90 0x7f50240bb420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 --2- 172.21.15.49:0/1327235594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2360 0x7f5024153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:52.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 >> 172.21.15.49:0/1327235594 conn(0x7f502405e010 msgr2=0x7f50240bd720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:52.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 shutdown_connections 2022-04-03T21:49:52.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:52.799+0000 7f5028978700 1 -- 172.21.15.49:0/1327235594 wait complete. 2022-04-03T21:49:52.826 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-03T21:49:53.044 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.041+0000 7f4556853700 1 Processor -- start 2022-04-03T21:49:53.044 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.041+0000 7f4556853700 1 -- start start 2022-04-03T21:49:53.047 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f4556853700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f455006c5f0 0x7f455006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.047 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f4556853700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4550069af0 0x7f455006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.047 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f4556853700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500b84a0 con 0x7f455006c220 2022-04-03T21:49:53.048 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f4556853700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455006d4f0 con 0x7f455006c5f0 2022-04-03T21:49:53.048 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f4556853700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455006eae0 con 0x7f4550069af0 2022-04-03T21:49:53.048 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f454f7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f455006c5f0 0x7f455006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.048 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f454ffff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f455006c220 0x7f45500693e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47374/0 (socket says 172.21.15.49:47374) 2022-04-03T21:49:53.048 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f454ffff700 1 -- 172.21.15.49:0/1074042122 learned_addr learned my addr 172.21.15.49:0/1074042122 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:53.049 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.042+0000 7f4554df0700 1 --2- 172.21.15.49:0/1074042122 >> v2:172.21.15.117:3300/0 conn(0x7f4550069af0 0x7f455006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.049 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454f7fe700 1 -- 172.21.15.49:0/1074042122 >> v2:172.21.15.117:3300/0 conn(0x7f4550069af0 msgr2=0x7f455006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:53.049 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454f7fe700 1 --2- 172.21.15.49:0/1074042122 >> v2:172.21.15.117:3300/0 conn(0x7f4550069af0 0x7f455006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.049 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454f7fe700 1 -- 172.21.15.49:0/1074042122 >> v1:172.21.15.117:6789/0 conn(0x7f455006c220 legacy=0x7f45500693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.050 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454f7fe700 1 -- 172.21.15.49:0/1074042122 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455006ce70 con 0x7f455006c5f0 2022-04-03T21:49:53.050 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454effd700 1 -- 172.21.15.49:0/1074042122 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283872920 0 0) 0x7f45500b84a0 con 0x7f455006c220 2022-04-03T21:49:53.050 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f4554df0700 1 --2- 172.21.15.49:0/1074042122 >> v2:172.21.15.117:3300/0 conn(0x7f4550069af0 0x7f455006a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:53.050 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454f7fe700 1 --2- 172.21.15.49:0/1074042122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455006c5f0 0x7f455006a170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4550067a70 tx=0x7f4544009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b377927a1098fab server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:53.050 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.043+0000 7f454effd700 1 -- 172.21.15.49:0/1074042122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544011630 con 0x7f455006c5f0 2022-04-03T21:49:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f454effd700 1 -- 172.21.15.49:0/1074042122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4544011790 con 0x7f455006c5f0 2022-04-03T21:49:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f454effd700 1 -- 172.21.15.49:0/1074042122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544011b30 con 0x7f455006c5f0 2022-04-03T21:49:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 -- 172.21.15.49:0/1074042122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455006c5f0 msgr2=0x7f455006a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.051 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 --2- 172.21.15.49:0/1074042122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455006c5f0 0x7f455006a170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4550067a70 tx=0x7f4544009060 comp rx=0 tx=0).stop 2022-04-03T21:49:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 -- 172.21.15.49:0/1074042122 shutdown_connections 2022-04-03T21:49:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 --2- 172.21.15.49:0/1074042122 >> v2:172.21.15.117:3300/0 conn(0x7f4550069af0 0x7f455006a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 --2- 172.21.15.49:0/1074042122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f455006c5f0 0x7f455006a170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.052 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 -- 172.21.15.49:0/1074042122 >> 172.21.15.49:0/1074042122 conn(0x7f45500675b0 msgr2=0x7f45500bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:53.053 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 -- 172.21.15.49:0/1074042122 shutdown_connections 2022-04-03T21:49:53.053 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.044+0000 7f4556853700 1 -- 172.21.15.49:0/1074042122 wait complete. 2022-04-03T21:49:53.056 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.046+0000 7f4556853700 1 Processor -- start 2022-04-03T21:49:53.056 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.046+0000 7f4556853700 1 -- start start 2022-04-03T21:49:53.056 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4556853700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 0x7f45500b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.056 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4556853700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006c220 0x7f45501490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.057 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4556853700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f455006c5f0 0x7f4550149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.057 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4556853700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455014bc30 con 0x7f4550069af0 2022-04-03T21:49:53.057 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4556853700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b4430 con 0x7f455006c220 2022-04-03T21:49:53.057 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4556853700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4550148c30 con 0x7f455006c5f0 2022-04-03T21:49:53.058 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f454ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 0x7f45500b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.058 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f454ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 0x7f45500b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34464/0 (socket says 172.21.15.49:34464) 2022-04-03T21:49:53.058 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f454ffff700 1 -- 172.21.15.49:0/811815873 learned_addr learned my addr 172.21.15.49:0/811815873 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:53.058 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f4554df0700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f455006c5f0 0x7f4550149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.059 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.047+0000 7f454f7fe700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006c220 0x7f45501490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.059 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f454ffff700 1 -- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f455006c5f0 msgr2=0x7f4550149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.059 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f454ffff700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f455006c5f0 0x7f4550149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.059 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f454ffff700 1 -- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006c220 msgr2=0x7f45501490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.059 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f454ffff700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006c220 0x7f45501490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f454ffff700 1 -- 172.21.15.49:0/811815873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009a20 con 0x7f4550069af0 2022-04-03T21:49:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f454ffff700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 0x7f45500b3100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f454000c510 tx=0x7f4540007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540007360 con 0x7f4550069af0 2022-04-03T21:49:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45400074c0 con 0x7f4550069af0 2022-04-03T21:49:53.060 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45440092a0 con 0x7f4550069af0 2022-04-03T21:49:53.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540004900 con 0x7f4550069af0 2022-04-03T21:49:53.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.048+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455015f280 con 0x7f4550069af0 2022-04-03T21:49:53.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.050+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4550148f10 con 0x7f4550069af0 2022-04-03T21:49:53.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.050+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4540010030 con 0x7f4550069af0 2022-04-03T21:49:53.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.051+0000 7f4537fff700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4530063ce0 0x7f4530066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.051+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f454007ffa0 con 0x7f4550069af0 2022-04-03T21:49:53.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.052+0000 7f454f7fe700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4530063ce0 0x7f4530066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.052+0000 7f454f7fe700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4530063ce0 0x7f4530066190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f455006e330 tx=0x7f4544017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:53.063 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.056+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f454004efb0 con 0x7f4550069af0 2022-04-03T21:49:53.263 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.261+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4550070a20 con 0x7f4550069af0 2022-04-03T21:49:53.264 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.261+0000 7f4537fff700 1 -- 172.21.15.49:0/811815873 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45400525d0 con 0x7f4550069af0 2022-04-03T21:49:53.265 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2022-04-03T21:49:53.267 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4530063ce0 msgr2=0x7f4530066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.267 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4530063ce0 0x7f4530066190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f455006e330 tx=0x7f4544017000 comp rx=0 tx=0).stop 2022-04-03T21:49:53.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 msgr2=0x7f45500b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 0x7f45500b3100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f454000c510 tx=0x7f4540007c70 comp rx=0 tx=0).stop 2022-04-03T21:49:53.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 shutdown_connections 2022-04-03T21:49:53.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4530063ce0 0x7f4530066190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f455006c5f0 0x7f4550149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4550069af0 0x7f45500b3100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 --2- 172.21.15.49:0/811815873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f455006c220 0x7f45501490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 >> 172.21.15.49:0/811815873 conn(0x7f45500675b0 msgr2=0x7f45500ba470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:53.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 shutdown_connections 2022-04-03T21:49:53.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.264+0000 7f4556853700 1 -- 172.21.15.49:0/811815873 wait complete. 2022-04-03T21:49:53.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-03T21:49:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.503+0000 7f51a5bb7700 1 Processor -- start 2022-04-03T21:49:53.506 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.503+0000 7f51a5bb7700 1 -- start start 2022-04-03T21:49:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f51a5bb7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 0x7f51a00bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.508 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f51a5bb7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 0x7f51a00a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f51a5bb7700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a00a4720 con 0x7f51a00bdc00 2022-04-03T21:49:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f51a5bb7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a00a5980 con 0x7f51a00c2310 2022-04-03T21:49:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f51a5bb7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00a5280 con 0x7f51a00c1f40 2022-04-03T21:49:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 0x7f51a00bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.504+0000 7f519effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 0x7f51a00a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 0x7f51a00bd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45696/0 (socket says 172.21.15.49:45696) 2022-04-03T21:49:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519effd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 0x7f51a00a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34466/0 (socket says 172.21.15.49:34466) 2022-04-03T21:49:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519effd700 1 -- 172.21.15.49:0/3454147460 learned_addr learned my addr 172.21.15.49:0/3454147460 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:53.510 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519ffff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f51a00bdc00 0x7f51a01482f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47376/0 (socket says 172.21.15.49:47376) 2022-04-03T21:49:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519f7fe700 1 -- 172.21.15.49:0/3454147460 >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 msgr2=0x7f51a00a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519f7fe700 1 --2- 172.21.15.49:0/3454147460 >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 0x7f51a00a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519f7fe700 1 -- 172.21.15.49:0/3454147460 >> v1:172.21.15.117:6789/0 conn(0x7f51a00bdc00 legacy=0x7f51a01482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519e7fc700 1 -- 172.21.15.49:0/3454147460 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933116681 0 0) 0x7f51a00a4720 con 0x7f51a00bdc00 2022-04-03T21:49:53.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519f7fe700 1 -- 172.21.15.49:0/3454147460 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00a49e0 con 0x7f51a00c1f40 2022-04-03T21:49:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519effd700 1 --2- 172.21.15.49:0/3454147460 >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 0x7f51a00a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.505+0000 7f519f7fe700 1 --2- 172.21.15.49:0/3454147460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 0x7f51a00bd6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5190009760 tx=0x7f5190009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39dcf54c4b65cc44 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f519e7fc700 1 -- 172.21.15.49:0/3454147460 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190011630 con 0x7f51a00c1f40 2022-04-03T21:49:53.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f519e7fc700 1 -- 172.21.15.49:0/3454147460 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190011790 con 0x7f51a00c1f40 2022-04-03T21:49:53.513 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f519e7fc700 1 -- 172.21.15.49:0/3454147460 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190011b50 con 0x7f51a00c1f40 2022-04-03T21:49:53.516 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 -- 172.21.15.49:0/3454147460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 msgr2=0x7f51a00bd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/3454147460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 0x7f51a00bd6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5190009760 tx=0x7f5190009060 comp rx=0 tx=0).stop 2022-04-03T21:49:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 -- 172.21.15.49:0/3454147460 shutdown_connections 2022-04-03T21:49:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/3454147460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00c1f40 0x7f51a00bd6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/3454147460 >> v2:172.21.15.49:3300/0 conn(0x7f51a00c2310 0x7f51a00a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 -- 172.21.15.49:0/3454147460 >> 172.21.15.49:0/3454147460 conn(0x7f51a005e010 msgr2=0x7f51a00c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.506+0000 7f51a5bb7700 1 -- 172.21.15.49:0/3454147460 shutdown_connections 2022-04-03T21:49:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.507+0000 7f51a5bb7700 1 -- 172.21.15.49:0/3454147460 wait complete. 2022-04-03T21:49:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.508+0000 7f51a5bb7700 1 Processor -- start 2022-04-03T21:49:53.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.508+0000 7f51a5bb7700 1 -- start start 2022-04-03T21:49:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f51a5bb7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 0x7f51a015b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f51a5bb7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 0x7f51a00b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f51a5bb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a00c2310 0x7f51a0097d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f51a5bb7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0099710 con 0x7f51a00c1f40 2022-04-03T21:49:53.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f51a5bb7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00b7110 con 0x7f51a00c2310 2022-04-03T21:49:53.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f51a5bb7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00b73f0 con 0x7f51a00bdc00 2022-04-03T21:49:53.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.509+0000 7f519effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 0x7f51a00b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 0x7f51a015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 0x7f51a00b7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34468/0 (socket says 172.21.15.49:34468) 2022-04-03T21:49:53.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519effd700 1 -- 172.21.15.49:0/1860585051 learned_addr learned my addr 172.21.15.49:0/1860585051 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:53.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 0x7f51a015b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45698/0 (socket says 172.21.15.49:45698) 2022-04-03T21:49:53.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a00c2310 0x7f51a0097d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 -- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a00c2310 msgr2=0x7f51a0097d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a00c2310 0x7f51a0097d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 -- 172.21.15.49:0/1860585051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 msgr2=0x7f51a00b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 0x7f51a00b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 -- 172.21.15.49:0/1860585051 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009370 con 0x7f51a00bdc00 2022-04-03T21:49:53.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519effd700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 0x7f51a00b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.510+0000 7f519f7fe700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 0x7f51a015b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5190016000 tx=0x7f5190017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.511+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190000bc0 con 0x7f51a00bdc00 2022-04-03T21:49:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.511+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190011900 con 0x7f51a00bdc00 2022-04-03T21:49:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.511+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190000d20 con 0x7f51a00bdc00 2022-04-03T21:49:53.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.511+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51900092a0 con 0x7f51a00bdc00 2022-04-03T21:49:53.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.511+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00b5480 con 0x7f51a00bdc00 2022-04-03T21:49:53.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.512+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a0070a20 con 0x7f51a00bdc00 2022-04-03T21:49:53.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.513+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f519000f050 con 0x7f51a00bdc00 2022-04-03T21:49:53.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.514+0000 7f51877fe700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5180063ce0 0x7f5180066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:53.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.514+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5190081550 con 0x7f51a00bdc00 2022-04-03T21:49:53.525 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.514+0000 7f519effd700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5180063ce0 0x7f5180066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:53.525 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.515+0000 7f519effd700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5180063ce0 0x7f5180066190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f51a00b5090 tx=0x7f51940090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:53.526 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.518+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f5190050530 con 0x7f51a00bdc00 2022-04-03T21:49:53.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.769+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51a0146a00 con 0x7f51a00bdc00 2022-04-03T21:49:53.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.770+0000 7f51877fe700 1 -- 172.21.15.49:0/1860585051 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f519002a090 con 0x7f51a00bdc00 2022-04-03T21:49:53.773 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:49:53.774 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2007434057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2007434057},{"type":"v1","addr":"172.21.15.117:6837","nonce":2007434057}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/561054047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":561054047},{"type":"v1","addr":"172.21.15.117:6836","nonce":561054047}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3845909239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3845909239},{"type":"v1","addr":"172.21.15.49:6833","nonce":3845909239}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1189888216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1189888216},{"type":"v1","addr":"172.21.15.49:6835","nonce":1189888216}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-04-03T21:49:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5180063ce0 msgr2=0x7f5180066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5180063ce0 0x7f5180066190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f51a00b5090 tx=0x7f51940090f0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 msgr2=0x7f51a015b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 0x7f51a015b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5190016000 tx=0x7f5190017000 comp rx=0 tx=0).stop 2022-04-03T21:49:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 shutdown_connections 2022-04-03T21:49:53.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5180063ce0 0x7f5180066190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51a00c2310 0x7f51a0097d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51a00bdc00 0x7f51a015b990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 --2- 172.21.15.49:0/1860585051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51a00c1f40 0x7f51a00b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:53.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 >> 172.21.15.49:0/1860585051 conn(0x7f51a005e010 msgr2=0x7f51a01480c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.772+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 shutdown_connections 2022-04-03T21:49:53.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:53.773+0000 7f51a5bb7700 1 -- 172.21.15.49:0/1860585051 wait complete. 2022-04-03T21:49:53.779 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2022-04-03T21:49:53.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:49:54.039 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.036+0000 7ff5d402f700 1 Processor -- start 2022-04-03T21:49:54.040 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.037+0000 7ff5d402f700 1 -- start start 2022-04-03T21:49:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d402f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5cc0b9030 0x7ff5cc148590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d402f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc0b7e00 con 0x7ff5cc0b8290 2022-04-03T21:49:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d402f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc06c5c0 con 0x7ff5cc141e80 2022-04-03T21:49:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d402f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc148ad0 con 0x7ff5cc0b9030 2022-04-03T21:49:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d15ca700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff5cc0b9030 0x7ff5cc148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d1dcb700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff5cc141e80 0x7ff5cc0bd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47378/0 (socket says 172.21.15.49:47378) 2022-04-03T21:49:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d1dcb700 1 -- 172.21.15.49:0/1129981904 learned_addr learned my addr 172.21.15.49:0/1129981904 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.038+0000 7ff5d25cc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff5cc0b8290 0x7ff5cc0a2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50452/0 (socket says 172.21.15.49:50452) 2022-04-03T21:49:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d15ca700 1 -- 172.21.15.49:0/1129981904 >> v1:172.21.15.117:6789/0 conn(0x7ff5cc141e80 legacy=0x7ff5cc0bd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d0dc9700 1 -- 172.21.15.49:0/1129981904 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279469108 0 0) 0x7ff5cc06c5c0 con 0x7ff5cc141e80 2022-04-03T21:49:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d15ca700 1 -- 172.21.15.49:0/1129981904 >> v1:172.21.15.49:6789/0 conn(0x7ff5cc0b8290 legacy=0x7ff5cc0a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d15ca700 1 -- 172.21.15.49:0/1129981904 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc06a780 con 0x7ff5cc0b9030 2022-04-03T21:49:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d15ca700 1 --2- 172.21.15.49:0/1129981904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b9030 0x7ff5cc148590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009760 tx=0x7ff5bc009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f531b97152487cf4 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d0dc9700 1 -- 172.21.15.49:0/1129981904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc004030 con 0x7ff5cc0b9030 2022-04-03T21:49:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d0dc9700 1 -- 172.21.15.49:0/1129981904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc004190 con 0x7ff5cc0b9030 2022-04-03T21:49:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.039+0000 7ff5d0dc9700 1 -- 172.21.15.49:0/1129981904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00f6b0 con 0x7ff5cc0b9030 2022-04-03T21:49:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 -- 172.21.15.49:0/1129981904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b9030 msgr2=0x7ff5cc148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 --2- 172.21.15.49:0/1129981904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b9030 0x7ff5cc148590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009760 tx=0x7ff5bc009060 comp rx=0 tx=0).stop 2022-04-03T21:49:54.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 -- 172.21.15.49:0/1129981904 shutdown_connections 2022-04-03T21:49:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 --2- 172.21.15.49:0/1129981904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b9030 0x7ff5cc148590 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 -- 172.21.15.49:0/1129981904 >> 172.21.15.49:0/1129981904 conn(0x7ff5cc067560 msgr2=0x7ff5cc0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 -- 172.21.15.49:0/1129981904 shutdown_connections 2022-04-03T21:49:54.062 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.040+0000 7ff5d402f700 1 -- 172.21.15.49:0/1129981904 wait complete. 2022-04-03T21:49:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.042+0000 7ff5d402f700 1 Processor -- start 2022-04-03T21:49:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.042+0000 7ff5d402f700 1 -- start start 2022-04-03T21:49:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.042+0000 7ff5d402f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 0x7ff5cc15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.042+0000 7ff5d402f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5cc0b9030 0x7ff5cc14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.063 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d402f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5cc141e80 0x7ff5cc146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d402f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc143360 con 0x7ff5cc0b8290 2022-04-03T21:49:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d402f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0b27a0 con 0x7ff5cc141e80 2022-04-03T21:49:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d402f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc143e10 con 0x7ff5cc0b9030 2022-04-03T21:49:54.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 0x7ff5cc15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 0x7ff5cc15e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34472/0 (socket says 172.21.15.49:34472) 2022-04-03T21:49:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 -- 172.21.15.49:0/2437966162 learned_addr learned my addr 172.21.15.49:0/2437966162 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d25cc700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5cc141e80 0x7ff5cc146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d15ca700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5cc0b9030 0x7ff5cc14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 -- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5cc0b9030 msgr2=0x7ff5cc14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5cc0b9030 0x7ff5cc14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 -- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5cc141e80 msgr2=0x7ff5cc146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5cc141e80 0x7ff5cc146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.043+0000 7ff5d1dcb700 1 -- 172.21.15.49:0/2437966162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0092a0 con 0x7ff5cc0b8290 2022-04-03T21:49:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.044+0000 7ff5d1dcb700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 0x7ff5cc15e220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80011e0 tx=0x7ff5c8007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.044+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8007150 con 0x7ff5cc0b8290 2022-04-03T21:49:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.044+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c80072b0 con 0x7ff5cc0b8290 2022-04-03T21:49:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.044+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc0b5660 con 0x7ff5cc0b8290 2022-04-03T21:49:54.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.044+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80046b0 con 0x7ff5cc0b8290 2022-04-03T21:49:54.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.044+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc0b6f80 con 0x7ff5cc0b8290 2022-04-03T21:49:54.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.045+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc070a20 con 0x7ff5cc0b8290 2022-04-03T21:49:54.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.046+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7ff5c8010030 con 0x7ff5cc0b8290 2022-04-03T21:49:54.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.047+0000 7ff5b9ffb700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff5ac063d10 0x7ff5ac0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.047+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff5c807ff30 con 0x7ff5cc0b8290 2022-04-03T21:49:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.047+0000 7ff5d15ca700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff5ac063d10 0x7ff5ac0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.048+0000 7ff5d15ca700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff5ac063d10 0x7ff5ac0661c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b9470 tx=0x7ff5bc018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.051+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7ff5c804edf0 con 0x7ff5cc0b8290 2022-04-03T21:49:54.263 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.260+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5cc0b8e10 con 0x7ff5cc0b8290 2022-04-03T21:49:54.264 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.261+0000 7ff5b9ffb700 1 -- 172.21.15.49:0/2437966162 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13626 (secure 0 0 0) 0x7ff5c8052410 con 0x7ff5cc0b8290 2022-04-03T21:49:54.264 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:49:54.264 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:49:52.818950+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:49:54.267 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff5ac063d10 msgr2=0x7ff5ac0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.267 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff5ac063d10 0x7ff5ac0661c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b9470 tx=0x7ff5bc018000 comp rx=0 tx=0).stop 2022-04-03T21:49:54.267 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 msgr2=0x7ff5cc15e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 0x7ff5cc15e220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80011e0 tx=0x7ff5c8007c40 comp rx=0 tx=0).stop 2022-04-03T21:49:54.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 shutdown_connections 2022-04-03T21:49:54.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff5ac063d10 0x7ff5ac0661c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.268 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5cc141e80 0x7ff5cc146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5cc0b8290 0x7ff5cc15e220 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 --2- 172.21.15.49:0/2437966162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5cc0b9030 0x7ff5cc14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 >> 172.21.15.49:0/2437966162 conn(0x7ff5cc067560 msgr2=0x7ff5cc0a2910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:54.269 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 shutdown_connections 2022-04-03T21:49:54.270 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.264+0000 7ff5d402f700 1 -- 172.21.15.49:0/2437966162 wait complete. 2022-04-03T21:49:54.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-04-03T21:49:42.179170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-04-03T21:49:49.988392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-04-03T21:49:54.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-04-03T21:49:54.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.510+0000 7f1e5bd35700 1 Processor -- start 2022-04-03T21:49:54.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.511+0000 7f1e5bd35700 1 -- start start 2022-04-03T21:49:54.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.511+0000 7f1e5bd35700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540c1f90 0x7f1e540bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e5bd35700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e5414e470 0x7f1e5414e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e5bd35700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e540a50a0 con 0x7f1e540c2360 2022-04-03T21:49:54.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e5bd35700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e540a6750 con 0x7f1e5414e470 2022-04-03T21:49:54.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e5bd35700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540a6a30 con 0x7f1e540c1f90 2022-04-03T21:49:54.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e592d0700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e540c2360 0x7f1e540bd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50454/0 (socket says 172.21.15.49:50454) 2022-04-03T21:49:54.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e592d0700 1 -- 172.21.15.49:0/865765257 learned_addr learned my addr 172.21.15.49:0/865765257 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:54.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e59ad1700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540c1f90 0x7f1e540bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e5a2d2700 1 --2- 172.21.15.49:0/865765257 >> v2:172.21.15.117:3300/0 conn(0x7f1e5414e470 0x7f1e5414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e58acf700 1 -- 172.21.15.49:0/865765257 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464857098 0 0) 0x7f1e540a50a0 con 0x7f1e540c2360 2022-04-03T21:49:54.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.512+0000 7f1e58acf700 1 -- 172.21.15.49:0/865765257 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e3c0033f0 con 0x7f1e540c2360 2022-04-03T21:49:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e5a2d2700 1 -- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540c1f90 msgr2=0x7f1e540bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e5a2d2700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540c1f90 0x7f1e540bbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e5a2d2700 1 -- 172.21.15.49:0/865765257 >> v1:172.21.15.49:6789/0 conn(0x7f1e540c2360 legacy=0x7f1e540bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e5a2d2700 1 -- 172.21.15.49:0/865765257 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540a6d10 con 0x7f1e5414e470 2022-04-03T21:49:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e59ad1700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540c1f90 0x7f1e540bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e5a2d2700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5414e470 0x7f1e5414e870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009e60 tx=0x7f1e4c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f51ad4359470862 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e58acf700 1 -- 172.21.15.49:0/865765257 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00e070 con 0x7f1e5414e470 2022-04-03T21:49:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e58acf700 1 -- 172.21.15.49:0/865765257 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00bab0 con 0x7f1e5414e470 2022-04-03T21:49:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.513+0000 7f1e58acf700 1 -- 172.21.15.49:0/865765257 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00be70 con 0x7f1e5414e470 2022-04-03T21:49:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 -- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5414e470 msgr2=0x7f1e5414e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5414e470 0x7f1e5414e870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009e60 tx=0x7f1e4c009780 comp rx=0 tx=0).stop 2022-04-03T21:49:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 -- 172.21.15.49:0/865765257 shutdown_connections 2022-04-03T21:49:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5414e470 0x7f1e5414e870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/865765257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e540c1f90 0x7f1e540bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 -- 172.21.15.49:0/865765257 >> 172.21.15.49:0/865765257 conn(0x7f1e5405e010 msgr2=0x7f1e540c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:54.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 -- 172.21.15.49:0/865765257 shutdown_connections 2022-04-03T21:49:54.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.514+0000 7f1e5bd35700 1 -- 172.21.15.49:0/865765257 wait complete. 2022-04-03T21:49:54.528 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.516+0000 7f1e5bd35700 1 Processor -- start 2022-04-03T21:49:54.528 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.516+0000 7f1e5bd35700 1 -- start start 2022-04-03T21:49:54.529 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5bd35700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 0x7f1e54149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.529 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5bd35700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e540c2360 0x7f1e54144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.529 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5bd35700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e5414e470 0x7f1e54144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.529 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5bd35700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54146870 con 0x7f1e540c2360 2022-04-03T21:49:54.530 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5bd35700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54145d20 con 0x7f1e540c1f90 2022-04-03T21:49:54.530 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5bd35700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5415e100 con 0x7f1e5414e470 2022-04-03T21:49:54.530 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e592d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e540c2360 0x7f1e54144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.530 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 0x7f1e54149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e5a2d2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e5414e470 0x7f1e54144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 0x7f1e54149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35296/0 (socket says 172.21.15.49:35296) 2022-04-03T21:49:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 -- 172.21.15.49:0/820931973 learned_addr learned my addr 172.21.15.49:0/820931973 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 -- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e5414e470 msgr2=0x7f1e54144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e5414e470 0x7f1e54144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 -- 172.21.15.49:0/820931973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e540c2360 msgr2=0x7f1e54144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e540c2360 0x7f1e54144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.518+0000 7f1e59ad1700 1 -- 172.21.15.49:0/820931973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500092a0 con 0x7f1e540c1f90 2022-04-03T21:49:54.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.519+0000 7f1e59ad1700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 0x7f1e54149ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ea20 tx=0x7f1e50009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.519+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50009600 con 0x7f1e540c1f90 2022-04-03T21:49:54.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.519+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5000c850 con 0x7f1e540c1f90 2022-04-03T21:49:54.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.519+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000cbf0 con 0x7f1e540c1f90 2022-04-03T21:49:54.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.519+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c009a20 con 0x7f1e540c1f90 2022-04-03T21:49:54.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.519+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5415e390 con 0x7f1e540c1f90 2022-04-03T21:49:54.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.520+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e54145af0 con 0x7f1e540c1f90 2022-04-03T21:49:54.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.521+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f1e50019030 con 0x7f1e540c1f90 2022-04-03T21:49:54.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.522+0000 7f1e41ffb700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1e34063d10 0x7f1e340661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.522+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1e50080460 con 0x7f1e540c1f90 2022-04-03T21:49:54.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.522+0000 7f1e592d0700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1e34063d10 0x7f1e340661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.523+0000 7f1e592d0700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1e34063d10 0x7f1e340661c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1e54069c80 tx=0x7f1e44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.536 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.527+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f1e54145af0 con 0x7f1e540c1f90 2022-04-03T21:49:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.729+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e54145af0 con 0x7f1e540c1f90 2022-04-03T21:49:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.730+0000 7f1e41ffb700 1 -- 172.21.15.49:0/820931973 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e54145af0 con 0x7f1e540c1f90 2022-04-03T21:49:54.733 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2022-04-03T21:49:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.732+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1e34063d10 msgr2=0x7f1e340661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.732+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1e34063d10 0x7f1e340661c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1e54069c80 tx=0x7f1e44009040 comp rx=0 tx=0).stop 2022-04-03T21:49:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.732+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 msgr2=0x7f1e54149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.732+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 0x7f1e54149ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ea20 tx=0x7f1e50009060 comp rx=0 tx=0).stop 2022-04-03T21:49:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 shutdown_connections 2022-04-03T21:49:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1e34063d10 0x7f1e340661c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e5414e470 0x7f1e54144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e540c1f90 0x7f1e54149ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 --2- 172.21.15.49:0/820931973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e540c2360 0x7f1e54144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 >> 172.21.15.49:0/820931973 conn(0x7f1e5405e010 msgr2=0x7f1e540c0290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 shutdown_connections 2022-04-03T21:49:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.733+0000 7f1e5bd35700 1 -- 172.21.15.49:0/820931973 wait complete. 2022-04-03T21:49:54.760 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-03T21:49:54.978 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.975+0000 7fc2fbdb4700 1 Processor -- start 2022-04-03T21:49:54.979 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.976+0000 7fc2fbdb4700 1 -- start start 2022-04-03T21:49:54.981 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2fbdb4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2f40bdac0 0x7fc2f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.981 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2fbdb4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40b7c60 con 0x7fc2f40bde90 2022-04-03T21:49:54.981 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2fbdb4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40b7f40 con 0x7fc2f40b9360 2022-04-03T21:49:54.981 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2fbdb4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f414c380 con 0x7fc2f40bdac0 2022-04-03T21:49:54.982 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2f934f700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc2f40bde90 0x7fc2f4141c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50456/0 (socket says 172.21.15.49:50456) 2022-04-03T21:49:54.982 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2f934f700 1 -- 172.21.15.49:0/3376653588 learned_addr learned my addr 172.21.15.49:0/3376653588 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:54.982 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2f9b50700 1 --2- 172.21.15.49:0/3376653588 >> v2:172.21.15.117:3300/0 conn(0x7fc2f40bdac0 0x7fc2f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.982 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.977+0000 7fc2f8b4e700 1 -- 172.21.15.49:0/3376653588 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358715717 0 0) 0x7fc2f40b7c60 con 0x7fc2f40bde90 2022-04-03T21:49:54.982 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f8b4e700 1 -- 172.21.15.49:0/3376653588 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc0033f0 con 0x7fc2f40bde90 2022-04-03T21:49:54.983 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f8b4e700 1 -- 172.21.15.49:0/3376653588 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261794219 0 0) 0x7fc2f40b7f40 con 0x7fc2f40b9360 2022-04-03T21:49:54.983 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f9b50700 1 -- 172.21.15.49:0/3376653588 >> v1:172.21.15.117:6789/0 conn(0x7fc2f40b9360 legacy=0x7fc2f40a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.983 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f9b50700 1 -- 172.21.15.49:0/3376653588 >> v1:172.21.15.49:6789/0 conn(0x7fc2f40bde90 legacy=0x7fc2f4141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.983 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f9b50700 1 -- 172.21.15.49:0/3376653588 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40b8220 con 0x7fc2f40bdac0 2022-04-03T21:49:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f9b50700 1 --2- 172.21.15.49:0/3376653588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bdac0 0x7fc2f40b8a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009760 tx=0x7fc2f0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f734b403ed5de4dd server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f8b4e700 1 -- 172.21.15.49:0/3376653588 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0011630 con 0x7fc2f40bdac0 2022-04-03T21:49:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f8b4e700 1 -- 172.21.15.49:0/3376653588 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0011790 con 0x7fc2f40bdac0 2022-04-03T21:49:54.984 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.978+0000 7fc2f8b4e700 1 -- 172.21.15.49:0/3376653588 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0011b30 con 0x7fc2f40bdac0 2022-04-03T21:49:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/3376653588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bdac0 msgr2=0x7fc2f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/3376653588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bdac0 0x7fc2f40b8a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009760 tx=0x7fc2f0009060 comp rx=0 tx=0).stop 2022-04-03T21:49:54.988 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/3376653588 shutdown_connections 2022-04-03T21:49:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/3376653588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bdac0 0x7fc2f40b8a20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/3376653588 >> 172.21.15.49:0/3376653588 conn(0x7fc2f40675b0 msgr2=0x7fc2f40bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/3376653588 shutdown_connections 2022-04-03T21:49:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.979+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/3376653588 wait complete. 2022-04-03T21:49:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.980+0000 7fc2fbdb4700 1 Processor -- start 2022-04-03T21:49:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.981+0000 7fc2fbdb4700 1 -- start start 2022-04-03T21:49:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.981+0000 7fc2fbdb4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 0x7fc2f40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.981+0000 7fc2fbdb4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40bdac0 0x7fc2f40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2fbdb4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bde90 0x7fc2f40b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2fbdb4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40b2e20 con 0x7fc2f40b9360 2022-04-03T21:49:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2fbdb4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41471d0 con 0x7fc2f40bde90 2022-04-03T21:49:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2fbdb4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f414b9b0 con 0x7fc2f40bdac0 2022-04-03T21:49:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 0x7fc2f40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f934f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40bdac0 0x7fc2f40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 0x7fc2f40b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34476/0 (socket says 172.21.15.49:34476) 2022-04-03T21:49:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 -- 172.21.15.49:0/2174365276 learned_addr learned my addr 172.21.15.49:0/2174365276 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2fa351700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bde90 0x7fc2f40b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 -- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40bdac0 msgr2=0x7fc2f40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40bdac0 0x7fc2f40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 -- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bde90 msgr2=0x7fc2f40b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bde90 0x7fc2f40b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.982+0000 7fc2f9b50700 1 -- 172.21.15.49:0/2174365276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00092a0 con 0x7fc2f40b9360 2022-04-03T21:49:54.994 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.983+0000 7fc2f9b50700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 0x7fc2f40b2610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009e00 tx=0x7fc2f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.994 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.983+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0000bc0 con 0x7fc2f40b9360 2022-04-03T21:49:54.994 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.983+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0011900 con 0x7fc2f40b9360 2022-04-03T21:49:54.994 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.983+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0026430 con 0x7fc2f40b9360 2022-04-03T21:49:54.994 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.983+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f4147550 con 0x7fc2f40b9360 2022-04-03T21:49:54.995 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.983+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f40b3d70 con 0x7fc2f40b9360 2022-04-03T21:49:54.995 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.984+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4070a20 con 0x7fc2f40b9360 2022-04-03T21:49:54.995 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.985+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fc2f002c020 con 0x7fc2f40b9360 2022-04-03T21:49:54.995 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.986+0000 7fc2e1ffb700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc2d4063db0 0x7fc2d4066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:54.996 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.986+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc2f0081b10 con 0x7fc2f40b9360 2022-04-03T21:49:54.996 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.986+0000 7fc2f934f700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc2d4063db0 0x7fc2d4066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.986+0000 7fc2f934f700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc2d4063db0 0x7fc2d4066260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2f414ae60 tx=0x7fc2e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:54.990+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fc2f0050aa0 con 0x7fc2f40b9360 2022-04-03T21:49:55.197 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.195+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2f406aab0 con 0x7fc2f40b9360 2022-04-03T21:49:55.198 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.195+0000 7fc2e1ffb700 1 -- 172.21.15.49:0/2174365276 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2f0054080 con 0x7fc2f40b9360 2022-04-03T21:49:55.198 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2022-04-03T21:49:55.200 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc2d4063db0 msgr2=0x7fc2d4066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.200 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc2d4063db0 0x7fc2d4066260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2f414ae60 tx=0x7fc2e4009040 comp rx=0 tx=0).stop 2022-04-03T21:49:55.201 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 msgr2=0x7fc2f40b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.201 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 0x7fc2f40b2610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009e00 tx=0x7fc2f0017000 comp rx=0 tx=0).stop 2022-04-03T21:49:55.201 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 shutdown_connections 2022-04-03T21:49:55.201 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc2d4063db0 0x7fc2d4066260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40bde90 0x7fc2f40b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f40b9360 0x7fc2f40b2610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 --2- 172.21.15.49:0/2174365276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40bdac0 0x7fc2f40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.197+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 >> 172.21.15.49:0/2174365276 conn(0x7fc2f40675b0 msgr2=0x7fc2f40a2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:55.203 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.198+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 shutdown_connections 2022-04-03T21:49:55.203 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.198+0000 7fc2fbdb4700 1 -- 172.21.15.49:0/2174365276 wait complete. 2022-04-03T21:49:55.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-04-03T21:49:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.435+0000 7f5260868700 1 Processor -- start 2022-04-03T21:49:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.435+0000 7f5260868700 1 -- start start 2022-04-03T21:49:55.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.436+0000 7f5260868700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f525c141e80 0x7f525c148590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.436+0000 7f5260868700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f525c0b9030 0x7f525c0bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.436+0000 7f5260868700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c0b7e00 con 0x7f525c0bde10 2022-04-03T21:49:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.436+0000 7f5260868700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c148ad0 con 0x7f525c0b9030 2022-04-03T21:49:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.436+0000 7f5260868700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c06c5c0 con 0x7f525c141e80 2022-04-03T21:49:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f525c0b9030 0x7f525c0bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f525c0b9030 0x7f525c0bd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34478/0 (socket says 172.21.15.49:34478) 2022-04-03T21:49:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 -- 172.21.15.49:0/1945114314 learned_addr learned my addr 172.21.15.49:0/1945114314 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f525a59c700 1 --2- 172.21.15.49:0/1945114314 >> v2:172.21.15.117:3300/0 conn(0x7f525c141e80 0x7f525c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 -- 172.21.15.49:0/1945114314 >> v2:172.21.15.117:3300/0 conn(0x7f525c141e80 msgr2=0x7f525c148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 --2- 172.21.15.49:0/1945114314 >> v2:172.21.15.117:3300/0 conn(0x7f525c141e80 0x7f525c148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 -- 172.21.15.49:0/1945114314 >> v1:172.21.15.117:6789/0 conn(0x7f525c0bde10 legacy=0x7f525c0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 -- 172.21.15.49:0/1945114314 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c06a780 con 0x7f525c0b9030 2022-04-03T21:49:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.437+0000 7f5259d9b700 1 --2- 172.21.15.49:0/1945114314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c0bd8d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f525c06abc0 tx=0x7f525000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a249bdc2a58fad6 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:55.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f525959a700 1 -- 172.21.15.49:0/1945114314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250004030 con 0x7f525c0b9030 2022-04-03T21:49:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f525959a700 1 -- 172.21.15.49:0/1945114314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250004190 con 0x7f525c0b9030 2022-04-03T21:49:55.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f525959a700 1 -- 172.21.15.49:0/1945114314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000da40 con 0x7f525c0b9030 2022-04-03T21:49:55.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f5260868700 1 -- 172.21.15.49:0/1945114314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 msgr2=0x7f525c0bd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f5260868700 1 --2- 172.21.15.49:0/1945114314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c0bd8d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f525c06abc0 tx=0x7f525000b3b0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f5260868700 1 -- 172.21.15.49:0/1945114314 shutdown_connections 2022-04-03T21:49:55.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f5260868700 1 --2- 172.21.15.49:0/1945114314 >> v2:172.21.15.117:3300/0 conn(0x7f525c141e80 0x7f525c148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f5260868700 1 --2- 172.21.15.49:0/1945114314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c0bd8d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.438+0000 7f5260868700 1 -- 172.21.15.49:0/1945114314 >> 172.21.15.49:0/1945114314 conn(0x7f525c067560 msgr2=0x7f525c0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:55.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.439+0000 7f5260868700 1 -- 172.21.15.49:0/1945114314 shutdown_connections 2022-04-03T21:49:55.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.439+0000 7f5260868700 1 -- 172.21.15.49:0/1945114314 wait complete. 2022-04-03T21:49:55.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.440+0000 7f5260868700 1 Processor -- start 2022-04-03T21:49:55.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.440+0000 7f5260868700 1 -- start start 2022-04-03T21:49:55.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f5260868700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f5260868700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0bde10 0x7f525c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f5260868700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c141e80 0x7f525c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f5260868700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b62a0 con 0x7f525c0b9030 2022-04-03T21:49:55.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f5260868700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b5230 con 0x7f525c0bde10 2022-04-03T21:49:55.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f5260868700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b72b0 con 0x7f525c141e80 2022-04-03T21:49:55.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f525a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f525a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34482/0 (socket says 172.21.15.49:34482) 2022-04-03T21:49:55.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.441+0000 7f525a59c700 1 -- 172.21.15.49:0/864381713 learned_addr learned my addr 172.21.15.49:0/864381713 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:55.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525ad9d700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c141e80 0x7f525c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f5259d9b700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0bde10 0x7f525c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525a59c700 1 -- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c141e80 msgr2=0x7f525c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525a59c700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c141e80 0x7f525c0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525a59c700 1 -- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0bde10 msgr2=0x7f525c15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525a59c700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0bde10 0x7f525c15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525a59c700 1 -- 172.21.15.49:0/864381713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525000b610 con 0x7f525c0b9030 2022-04-03T21:49:55.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.442+0000 7f525a59c700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c143430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f524c00e900 tx=0x7f524c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:55.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.443+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c013680 con 0x7f525c0b9030 2022-04-03T21:49:55.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.443+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c0137e0 con 0x7f525c0b9030 2022-04-03T21:49:55.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.443+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c013b60 con 0x7f525c0b9030 2022-04-03T21:49:55.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.443+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c0b4f50 con 0x7f525c0b9030 2022-04-03T21:49:55.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.443+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c0b4a90 con 0x7f525c0b9030 2022-04-03T21:49:55.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.444+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c15f1d0 con 0x7f525c0b9030 2022-04-03T21:49:55.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.445+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f524c019030 con 0x7f525c0b9030 2022-04-03T21:49:55.456 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.446+0000 7f524a7fc700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5238063d10 0x7f52380661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.456 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.446+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f524c080310 con 0x7f525c0b9030 2022-04-03T21:49:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.446+0000 7f5259d9b700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5238063d10 0x7f52380661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.447+0000 7f5259d9b700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5238063d10 0x7f52380661c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f525c0b9470 tx=0x7f525001a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.450+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f524c04f150 con 0x7f525c0b9030 2022-04-03T21:49:55.660 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.657+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f525c070a20 con 0x7f525c0b9030 2022-04-03T21:49:55.661 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.658+0000 7f524a7fc700 1 -- 172.21.15.49:0/864381713 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f524c017090 con 0x7f525c0b9030 2022-04-03T21:49:55.661 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:49:55.661 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2022-04-03T21:49:55.662 INFO:teuthology.orchestra.run.smithi049.stdout: { 2022-04-03T21:49:55.662 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2022-04-03T21:49:55.662 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2022-04-03T21:49:55.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2022-04-03T21:49:55.662 INFO:teuthology.orchestra.run.smithi049.stdout: { 2022-04-03T21:49:55.663 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2022-04-03T21:49:55.663 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2022-04-03T21:49:55.663 INFO:teuthology.orchestra.run.smithi049.stdout: } 2022-04-03T21:49:55.663 INFO:teuthology.orchestra.run.smithi049.stdout:] 2022-04-03T21:49:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5238063d10 msgr2=0x7f52380661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5238063d10 0x7f52380661c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f525c0b9470 tx=0x7f525001a000 comp rx=0 tx=0).stop 2022-04-03T21:49:55.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 msgr2=0x7f525c143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c143430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f524c00e900 tx=0x7f524c009060 comp rx=0 tx=0).stop 2022-04-03T21:49:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 shutdown_connections 2022-04-03T21:49:55.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5238063d10 0x7f52380661c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c141e80 0x7f525c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f525c0b9030 0x7f525c143430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 --2- 172.21.15.49:0/864381713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0bde10 0x7f525c15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.660+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 >> 172.21.15.49:0/864381713 conn(0x7f525c067560 msgr2=0x7f525c0ba1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:55.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.661+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 shutdown_connections 2022-04-03T21:49:55.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.661+0000 7f5260868700 1 -- 172.21.15.49:0/864381713 wait complete. 2022-04-03T21:49:55.687 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-04-03T21:49:55.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-04-03T21:49:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.903+0000 7f9c622b7700 1 Processor -- start 2022-04-03T21:49:55.906 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.903+0000 7f9c622b7700 1 -- start start 2022-04-03T21:49:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.904+0000 7f9c622b7700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 0x7f9c5c0a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.908 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.904+0000 7f9c622b7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c5c0a6e50 0x7f9c5c147e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.904+0000 7f9c622b7700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0bde50 con 0x7f9c5c0c2340 2022-04-03T21:49:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.904+0000 7f9c622b7700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0a4fb0 con 0x7f9c5c0c1f70 2022-04-03T21:49:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.904+0000 7f9c622b7700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0bd520 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.904+0000 7f9c5bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 0x7f9c5c0a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c60854700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c5c0a6e50 0x7f9c5c147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c5bfff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 0x7f9c5c0a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34486/0 (socket says 172.21.15.49:34486) 2022-04-03T21:49:55.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c5bfff700 1 -- 172.21.15.49:0/2680197901 learned_addr learned my addr 172.21.15.49:0/2680197901 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:55.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c5b7fe700 1 --1- 172.21.15.49:0/2680197901 >> v1:172.21.15.117:6789/0 conn(0x7f9c5c0c2340 0x7f9c5c0a6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47384/0 (socket says 172.21.15.49:47384) 2022-04-03T21:49:55.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c60854700 1 -- 172.21.15.49:0/2680197901 >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 msgr2=0x7f9c5c0a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:55.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c60854700 1 --2- 172.21.15.49:0/2680197901 >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 0x7f9c5c0a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c60854700 1 -- 172.21.15.49:0/2680197901 >> v1:172.21.15.117:6789/0 conn(0x7f9c5c0c2340 legacy=0x7f9c5c0a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c5affd700 1 -- 172.21.15.49:0/2680197901 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701233807 0 0) 0x7f9c5c0bde50 con 0x7f9c5c0c2340 2022-04-03T21:49:55.911 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c60854700 1 -- 172.21.15.49:0/2680197901 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0bd800 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.905+0000 7f9c5bfff700 1 --2- 172.21.15.49:0/2680197901 >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 0x7f9c5c0a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.906+0000 7f9c60854700 1 --2- 172.21.15.49:0/2680197901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0a6e50 0x7f9c5c147e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0a5c10 tx=0x7f9c54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2317e6135fcde99 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.906+0000 7f9c5affd700 1 -- 172.21.15.49:0/2680197901 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400e070 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.906+0000 7f9c5affd700 1 -- 172.21.15.49:0/2680197901 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400bb60 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.906+0000 7f9c5affd700 1 -- 172.21.15.49:0/2680197901 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54012430 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.915 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.906+0000 7f9c622b7700 1 -- 172.21.15.49:0/2680197901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0a6e50 msgr2=0x7f9c5c147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.906+0000 7f9c622b7700 1 --2- 172.21.15.49:0/2680197901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0a6e50 0x7f9c5c147e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0a5c10 tx=0x7f9c54009780 comp rx=0 tx=0).stop 2022-04-03T21:49:55.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.907+0000 7f9c622b7700 1 -- 172.21.15.49:0/2680197901 shutdown_connections 2022-04-03T21:49:55.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.907+0000 7f9c622b7700 1 --2- 172.21.15.49:0/2680197901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0a6e50 0x7f9c5c147e60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.907+0000 7f9c622b7700 1 --2- 172.21.15.49:0/2680197901 >> v2:172.21.15.49:3300/0 conn(0x7f9c5c0c1f70 0x7f9c5c0a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.907+0000 7f9c622b7700 1 -- 172.21.15.49:0/2680197901 >> 172.21.15.49:0/2680197901 conn(0x7f9c5c05dfe0 msgr2=0x7f9c5c0c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.907+0000 7f9c622b7700 1 -- 172.21.15.49:0/2680197901 shutdown_connections 2022-04-03T21:49:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.907+0000 7f9c622b7700 1 -- 172.21.15.49:0/2680197901 wait complete. 2022-04-03T21:49:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.908+0000 7f9c622b7700 1 Processor -- start 2022-04-03T21:49:55.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.908+0000 7f9c622b7700 1 -- start start 2022-04-03T21:49:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.909+0000 7f9c622b7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 0x7f9c5c15c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.909+0000 7f9c622b7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0c1f70 0x7f9c5c15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.909+0000 7f9c622b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c5c0c2340 0x7f9c5c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.909+0000 7f9c622b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0bb490 con 0x7f9c5c0c2340 2022-04-03T21:49:55.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.909+0000 7f9c622b7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b8740 con 0x7f9c5c0c1f70 2022-04-03T21:49:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.909+0000 7f9c622b7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c14a040 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 0x7f9c5c15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0c1f70 0x7f9c5c15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 0x7f9c5c15c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45710/0 (socket says 172.21.15.49:45710) 2022-04-03T21:49:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 -- 172.21.15.49:0/4241115480 learned_addr learned my addr 172.21.15.49:0/4241115480 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c60854700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c5c0c2340 0x7f9c5c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 -- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0c1f70 msgr2=0x7f9c5c15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0c1f70 0x7f9c5c15c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 -- 172.21.15.49:0/4241115480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c5c0c2340 msgr2=0x7f9c5c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c5c0c2340 0x7f9c5c14c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 -- 172.21.15.49:0/4241115480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009370 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5b7fe700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0c1f70 0x7f9c5c15c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.910+0000 7f9c5bfff700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 0x7f9c5c15c360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00ea50 tx=0x7f9c4c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.911+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c009650 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.911+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00ee90 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.911+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c54009a20 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.911+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00caa0 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.911+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c15bed0 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.912+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c15c1b0 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.913+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9c4c019030 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.914+0000 7f9c43fff700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9c3c063ce0 0x7f9c3c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.914+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9c4c080500 con 0x7f9c5c0a6e50 2022-04-03T21:49:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.914+0000 7f9c5b7fe700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9c3c063ce0 0x7f9c3c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.915+0000 7f9c5b7fe700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9c3c063ce0 0x7f9c3c066190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c50007990 tx=0x7f9c50007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:55.918+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9c4c04f3d0 con 0x7f9c5c0a6e50 2022-04-03T21:49:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.127+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9c5c096cc0 con 0x7f9c5c0a6e50 2022-04-03T21:49:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.842+0000 7f9c43fff700 1 -- 172.21.15.49:0/4241115480 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9c4c0529f0 con 0x7f9c5c0a6e50 2022-04-03T21:49:56.850 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.848+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9c3c063ce0 msgr2=0x7f9c3c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:56.850 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.848+0000 7f9c622b7700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9c3c063ce0 0x7f9c3c066190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c50007990 tx=0x7f9c50007bb0 comp rx=0 tx=0).stop 2022-04-03T21:49:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.848+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 msgr2=0x7f9c5c15c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.848+0000 7f9c622b7700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 0x7f9c5c15c360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00ea50 tx=0x7f9c4c0090f0 comp rx=0 tx=0).stop 2022-04-03T21:49:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.852+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 shutdown_connections 2022-04-03T21:49:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.852+0000 7f9c622b7700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9c3c063ce0 0x7f9c3c066190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.852+0000 7f9c622b7700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c5c0c2340 0x7f9c5c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.852+0000 7f9c622b7700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c5c0a6e50 0x7f9c5c15c360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.852+0000 7f9c622b7700 1 --2- 172.21.15.49:0/4241115480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c5c0c1f70 0x7f9c5c15c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.852+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 >> 172.21.15.49:0/4241115480 conn(0x7f9c5c05dfe0 msgr2=0x7f9c5c067d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.853+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 shutdown_connections 2022-04-03T21:49:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:56.853+0000 7f9c622b7700 1 -- 172.21.15.49:0/4241115480 wait complete. 2022-04-03T21:49:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2022-04-03T21:49:56.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2022-04-03T21:49:57.106 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.104+0000 7f5b48151700 1 Processor -- start 2022-04-03T21:49:57.107 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.104+0000 7f5b48151700 1 -- start start 2022-04-03T21:49:57.108 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b48151700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b400c1f00 0x7f5b400a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b48151700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b400c22d0 0x7f5b400a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b48151700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b400bdee0 con 0x7f5b400bc010 2022-04-03T21:49:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b48151700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b400bc900 con 0x7f5b400c1f00 2022-04-03T21:49:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b48151700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b400a5040 con 0x7f5b400c22d0 2022-04-03T21:49:57.109 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b45eed700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b400c1f00 0x7f5b400a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:57.110 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b456ec700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b400c22d0 0x7f5b400a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:57.110 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b466ee700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5b400bc010 0x7f5b4014e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47386/0 (socket says 172.21.15.49:47386) 2022-04-03T21:49:57.110 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.105+0000 7f5b466ee700 1 -- 172.21.15.49:0/3638536793 learned_addr learned my addr 172.21.15.49:0/3638536793 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:57.110 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b44eeb700 1 -- 172.21.15.49:0/3638536793 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029115255 0 0) 0x7f5b400bdee0 con 0x7f5b400bc010 2022-04-03T21:49:57.111 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b44eeb700 1 -- 172.21.15.49:0/3638536793 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b280033f0 con 0x7f5b400bc010 2022-04-03T21:49:57.111 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b456ec700 1 -- 172.21.15.49:0/3638536793 >> v2:172.21.15.49:3300/0 conn(0x7f5b400c1f00 msgr2=0x7f5b400a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:57.111 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b456ec700 1 --2- 172.21.15.49:0/3638536793 >> v2:172.21.15.49:3300/0 conn(0x7f5b400c1f00 0x7f5b400a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.111 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b456ec700 1 -- 172.21.15.49:0/3638536793 >> v1:172.21.15.117:6789/0 conn(0x7f5b400bc010 legacy=0x7f5b4014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:57.111 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b456ec700 1 -- 172.21.15.49:0/3638536793 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400bd640 con 0x7f5b400c22d0 2022-04-03T21:49:57.112 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b45eed700 1 --2- 172.21.15.49:0/3638536793 >> v2:172.21.15.49:3300/0 conn(0x7f5b400c1f00 0x7f5b400a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:57.112 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b456ec700 1 --2- 172.21.15.49:0/3638536793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400c22d0 0x7f5b400a6de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b400b8680 tx=0x7f5b30009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a55447e7eb44dcb server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b44eeb700 1 -- 172.21.15.49:0/3638536793 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30011630 con 0x7f5b400c22d0 2022-04-03T21:49:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b44eeb700 1 -- 172.21.15.49:0/3638536793 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30011790 con 0x7f5b400c22d0 2022-04-03T21:49:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.106+0000 7f5b44eeb700 1 -- 172.21.15.49:0/3638536793 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30011b10 con 0x7f5b400c22d0 2022-04-03T21:49:57.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 -- 172.21.15.49:0/3638536793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400c22d0 msgr2=0x7f5b400a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:57.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 --2- 172.21.15.49:0/3638536793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400c22d0 0x7f5b400a6de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b400b8680 tx=0x7f5b30009060 comp rx=0 tx=0).stop 2022-04-03T21:49:57.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 -- 172.21.15.49:0/3638536793 shutdown_connections 2022-04-03T21:49:57.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 --2- 172.21.15.49:0/3638536793 >> v2:172.21.15.49:3300/0 conn(0x7f5b400c1f00 0x7f5b400a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 --2- 172.21.15.49:0/3638536793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400c22d0 0x7f5b400a6de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 -- 172.21.15.49:0/3638536793 >> 172.21.15.49:0/3638536793 conn(0x7f5b4005e010 msgr2=0x7f5b400c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:57.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 -- 172.21.15.49:0/3638536793 shutdown_connections 2022-04-03T21:49:57.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.107+0000 7f5b48151700 1 -- 172.21.15.49:0/3638536793 wait complete. 2022-04-03T21:49:57.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.109+0000 7f5b48151700 1 Processor -- start 2022-04-03T21:49:57.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.109+0000 7f5b48151700 1 -- start start 2022-04-03T21:49:57.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b48151700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400bc010 0x7f5b400b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:57.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b48151700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 0x7f5b400b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:57.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b48151700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b400c22d0 0x7f5b40147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:57.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b48151700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400b6840 con 0x7f5b400c22d0 2022-04-03T21:49:57.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b48151700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400b6560 con 0x7f5b400bc010 2022-04-03T21:49:57.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b48151700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400b6cd0 con 0x7f5b400c1f00 2022-04-03T21:49:57.120 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b466ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b400c22d0 0x7f5b40147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:57.120 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b456ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 0x7f5b400b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:57.120 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b45eed700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400bc010 0x7f5b400b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:57.120 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b456ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 0x7f5b400b8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45712/0 (socket says 172.21.15.49:45712) 2022-04-03T21:49:57.120 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.110+0000 7f5b456ec700 1 -- 172.21.15.49:0/2506126135 learned_addr learned my addr 172.21.15.49:0/2506126135 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:57.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b456ec700 1 -- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400bc010 msgr2=0x7f5b400b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:57.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b456ec700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400bc010 0x7f5b400b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b456ec700 1 -- 172.21.15.49:0/2506126135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b400c22d0 msgr2=0x7f5b40147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:57.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b456ec700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b400c22d0 0x7f5b40147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b456ec700 1 -- 172.21.15.49:0/2506126135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0092a0 con 0x7f5b400c1f00 2022-04-03T21:49:57.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b456ec700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 0x7f5b400b8d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b30013000 tx=0x7f5b30017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:57.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300036f0 con 0x7f5b400c1f00 2022-04-03T21:49:57.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30003870 con 0x7f5b400c1f00 2022-04-03T21:49:57.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b300092a0 con 0x7f5b400c1f00 2022-04-03T21:49:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.111+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30003c30 con 0x7f5b400c1f00 2022-04-03T21:49:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.112+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b400b92c0 con 0x7f5b400c1f00 2022-04-03T21:49:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.112+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b400b6b30 con 0x7f5b400c1f00 2022-04-03T21:49:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.113+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f5b3000f050 con 0x7f5b400c1f00 2022-04-03T21:49:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.114+0000 7f5b2dffb700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5b20063d10 0x7f5b200661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.114+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f5b30081bb0 con 0x7f5b400c1f00 2022-04-03T21:49:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.114+0000 7f5b45eed700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5b20063d10 0x7f5b200661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.115+0000 7f5b45eed700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5b20063d10 0x7f5b200661c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009dc0 tx=0x7f5b3c009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.117+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f5b30050900 con 0x7f5b400c1f00 2022-04-03T21:49:57.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.329+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5b400b6b30 con 0x7f5b400c1f00 2022-04-03T21:49:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.847+0000 7f5b2dffb700 1 -- 172.21.15.49:0/2506126135 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5b400b6b30 con 0x7f5b400c1f00 2022-04-03T21:49:57.863 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.860+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5b20063d10 msgr2=0x7f5b200661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:57.863 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.860+0000 7f5b48151700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5b20063d10 0x7f5b200661c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009dc0 tx=0x7f5b3c009060 comp rx=0 tx=0).stop 2022-04-03T21:49:57.863 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.860+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 msgr2=0x7f5b400b8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:57.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.860+0000 7f5b48151700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 0x7f5b400b8d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b30013000 tx=0x7f5b30017000 comp rx=0 tx=0).stop 2022-04-03T21:49:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.867+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 shutdown_connections 2022-04-03T21:49:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.867+0000 7f5b48151700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f5b20063d10 0x7f5b200661c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.867+0000 7f5b48151700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b400c22d0 0x7f5b40147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.867+0000 7f5b48151700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b400bc010 0x7f5b400b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.867+0000 7f5b48151700 1 --2- 172.21.15.49:0/2506126135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b400c1f00 0x7f5b400b8d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:57.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.867+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 >> 172.21.15.49:0/2506126135 conn(0x7f5b4005e010 msgr2=0x7f5b4014cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:57.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.869+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 shutdown_connections 2022-04-03T21:49:57.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:57.869+0000 7f5b48151700 1 -- 172.21.15.49:0/2506126135 wait complete. 2022-04-03T21:49:57.877 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2022-04-03T21:49:57.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-04-03T21:49:58.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.116+0000 7fc49507a700 1 Processor -- start 2022-04-03T21:49:58.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.116+0000 7fc49507a700 1 -- start start 2022-04-03T21:49:58.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc49507a700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4900bd650 0x7fc49014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc49507a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc490069080 0x7fc49014f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.121 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc49507a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900a3520 0x7fc4900a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc49507a700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900bda20 con 0x7fc4900bd650 2022-04-03T21:49:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc49507a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900a2030 con 0x7fc490069080 2022-04-03T21:49:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc49507a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900a1140 con 0x7fc4900a3520 2022-04-03T21:49:58.122 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc48ed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4900bd650 0x7fc49014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc48ed9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4900bd650 0x7fc49014eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34494/0 (socket says 172.21.15.49:34494) 2022-04-03T21:49:58.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc48ed9d700 1 -- 172.21.15.49:0/173513891 learned_addr learned my addr 172.21.15.49:0/173513891 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:58.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc48f59e700 1 --2- 172.21.15.49:0/173513891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900a3520 0x7fc4900a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.117+0000 7fc48e59c700 1 --2- 172.21.15.49:0/173513891 >> v2:172.21.15.117:3300/0 conn(0x7fc490069080 0x7fc49014f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48ed9d700 1 -- 172.21.15.49:0/173513891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900a3520 msgr2=0x7fc4900a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48ed9d700 1 --2- 172.21.15.49:0/173513891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900a3520 0x7fc4900a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48ed9d700 1 -- 172.21.15.49:0/173513891 >> v2:172.21.15.117:3300/0 conn(0x7fc490069080 msgr2=0x7fc49014f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48ed9d700 1 --2- 172.21.15.49:0/173513891 >> v2:172.21.15.117:3300/0 conn(0x7fc490069080 0x7fc49014f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48ed9d700 1 -- 172.21.15.49:0/173513891 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900a1420 con 0x7fc4900bd650 2022-04-03T21:49:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48ed9d700 1 --2- 172.21.15.49:0/173513891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900bd650 0x7fc49014eb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc4900a1040 tx=0x7fc4800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d2003dfad52986 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48dd9b700 1 -- 172.21.15.49:0/173513891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480004030 con 0x7fc4900bd650 2022-04-03T21:49:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48dd9b700 1 -- 172.21.15.49:0/173513891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480004190 con 0x7fc4900bd650 2022-04-03T21:49:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.118+0000 7fc48dd9b700 1 -- 172.21.15.49:0/173513891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480011630 con 0x7fc4900bd650 2022-04-03T21:49:58.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 -- 172.21.15.49:0/173513891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900bd650 msgr2=0x7fc49014eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 --2- 172.21.15.49:0/173513891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900bd650 0x7fc49014eb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc4900a1040 tx=0x7fc4800090f0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 -- 172.21.15.49:0/173513891 shutdown_connections 2022-04-03T21:49:58.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 --2- 172.21.15.49:0/173513891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900a3520 0x7fc4900a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 --2- 172.21.15.49:0/173513891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900bd650 0x7fc49014eb10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 --2- 172.21.15.49:0/173513891 >> v2:172.21.15.117:3300/0 conn(0x7fc490069080 0x7fc49014f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 -- 172.21.15.49:0/173513891 >> 172.21.15.49:0/173513891 conn(0x7fc4900c1680 msgr2=0x7fc4900c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 -- 172.21.15.49:0/173513891 shutdown_connections 2022-04-03T21:49:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.119+0000 7fc49507a700 1 -- 172.21.15.49:0/173513891 wait complete. 2022-04-03T21:49:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.121+0000 7fc49507a700 1 Processor -- start 2022-04-03T21:49:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.121+0000 7fc49507a700 1 -- start start 2022-04-03T21:49:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc49507a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc490069080 0x7fc490147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc49507a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900a3520 0x7fc4901475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc49507a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900bd650 0x7fc49015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc49507a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900a6fc0 con 0x7fc4900a3520 2022-04-03T21:49:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc49507a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900a6120 con 0x7fc490069080 2022-04-03T21:49:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc49507a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900a63b0 con 0x7fc4900bd650 2022-04-03T21:49:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc48e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900a3520 0x7fc4901475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc48f59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900bd650 0x7fc49015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc48e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900a3520 0x7fc4901475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34496/0 (socket says 172.21.15.49:34496) 2022-04-03T21:49:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc48e59c700 1 -- 172.21.15.49:0/2106116553 learned_addr learned my addr 172.21.15.49:0/2106116553 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.122+0000 7fc48ed9d700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc490069080 0x7fc490147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc48f59e700 1 -- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc490069080 msgr2=0x7fc490147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc48f59e700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc490069080 0x7fc490147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc48f59e700 1 -- 172.21.15.49:0/2106116553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900a3520 msgr2=0x7fc4901475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc48f59e700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900a3520 0x7fc4901475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc48f59e700 1 -- 172.21.15.49:0/2106116553 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480009370 con 0x7fc4900bd650 2022-04-03T21:49:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc48f59e700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900bd650 0x7fc49015ade0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800caa0 con 0x7fc4900bd650 2022-04-03T21:49:58.135 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800f040 con 0x7fc4900bd650 2022-04-03T21:49:58.135 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800ce70 con 0x7fc4900bd650 2022-04-03T21:49:58.135 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4900a6690 con 0x7fc4900bd650 2022-04-03T21:49:58.135 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.123+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4900a6c50 con 0x7fc4900bd650 2022-04-03T21:49:58.136 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.124+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc490066ae0 con 0x7fc4900bd650 2022-04-03T21:49:58.136 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.125+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fc488014690 con 0x7fc4900bd650 2022-04-03T21:49:58.137 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.126+0000 7fc476ffd700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc470063ce0 0x7fc470066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.137 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.126+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fc4880816f0 con 0x7fc4900bd650 2022-04-03T21:49:58.137 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.127+0000 7fc48ed9d700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc470063ce0 0x7fc470066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.137 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.127+0000 7fc48ed9d700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc470063ce0 0x7fc470066190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4900a1040 tx=0x7fc480016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:58.138 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.131+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fc4880502d0 con 0x7fc4900bd650 2022-04-03T21:49:58.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.379+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc490070a20 con 0x7fc4900bd650 2022-04-03T21:49:58.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.390+0000 7fc476ffd700 1 -- 172.21.15.49:0/2106116553 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc4880538f0 con 0x7fc4900bd650 2022-04-03T21:49:58.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.398+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc470063ce0 msgr2=0x7fc470066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.398+0000 7fc49507a700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc470063ce0 0x7fc470066190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4900a1040 tx=0x7fc480016000 comp rx=0 tx=0).stop 2022-04-03T21:49:58.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.398+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900bd650 msgr2=0x7fc49015ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.398+0000 7fc49507a700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900bd650 0x7fc49015ade0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48800b040 comp rx=0 tx=0).stop 2022-04-03T21:49:58.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.399+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 shutdown_connections 2022-04-03T21:49:58.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.399+0000 7fc49507a700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc470063ce0 0x7fc470066190 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4900a1040 tx=0x7fc480016000 comp rx=0 tx=0).stop 2022-04-03T21:49:58.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.399+0000 7fc49507a700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4900bd650 0x7fc49015ade0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.399+0000 7fc49507a700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc490069080 0x7fc490147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.399+0000 7fc49507a700 1 --2- 172.21.15.49:0/2106116553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4900a3520 0x7fc4901475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.399+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 >> 172.21.15.49:0/2106116553 conn(0x7fc4900c1680 msgr2=0x7fc4900c1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:58.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.406+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 shutdown_connections 2022-04-03T21:49:58.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.409+0000 7fc49507a700 1 -- 172.21.15.49:0/2106116553 wait complete. 2022-04-03T21:49:58.423 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 3 and data pool 4 2022-04-03T21:49:58.448 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2022-04-03T21:49:58.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2022-04-03T21:49:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.666+0000 7f31f65b3700 1 Processor -- start 2022-04-03T21:49:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.666+0000 7f31f65b3700 1 -- start start 2022-04-03T21:49:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f65b3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f00a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f65b3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31f00c22d0 0x7f31f00a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f65b3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f00bdee0 con 0x7f31f00bc010 2022-04-03T21:49:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f65b3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f00bc900 con 0x7f31f00c22d0 2022-04-03T21:49:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f65b3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00a5040 con 0x7f31f00c1f00 2022-04-03T21:49:58.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f4b50700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f31f00bc010 0x7f31f014e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50458/0 (socket says 172.21.15.49:50458) 2022-04-03T21:49:58.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31f4b50700 1 -- 172.21.15.49:0/627586249 learned_addr learned my addr 172.21.15.49:0/627586249 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:58.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31ef7fe700 1 --2- 172.21.15.49:0/627586249 >> v2:172.21.15.117:3300/0 conn(0x7f31f00c22d0 0x7f31f00a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.667+0000 7f31effff700 1 --2- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f00a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31eeffd700 1 -- 172.21.15.49:0/627586249 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818347263 0 0) 0x7f31f00bdee0 con 0x7f31f00bc010 2022-04-03T21:49:58.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31ef7fe700 1 -- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 msgr2=0x7f31f00a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:58.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31ef7fe700 1 --2- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f00a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31ef7fe700 1 -- 172.21.15.49:0/627586249 >> v1:172.21.15.49:6789/0 conn(0x7f31f00bc010 legacy=0x7f31f014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31ef7fe700 1 -- 172.21.15.49:0/627586249 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00bd640 con 0x7f31f00c22d0 2022-04-03T21:49:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31ef7fe700 1 --2- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f00a6de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009760 tx=0x7f31e4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb0fa4a113ee448 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:58.674 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31eeffd700 1 -- 172.21.15.49:0/627586249 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011630 con 0x7f31f00c22d0 2022-04-03T21:49:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31eeffd700 1 -- 172.21.15.49:0/627586249 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e4011790 con 0x7f31f00c22d0 2022-04-03T21:49:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.668+0000 7f31eeffd700 1 -- 172.21.15.49:0/627586249 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011b50 con 0x7f31f00c22d0 2022-04-03T21:49:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 -- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 msgr2=0x7f31f00a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 --2- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f00a6de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009760 tx=0x7f31e4009060 comp rx=0 tx=0).stop 2022-04-03T21:49:58.675 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 -- 172.21.15.49:0/627586249 shutdown_connections 2022-04-03T21:49:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 --2- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f00a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 --2- 172.21.15.49:0/627586249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f00a6de0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 -- 172.21.15.49:0/627586249 >> 172.21.15.49:0/627586249 conn(0x7f31f005e010 msgr2=0x7f31f00c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 -- 172.21.15.49:0/627586249 shutdown_connections 2022-04-03T21:49:58.676 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.669+0000 7f31f65b3700 1 -- 172.21.15.49:0/627586249 wait complete. 2022-04-03T21:49:58.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.671+0000 7f31f65b3700 1 Processor -- start 2022-04-03T21:49:58.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.671+0000 7f31f65b3700 1 -- start start 2022-04-03T21:49:58.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f65b3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 0x7f31f00b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f65b3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f0145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f65b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f65b3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00bad80 con 0x7f31f00bc010 2022-04-03T21:49:58.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f65b3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00b83b0 con 0x7f31f00c22d0 2022-04-03T21:49:58.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f65b3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0146960 con 0x7f31f00c1f00 2022-04-03T21:49:58.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 0x7f31f00b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 0x7f31f00b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34498/0 (socket says 172.21.15.49:34498) 2022-04-03T21:49:58.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 -- 172.21.15.49:0/2941208004 learned_addr learned my addr 172.21.15.49:0/2941208004 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:58.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31ef7fe700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f0145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31f4b50700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 -- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 msgr2=0x7f31f0145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f0145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 -- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 msgr2=0x7f31f015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:58.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f015e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:58.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.672+0000 7f31effff700 1 -- 172.21.15.49:0/2941208004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40092a0 con 0x7f31f00bc010 2022-04-03T21:49:58.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.673+0000 7f31effff700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 0x7f31f00b7420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31e000e930 tx=0x7f31e0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:58.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.673+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0013680 con 0x7f31f00bc010 2022-04-03T21:49:58.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.673+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00137e0 con 0x7f31f00bc010 2022-04-03T21:49:58.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.673+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f015efe0 con 0x7f31f00bc010 2022-04-03T21:49:58.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.673+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0013b60 con 0x7f31f00bc010 2022-04-03T21:49:58.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.673+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f00b7e90 con 0x7f31f00bc010 2022-04-03T21:49:58.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.674+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f0069020 con 0x7f31f00bc010 2022-04-03T21:49:58.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.675+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f31e0019030 con 0x7f31f00bc010 2022-04-03T21:49:58.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.676+0000 7f31d7fff700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f31d0063ce0 0x7f31d0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:58.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.676+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f31e0080950 con 0x7f31f00bc010 2022-04-03T21:49:58.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.677+0000 7f31ef7fe700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f31d0063ce0 0x7f31d0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:58.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.677+0000 7f31ef7fe700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f31d0063ce0 0x7f31d0066190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009760 tx=0x7f31e4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:58.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.682+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f31e004f440 con 0x7f31f00bc010 2022-04-03T21:49:58.904 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:58.902+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f31f00b8200 con 0x7f31f00bc010 2022-04-03T21:49:59.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.392+0000 7f31d7fff700 1 -- 172.21.15.49:0/2941208004 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f31e00210e0 con 0x7f31f00bc010 2022-04-03T21:49:59.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f31d0063ce0 msgr2=0x7f31d0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:59.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f31d0063ce0 0x7f31d0066190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009760 tx=0x7f31e4017000 comp rx=0 tx=0).stop 2022-04-03T21:49:59.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 msgr2=0x7f31f00b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:59.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 0x7f31f00b7420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31e000e930 tx=0x7f31e0009060 comp rx=0 tx=0).stop 2022-04-03T21:49:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 shutdown_connections 2022-04-03T21:49:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f31d0063ce0 0x7f31d0066190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31f00c22d0 0x7f31f015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f00bc010 0x7f31f00b7420 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 --2- 172.21.15.49:0/2941208004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31f00c1f00 0x7f31f0145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 >> 172.21.15.49:0/2941208004 conn(0x7f31f005e010 msgr2=0x7f31f00bf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 shutdown_connections 2022-04-03T21:49:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.395+0000 7f31f65b3700 1 -- 172.21.15.49:0/2941208004 wait complete. 2022-04-03T21:49:59.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2022-04-03T21:49:59.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.646+0000 7f099ba7f700 1 Processor -- start 2022-04-03T21:49:59.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.646+0000 7f099ba7f700 1 -- start start 2022-04-03T21:49:59.651 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.647+0000 7f099ba7f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0994148630 0x7f09940b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:59.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.647+0000 7f099ba7f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940b95d0 0x7f09941419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:59.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099ba7f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099406a330 con 0x7f09940b8cc0 2022-04-03T21:49:59.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099ba7f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09940a2e00 con 0x7f0994148630 2022-04-03T21:49:59.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099ba7f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994148ad0 con 0x7f09940b95d0 2022-04-03T21:49:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099981b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f09940b8cc0 0x7f09940a05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50460/0 (socket says 172.21.15.49:50460) 2022-04-03T21:49:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099981b700 1 -- 172.21.15.49:0/250346833 learned_addr learned my addr 172.21.15.49:0/250346833 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:49:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099901a700 1 --2- 172.21.15.49:0/250346833 >> v2:172.21.15.117:3300/0 conn(0x7f0994148630 0x7f09940b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f099a01c700 1 --2- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940b95d0 0x7f09941419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:59.653 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f0998819700 1 -- 172.21.15.49:0/250346833 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403515997 0 0) 0x7f099406a330 con 0x7f09940b8cc0 2022-04-03T21:49:59.654 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.648+0000 7f0998819700 1 -- 172.21.15.49:0/250346833 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c0033f0 con 0x7f09940b8cc0 2022-04-03T21:49:59.654 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f099901a700 1 -- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940b95d0 msgr2=0x7f09941419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:49:59.654 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f099901a700 1 --2- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940b95d0 0x7f09941419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.654 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f099901a700 1 -- 172.21.15.49:0/250346833 >> v1:172.21.15.49:6789/0 conn(0x7f09940b8cc0 legacy=0x7f09940a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f099901a700 1 -- 172.21.15.49:0/250346833 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994069720 con 0x7f0994148630 2022-04-03T21:49:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f099901a700 1 --2- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0994148630 0x7f09940b9090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0984009790 tx=0x7f0984009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e46b6cd3ffc1adb8 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f0998819700 1 -- 172.21.15.49:0/250346833 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840105b0 con 0x7f0994148630 2022-04-03T21:49:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f0998819700 1 -- 172.21.15.49:0/250346833 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984010710 con 0x7f0994148630 2022-04-03T21:49:59.655 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.649+0000 7f0998819700 1 -- 172.21.15.49:0/250346833 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984010ad0 con 0x7f0994148630 2022-04-03T21:49:59.659 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 -- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0994148630 msgr2=0x7f09940b9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:59.659 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 --2- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0994148630 0x7f09940b9090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0984009790 tx=0x7f0984009060 comp rx=0 tx=0).stop 2022-04-03T21:49:59.659 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 -- 172.21.15.49:0/250346833 shutdown_connections 2022-04-03T21:49:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 --2- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940b95d0 0x7f09941419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 --2- 172.21.15.49:0/250346833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0994148630 0x7f09940b9090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 -- 172.21.15.49:0/250346833 >> 172.21.15.49:0/250346833 conn(0x7f09940bd210 msgr2=0x7f09940bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:49:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 -- 172.21.15.49:0/250346833 shutdown_connections 2022-04-03T21:49:59.660 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.650+0000 7f099ba7f700 1 -- 172.21.15.49:0/250346833 wait complete. 2022-04-03T21:49:59.661 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.652+0000 7f099ba7f700 1 Processor -- start 2022-04-03T21:49:59.661 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.652+0000 7f099ba7f700 1 -- start start 2022-04-03T21:49:59.661 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099ba7f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 0x7f0994144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:59.661 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099ba7f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940b95d0 0x7f09940b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:59.662 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099ba7f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0994148630 0x7f099406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:59.662 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099ba7f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b3390 con 0x7f09940b8cc0 2022-04-03T21:49:59.662 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099ba7f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b29c0 con 0x7f09940b95d0 2022-04-03T21:49:59.662 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099ba7f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994143740 con 0x7f0994148630 2022-04-03T21:49:59.663 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099981b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 0x7f0994144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:59.663 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099981b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 0x7f0994144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34500/0 (socket says 172.21.15.49:34500) 2022-04-03T21:49:59.663 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099981b700 1 -- 172.21.15.49:0/1784551757 learned_addr learned my addr 172.21.15.49:0/1784551757 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:49:59.663 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099901a700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940b95d0 0x7f09940b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:59.663 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.653+0000 7f099a01c700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0994148630 0x7f099406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:59.664 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099901a700 1 -- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0994148630 msgr2=0x7f099406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:59.664 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099901a700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0994148630 0x7f099406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.664 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099901a700 1 -- 172.21.15.49:0/1784551757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 msgr2=0x7f0994144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:49:59.664 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099901a700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 0x7f0994144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:49:59.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099901a700 1 -- 172.21.15.49:0/1784551757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840092a0 con 0x7f09940b95d0 2022-04-03T21:49:59.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099981b700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 0x7f0994144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:49:59.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099901a700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940b95d0 0x7f09940b37e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0984015000 tx=0x7f0984016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:59.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984010880 con 0x7f09940b95d0 2022-04-03T21:49:59.665 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984010a40 con 0x7f09940b95d0 2022-04-03T21:49:59.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984025640 con 0x7f09940b95d0 2022-04-03T21:49:59.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.654+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940b2c80 con 0x7f09940b95d0 2022-04-03T21:49:59.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.655+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09941445c0 con 0x7f09940b95d0 2022-04-03T21:49:59.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.656+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09940b3500 con 0x7f09940b95d0 2022-04-03T21:49:59.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.656+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f098400f070 con 0x7f09940b95d0 2022-04-03T21:49:59.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.657+0000 7f0981ffb700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0974063ce0 0x7f0974066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:49:59.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.657+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f0984081e40 con 0x7f09940b95d0 2022-04-03T21:49:59.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.658+0000 7f099981b700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0974063ce0 0x7f0974066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:49:59.668 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.658+0000 7f099981b700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0974063ce0 0x7f0974066190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0990007fd0 tx=0x7f0990009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:49:59.669 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.662+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f09940b3500 con 0x7f09940b95d0 2022-04-03T21:49:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:49:59.853+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f09940b3500 con 0x7f09940b95d0 2022-04-03T21:50:01.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.399+0000 7f0981ffb700 1 -- 172.21.15.49:0/1784551757 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f09940b3500 con 0x7f09940b95d0 2022-04-03T21:50:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.409+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0974063ce0 msgr2=0x7f0974066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:01.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.409+0000 7f099ba7f700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0974063ce0 0x7f0974066190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0990007fd0 tx=0x7f0990009040 comp rx=0 tx=0).stop 2022-04-03T21:50:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.409+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940b95d0 msgr2=0x7f09940b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:01.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.409+0000 7f099ba7f700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940b95d0 0x7f09940b37e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0984015000 tx=0x7f0984016000 comp rx=0 tx=0).stop 2022-04-03T21:50:01.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.412+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 shutdown_connections 2022-04-03T21:50:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.412+0000 7f099ba7f700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f0974063ce0 0x7f0974066190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.412+0000 7f099ba7f700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0994148630 0x7f099406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.412+0000 7f099ba7f700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09940b8cc0 0x7f0994144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.412+0000 7f099ba7f700 1 --2- 172.21.15.49:0/1784551757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940b95d0 0x7f09940b37e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.412+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 >> 172.21.15.49:0/1784551757 conn(0x7f09940bd210 msgr2=0x7f09940bb110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.414+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 shutdown_connections 2022-04-03T21:50:01.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.415+0000 7f099ba7f700 1 -- 172.21.15.49:0/1784551757 wait complete. 2022-04-03T21:50:01.419 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' created 2022-04-03T21:50:01.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2022-04-03T21:50:01.666 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.664+0000 7fae7ed45700 1 Processor -- start 2022-04-03T21:50:01.667 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.664+0000 7fae7ed45700 1 -- start start 2022-04-03T21:50:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7ed45700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae780c1f70 0x7fae780a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7ed45700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae780c2340 0x7fae780a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7ed45700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 0x7fae78067d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7ed45700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780a4fb0 con 0x7fae780c1f70 2022-04-03T21:50:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7ed45700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780bde50 con 0x7fae780c2340 2022-04-03T21:50:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7ed45700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780a7100 con 0x7fae780a6c80 2022-04-03T21:50:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7cae1700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae780c1f70 0x7fae780a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7d2e2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 0x7fae78067d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.671 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae77fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae780c2340 0x7fae780a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.671 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7d2e2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 0x7fae78067d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45726/0 (socket says 172.21.15.49:45726) 2022-04-03T21:50:01.671 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.665+0000 7fae7d2e2700 1 -- 172.21.15.49:0/4265193899 learned_addr learned my addr 172.21.15.49:0/4265193899 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:01.671 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae7d2e2700 1 -- 172.21.15.49:0/4265193899 >> v2:172.21.15.117:3300/0 conn(0x7fae780c2340 msgr2=0x7fae780a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae7d2e2700 1 --2- 172.21.15.49:0/4265193899 >> v2:172.21.15.117:3300/0 conn(0x7fae780c2340 0x7fae780a6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae7d2e2700 1 -- 172.21.15.49:0/4265193899 >> v2:172.21.15.49:3300/0 conn(0x7fae780c1f70 msgr2=0x7fae780a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae7d2e2700 1 --2- 172.21.15.49:0/4265193899 >> v2:172.21.15.49:3300/0 conn(0x7fae780c1f70 0x7fae780a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae7d2e2700 1 -- 172.21.15.49:0/4265193899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780bd520 con 0x7fae780a6c80 2022-04-03T21:50:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae7d2e2700 1 --2- 172.21.15.49:0/4265193899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 0x7fae78067d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae780bf190 tx=0x7fae70009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4cf7523ad1953 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae777fe700 1 -- 172.21.15.49:0/4265193899 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7000e070 con 0x7fae780a6c80 2022-04-03T21:50:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae777fe700 1 -- 172.21.15.49:0/4265193899 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7000b970 con 0x7fae780a6c80 2022-04-03T21:50:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.666+0000 7fae777fe700 1 -- 172.21.15.49:0/4265193899 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700092e0 con 0x7fae780a6c80 2022-04-03T21:50:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 -- 172.21.15.49:0/4265193899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 msgr2=0x7fae78067d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4265193899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 0x7fae78067d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae780bf190 tx=0x7fae70009840 comp rx=0 tx=0).stop 2022-04-03T21:50:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 -- 172.21.15.49:0/4265193899 shutdown_connections 2022-04-03T21:50:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4265193899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780a6c80 0x7fae78067d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4265193899 >> v2:172.21.15.49:3300/0 conn(0x7fae780c1f70 0x7fae780a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4265193899 >> v2:172.21.15.117:3300/0 conn(0x7fae780c2340 0x7fae780a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 -- 172.21.15.49:0/4265193899 >> 172.21.15.49:0/4265193899 conn(0x7fae7805dfe0 msgr2=0x7fae780c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 -- 172.21.15.49:0/4265193899 shutdown_connections 2022-04-03T21:50:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.667+0000 7fae7ed45700 1 -- 172.21.15.49:0/4265193899 wait complete. 2022-04-03T21:50:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.669+0000 7fae7ed45700 1 Processor -- start 2022-04-03T21:50:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.669+0000 7fae7ed45700 1 -- start start 2022-04-03T21:50:01.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7ed45700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 0x7fae780c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7ed45700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780c1f70 0x7fae780bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7ed45700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae780c2340 0x7fae78154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7ed45700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae78098850 con 0x7fae780a6c80 2022-04-03T21:50:01.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7ed45700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780bbd80 con 0x7fae780c2340 2022-04-03T21:50:01.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7ed45700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780bb8f0 con 0x7fae780c1f70 2022-04-03T21:50:01.681 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7cae1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 0x7fae780c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae77fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780c1f70 0x7fae780bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7cae1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 0x7fae780c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34504/0 (socket says 172.21.15.49:34504) 2022-04-03T21:50:01.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7cae1700 1 -- 172.21.15.49:0/4271232782 learned_addr learned my addr 172.21.15.49:0/4271232782 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:01.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7d2e2700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae780c2340 0x7fae78154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.670+0000 7fae7cae1700 1 -- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780c1f70 msgr2=0x7fae780bacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:01.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7cae1700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780c1f70 0x7fae780bacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7cae1700 1 -- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae780c2340 msgr2=0x7fae78154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:01.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7cae1700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae780c2340 0x7fae78154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:01.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7cae1700 1 -- 172.21.15.49:0/4271232782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009ae0 con 0x7fae780a6c80 2022-04-03T21:50:01.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae77fff700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780c1f70 0x7fae780bacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:01.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7cae1700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 0x7fae780c0d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e960 tx=0x7fae6c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:01.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c013680 con 0x7fae780a6c80 2022-04-03T21:50:01.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0137e0 con 0x7fae780a6c80 2022-04-03T21:50:01.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c013b60 con 0x7fae780a6c80 2022-04-03T21:50:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7815b870 con 0x7fae780a6c80 2022-04-03T21:50:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.671+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae78098570 con 0x7fae780a6c80 2022-04-03T21:50:01.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.672+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae780bbbd0 con 0x7fae780a6c80 2022-04-03T21:50:01.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.673+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fae6c019030 con 0x7fae780a6c80 2022-04-03T21:50:01.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.674+0000 7fae74ff9700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fae60063ce0 0x7fae60066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:01.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.675+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fae6c080a70 con 0x7fae780a6c80 2022-04-03T21:50:01.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.675+0000 7fae77fff700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fae60063ce0 0x7fae60066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:01.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.676+0000 7fae77fff700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fae60063ce0 0x7fae60066190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae78099ad0 tx=0x7fae64009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:01.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.680+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fae6c04f380 con 0x7fae780a6c80 2022-04-03T21:50:01.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:01.885+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fae78070a20 con 0x7fae780a6c80 2022-04-03T21:50:02.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.399+0000 7fae74ff9700 1 -- 172.21.15.49:0/4271232782 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae6c0170c0 con 0x7fae780a6c80 2022-04-03T21:50:02.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.403+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fae60063ce0 msgr2=0x7fae60066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.403+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fae60063ce0 0x7fae60066190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae78099ad0 tx=0x7fae64009060 comp rx=0 tx=0).stop 2022-04-03T21:50:02.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.403+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 msgr2=0x7fae780c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.407 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.403+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 0x7fae780c0d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e960 tx=0x7fae6c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:02.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 shutdown_connections 2022-04-03T21:50:02.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fae60063ce0 0x7fae60066190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae780c2340 0x7fae78154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae780a6c80 0x7fae780c0d10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 --2- 172.21.15.49:0/4271232782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae780c1f70 0x7fae780bacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 >> 172.21.15.49:0/4271232782 conn(0x7fae7805dfe0 msgr2=0x7fae780b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:02.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.404+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 shutdown_connections 2022-04-03T21:50:02.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.405+0000 7fae7ed45700 1 -- 172.21.15.49:0/4271232782 wait complete. 2022-04-03T21:50:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:set pool 5 allow_ec_overwrites to true 2022-04-03T21:50:02.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2022-04-03T21:50:02.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.676+0000 7f7820d47700 1 Processor -- start 2022-04-03T21:50:02.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.676+0000 7f7820d47700 1 -- start start 2022-04-03T21:50:02.682 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.677+0000 7f7820d47700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c1537a0 0x7f781c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:02.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.677+0000 7f7820d47700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c0a50a0 con 0x7f781c0c1f90 2022-04-03T21:50:02.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f7820d47700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c0a6750 con 0x7f781c0c2360 2022-04-03T21:50:02.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f7820d47700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0a6a30 con 0x7f781c1537a0 2022-04-03T21:50:02.683 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f781c0c1f90 0x7f781c0bbf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50462/0 (socket says 172.21.15.49:50462) 2022-04-03T21:50:02.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781a59c700 1 -- 172.21.15.49:0/574560697 learned_addr learned my addr 172.21.15.49:0/574560697 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:02.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781ad9d700 1 --2- 172.21.15.49:0/574560697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c1537a0 0x7f781c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:02.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579426918 0 0) 0x7f781c0a6750 con 0x7f781c0c2360 2022-04-03T21:50:02.684 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78000033f0 con 0x7f781c0c2360 2022-04-03T21:50:02.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115636567 0 0) 0x7f781c0a50a0 con 0x7f781c0c1f90 2022-04-03T21:50:02.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f781c0a6750 con 0x7f781c0c1f90 2022-04-03T21:50:02.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781ad9d700 1 -- 172.21.15.49:0/574560697 >> v1:172.21.15.117:6789/0 conn(0x7f781c0c2360 legacy=0x7f781c0bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781ad9d700 1 -- 172.21.15.49:0/574560697 >> v1:172.21.15.49:6789/0 conn(0x7f781c0c1f90 legacy=0x7f781c0bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.685 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.678+0000 7f781ad9d700 1 -- 172.21.15.49:0/574560697 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0a6d10 con 0x7f781c1537a0 2022-04-03T21:50:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.679+0000 7f781ad9d700 1 --2- 172.21.15.49:0/574560697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c1537a0 0x7f781c155b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7814009e90 tx=0x7f7814009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bebbf09e4e777a27 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.679+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400e070 con 0x7f781c1537a0 2022-04-03T21:50:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.679+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400bb80 con 0x7f781c1537a0 2022-04-03T21:50:02.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.679+0000 7f781959a700 1 -- 172.21.15.49:0/574560697 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814012430 con 0x7f781c1537a0 2022-04-03T21:50:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 -- 172.21.15.49:0/574560697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c1537a0 msgr2=0x7f781c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 --2- 172.21.15.49:0/574560697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c1537a0 0x7f781c155b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7814009e90 tx=0x7f7814009780 comp rx=0 tx=0).stop 2022-04-03T21:50:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 -- 172.21.15.49:0/574560697 shutdown_connections 2022-04-03T21:50:02.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 --2- 172.21.15.49:0/574560697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c1537a0 0x7f781c155b80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.688 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 -- 172.21.15.49:0/574560697 >> 172.21.15.49:0/574560697 conn(0x7f781c05e010 msgr2=0x7f781c0c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:02.688 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 -- 172.21.15.49:0/574560697 shutdown_connections 2022-04-03T21:50:02.688 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.680+0000 7f7820d47700 1 -- 172.21.15.49:0/574560697 wait complete. 2022-04-03T21:50:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.681+0000 7f7820d47700 1 Processor -- start 2022-04-03T21:50:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.681+0000 7f7820d47700 1 -- start start 2022-04-03T21:50:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.682+0000 7f7820d47700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c0c1f90 0x7f781c0bb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:02.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.682+0000 7f7820d47700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 0x7f781c0b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.682+0000 7f7820d47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f781c1537a0 0x7f781c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.682+0000 7f7820d47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c14f880 con 0x7f781c1537a0 2022-04-03T21:50:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.682+0000 7f7820d47700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0ba6e0 con 0x7f781c0c2360 2022-04-03T21:50:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.682+0000 7f7820d47700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0ba980 con 0x7f781c0c1f90 2022-04-03T21:50:02.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 0x7f781c0b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f781ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f781c1537a0 0x7f781c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f781a59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c0c1f90 0x7f781c0bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 0x7f781c0b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35332/0 (socket says 172.21.15.49:35332) 2022-04-03T21:50:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 -- 172.21.15.49:0/1716400479 learned_addr learned my addr 172.21.15.49:0/1716400479 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 -- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c0c1f90 msgr2=0x7f781c0bb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c0c1f90 0x7f781c0bb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 -- 172.21.15.49:0/1716400479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f781c1537a0 msgr2=0x7f781c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f781c1537a0 0x7f781c15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f7819d9b700 1 -- 172.21.15.49:0/1716400479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009a20 con 0x7f781c0c2360 2022-04-03T21:50:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.683+0000 7f781a59c700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c0c1f90 0x7f781c0bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.684+0000 7f7819d9b700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 0x7f781c0b8760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f781000c490 tx=0x7f7810007c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.684+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781000ce40 con 0x7f781c0c2360 2022-04-03T21:50:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.684+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78100050d0 con 0x7f781c0c2360 2022-04-03T21:50:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.684+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011590 con 0x7f781c0c2360 2022-04-03T21:50:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.684+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c0bac60 con 0x7f781c0c2360 2022-04-03T21:50:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.684+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c14fdb0 con 0x7f781c0c2360 2022-04-03T21:50:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.685+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c070a20 con 0x7f781c0c2360 2022-04-03T21:50:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.686+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f7810019030 con 0x7f781c0c2360 2022-04-03T21:50:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.687+0000 7f780a7fc700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f77f8063d10 0x7f77f80661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.687+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f781007fc40 con 0x7f781c0c2360 2022-04-03T21:50:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.687+0000 7f781a59c700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f77f8063d10 0x7f77f80661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.688+0000 7f781a59c700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f77f8063d10 0x7f77f80661c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f780c005750 tx=0x7f780c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:02.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.692+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f781004e4f0 con 0x7f781c0c2360 2022-04-03T21:50:02.940 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.938+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f781c14ff70 con 0x7f781c0c2360 2022-04-03T21:50:02.946 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.944+0000 7f780a7fc700 1 -- 172.21.15.49:0/1716400479 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7810017020 con 0x7f781c0c2360 2022-04-03T21:50:02.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f77f8063d10 msgr2=0x7f77f80661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f77f8063d10 0x7f77f80661c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f780c005750 tx=0x7f780c009040 comp rx=0 tx=0).stop 2022-04-03T21:50:02.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 msgr2=0x7f781c0b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:02.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 0x7f781c0b8760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f781000c490 tx=0x7f7810007c90 comp rx=0 tx=0).stop 2022-04-03T21:50:02.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 shutdown_connections 2022-04-03T21:50:02.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f77f8063d10 0x7f77f80661c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f781c1537a0 0x7f781c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f781c0c1f90 0x7f781c0bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 --2- 172.21.15.49:0/1716400479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f781c0c2360 0x7f781c0b8760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:02.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 >> 172.21.15.49:0/1716400479 conn(0x7f781c05e010 msgr2=0x7f781c0bf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:02.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 shutdown_connections 2022-04-03T21:50:02.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:02.946+0000 7f7820d47700 1 -- 172.21.15.49:0/1716400479 wait complete. 2022-04-03T21:50:02.953 INFO:teuthology.orchestra.run.smithi049.stderr:added data pool 5 to fsmap 2022-04-03T21:50:02.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-03T21:50:02.982 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T21:50:02.980+0000 7f5a716e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-04-03T21:50:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.186+0000 7fd8f250a700 1 Processor -- start 2022-04-03T21:50:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.187+0000 7fd8f250a700 1 -- start start 2022-04-03T21:50:03.192 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f250a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec0bd8d0 0x7fd8ec0bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f250a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8ec06e7b0 0x7fd8ec142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f250a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec148c40 con 0x7fd8ec1430e0 2022-04-03T21:50:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f250a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec0a06c0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.193 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f250a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec14cc00 con 0x7fd8ec0bd8d0 2022-04-03T21:50:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f0aa7700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd8ec1430e0 0x7fd8ec149140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50464/0 (socket says 172.21.15.49:50464) 2022-04-03T21:50:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8f0aa7700 1 -- 172.21.15.49:0/3736013087 learned_addr learned my addr 172.21.15.49:0/3736013087 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8eb7fe700 1 --2- 172.21.15.49:0/3736013087 >> v2:172.21.15.117:3300/0 conn(0x7fd8ec06e7b0 0x7fd8ec142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.194 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.188+0000 7fd8ebfff700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec0bd8d0 0x7fd8ec0bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eaffd700 1 -- 172.21.15.49:0/3736013087 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732963128 0 0) 0x7fd8ec148c40 con 0x7fd8ec1430e0 2022-04-03T21:50:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eaffd700 1 -- 172.21.15.49:0/3736013087 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d80033f0 con 0x7fd8ec1430e0 2022-04-03T21:50:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eb7fe700 1 -- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec0bd8d0 msgr2=0x7fd8ec0bdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:03.195 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eb7fe700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec0bd8d0 0x7fd8ec0bdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.196 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eb7fe700 1 -- 172.21.15.49:0/3736013087 >> v1:172.21.15.49:6789/0 conn(0x7fd8ec1430e0 legacy=0x7fd8ec149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.196 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eb7fe700 1 -- 172.21.15.49:0/3736013087 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec14cec0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.196 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8ebfff700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec0bd8d0 0x7fd8ec0bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:03.196 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eb7fe700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec06e7b0 0x7fd8ec142ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009760 tx=0x7fd8e0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8652dc64babd77e0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eaffd700 1 -- 172.21.15.49:0/3736013087 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00105b0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eaffd700 1 -- 172.21.15.49:0/3736013087 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0010710 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.189+0000 7fd8eaffd700 1 -- 172.21.15.49:0/3736013087 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0010ab0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 -- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec06e7b0 msgr2=0x7fd8ec142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.197 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec06e7b0 0x7fd8ec142ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009760 tx=0x7fd8e0009060 comp rx=0 tx=0).stop 2022-04-03T21:50:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 -- 172.21.15.49:0/3736013087 shutdown_connections 2022-04-03T21:50:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec0bd8d0 0x7fd8ec0bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 --2- 172.21.15.49:0/3736013087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec06e7b0 0x7fd8ec142ba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.198 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 -- 172.21.15.49:0/3736013087 >> 172.21.15.49:0/3736013087 conn(0x7fd8ec067560 msgr2=0x7fd8ec0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:03.199 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 -- 172.21.15.49:0/3736013087 shutdown_connections 2022-04-03T21:50:03.199 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.190+0000 7fd8f250a700 1 -- 172.21.15.49:0/3736013087 wait complete. 2022-04-03T21:50:03.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.192+0000 7fd8f250a700 1 Processor -- start 2022-04-03T21:50:03.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.192+0000 7fd8f250a700 1 -- start start 2022-04-03T21:50:03.202 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f250a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 0x7fd8ec148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.203 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f250a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 0x7fd8ec1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.203 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f250a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec1430e0 0x7fd8ec159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.203 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f250a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec15bdf0 con 0x7fd8ec0bd8d0 2022-04-03T21:50:03.203 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f250a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b6bf0 con 0x7fd8ec1430e0 2022-04-03T21:50:03.204 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f250a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec158c90 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.204 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 0x7fd8ec1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.204 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 0x7fd8ec148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.204 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 0x7fd8ec148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45736/0 (socket says 172.21.15.49:45736) 2022-04-03T21:50:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 0x7fd8ec1590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34508/0 (socket says 172.21.15.49:34508) 2022-04-03T21:50:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 -- 172.21.15.49:0/2277792405 learned_addr learned my addr 172.21.15.49:0/2277792405 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8f0aa7700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec1430e0 0x7fd8ec159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 -- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec1430e0 msgr2=0x7fd8ec159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec1430e0 0x7fd8ec159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.206 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 -- 172.21.15.49:0/2277792405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 msgr2=0x7fd8ec1590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.206 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.193+0000 7fd8ebfff700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 0x7fd8ec1590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.206 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8ebfff700 1 -- 172.21.15.49:0/2277792405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0092a0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.206 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8eb7fe700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 0x7fd8ec1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:03.206 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8ebfff700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 0x7fd8ec148330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00ea50 tx=0x7fd8dc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:03.207 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00ee90 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.207 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc00c850 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.207 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e00092a0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.207 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00cbd0 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.208 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.194+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec0b2f20 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.208 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.195+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec070a20 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.208 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.196+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fd8dc019030 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.208 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.197+0000 7fd8d3fff700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd8cc063ce0 0x7fd8cc066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.197+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd8dc080c40 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.197+0000 7fd8eb7fe700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd8cc063ce0 0x7fd8cc066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.198+0000 7fd8eb7fe700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd8cc063ce0 0x7fd8cc066190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009760 tx=0x7fd8e0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:03.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.202+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fd8dc04f440 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.450+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8ec158f30 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.451+0000 7fd8d3fff700 1 -- 172.21.15.49:0/2277792405 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4596 (secure 0 0 0) 0x7fd8dc021090 con 0x7fd8ec06e7b0 2022-04-03T21:50:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:03.454 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2007434057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2007434057},{"type":"v1","addr":"172.21.15.117:6837","nonce":2007434057}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/561054047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":561054047},{"type":"v1","addr":"172.21.15.117:6836","nonce":561054047}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3845909239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3845909239},{"type":"v1","addr":"172.21.15.49:6833","nonce":3845909239}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-03T21:49:58.381806+0000","modified":"2022-04-03T21:50:02.940637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1189888216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1189888216},{"type":"v1","addr":"172.21.15.49:6835","nonce":1189888216}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-04-03T21:50:03.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd8cc063ce0 msgr2=0x7fd8cc066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd8cc063ce0 0x7fd8cc066190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009760 tx=0x7fd8e0016000 comp rx=0 tx=0).stop 2022-04-03T21:50:03.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 msgr2=0x7fd8ec148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 0x7fd8ec148330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00ea50 tx=0x7fd8dc009060 comp rx=0 tx=0).stop 2022-04-03T21:50:03.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 shutdown_connections 2022-04-03T21:50:03.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd8cc063ce0 0x7fd8cc066190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8ec1430e0 0x7fd8ec159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8ec06e7b0 0x7fd8ec148330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.459 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 --2- 172.21.15.49:0/2277792405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8ec0bd8d0 0x7fd8ec1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.459 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 >> 172.21.15.49:0/2277792405 conn(0x7fd8ec067560 msgr2=0x7fd8ec0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:03.459 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 shutdown_connections 2022-04-03T21:50:03.459 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.454+0000 7fd8f250a700 1 -- 172.21.15.49:0/2277792405 wait complete. 2022-04-03T21:50:03.460 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2022-04-03T21:50:03.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:03.735 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.732+0000 7fb613804700 1 Processor -- start 2022-04-03T21:50:03.736 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.733+0000 7fb613804700 1 -- start start 2022-04-03T21:50:03.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb613804700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb60c0c1f30 0x7fb60c14b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb613804700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb60c0c2300 0x7fb60c0a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb613804700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c14b1a0 con 0x7fb60c14be70 2022-04-03T21:50:03.739 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb613804700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c0a5ad0 con 0x7fb60c0c2300 2022-04-03T21:50:03.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb613804700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c0bdd60 con 0x7fb60c0c1f30 2022-04-03T21:50:03.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb610d9f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb60c0c2300 0x7fb60c0a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb6115a0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb60c0c1f30 0x7fb60c14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.740 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb6115a0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb60c0c1f30 0x7fb60c14b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35338/0 (socket says 172.21.15.49:35338) 2022-04-03T21:50:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb610d9f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb60c0c2300 0x7fb60c0a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34512/0 (socket says 172.21.15.49:34512) 2022-04-03T21:50:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb6115a0700 1 -- 172.21.15.49:0/1968141100 learned_addr learned my addr 172.21.15.49:0/1968141100 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.734+0000 7fb611da1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb60c14be70 0x7fb60c14e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50466/0 (socket says 172.21.15.49:50466) 2022-04-03T21:50:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb610d9f700 1 -- 172.21.15.49:0/1968141100 >> v2:172.21.15.117:3300/0 conn(0x7fb60c0c1f30 msgr2=0x7fb60c14b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb610d9f700 1 --2- 172.21.15.49:0/1968141100 >> v2:172.21.15.117:3300/0 conn(0x7fb60c0c1f30 0x7fb60c14b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb610d9f700 1 -- 172.21.15.49:0/1968141100 >> v1:172.21.15.49:6789/0 conn(0x7fb60c14be70 legacy=0x7fb60c14e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb610d9f700 1 -- 172.21.15.49:0/1968141100 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0bdac0 con 0x7fb60c0c2300 2022-04-03T21:50:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb610d9f700 1 --2- 172.21.15.49:0/1968141100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c0c2300 0x7fb60c0a6df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb60c066780 tx=0x7fb5fc009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a3f266fe7127b5 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:03.743 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb5fbfff700 1 -- 172.21.15.49:0/1968141100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011630 con 0x7fb60c0c2300 2022-04-03T21:50:03.743 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb5fbfff700 1 -- 172.21.15.49:0/1968141100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc011790 con 0x7fb60c0c2300 2022-04-03T21:50:03.743 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.735+0000 7fb5fbfff700 1 -- 172.21.15.49:0/1968141100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011b30 con 0x7fb60c0c2300 2022-04-03T21:50:03.743 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 -- 172.21.15.49:0/1968141100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c0c2300 msgr2=0x7fb60c0a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 --2- 172.21.15.49:0/1968141100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c0c2300 0x7fb60c0a6df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb60c066780 tx=0x7fb5fc009060 comp rx=0 tx=0).stop 2022-04-03T21:50:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 -- 172.21.15.49:0/1968141100 shutdown_connections 2022-04-03T21:50:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 --2- 172.21.15.49:0/1968141100 >> v2:172.21.15.117:3300/0 conn(0x7fb60c0c1f30 0x7fb60c14b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 --2- 172.21.15.49:0/1968141100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c0c2300 0x7fb60c0a6df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 -- 172.21.15.49:0/1968141100 >> 172.21.15.49:0/1968141100 conn(0x7fb60c05dfc0 msgr2=0x7fb60c0c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 -- 172.21.15.49:0/1968141100 shutdown_connections 2022-04-03T21:50:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.736+0000 7fb613804700 1 -- 172.21.15.49:0/1968141100 wait complete. 2022-04-03T21:50:03.748 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.737+0000 7fb613804700 1 Processor -- start 2022-04-03T21:50:03.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.738+0000 7fb613804700 1 -- start start 2022-04-03T21:50:03.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.738+0000 7fb613804700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0c1f30 0x7fb60c14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.738+0000 7fb613804700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb60c0c2300 0x7fb60c14d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.738+0000 7fb613804700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 0x7fb60c14edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.738+0000 7fb613804700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c14cce0 con 0x7fb60c14be70 2022-04-03T21:50:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.738+0000 7fb613804700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c14dbe0 con 0x7fb60c0c1f30 2022-04-03T21:50:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb613804700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0b7720 con 0x7fb60c0c2300 2022-04-03T21:50:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 0x7fb60c14edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 0x7fb60c14edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34514/0 (socket says 172.21.15.49:34514) 2022-04-03T21:50:03.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 -- 172.21.15.49:0/981733276 learned_addr learned my addr 172.21.15.49:0/981733276 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:03.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb610d9f700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb60c0c2300 0x7fb60c14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb6115a0700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0c1f30 0x7fb60c14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 -- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb60c0c2300 msgr2=0x7fb60c14d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb60c0c2300 0x7fb60c14d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 -- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0c1f30 msgr2=0x7fb60c14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0c1f30 0x7fb60c14ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.739+0000 7fb611da1700 1 -- 172.21.15.49:0/981733276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0092a0 con 0x7fb60c14be70 2022-04-03T21:50:03.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.740+0000 7fb611da1700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 0x7fb60c14edd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb60400c790 tx=0x7fb6040015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:03.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.740+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604005c70 con 0x7fb60c14be70 2022-04-03T21:50:03.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.740+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604005dd0 con 0x7fb60c14be70 2022-04-03T21:50:03.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.740+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604007300 con 0x7fb60c14be70 2022-04-03T21:50:03.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.740+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c0b7010 con 0x7fb60c14be70 2022-04-03T21:50:03.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.740+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c0b7c50 con 0x7fb60c14be70 2022-04-03T21:50:03.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.741+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c14ce20 con 0x7fb60c14be70 2022-04-03T21:50:03.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.742+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fb604010070 con 0x7fb60c14be70 2022-04-03T21:50:03.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.743+0000 7fb5f97fa700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb5ec063ce0 0x7fb5ec066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:03.755 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.743+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb6040804c0 con 0x7fb60c14be70 2022-04-03T21:50:03.755 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.743+0000 7fb6115a0700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb5ec063ce0 0x7fb5ec066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:03.755 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.744+0000 7fb6115a0700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb5ec063ce0 0x7fb5ec066190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb608006bc0 tx=0x7fb6080090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:03.756 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.747+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fb60c14ce20 con 0x7fb60c14be70 2022-04-03T21:50:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.958+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb60c14ce20 con 0x7fb60c14be70 2022-04-03T21:50:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.959+0000 7fb5f97fa700 1 -- 172.21.15.49:0/981733276 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7fb60c14ce20 con 0x7fb60c14be70 2022-04-03T21:50:03.962 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:03.963 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb5ec063ce0 msgr2=0x7fb5ec066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb5ec063ce0 0x7fb5ec066190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb608006bc0 tx=0x7fb6080090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 msgr2=0x7fb60c14edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 0x7fb60c14edd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb60400c790 tx=0x7fb6040015e0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 shutdown_connections 2022-04-03T21:50:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb5ec063ce0 0x7fb5ec066190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c14be70 0x7fb60c14edd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0c1f30 0x7fb60c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 --2- 172.21.15.49:0/981733276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb60c0c2300 0x7fb60c14d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 >> 172.21.15.49:0/981733276 conn(0x7fb60c05dfc0 msgr2=0x7fb60c149a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 shutdown_connections 2022-04-03T21:50:03.968 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:03.962+0000 7fb613804700 1 -- 172.21.15.49:0/981733276 wait complete. 2022-04-03T21:50:03.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:04.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.202+0000 7fd21a60e700 1 Processor -- start 2022-04-03T21:50:04.205 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.202+0000 7fd21a60e700 1 -- start start 2022-04-03T21:50:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.203+0000 7fd21a60e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2140c2310 0x7fd2140a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.203+0000 7fd21a60e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140a7570 con 0x7fd2140a7130 2022-04-03T21:50:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.203+0000 7fd21a60e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140a4720 con 0x7fd2140c1f40 2022-04-03T21:50:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.203+0000 7fd21a60e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140a5980 con 0x7fd2140c2310 2022-04-03T21:50:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd2137fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2140c2310 0x7fd2140a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd218bab700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd2140a7130 0x7fd2141482f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50470/0 (socket says 172.21.15.49:50470) 2022-04-03T21:50:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd218bab700 1 -- 172.21.15.49:0/3043943724 learned_addr learned my addr 172.21.15.49:0/3043943724 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd2137fe700 1 -- 172.21.15.49:0/3043943724 >> v1:172.21.15.117:6789/0 conn(0x7fd2140c1f40 legacy=0x7fd2140bd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd2137fe700 1 -- 172.21.15.49:0/3043943724 >> v1:172.21.15.49:6789/0 conn(0x7fd2140a7130 legacy=0x7fd2141482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd212ffd700 1 -- 172.21.15.49:0/3043943724 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588401429 0 0) 0x7fd2140a7570 con 0x7fd2140a7130 2022-04-03T21:50:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.204+0000 7fd2137fe700 1 -- 172.21.15.49:0/3043943724 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140a49e0 con 0x7fd2140c2310 2022-04-03T21:50:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.205+0000 7fd2137fe700 1 --2- 172.21.15.49:0/3043943724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a6bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2080096e0 tx=0x7fd208009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38a4fac8cc3024e server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.205+0000 7fd212ffd700 1 -- 172.21.15.49:0/3043943724 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208004030 con 0x7fd2140c2310 2022-04-03T21:50:04.212 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.205+0000 7fd212ffd700 1 -- 172.21.15.49:0/3043943724 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208004190 con 0x7fd2140c2310 2022-04-03T21:50:04.213 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.205+0000 7fd212ffd700 1 -- 172.21.15.49:0/3043943724 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011630 con 0x7fd2140c2310 2022-04-03T21:50:04.213 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.205+0000 7fd21a60e700 1 -- 172.21.15.49:0/3043943724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 msgr2=0x7fd2140a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.213 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.205+0000 7fd21a60e700 1 --2- 172.21.15.49:0/3043943724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a6bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2080096e0 tx=0x7fd208009060 comp rx=0 tx=0).stop 2022-04-03T21:50:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.206+0000 7fd21a60e700 1 -- 172.21.15.49:0/3043943724 shutdown_connections 2022-04-03T21:50:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.206+0000 7fd21a60e700 1 --2- 172.21.15.49:0/3043943724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a6bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.206+0000 7fd21a60e700 1 -- 172.21.15.49:0/3043943724 >> 172.21.15.49:0/3043943724 conn(0x7fd21405e010 msgr2=0x7fd2140c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.206+0000 7fd21a60e700 1 -- 172.21.15.49:0/3043943724 shutdown_connections 2022-04-03T21:50:04.215 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.206+0000 7fd21a60e700 1 -- 172.21.15.49:0/3043943724 wait complete. 2022-04-03T21:50:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.207+0000 7fd21a60e700 1 Processor -- start 2022-04-03T21:50:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.207+0000 7fd21a60e700 1 -- start start 2022-04-03T21:50:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd21a60e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2140a7130 0x7fd21415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.219 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd21a60e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 0x7fd21415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd21a60e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd21a60e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140a5280 con 0x7fd2140c1f40 2022-04-03T21:50:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd21a60e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140bab90 con 0x7fd2140c2310 2022-04-03T21:50:04.220 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd21a60e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21415cbc0 con 0x7fd2140a7130 2022-04-03T21:50:04.221 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 0x7fd21415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.221 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.208+0000 7fd213fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2140a7130 0x7fd21415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.221 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 0x7fd21415e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34516/0 (socket says 172.21.15.49:34516) 2022-04-03T21:50:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd2137fe700 1 -- 172.21.15.49:0/2682862987 learned_addr learned my addr 172.21.15.49:0/2682862987 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:04.222 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 -- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2140a7130 msgr2=0x7fd21415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2140a7130 0x7fd21415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 -- 172.21.15.49:0/2682862987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 msgr2=0x7fd21415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 0x7fd21415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.223 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 -- 172.21.15.49:0/2682862987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080092a0 con 0x7fd2140c2310 2022-04-03T21:50:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd2137fe700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 0x7fd21415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.209+0000 7fd218bab700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a0be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c7c0 tx=0x7fd20c007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:04.224 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.210+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004c40 con 0x7fd2140c2310 2022-04-03T21:50:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.210+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c004dc0 con 0x7fd2140c2310 2022-04-03T21:50:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.210+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21415f230 con 0x7fd2140c2310 2022-04-03T21:50:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.210+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0073a0 con 0x7fd2140c2310 2022-04-03T21:50:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.210+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140ba820 con 0x7fd2140c2310 2022-04-03T21:50:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.211+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2140ba390 con 0x7fd2140c2310 2022-04-03T21:50:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.212+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fd20c010030 con 0x7fd2140c2310 2022-04-03T21:50:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.212+0000 7fd1fbfff700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd1f4063ce0 0x7fd1f4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.227 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.213+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd20c080850 con 0x7fd2140c2310 2022-04-03T21:50:04.227 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.213+0000 7fd213fff700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd1f4063ce0 0x7fd1f4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.227 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.213+0000 7fd213fff700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd1f4063ce0 0x7fd1f4066190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2040018e0 tx=0x7fd204009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:04.228 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.217+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fd20c04f1c0 con 0x7fd2140c2310 2022-04-03T21:50:04.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.427+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd214070a20 con 0x7fd2140c2310 2022-04-03T21:50:04.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.428+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2682862987 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7fd20c007710 con 0x7fd2140c2310 2022-04-03T21:50:04.432 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:04.432 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:04.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd1f4063ce0 msgr2=0x7fd1f4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd1f4063ce0 0x7fd1f4066190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2040018e0 tx=0x7fd204009040 comp rx=0 tx=0).stop 2022-04-03T21:50:04.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 msgr2=0x7fd2140a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a0be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c7c0 tx=0x7fd20c007f20 comp rx=0 tx=0).stop 2022-04-03T21:50:04.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 shutdown_connections 2022-04-03T21:50:04.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd1f4063ce0 0x7fd1f4066190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2140c2310 0x7fd2140a0be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2140a7130 0x7fd21415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 --2- 172.21.15.49:0/2682862987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2140c1f40 0x7fd21415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 >> 172.21.15.49:0/2682862987 conn(0x7fd21405e010 msgr2=0x7fd2141470e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:04.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 shutdown_connections 2022-04-03T21:50:04.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.431+0000 7fd21a60e700 1 -- 172.21.15.49:0/2682862987 wait complete. 2022-04-03T21:50:04.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-04-03T21:50:04.686 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.684+0000 7f4fb649b700 1 Processor -- start 2022-04-03T21:50:04.687 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.684+0000 7f4fb649b700 1 -- start start 2022-04-03T21:50:04.690 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb649b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb00b71e0 0x7f4fb00b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.690 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb649b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4fb006a800 0x7f4fb00b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.690 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb649b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb0149890 con 0x7f4fb00b6e10 2022-04-03T21:50:04.691 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb649b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb0149dc0 con 0x7f4fb006a800 2022-04-03T21:50:04.691 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb649b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00b2e70 con 0x7f4fb00b71e0 2022-04-03T21:50:04.691 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb5499700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4fb00b6e10 0x7f4fb0142cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47394/0 (socket says 172.21.15.49:47394) 2022-04-03T21:50:04.691 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb4c98700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb00b71e0 0x7f4fb00b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.691 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb5499700 1 -- 172.21.15.49:0/3980492317 learned_addr learned my addr 172.21.15.49:0/3980492317 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:04.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.685+0000 7f4fb5c9a700 1 --2- 172.21.15.49:0/3980492317 >> v2:172.21.15.117:3300/0 conn(0x7f4fb006a800 0x7f4fb00b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4f9ffff700 1 -- 172.21.15.49:0/3980492317 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032326917 0 0) 0x7f4fb0149890 con 0x7f4fb00b6e10 2022-04-03T21:50:04.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4f9ffff700 1 -- 172.21.15.49:0/3980492317 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f980033f0 con 0x7f4fb00b6e10 2022-04-03T21:50:04.692 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4fb4c98700 1 -- 172.21.15.49:0/3980492317 >> v2:172.21.15.117:3300/0 conn(0x7f4fb006a800 msgr2=0x7f4fb00b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:04.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4fb4c98700 1 --2- 172.21.15.49:0/3980492317 >> v2:172.21.15.117:3300/0 conn(0x7f4fb006a800 0x7f4fb00b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4fb4c98700 1 -- 172.21.15.49:0/3980492317 >> v1:172.21.15.117:6789/0 conn(0x7f4fb00b6e10 legacy=0x7f4fb0142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4fb4c98700 1 -- 172.21.15.49:0/3980492317 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0149ae0 con 0x7f4fb00b71e0 2022-04-03T21:50:04.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4fb5c9a700 1 --2- 172.21.15.49:0/3980492317 >> v2:172.21.15.117:3300/0 conn(0x7f4fb006a800 0x7f4fb00b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:04.693 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4fb4c98700 1 --2- 172.21.15.49:0/3980492317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb00b71e0 0x7f4fb00b23f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009760 tx=0x7f4fa0009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3997670f1fad514 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:04.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.686+0000 7f4f9ffff700 1 -- 172.21.15.49:0/3980492317 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00105b0 con 0x7f4fb00b71e0 2022-04-03T21:50:04.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4f9ffff700 1 -- 172.21.15.49:0/3980492317 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0010710 con 0x7f4fb00b71e0 2022-04-03T21:50:04.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4f9ffff700 1 -- 172.21.15.49:0/3980492317 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0010ab0 con 0x7f4fb00b71e0 2022-04-03T21:50:04.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 -- 172.21.15.49:0/3980492317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb00b71e0 msgr2=0x7f4fb00b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.694 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 --2- 172.21.15.49:0/3980492317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb00b71e0 0x7f4fb00b23f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009760 tx=0x7f4fa0009060 comp rx=0 tx=0).stop 2022-04-03T21:50:04.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 -- 172.21.15.49:0/3980492317 shutdown_connections 2022-04-03T21:50:04.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 --2- 172.21.15.49:0/3980492317 >> v2:172.21.15.117:3300/0 conn(0x7f4fb006a800 0x7f4fb00b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 --2- 172.21.15.49:0/3980492317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb00b71e0 0x7f4fb00b23f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.695 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 -- 172.21.15.49:0/3980492317 >> 172.21.15.49:0/3980492317 conn(0x7f4fb00bdb50 msgr2=0x7f4fb00b9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:04.696 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 -- 172.21.15.49:0/3980492317 shutdown_connections 2022-04-03T21:50:04.696 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.687+0000 7f4fb649b700 1 -- 172.21.15.49:0/3980492317 wait complete. 2022-04-03T21:50:04.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.689+0000 7f4fb649b700 1 Processor -- start 2022-04-03T21:50:04.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.689+0000 7f4fb649b700 1 -- start start 2022-04-03T21:50:04.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb649b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb006a800 0x7f4fb014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb649b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 0x7f4fb0146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.700 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb649b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb00b71e0 0x7f4fb0147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.700 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb649b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb006c780 con 0x7f4fb00b71e0 2022-04-03T21:50:04.700 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb649b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0148620 con 0x7f4fb00b6e10 2022-04-03T21:50:04.700 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb649b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0148040 con 0x7f4fb006a800 2022-04-03T21:50:04.701 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb4c98700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 0x7f4fb0146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.701 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb5499700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb006a800 0x7f4fb014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.701 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb5c9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb00b71e0 0x7f4fb0147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.701 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb4c98700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 0x7f4fb0146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35348/0 (socket says 172.21.15.49:35348) 2022-04-03T21:50:04.701 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.690+0000 7f4fb4c98700 1 -- 172.21.15.49:0/1367510627 learned_addr learned my addr 172.21.15.49:0/1367510627 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:04.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb4c98700 1 -- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb006a800 msgr2=0x7f4fb014d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb4c98700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb006a800 0x7f4fb014d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb4c98700 1 -- 172.21.15.49:0/1367510627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb00b71e0 msgr2=0x7f4fb0147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb4c98700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb00b71e0 0x7f4fb0147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb4c98700 1 -- 172.21.15.49:0/1367510627 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa800de30 con 0x7f4fb00b6e10 2022-04-03T21:50:04.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb4c98700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 0x7f4fb0146ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0011fa0 tx=0x7f4fa0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:04.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0009110 con 0x7f4fb00b6e10 2022-04-03T21:50:04.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0006910 con 0x7f4fb00b6e10 2022-04-03T21:50:04.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa00092a0 con 0x7f4fb00b6e10 2022-04-03T21:50:04.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.691+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0010880 con 0x7f4fb00b6e10 2022-04-03T21:50:04.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.692+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb01482b0 con 0x7f4fb00b6e10 2022-04-03T21:50:04.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.692+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb004b890 con 0x7f4fb00b6e10 2022-04-03T21:50:04.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.694+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4fa000f070 con 0x7f4fb00b6e10 2022-04-03T21:50:04.705 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.694+0000 7f4f9d7fa700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4f90063ce0 0x7f4f90066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:04.705 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.695+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4fa0082640 con 0x7f4fb00b6e10 2022-04-03T21:50:04.705 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.695+0000 7f4fb5499700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4f90063ce0 0x7f4f90066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:04.705 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.695+0000 7f4fb5499700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4f90063ce0 0x7f4f90066190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fac005750 tx=0x7f4fac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:04.706 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.699+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4fa0050f30 con 0x7f4fb00b6e10 2022-04-03T21:50:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.942+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4fb00ba360 con 0x7f4fb00b6e10 2022-04-03T21:50:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.943+0000 7f4f9d7fa700 1 -- 172.21.15.49:0/1367510627 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4fa002b070 con 0x7f4fb00b6e10 2022-04-03T21:50:04.945 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2022-04-03T21:50:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4f90063ce0 msgr2=0x7f4f90066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4f90063ce0 0x7f4f90066190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fac005750 tx=0x7f4fac009040 comp rx=0 tx=0).stop 2022-04-03T21:50:04.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 msgr2=0x7f4fb0146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 0x7f4fb0146ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0011fa0 tx=0x7f4fa0016000 comp rx=0 tx=0).stop 2022-04-03T21:50:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 shutdown_connections 2022-04-03T21:50:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4f90063ce0 0x7f4f90066190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb00b71e0 0x7f4fb0147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb006a800 0x7f4fb014d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 --2- 172.21.15.49:0/1367510627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb00b6e10 0x7f4fb0146ef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:04.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 >> 172.21.15.49:0/1367510627 conn(0x7f4fb00bdb50 msgr2=0x7f4fb00bb520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:04.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 shutdown_connections 2022-04-03T21:50:04.950 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:04.945+0000 7f4fb649b700 1 -- 172.21.15.49:0/1367510627 wait complete. 2022-04-03T21:50:04.972 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2022-04-03T21:50:04.973 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-04-03T21:50:04.973 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2022-04-03T21:50:04.974 INFO:tasks.cephfs.mount:self.client.name = client.admin 2022-04-03T21:50:04.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:04.974 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2022-04-03T21:50:04.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-04-03T21:50:04.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-04-03T21:50:04.975 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2022-04-03T21:50:04.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:04.976 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2022-04-03T21:50:05.031 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-04-03T21:50:05.031 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-04-03T21:50:05.032 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2022-04-03T21:50:05.032 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2022-04-03T21:50:05.032 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2022-04-03T21:50:05.032 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2022-04-03T21:50:05.033 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-03T21:50:05.033 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:05.033 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2022-04-03T21:50:05.033 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-03T21:50:05.033 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:05.034 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2022-04-03T21:50:05.034 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2022-04-03T21:50:05.034 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:05.034 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2022-04-03T21:50:05.035 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2022-04-03T21:50:05.035 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42791sec preferred_lft 42791sec 2022-04-03T21:50:05.035 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2022-04-03T21:50:05.035 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2022-04-03T21:50:05.036 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-03T21:50:05.036 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:05.036 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2022-04-03T21:50:05.037 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-04-03T21:50:05.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:05.038 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:05.039 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:05.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2022-04-03T21:50:05.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2022-04-03T21:50:05.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2022-04-03T21:50:05.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-04-03T21:50:05.041 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:06.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:06.149 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-04-03T21:50:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:1 2022-04-03T21:50:06.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:06.280 DEBUG:teuthology.orchestra.run.smithi049:> route 2022-04-03T21:50:06.358 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2022-04-03T21:50:06.359 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-04-03T21:50:06.359 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2022-04-03T21:50:06.359 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2022-04-03T21:50:06.359 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-04-03T21:50:06.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:06.361 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:06.362 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:06.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2022-04-03T21:50:06.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2022-04-03T21:50:06.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2022-04-03T21:50:06.363 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:07.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:07.099 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2022-04-03T21:50:07.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:07.155 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2022-04-03T21:50:07.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:07.211 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:07.211 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:07.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-04-03T21:50:07.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2022-04-03T21:50:07.213 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:07.383 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2022-04-03T21:50:07.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:07.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:07.384 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:07.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2022-04-03T21:50:07.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-04-03T21:50:07.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2022-04-03T21:50:07.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2022-04-03T21:50:07.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2022-04-03T21:50:07.387 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:07.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:07.704 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:07.704 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:07.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2022-04-03T21:50:07.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2022-04-03T21:50:07.706 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:07.907 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2022-04-03T21:50:07.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-04-03T21:50:07.908 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:07.962 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2022-04-03T21:50:07.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-04-03T21:50:07.963 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:08.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2022-04-03T21:50:08.102 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-04-03T21:50:08.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-04-03T21:50:08.185 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-04-03T21:50:08.189 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-04-03T21:50:08.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-03T21:50:08.190 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2022-04-03T21:50:08.245 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-04-03T21:50:08.246 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2022-04-03T21:50:08.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2022-04-03T21:50:08.334 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-04-03T21:50:08.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-04-03T21:50:08.415 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-04-03T21:50:08.418 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-04-03T21:50:08.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-03T21:50:08.420 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2022-04-03T21:50:08.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:2022-04-03T21:50:08.452+0000 7f5d0656f3c0 -1 init, newargv = 0x560806bb77e0 newargc=15 2022-04-03T21:50:08.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[27326]: starting ceph client 2022-04-03T21:50:08.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[27326]: starting fuse 2022-04-03T21:50:08.480 INFO:teuthology.orchestra.run.smithi049.stdout:41 2022-04-03T21:50:08.481 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2022-04-03T21:50:08.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-04-03T21:50:08.482 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2022-04-03T21:50:08.482 DEBUG:teuthology.orchestra.run.smithi049:> import re 2022-04-03T21:50:08.482 DEBUG:teuthology.orchestra.run.smithi049:> import os 2022-04-03T21:50:08.483 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2022-04-03T21:50:08.483 DEBUG:teuthology.orchestra.run.smithi049:> 2022-04-03T21:50:08.484 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2022-04-03T21:50:08.484 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2022-04-03T21:50:08.484 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2022-04-03T21:50:08.485 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2022-04-03T21:50:08.485 DEBUG:teuthology.orchestra.run.smithi049:> 2022-04-03T21:50:08.485 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2022-04-03T21:50:08.486 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2022-04-03T21:50:08.486 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2022-04-03T21:50:08.487 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2022-04-03T21:50:08.487 DEBUG:teuthology.orchestra.run.smithi049:> 2022-04-03T21:50:08.487 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2022-04-03T21:50:08.488 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-04-03T21:50:08.488 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2022-04-03T21:50:08.489 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-04-03T21:50:08.489 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2022-04-03T21:50:08.489 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2022-04-03T21:50:08.490 DEBUG:teuthology.orchestra.run.smithi049:> return f 2022-04-03T21:50:08.490 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-04-03T21:50:08.490 DEBUG:teuthology.orchestra.run.smithi049:> 2022-04-03T21:50:08.491 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.admin")) 2022-04-03T21:50:08.491 DEBUG:teuthology.orchestra.run.smithi049:> ' 2022-04-03T21:50:08.655 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.admin.27326.asok 2022-04-03T21:50:08.833 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.27326.asok 2022-04-03T21:50:08.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-03T21:50:08.834 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.27326.asok status 2022-04-03T21:50:09.073 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2022-04-03T21:50:09.073 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2022-04-03T21:50:09.074 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "cfb8f943163b374162da0d7b0240f267dd46e4e1", 2022-04-03T21:50:09.074 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev)", 2022-04-03T21:50:09.074 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "admin", 2022-04-03T21:50:09.074 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2022-04-03T21:50:09.075 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2022-04-03T21:50:09.075 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "27326", 2022-04-03T21:50:09.075 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2022-04-03T21:50:09.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2022-04-03T21:50:09.076 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2022-04-03T21:50:09.076 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2022-04-03T21:50:09.076 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4361, 2022-04-03T21:50:09.076 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2022-04-03T21:50:09.076 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2022-04-03T21:50:09.077 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2022-04-03T21:50:09.077 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4361 2022-04-03T21:50:09.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2022-04-03T21:50:09.077 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2022-04-03T21:50:09.078 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2022-04-03T21:50:09.078 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2022-04-03T21:50:09.078 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 340289210 2022-04-03T21:50:09.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2022-04-03T21:50:09.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2022-04-03T21:50:09.079 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2022-04-03T21:50:09.079 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2022-04-03T21:50:09.079 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2022-04-03T21:50:09.079 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 340289210 2022-04-03T21:50:09.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2022-04-03T21:50:09.080 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4361 172.21.15.49:0/340289210", 2022-04-03T21:50:09.080 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "172.21.15.49:0/340289210", 2022-04-03T21:50:09.080 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2022-04-03T21:50:09.081 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 7, 2022-04-03T21:50:09.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 28, 2022-04-03T21:50:09.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2022-04-03T21:50:09.081 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2022-04-03T21:50:09.081 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2022-04-03T21:50:09.082 INFO:teuthology.orchestra.run.smithi049.stdout:} 2022-04-03T21:50:09.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-03T21:50:09.093 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2022-04-03T21:50:09.093 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:09.151 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2022-04-03T21:50:09.152 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:09.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-03T21:50:09.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:09.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-03T21:50:09.237 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2022-04-03T21:50:09.398 INFO:teuthology.orchestra.run.smithi049.stdout:# file: . 2022-04-03T21:50:09.398 INFO:teuthology.orchestra.run.smithi049.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2022-04-03T21:50:09.399 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:09.400 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2022-04-03T21:50:09.400 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-04-03T21:50:09.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2022-04-03T21:50:09.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[27326]: fuse finished with error 0 and tester_r 0 2022-04-03T21:50:09.485 INFO:teuthology.orchestra.run:waiting for 900 2022-04-03T21:50:15.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2022-04-03T21:50:15.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:15.588 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2022-04-03T21:50:15.655 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:15.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.872+0000 7f4b7ee74700 1 Processor -- start 2022-04-03T21:50:15.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.872+0000 7f4b7ee74700 1 -- start start 2022-04-03T21:50:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7ee74700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b780b6e10 0x7f4b78142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.878 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7ee74700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b780b71e0 0x7f4b78143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7ee74700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b7806a800 0x7f4b780b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7ee74700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b78149dc0 con 0x7f4b7806a800 2022-04-03T21:50:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7ee74700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b78149890 con 0x7f4b780b6e10 2022-04-03T21:50:15.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7ee74700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78149ae0 con 0x7f4b780b71e0 2022-04-03T21:50:15.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7de72700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b780b6e10 0x7f4b78142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7d671700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b780b71e0 0x7f4b78143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7e673700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b7806a800 0x7f4b780b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7de72700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b780b6e10 0x7f4b78142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35350/0 (socket says 172.21.15.49:35350) 2022-04-03T21:50:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.873+0000 7f4b7de72700 1 -- 172.21.15.49:0/328436264 learned_addr learned my addr 172.21.15.49:0/328436264 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7de72700 1 -- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b780b71e0 msgr2=0x7f4b78143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7de72700 1 --2- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b780b71e0 0x7f4b78143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7de72700 1 -- 172.21.15.49:0/328436264 >> v2:172.21.15.49:3300/0 conn(0x7f4b7806a800 msgr2=0x7f4b780b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7de72700 1 --2- 172.21.15.49:0/328436264 >> v2:172.21.15.49:3300/0 conn(0x7f4b7806a800 0x7f4b780b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7de72700 1 -- 172.21.15.49:0/328436264 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780ba360 con 0x7f4b780b6e10 2022-04-03T21:50:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7de72700 1 --2- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b6e10 0x7f4b78142cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b78068ea0 tx=0x7f4b740090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afa8691ff47c849f server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:15.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.874+0000 7f4b7ce70700 1 -- 172.21.15.49:0/328436264 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74004030 con 0x7f4b780b6e10 2022-04-03T21:50:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ce70700 1 -- 172.21.15.49:0/328436264 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b740041b0 con 0x7f4b780b6e10 2022-04-03T21:50:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ce70700 1 -- 172.21.15.49:0/328436264 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74011630 con 0x7f4b780b6e10 2022-04-03T21:50:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 -- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b6e10 msgr2=0x7f4b78142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:15.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b6e10 0x7f4b78142cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b78068ea0 tx=0x7f4b740090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 -- 172.21.15.49:0/328436264 shutdown_connections 2022-04-03T21:50:15.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b6e10 0x7f4b78142cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/328436264 >> v2:172.21.15.49:3300/0 conn(0x7f4b7806a800 0x7f4b780b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/328436264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b780b71e0 0x7f4b78143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.885 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 -- 172.21.15.49:0/328436264 >> 172.21.15.49:0/328436264 conn(0x7f4b780bdb50 msgr2=0x7f4b780b9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:15.885 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 -- 172.21.15.49:0/328436264 shutdown_connections 2022-04-03T21:50:15.885 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.875+0000 7f4b7ee74700 1 -- 172.21.15.49:0/328436264 wait complete. 2022-04-03T21:50:15.888 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.877+0000 7f4b7ee74700 1 Processor -- start 2022-04-03T21:50:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.877+0000 7f4b7ee74700 1 -- start start 2022-04-03T21:50:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7ee74700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b7806a800 0x7f4b7815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7ee74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 0x7f4b7814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7ee74700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b71e0 0x7f4b78140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7ee74700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780b60f0 con 0x7f4b780b6e10 2022-04-03T21:50:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7ee74700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780b7aa0 con 0x7f4b780b71e0 2022-04-03T21:50:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7ee74700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78150fd0 con 0x7f4b7806a800 2022-04-03T21:50:15.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7d671700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 0x7f4b7814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7d671700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 0x7f4b7814d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34522/0 (socket says 172.21.15.49:34522) 2022-04-03T21:50:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7d671700 1 -- 172.21.15.49:0/649026221 learned_addr learned my addr 172.21.15.49:0/649026221 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7de72700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b7806a800 0x7f4b7815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.878+0000 7f4b7e673700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b71e0 0x7f4b78140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7d671700 1 -- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b7806a800 msgr2=0x7f4b7815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7d671700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b7806a800 0x7f4b7815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7d671700 1 -- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b71e0 msgr2=0x7f4b78140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:15.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7d671700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b71e0 0x7f4b78140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:15.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7d671700 1 -- 172.21.15.49:0/649026221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009370 con 0x7f4b780b6e10 2022-04-03T21:50:15.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7d671700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 0x7f4b7814d920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e8d0 tx=0x7f4b68009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:15.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68013680 con 0x7f4b780b6e10 2022-04-03T21:50:15.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680137e0 con 0x7f4b780b6e10 2022-04-03T21:50:15.894 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7815e740 con 0x7f4b780b6e10 2022-04-03T21:50:15.894 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.879+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68013ba0 con 0x7f4b780b6e10 2022-04-03T21:50:15.894 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.880+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b78151560 con 0x7f4b780b6e10 2022-04-03T21:50:15.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.881+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7815e8d0 con 0x7f4b780b6e10 2022-04-03T21:50:15.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.881+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f4b68019030 con 0x7f4b780b6e10 2022-04-03T21:50:15.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.882+0000 7f4b65ffb700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4b58063ce0 0x7f4b58066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:15.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.882+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4b68080830 con 0x7f4b780b6e10 2022-04-03T21:50:15.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.883+0000 7f4b7de72700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4b58063ce0 0x7f4b58066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:15.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.883+0000 7f4b7de72700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4b58063ce0 0x7f4b58066190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b78068ea0 tx=0x7f4b74015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:15.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:15.887+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f4b6804f120 con 0x7f4b780b6e10 2022-04-03T21:50:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.090+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b7804b890 con 0x7f4b780b6e10 2022-04-03T21:50:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.091+0000 7f4b65ffb700 1 -- 172.21.15.49:0/649026221 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f4b68052740 con 0x7f4b780b6e10 2022-04-03T21:50:16.094 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:16.095 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4b58063ce0 msgr2=0x7f4b58066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4b58063ce0 0x7f4b58066190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b78068ea0 tx=0x7f4b74015000 comp rx=0 tx=0).stop 2022-04-03T21:50:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 msgr2=0x7f4b7814d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 0x7f4b7814d920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e8d0 tx=0x7f4b68009060 comp rx=0 tx=0).stop 2022-04-03T21:50:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 shutdown_connections 2022-04-03T21:50:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f4b58063ce0 0x7f4b58066190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b780b71e0 0x7f4b78140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b7806a800 0x7f4b7815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 --2- 172.21.15.49:0/649026221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b780b6e10 0x7f4b7814d920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 >> 172.21.15.49:0/649026221 conn(0x7f4b780bdb50 msgr2=0x7f4b780bbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:16.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 shutdown_connections 2022-04-03T21:50:16.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.094+0000 7f4b7ee74700 1 -- 172.21.15.49:0/649026221 wait complete. 2022-04-03T21:50:16.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:16.337 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.334+0000 7f9251be3700 1 Processor -- start 2022-04-03T21:50:16.338 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.334+0000 7f9251be3700 1 -- start start 2022-04-03T21:50:16.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.335+0000 7f9251be3700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 0x7f924c0b8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.335+0000 7f9251be3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c0b8380 0x7f924c0bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.335+0000 7f9251be3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f924c0bde10 0x7f924c146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f9251be3700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c06d6a0 con 0x7f924c06eca0 2022-04-03T21:50:16.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f9251be3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0b8dd0 con 0x7f924c0bde10 2022-04-03T21:50:16.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f9251be3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c14afa0 con 0x7f924c0b8380 2022-04-03T21:50:16.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 0x7f924c0b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f924c0bde10 0x7f924c146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924affd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c0b8380 0x7f924c0bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 0x7f924c0b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34524/0 (socket says 172.21.15.49:34524) 2022-04-03T21:50:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924b7fe700 1 -- 172.21.15.49:0/3850724321 learned_addr learned my addr 172.21.15.49:0/3850724321 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924affd700 1 -- 172.21.15.49:0/3850724321 >> v2:172.21.15.117:3300/0 conn(0x7f924c0bde10 msgr2=0x7f924c146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.336+0000 7f924affd700 1 --2- 172.21.15.49:0/3850724321 >> v2:172.21.15.117:3300/0 conn(0x7f924c0bde10 0x7f924c146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924affd700 1 -- 172.21.15.49:0/3850724321 >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 msgr2=0x7f924c0b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:16.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924affd700 1 --2- 172.21.15.49:0/3850724321 >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 0x7f924c0b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924affd700 1 -- 172.21.15.49:0/3850724321 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c14a670 con 0x7f924c0b8380 2022-04-03T21:50:16.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924b7fe700 1 --2- 172.21.15.49:0/3850724321 >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 0x7f924c0b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924affd700 1 --2- 172.21.15.49:0/3850724321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c0b8380 0x7f924c0bd8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f924c0bb060 tx=0x7f9240009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc19d1fcd608414 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924a7fc700 1 -- 172.21.15.49:0/3850724321 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92400105b0 con 0x7f924c0b8380 2022-04-03T21:50:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924a7fc700 1 -- 172.21.15.49:0/3850724321 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240010710 con 0x7f924c0b8380 2022-04-03T21:50:16.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.337+0000 7f924a7fc700 1 -- 172.21.15.49:0/3850724321 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240010ad0 con 0x7f924c0b8380 2022-04-03T21:50:16.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 -- 172.21.15.49:0/3850724321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c0b8380 msgr2=0x7f924c0bd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 --2- 172.21.15.49:0/3850724321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c0b8380 0x7f924c0bd8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f924c0bb060 tx=0x7f9240009060 comp rx=0 tx=0).stop 2022-04-03T21:50:16.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 -- 172.21.15.49:0/3850724321 shutdown_connections 2022-04-03T21:50:16.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 --2- 172.21.15.49:0/3850724321 >> v2:172.21.15.117:3300/0 conn(0x7f924c0bde10 0x7f924c146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 --2- 172.21.15.49:0/3850724321 >> v2:172.21.15.49:3300/0 conn(0x7f924c06eca0 0x7f924c0b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 --2- 172.21.15.49:0/3850724321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c0b8380 0x7f924c0bd8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 -- 172.21.15.49:0/3850724321 >> 172.21.15.49:0/3850724321 conn(0x7f924c067560 msgr2=0x7f924c0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 -- 172.21.15.49:0/3850724321 shutdown_connections 2022-04-03T21:50:16.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.338+0000 7f9251be3700 1 -- 172.21.15.49:0/3850724321 wait complete. 2022-04-03T21:50:16.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.340+0000 7f9251be3700 1 Processor -- start 2022-04-03T21:50:16.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.340+0000 7f9251be3700 1 -- start start 2022-04-03T21:50:16.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f9251be3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c06eca0 0x7f924c14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f9251be3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924c0b8380 0x7f924c141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f9251be3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 0x7f924c14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f9251be3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c15f0c0 con 0x7f924c0bde10 2022-04-03T21:50:16.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f9251be3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0a22f0 con 0x7f924c0b8380 2022-04-03T21:50:16.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f9251be3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0a25d0 con 0x7f924c06eca0 2022-04-03T21:50:16.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f924b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c06eca0 0x7f924c14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f924bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 0x7f924c14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f924affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924c0b8380 0x7f924c141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f924b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c06eca0 0x7f924c14db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45752/0 (socket says 172.21.15.49:45752) 2022-04-03T21:50:16.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f924bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 0x7f924c14c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34526/0 (socket says 172.21.15.49:34526) 2022-04-03T21:50:16.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.341+0000 7f924b7fe700 1 -- 172.21.15.49:0/1545809455 learned_addr learned my addr 172.21.15.49:0/1545809455 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:16.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f924bfff700 1 -- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c06eca0 msgr2=0x7f924c14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f924bfff700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c06eca0 0x7f924c14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f924bfff700 1 -- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924c0b8380 msgr2=0x7f924c141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f924bfff700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924c0b8380 0x7f924c141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f924bfff700 1 -- 172.21.15.49:0/1545809455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c00b610 con 0x7f924c0bde10 2022-04-03T21:50:16.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f924bfff700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 0x7f924c14c150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f924400ec90 tx=0x7f924400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:16.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400c890 con 0x7f924c0bde10 2022-04-03T21:50:16.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400f040 con 0x7f924c0bde10 2022-04-03T21:50:16.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.342+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92400092a0 con 0x7f924c0bde10 2022-04-03T21:50:16.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.343+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400cc40 con 0x7f924c0bde10 2022-04-03T21:50:16.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.343+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c0a2c90 con 0x7f924c0bde10 2022-04-03T21:50:16.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.344+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c0b96c0 con 0x7f924c0bde10 2022-04-03T21:50:16.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.345+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9244014690 con 0x7f924c0bde10 2022-04-03T21:50:16.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.345+0000 7f92337fe700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f922c063ce0 0x7f922c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.345+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9244081860 con 0x7f924c0bde10 2022-04-03T21:50:16.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.346+0000 7f924b7fe700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f922c063ce0 0x7f922c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.346+0000 7f924b7fe700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f922c063ce0 0x7f922c066190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f923c00b240 tx=0x7f923c00b3b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:16.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.350+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9244050060 con 0x7f924c0bde10 2022-04-03T21:50:16.561 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.558+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f924c0a2e80 con 0x7f924c0bde10 2022-04-03T21:50:16.562 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.559+0000 7f92337fe700 1 -- 172.21.15.49:0/1545809455 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f9244053680 con 0x7f924c0bde10 2022-04-03T21:50:16.562 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:16.563 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:16.564 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.561+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f922c063ce0 msgr2=0x7f922c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.561+0000 7f9251be3700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f922c063ce0 0x7f922c066190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f923c00b240 tx=0x7f923c00b3b0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.561+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 msgr2=0x7f924c14c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.561+0000 7f9251be3700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 0x7f924c14c150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f924400ec90 tx=0x7f924400b040 comp rx=0 tx=0).stop 2022-04-03T21:50:16.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 shutdown_connections 2022-04-03T21:50:16.566 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f922c063ce0 0x7f922c066190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.566 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924c0bde10 0x7f924c14c150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.566 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924c06eca0 0x7f924c14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.566 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 --2- 172.21.15.49:0/1545809455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924c0b8380 0x7f924c141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.566 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 >> 172.21.15.49:0/1545809455 conn(0x7f924c067560 msgr2=0x7f924c0bbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 shutdown_connections 2022-04-03T21:50:16.567 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.562+0000 7f9251be3700 1 -- 172.21.15.49:0/1545809455 wait complete. 2022-04-03T21:50:16.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-04-03T21:50:16.806 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.804+0000 7f15cb7ba700 1 Processor -- start 2022-04-03T21:50:16.807 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.804+0000 7f15cb7ba700 1 -- start start 2022-04-03T21:50:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15cb7ba700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c1f90 0x7f15c40bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15cb7ba700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15c40c2360 0x7f15c40bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15cb7ba700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40a50a0 con 0x7f15c4067d80 2022-04-03T21:50:16.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15cb7ba700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40a6750 con 0x7f15c40c2360 2022-04-03T21:50:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15cb7ba700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40a6a30 con 0x7f15c40c1f90 2022-04-03T21:50:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15c9556700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c1f90 0x7f15c40bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15c8d55700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15c40c2360 0x7f15c40bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15c9d57700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f15c4067d80 0x7f15c4068180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47396/0 (socket says 172.21.15.49:47396) 2022-04-03T21:50:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.805+0000 7f15c9d57700 1 -- 172.21.15.49:0/3449389583 learned_addr learned my addr 172.21.15.49:0/3449389583 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.806+0000 7f15c8d55700 1 -- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c1f90 msgr2=0x7f15c40bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.806+0000 7f15c8d55700 1 --2- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c1f90 0x7f15c40bbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.806+0000 7f15c8d55700 1 -- 172.21.15.49:0/3449389583 >> v1:172.21.15.117:6789/0 conn(0x7f15c4067d80 legacy=0x7f15c4068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.806+0000 7f15c8d55700 1 -- 172.21.15.49:0/3449389583 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40a6d10 con 0x7f15c40c2360 2022-04-03T21:50:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.806+0000 7f15b3fff700 1 -- 172.21.15.49:0/3449389583 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140409095 0 0) 0x7f15c40a50a0 con 0x7f15c4067d80 2022-04-03T21:50:16.812 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.806+0000 7f15c8d55700 1 --2- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c40bd960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009760 tx=0x7f15b4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162cdd82de526944 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:16.816 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15b3fff700 1 -- 172.21.15.49:0/3449389583 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011630 con 0x7f15c40c2360 2022-04-03T21:50:16.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15b3fff700 1 -- 172.21.15.49:0/3449389583 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4011790 con 0x7f15c40c2360 2022-04-03T21:50:16.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15b3fff700 1 -- 172.21.15.49:0/3449389583 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011b50 con 0x7f15c40c2360 2022-04-03T21:50:16.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 -- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 msgr2=0x7f15c40bd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c40bd960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009760 tx=0x7f15b4009060 comp rx=0 tx=0).stop 2022-04-03T21:50:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 -- 172.21.15.49:0/3449389583 shutdown_connections 2022-04-03T21:50:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c1f90 0x7f15c40bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.818 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/3449389583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c40bd960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 -- 172.21.15.49:0/3449389583 >> 172.21.15.49:0/3449389583 conn(0x7f15c405e010 msgr2=0x7f15c40c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.807+0000 7f15cb7ba700 1 -- 172.21.15.49:0/3449389583 shutdown_connections 2022-04-03T21:50:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.808+0000 7f15cb7ba700 1 -- 172.21.15.49:0/3449389583 wait complete. 2022-04-03T21:50:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.809+0000 7f15cb7ba700 1 Processor -- start 2022-04-03T21:50:16.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.809+0000 7f15cb7ba700 1 -- start start 2022-04-03T21:50:16.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15cb7ba700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c4067d80 0x7f15c40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15cb7ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c40c1f90 0x7f15c415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15cb7ba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c4149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15cb7ba700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40b9630 con 0x7f15c40c1f90 2022-04-03T21:50:16.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15cb7ba700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40ba250 con 0x7f15c40c2360 2022-04-03T21:50:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15cb7ba700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40bbd30 con 0x7f15c4067d80 2022-04-03T21:50:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.810+0000 7f15c8d55700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c40c1f90 0x7f15c415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c4149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c4149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35362/0 (socket says 172.21.15.49:35362) 2022-04-03T21:50:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 -- 172.21.15.49:0/4090583717 learned_addr learned my addr 172.21.15.49:0/4090583717 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9556700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c4067d80 0x7f15c40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 -- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c4067d80 msgr2=0x7f15c40b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c4067d80 0x7f15c40b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 -- 172.21.15.49:0/4090583717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c40c1f90 msgr2=0x7f15c415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c40c1f90 0x7f15c415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 -- 172.21.15.49:0/4090583717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40092a0 con 0x7f15c40c2360 2022-04-03T21:50:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.811+0000 7f15c9d57700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c4149ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c730 tx=0x7f15bc001540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.812+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc004c40 con 0x7f15c40c2360 2022-04-03T21:50:16.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.812+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc004da0 con 0x7f15c40c2360 2022-04-03T21:50:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.812+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc007380 con 0x7f15c40c2360 2022-04-03T21:50:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.812+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c40b9880 con 0x7f15c40c2360 2022-04-03T21:50:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.812+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c415eaf0 con 0x7f15c40c2360 2022-04-03T21:50:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.813+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40b4f20 con 0x7f15c40c2360 2022-04-03T21:50:16.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.814+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f15bc010030 con 0x7f15c40c2360 2022-04-03T21:50:16.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.815+0000 7f15b17fa700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f15a4063ce0 0x7f15a4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:16.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.815+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f15bc080910 con 0x7f15c40c2360 2022-04-03T21:50:16.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.815+0000 7f15c9556700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f15a4063ce0 0x7f15a4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:16.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.816+0000 7f15c9556700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f15a4063ce0 0x7f15a4066190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009c30 tx=0x7f15c0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:16.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:16.819+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f15bc04f190 con 0x7f15c40c2360 2022-04-03T21:50:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.071+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f15c4070a20 con 0x7f15c40c2360 2022-04-03T21:50:17.831 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.828+0000 7f15b17fa700 1 -- 172.21.15.49:0/4090583717 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f15bc0527b0 con 0x7f15c40c2360 2022-04-03T21:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f15a4063ce0 msgr2=0x7f15a4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f15a4063ce0 0x7f15a4066190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009c30 tx=0x7f15c0009060 comp rx=0 tx=0).stop 2022-04-03T21:50:17.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 msgr2=0x7f15c4149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c4149ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c730 tx=0x7f15bc001540 comp rx=0 tx=0).stop 2022-04-03T21:50:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 shutdown_connections 2022-04-03T21:50:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f15a4063ce0 0x7f15a4066190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:17.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c2360 0x7f15c4149ea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c4067d80 0x7f15c40b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 --2- 172.21.15.49:0/4090583717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15c40c1f90 0x7f15c415ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 >> 172.21.15.49:0/4090583717 conn(0x7f15c405e010 msgr2=0x7f15c40c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:17.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 shutdown_connections 2022-04-03T21:50:17.838 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:17.832+0000 7f15cb7ba700 1 -- 172.21.15.49:0/4090583717 wait complete. 2022-04-03T21:50:17.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-04-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.081+0000 7f83a4b27700 1 Processor -- start 2022-04-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.081+0000 7f83a4b27700 1 -- start start 2022-04-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.082+0000 7f83a4b27700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f83a0069060 0x7f83a014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.082+0000 7f83a4b27700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a006bc20 0x7f83a006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.082+0000 7f83a4b27700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a006b790 con 0x7f83a0069430 2022-04-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.082+0000 7f83a4b27700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a006c5b0 con 0x7f83a0069060 2022-04-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.082+0000 7f83a4b27700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a006e0e0 con 0x7f83a006bc20 2022-04-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f83a0069430 0x7f83a0144e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50472/0 (socket says 172.21.15.49:50472) 2022-04-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839effd700 1 -- 172.21.15.49:0/3162994266 learned_addr learned my addr 172.21.15.49:0/3162994266 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839ffff700 1 --2- 172.21.15.49:0/3162994266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a006bc20 0x7f83a006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839f7fe700 1 --2- 172.21.15.49:0/3162994266 >> v2:172.21.15.117:3300/0 conn(0x7f83a0069060 0x7f83a014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839ffff700 1 -- 172.21.15.49:0/3162994266 >> v2:172.21.15.117:3300/0 conn(0x7f83a0069060 msgr2=0x7f83a014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839e7fc700 1 -- 172.21.15.49:0/3162994266 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169791574 0 0) 0x7f83a006b790 con 0x7f83a0069430 2022-04-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839ffff700 1 --2- 172.21.15.49:0/3162994266 >> v2:172.21.15.117:3300/0 conn(0x7f83a0069060 0x7f83a014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839ffff700 1 -- 172.21.15.49:0/3162994266 >> v1:172.21.15.49:6789/0 conn(0x7f83a0069430 legacy=0x7f83a0144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.083+0000 7f839ffff700 1 -- 172.21.15.49:0/3162994266 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a006e3c0 con 0x7f83a006bc20 2022-04-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.084+0000 7f839ffff700 1 --2- 172.21.15.49:0/3162994266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a006bc20 0x7f83a006c070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8398009e60 tx=0x7f8398009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106e23e09c3292e6 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.084+0000 7f839e7fc700 1 -- 172.21.15.49:0/3162994266 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800e070 con 0x7f83a006bc20 2022-04-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.084+0000 7f839e7fc700 1 -- 172.21.15.49:0/3162994266 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800bb60 con 0x7f83a006bc20 2022-04-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.084+0000 7f839e7fc700 1 -- 172.21.15.49:0/3162994266 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398012430 con 0x7f83a006bc20 2022-04-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.084+0000 7f83a4b27700 1 -- 172.21.15.49:0/3162994266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a006bc20 msgr2=0x7f83a006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.084+0000 7f83a4b27700 1 --2- 172.21.15.49:0/3162994266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a006bc20 0x7f83a006c070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8398009e60 tx=0x7f8398009780 comp rx=0 tx=0).stop 2022-04-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.085+0000 7f83a4b27700 1 -- 172.21.15.49:0/3162994266 shutdown_connections 2022-04-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.085+0000 7f83a4b27700 1 --2- 172.21.15.49:0/3162994266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a006bc20 0x7f83a006c070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.085+0000 7f83a4b27700 1 --2- 172.21.15.49:0/3162994266 >> v2:172.21.15.117:3300/0 conn(0x7f83a0069060 0x7f83a014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.085+0000 7f83a4b27700 1 -- 172.21.15.49:0/3162994266 >> 172.21.15.49:0/3162994266 conn(0x7f83a00bf270 msgr2=0x7f83a00bf670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.085+0000 7f83a4b27700 1 -- 172.21.15.49:0/3162994266 shutdown_connections 2022-04-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.085+0000 7f83a4b27700 1 -- 172.21.15.49:0/3162994266 wait complete. 2022-04-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.086+0000 7f83a4b27700 1 Processor -- start 2022-04-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.086+0000 7f83a4b27700 1 -- start start 2022-04-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.087+0000 7f83a4b27700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a0069060 0x7f83a00a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.087+0000 7f83a4b27700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a0069430 0x7f83a00b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.087+0000 7f83a4b27700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 0x7f83a00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.087+0000 7f83a4b27700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0148700 con 0x7f83a006bc20 2022-04-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.087+0000 7f83a4b27700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00b22a0 con 0x7f83a0069060 2022-04-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.087+0000 7f83a4b27700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00b5a80 con 0x7f83a0069430 2022-04-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 0x7f83a00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839effd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a0069430 0x7f83a00b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a0069060 0x7f83a00a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 0x7f83a00b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34530/0 (socket says 172.21.15.49:34530) 2022-04-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 -- 172.21.15.49:0/322797058 learned_addr learned my addr 172.21.15.49:0/322797058 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 -- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a0069430 msgr2=0x7f83a00b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a0069430 0x7f83a00b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 -- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a0069060 msgr2=0x7f83a00a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a0069060 0x7f83a00a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.088+0000 7f839ffff700 1 -- 172.21.15.49:0/322797058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009a20 con 0x7f83a006bc20 2022-04-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.089+0000 7f839ffff700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 0x7f83a00b1d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8398009990 tx=0x7f8398019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.089+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398012c00 con 0x7f83a006bc20 2022-04-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.089+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398012d60 con 0x7f83a006bc20 2022-04-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.089+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a014dde0 con 0x7f83a006bc20 2022-04-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.089+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398024650 con 0x7f83a006bc20 2022-04-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.089+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a014e270 con 0x7f83a006bc20 2022-04-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.090+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a014df70 con 0x7f83a006bc20 2022-04-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.091+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f83980249c0 con 0x7f83a006bc20 2022-04-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.092+0000 7f83877fe700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8380063ce0 0x7f8380066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.092+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8398082910 con 0x7f83a006bc20 2022-04-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.093+0000 7f839f7fe700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8380063ce0 0x7f8380066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.093+0000 7f839f7fe700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8380063ce0 0x7f8380066190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8390009c30 tx=0x7f8390009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.097+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f8398051200 con 0x7f83a006bc20 2022-04-03T21:50:18.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.343+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f83a004b890 con 0x7f83a006bc20 2022-04-03T21:50:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.836+0000 7f83877fe700 1 -- 172.21.15.49:0/322797058 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8398054820 con 0x7f83a006bc20 2022-04-03T21:50:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8380063ce0 msgr2=0x7f8380066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8380063ce0 0x7f8380066190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8390009c30 tx=0x7f8390009060 comp rx=0 tx=0).stop 2022-04-03T21:50:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 msgr2=0x7f83a00b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 0x7f83a00b1d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8398009990 tx=0x7f8398019000 comp rx=0 tx=0).stop 2022-04-03T21:50:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 shutdown_connections 2022-04-03T21:50:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8380063ce0 0x7f8380066190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83a006bc20 0x7f83a00b1d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a0069060 0x7f83a00a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 --2- 172.21.15.49:0/322797058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a0069430 0x7f83a00b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 >> 172.21.15.49:0/322797058 conn(0x7f83a00bf270 msgr2=0x7f83a01440e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 shutdown_connections 2022-04-03T21:50:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:18.840+0000 7f83a4b27700 1 -- 172.21.15.49:0/322797058 wait complete. 2022-04-03T21:50:18.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-03T21:50:19.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.084+0000 7ff7392d9700 1 Processor -- start 2022-04-03T21:50:19.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.084+0000 7ff7392d9700 1 -- start start 2022-04-03T21:50:19.089 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.085+0000 7ff7392d9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff73406e7b0 0x7ff7340bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.089 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.085+0000 7ff7392d9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff734149140 0x7ff7341495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.089 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.085+0000 7ff7392d9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff734148c40 con 0x7ff7340bd8d0 2022-04-03T21:50:19.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.085+0000 7ff7392d9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7340a06c0 con 0x7ff73406e7b0 2022-04-03T21:50:19.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.085+0000 7ff7392d9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff734149ae0 con 0x7ff734149140 2022-04-03T21:50:19.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff732ffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff7340bd8d0 0x7ff734142ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47398/0 (socket says 172.21.15.49:47398) 2022-04-03T21:50:19.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff732ffd700 1 -- 172.21.15.49:0/1311768352 learned_addr learned my addr 172.21.15.49:0/1311768352 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:19.090 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7327fc700 1 --2- 172.21.15.49:0/1311768352 >> v2:172.21.15.117:3300/0 conn(0x7ff73406e7b0 0x7ff7340bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7337fe700 1 --2- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff734149140 0x7ff7341495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff731ffb700 1 -- 172.21.15.49:0/1311768352 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736652230 0 0) 0x7ff734148c40 con 0x7ff7340bd8d0 2022-04-03T21:50:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff731ffb700 1 -- 172.21.15.49:0/1311768352 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7200033f0 con 0x7ff7340bd8d0 2022-04-03T21:50:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7327fc700 1 -- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff734149140 msgr2=0x7ff7341495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:19.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7327fc700 1 --2- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff734149140 0x7ff7341495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7327fc700 1 -- 172.21.15.49:0/1311768352 >> v1:172.21.15.117:6789/0 conn(0x7ff7340bd8d0 legacy=0x7ff734142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7327fc700 1 -- 172.21.15.49:0/1311768352 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73414cc00 con 0x7ff73406e7b0 2022-04-03T21:50:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.086+0000 7ff7327fc700 1 --2- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340bdca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff728009760 tx=0x7ff728009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9b47c32e9cde98 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff731ffb700 1 -- 172.21.15.49:0/1311768352 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280105b0 con 0x7ff73406e7b0 2022-04-03T21:50:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff731ffb700 1 -- 172.21.15.49:0/1311768352 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff728010710 con 0x7ff73406e7b0 2022-04-03T21:50:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff731ffb700 1 -- 172.21.15.49:0/1311768352 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728010ab0 con 0x7ff73406e7b0 2022-04-03T21:50:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff7392d9700 1 -- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 msgr2=0x7ff7340bdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff7392d9700 1 --2- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340bdca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff728009760 tx=0x7ff728009060 comp rx=0 tx=0).stop 2022-04-03T21:50:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff7392d9700 1 -- 172.21.15.49:0/1311768352 shutdown_connections 2022-04-03T21:50:19.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff7392d9700 1 --2- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff734149140 0x7ff7341495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff7392d9700 1 --2- 172.21.15.49:0/1311768352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340bdca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.087+0000 7ff7392d9700 1 -- 172.21.15.49:0/1311768352 >> 172.21.15.49:0/1311768352 conn(0x7ff734067560 msgr2=0x7ff7340bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:19.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.088+0000 7ff7392d9700 1 -- 172.21.15.49:0/1311768352 shutdown_connections 2022-04-03T21:50:19.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.088+0000 7ff7392d9700 1 -- 172.21.15.49:0/1311768352 wait complete. 2022-04-03T21:50:19.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.089+0000 7ff7392d9700 1 Processor -- start 2022-04-03T21:50:19.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.089+0000 7ff7392d9700 1 -- start start 2022-04-03T21:50:19.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7392d9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7392d9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7340bd8d0 0x7ff7340b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7392d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 0x7ff73415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7392d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734147580 con 0x7ff734149140 2022-04-03T21:50:19.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7392d9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734146fc0 con 0x7ff73406e7b0 2022-04-03T21:50:19.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7392d9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341472a0 con 0x7ff7340bd8d0 2022-04-03T21:50:19.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 0x7ff73415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 0x7ff73415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34532/0 (socket says 172.21.15.49:34532) 2022-04-03T21:50:19.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7337fe700 1 -- 172.21.15.49:0/2096974195 learned_addr learned my addr 172.21.15.49:0/2096974195 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:19.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.090+0000 7ff7327fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7340bd8d0 0x7ff7340b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff7337fe700 1 -- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7340bd8d0 msgr2=0x7ff7340b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff7337fe700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7340bd8d0 0x7ff7340b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff7337fe700 1 -- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 msgr2=0x7ff7340b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff7337fe700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff7337fe700 1 -- 172.21.15.49:0/2096974195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280092a0 con 0x7ff734149140 2022-04-03T21:50:19.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff7337fe700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 0x7ff73415e060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009e90 tx=0x7ff72c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:19.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.091+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00caa0 con 0x7ff734149140 2022-04-03T21:50:19.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.092+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00f040 con 0x7ff734149140 2022-04-03T21:50:19.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.092+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7340b2960 con 0x7ff734149140 2022-04-03T21:50:19.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.092+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00ce50 con 0x7ff734149140 2022-04-03T21:50:19.102 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.092+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7340a2f90 con 0x7ff734149140 2022-04-03T21:50:19.103 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.093+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff734148c50 con 0x7ff734149140 2022-04-03T21:50:19.103 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.094+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7ff72c014690 con 0x7ff734149140 2022-04-03T21:50:19.103 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.094+0000 7ff71affd700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff714063d10 0x7ff7140661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.103 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.095+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff72c081730 con 0x7ff734149140 2022-04-03T21:50:19.103 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.095+0000 7ff732ffd700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff714063d10 0x7ff7140661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.104 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.096+0000 7ff732ffd700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff714063d10 0x7ff7140661c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff724005750 tx=0x7ff724009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:19.104 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.099+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7ff72c050020 con 0x7ff734149140 2022-04-03T21:50:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.347+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff73406e590 con 0x7ff734149140 2022-04-03T21:50:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.348+0000 7ff71affd700 1 -- 172.21.15.49:0/2096974195 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7ff72c018020 con 0x7ff734149140 2022-04-03T21:50:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:19.350 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2007434057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2007434057},{"type":"v1","addr":"172.21.15.117:6837","nonce":2007434057}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/561054047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":561054047},{"type":"v1","addr":"172.21.15.117:6836","nonce":561054047}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3845909239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3845909239},{"type":"v1","addr":"172.21.15.49:6833","nonce":3845909239}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-03T21:49:58.381806+0000","modified":"2022-04-03T21:50:18.831161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1189888216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1189888216},{"type":"v1","addr":"172.21.15.49:6835","nonce":1189888216}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-03T21:50:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff714063d10 msgr2=0x7ff7140661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff714063d10 0x7ff7140661c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff724005750 tx=0x7ff724009040 comp rx=0 tx=0).stop 2022-04-03T21:50:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 msgr2=0x7ff73415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 0x7ff73415e060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009e90 tx=0x7ff72c00b040 comp rx=0 tx=0).stop 2022-04-03T21:50:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 shutdown_connections 2022-04-03T21:50:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7ff714063d10 0x7ff7140661c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff734149140 0x7ff73415e060 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73406e7b0 0x7ff7340b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 --2- 172.21.15.49:0/2096974195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7340bd8d0 0x7ff7340b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 >> 172.21.15.49:0/2096974195 conn(0x7ff734067560 msgr2=0x7ff7340bb950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 shutdown_connections 2022-04-03T21:50:19.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.350+0000 7ff7392d9700 1 -- 172.21.15.49:0/2096974195 wait complete. 2022-04-03T21:50:19.355 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2022-04-03T21:50:19.376 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.588+0000 7eff720aa700 1 Processor -- start 2022-04-03T21:50:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.588+0000 7eff720aa700 1 -- start start 2022-04-03T21:50:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.589+0000 7eff720aa700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff6c0c1f40 0x7eff6c0bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.589+0000 7eff720aa700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff6c0c2310 0x7eff6c0a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff720aa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0a4720 con 0x7eff6c0bdc00 2022-04-03T21:50:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff720aa700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0a5980 con 0x7eff6c0c1f40 2022-04-03T21:50:19.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff720aa700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0a5280 con 0x7eff6c0c2310 2022-04-03T21:50:19.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff6c0c1f40 0x7eff6c0bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6bfff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7eff6c0bdc00 0x7eff6c1482f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50474/0 (socket says 172.21.15.49:50474) 2022-04-03T21:50:19.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6bfff700 1 -- 172.21.15.49:0/2106100282 learned_addr learned my addr 172.21.15.49:0/2106100282 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:19.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6b7fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7eff6c0c1f40 0x7eff6c0bd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34534/0 (socket says 172.21.15.49:34534) 2022-04-03T21:50:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6affd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff6c0c2310 0x7eff6c0a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6affd700 1 -- 172.21.15.49:0/2106100282 >> v2:172.21.15.49:3300/0 conn(0x7eff6c0c1f40 msgr2=0x7eff6c0bd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6affd700 1 --2- 172.21.15.49:0/2106100282 >> v2:172.21.15.49:3300/0 conn(0x7eff6c0c1f40 0x7eff6c0bd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6affd700 1 -- 172.21.15.49:0/2106100282 >> v1:172.21.15.49:6789/0 conn(0x7eff6c0bdc00 legacy=0x7eff6c1482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.590+0000 7eff6affd700 1 -- 172.21.15.49:0/2106100282 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0a49e0 con 0x7eff6c0c2310 2022-04-03T21:50:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.591+0000 7eff6affd700 1 --2- 172.21.15.49:0/2106100282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c2310 0x7eff6c0a6bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff6c067070 tx=0x7eff60009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a711a1ae50d77edb server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.591+0000 7eff6a7fc700 1 -- 172.21.15.49:0/2106100282 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60011630 con 0x7eff6c0c2310 2022-04-03T21:50:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.591+0000 7eff6a7fc700 1 -- 172.21.15.49:0/2106100282 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60011790 con 0x7eff6c0c2310 2022-04-03T21:50:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.591+0000 7eff6a7fc700 1 -- 172.21.15.49:0/2106100282 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60011b30 con 0x7eff6c0c2310 2022-04-03T21:50:19.602 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 -- 172.21.15.49:0/2106100282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c2310 msgr2=0x7eff6c0a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.708 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 --2- 172.21.15.49:0/2106100282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c2310 0x7eff6c0a6bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff6c067070 tx=0x7eff60009060 comp rx=0 tx=0).stop 2022-04-03T21:50:19.708 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 -- 172.21.15.49:0/2106100282 shutdown_connections 2022-04-03T21:50:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 --2- 172.21.15.49:0/2106100282 >> v2:172.21.15.49:3300/0 conn(0x7eff6c0c1f40 0x7eff6c0bd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 --2- 172.21.15.49:0/2106100282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c2310 0x7eff6c0a6bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 -- 172.21.15.49:0/2106100282 >> 172.21.15.49:0/2106100282 conn(0x7eff6c05e010 msgr2=0x7eff6c0c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:19.710 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 -- 172.21.15.49:0/2106100282 shutdown_connections 2022-04-03T21:50:19.710 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.592+0000 7eff720aa700 1 -- 172.21.15.49:0/2106100282 wait complete. 2022-04-03T21:50:19.710 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.593+0000 7eff720aa700 1 Processor -- start 2022-04-03T21:50:19.710 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 -- start start 2022-04-03T21:50:19.711 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 0x7eff6c097120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.711 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c1f40 0x7eff6c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.711 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c0c2310 0x7eff6c0bad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.711 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c15b800 con 0x7eff6c0c2310 2022-04-03T21:50:19.711 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c15b1d0 con 0x7eff6c0c1f40 2022-04-03T21:50:19.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.594+0000 7eff720aa700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c15f490 con 0x7eff6c0bdc00 2022-04-03T21:50:19.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c0c2310 0x7eff6c0bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c1f40 0x7eff6c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.712 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 0x7eff6c097120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 0x7eff6c097120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45766/0 (socket says 172.21.15.49:45766) 2022-04-03T21:50:19.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 -- 172.21.15.49:0/3911814363 learned_addr learned my addr 172.21.15.49:0/3911814363 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:19.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 -- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c1f40 msgr2=0x7eff6c15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.713 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c1f40 0x7eff6c15bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 -- 172.21.15.49:0/3911814363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c0c2310 msgr2=0x7eff6c0bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c0c2310 0x7eff6c0bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.595+0000 7eff6b7fe700 1 -- 172.21.15.49:0/3911814363 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600092a0 con 0x7eff6c0bdc00 2022-04-03T21:50:19.714 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.596+0000 7eff6b7fe700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 0x7eff6c097120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e930 tx=0x7eff5c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:19.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.596+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c013680 con 0x7eff6c0bdc00 2022-04-03T21:50:19.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.596+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0137e0 con 0x7eff6c0bdc00 2022-04-03T21:50:19.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.596+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c15b490 con 0x7eff6c0bdc00 2022-04-03T21:50:19.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.596+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c013b60 con 0x7eff6c0bdc00 2022-04-03T21:50:19.715 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.596+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c15f130 con 0x7eff6c0bdc00 2022-04-03T21:50:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.597+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c1496f0 con 0x7eff6c0bdc00 2022-04-03T21:50:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.598+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7eff5c019030 con 0x7eff6c0bdc00 2022-04-03T21:50:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.599+0000 7eff537fe700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7eff4c063ce0 0x7eff4c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.599+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7eff5c080b40 con 0x7eff6c0bdc00 2022-04-03T21:50:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.599+0000 7eff6affd700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7eff4c063ce0 0x7eff4c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.600+0000 7eff6affd700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7eff4c063ce0 0x7eff4c066190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff6c155b40 tx=0x7eff60017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:19.718 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.604+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7eff5c04f340 con 0x7eff6c0bdc00 2022-04-03T21:50:19.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.814+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff6c070a20 con 0x7eff6c0bdc00 2022-04-03T21:50:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.815+0000 7eff537fe700 1 -- 172.21.15.49:0/3911814363 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7eff5c052960 con 0x7eff6c0bdc00 2022-04-03T21:50:19.817 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:19.817 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:19.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.817+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7eff4c063ce0 msgr2=0x7eff4c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.817+0000 7eff720aa700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7eff4c063ce0 0x7eff4c066190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff6c155b40 tx=0x7eff60017000 comp rx=0 tx=0).stop 2022-04-03T21:50:19.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.817+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 msgr2=0x7eff6c097120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:19.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.817+0000 7eff720aa700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 0x7eff6c097120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e930 tx=0x7eff5c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:19.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 shutdown_connections 2022-04-03T21:50:19.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7eff4c063ce0 0x7eff4c066190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c0c2310 0x7eff6c0bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff6c0bdc00 0x7eff6c097120 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 --2- 172.21.15.49:0/3911814363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6c0c1f40 0x7eff6c15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:19.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 >> 172.21.15.49:0/3911814363 conn(0x7eff6c05e010 msgr2=0x7eff6c0b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:19.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 shutdown_connections 2022-04-03T21:50:19.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:19.818+0000 7eff720aa700 1 -- 172.21.15.49:0/3911814363 wait complete. 2022-04-03T21:50:19.845 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-04-03T21:50:19.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-03T21:50:20.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.059+0000 7fc4f1717700 1 Processor -- start 2022-04-03T21:50:20.061 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.059+0000 7fc4f1717700 1 -- start start 2022-04-03T21:50:20.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.060+0000 7fc4f1717700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4ec0c1f30 0x7fc4ec0a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.060+0000 7fc4f1717700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec14b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.060+0000 7fc4f1717700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0bda50 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.060+0000 7fc4f1717700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0bca90 con 0x7fc4ec0c1f30 2022-04-03T21:50:20.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.060+0000 7fc4f1717700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0bdf60 con 0x7fc4ec0c2300 2022-04-03T21:50:20.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eaffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc4ec0c1f30 0x7fc4ec0a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eb7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc4ec0a73e0 0x7fc4ec14e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50476/0 (socket says 172.21.15.49:50476) 2022-04-03T21:50:20.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eb7fe700 1 -- 172.21.15.49:0/2894999956 learned_addr learned my addr 172.21.15.49:0/2894999956 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:20.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4ea7fc700 1 --2- 172.21.15.49:0/2894999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2894999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 msgr2=0x7fc4ec14b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:20.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eaffd700 1 --2- 172.21.15.49:0/2894999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec14b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2894999956 >> v1:172.21.15.49:6789/0 conn(0x7fc4ec0a73e0 legacy=0x7fc4ec14e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2894999956 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0bcd00 con 0x7fc4ec0c1f30 2022-04-03T21:50:20.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.061+0000 7fc4e9ffb700 1 -- 172.21.15.49:0/2894999956 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110613138 0 0) 0x7fc4ec0bda50 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4eaffd700 1 --2- 172.21.15.49:0/2894999956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec0a4d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009760 tx=0x7fc4dc009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17218240d581933 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:20.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4e9ffb700 1 -- 172.21.15.49:0/2894999956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc011630 con 0x7fc4ec0c1f30 2022-04-03T21:50:20.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4e9ffb700 1 -- 172.21.15.49:0/2894999956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc011790 con 0x7fc4ec0c1f30 2022-04-03T21:50:20.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4e9ffb700 1 -- 172.21.15.49:0/2894999956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc011b50 con 0x7fc4ec0c1f30 2022-04-03T21:50:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4f1717700 1 -- 172.21.15.49:0/2894999956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0c1f30 msgr2=0x7fc4ec0a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2894999956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec0a4d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009760 tx=0x7fc4dc009060 comp rx=0 tx=0).stop 2022-04-03T21:50:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.062+0000 7fc4f1717700 1 -- 172.21.15.49:0/2894999956 shutdown_connections 2022-04-03T21:50:20.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.063+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2894999956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec0a4d00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.063+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2894999956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec14b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.063+0000 7fc4f1717700 1 -- 172.21.15.49:0/2894999956 >> 172.21.15.49:0/2894999956 conn(0x7fc4ec05dfd0 msgr2=0x7fc4ec0c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.063+0000 7fc4f1717700 1 -- 172.21.15.49:0/2894999956 shutdown_connections 2022-04-03T21:50:20.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.063+0000 7fc4f1717700 1 -- 172.21.15.49:0/2894999956 wait complete. 2022-04-03T21:50:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.064+0000 7fc4f1717700 1 Processor -- start 2022-04-03T21:50:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.064+0000 7fc4f1717700 1 -- start start 2022-04-03T21:50:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4f1717700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 0x7fc4ec0c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4f1717700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4f1717700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4f1717700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec097240 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4f1717700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0bb920 con 0x7fc4ec0c1f30 2022-04-03T21:50:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4f1717700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c17d0 con 0x7fc4ec0c2300 2022-04-03T21:50:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 0x7fc4ec0c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 0x7fc4ec0c04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34542/0 (socket says 172.21.15.49:34542) 2022-04-03T21:50:20.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.065+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2160436927 learned_addr learned my addr 172.21.15.49:0/2160436927 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:20.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eb7fe700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4ea7fc700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 msgr2=0x7fc4ec15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eaffd700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec0c1f30 msgr2=0x7fc4ec15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eaffd700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eaffd700 1 -- 172.21.15.49:0/2160436927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc0092a0 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.066+0000 7fc4eaffd700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 0x7fc4ec0c04d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0091e0 tx=0x7fc4dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:20.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.067+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc000bc0 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.067+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc011900 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.067+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec097e90 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.067+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc000d20 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.067+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec15eb90 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.068+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec070a20 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.069+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fc4dc02c030 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.069+0000 7fc4d2ffd700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc4cc063ce0 0x7fc4cc066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.070+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc4dc081ec0 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.070+0000 7fc4ea7fc700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc4cc063ce0 0x7fc4cc066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.070+0000 7fc4ea7fc700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc4cc063ce0 0x7fc4cc066190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec097dc0 tx=0x7fc4e0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:20.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.074+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fc4dc0507b0 con 0x7fc4ec0a73e0 2022-04-03T21:50:20.284 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.282+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 --> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4ec0c1910 con 0x7fc4cc063ce0 2022-04-03T21:50:20.295 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.294+0000 7fc4d2ffd700 1 -- 172.21.15.49:0/2160436927 <== mgr.4101 v2:172.21.15.117:6832/26568 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+364876 (secure 0 0 0) 0x7fc4e0011860 con 0x7fc4cc063ce0 2022-04-03T21:50:20.301 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.299+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc4cc063ce0 msgr2=0x7fc4cc066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.299+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc4cc063ce0 0x7fc4cc066190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec097dc0 tx=0x7fc4e0009060 comp rx=0 tx=0).stop 2022-04-03T21:50:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.299+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 msgr2=0x7fc4ec0c04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.299+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 0x7fc4ec0c04d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0091e0 tx=0x7fc4dc017000 comp rx=0 tx=0).stop 2022-04-03T21:50:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 shutdown_connections 2022-04-03T21:50:20.305 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc4cc063ce0 0x7fc4cc066190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4ec0c2300 0x7fc4ec15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4ec0a73e0 0x7fc4ec0c04d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 --2- 172.21.15.49:0/2160436927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ec0c1f30 0x7fc4ec15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 >> 172.21.15.49:0/2160436927 conn(0x7fc4ec05dfd0 msgr2=0x7fc4ec0be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:20.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 shutdown_connections 2022-04-03T21:50:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.300+0000 7fc4f1717700 1 -- 172.21.15.49:0/2160436927 wait complete. 2022-04-03T21:50:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2022-04-03T21:50:20.326 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2022-04-03T21:50:20.093702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594898,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66960,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":63488,"kb_avail":754907760,"statfs":{"total":773094113280,"available":773025546240,"internally_reserved":0,"allocated":3489792,"data_stored":2039588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65011712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2200,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003863"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402622+0000","last_change":"2022-04-03T21:49:58.414058+0000","last_active":"2022-04-03T21:50:02.402622+0000","last_peered":"2022-04-03T21:50:02.402622+0000","last_clean":"2022-04-03T21:50:02.402622+0000","last_became_active":"2022-04-03T21:49:58.413775+0000","last_became_peered":"2022-04-03T21:49:58.413775+0000","last_unstale":"2022-04-03T21:50:02.402622+0000","last_undegraded":"2022-04-03T21:50:02.402622+0000","last_fullsized":"2022-04-03T21:50:02.402622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:53.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408368+0000","last_change":"2022-04-03T21:49:58.409713+0000","last_active":"2022-04-03T21:50:02.408368+0000","last_peered":"2022-04-03T21:50:02.408368+0000","last_clean":"2022-04-03T21:50:02.408368+0000","last_became_active":"2022-04-03T21:49:58.409410+0000","last_became_peered":"2022-04-03T21:49:58.409410+0000","last_unstale":"2022-04-03T21:50:02.408368+0000","last_undegraded":"2022-04-03T21:50:02.408368+0000","last_fullsized":"2022-04-03T21:50:02.408368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:10.539087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421211+0000","last_change":"2022-04-03T21:49:58.422325+0000","last_active":"2022-04-03T21:50:02.421211+0000","last_peered":"2022-04-03T21:50:02.421211+0000","last_clean":"2022-04-03T21:50:02.421211+0000","last_became_active":"2022-04-03T21:49:58.422026+0000","last_became_peered":"2022-04-03T21:49:58.422026+0000","last_unstale":"2022-04-03T21:50:02.421211+0000","last_undegraded":"2022-04-03T21:50:02.421211+0000","last_fullsized":"2022-04-03T21:50:02.421211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:09:11.502569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421334+0000","last_change":"2022-04-03T21:49:58.423449+0000","last_active":"2022-04-03T21:50:02.421334+0000","last_peered":"2022-04-03T21:50:02.421334+0000","last_clean":"2022-04-03T21:50:02.421334+0000","last_became_active":"2022-04-03T21:49:58.423128+0000","last_became_peered":"2022-04-03T21:49:58.423128+0000","last_unstale":"2022-04-03T21:50:02.421334+0000","last_undegraded":"2022-04-03T21:50:02.421334+0000","last_fullsized":"2022-04-03T21:50:02.421334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:02:31.777504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405877+0000","last_change":"2022-04-03T21:49:58.416006+0000","last_active":"2022-04-03T21:50:02.405877+0000","last_peered":"2022-04-03T21:50:02.405877+0000","last_clean":"2022-04-03T21:50:02.405877+0000","last_became_active":"2022-04-03T21:49:58.415782+0000","last_became_peered":"2022-04-03T21:49:58.415782+0000","last_unstale":"2022-04-03T21:50:02.405877+0000","last_undegraded":"2022-04-03T21:50:02.405877+0000","last_fullsized":"2022-04-03T21:50:02.405877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:27:40.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403571+0000","last_change":"2022-04-03T21:49:58.399107+0000","last_active":"2022-04-03T21:50:02.403571+0000","last_peered":"2022-04-03T21:50:02.403571+0000","last_clean":"2022-04-03T21:50:02.403571+0000","last_became_active":"2022-04-03T21:49:58.398700+0000","last_became_peered":"2022-04-03T21:49:58.398700+0000","last_unstale":"2022-04-03T21:50:02.403571+0000","last_undegraded":"2022-04-03T21:50:02.403571+0000","last_fullsized":"2022-04-03T21:50:02.403571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:39:58.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402584+0000","last_change":"2022-04-03T21:49:58.424480+0000","last_active":"2022-04-03T21:50:02.402584+0000","last_peered":"2022-04-03T21:50:02.402584+0000","last_clean":"2022-04-03T21:50:02.402584+0000","last_became_active":"2022-04-03T21:49:58.424164+0000","last_became_peered":"2022-04-03T21:49:58.424164+0000","last_unstale":"2022-04-03T21:50:02.402584+0000","last_undegraded":"2022-04-03T21:50:02.402584+0000","last_fullsized":"2022-04-03T21:50:02.402584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:05:12.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412069+0000","last_change":"2022-04-03T21:49:58.425384+0000","last_active":"2022-04-03T21:50:02.412069+0000","last_peered":"2022-04-03T21:50:02.412069+0000","last_clean":"2022-04-03T21:50:02.412069+0000","last_became_active":"2022-04-03T21:49:58.425084+0000","last_became_peered":"2022-04-03T21:49:58.425084+0000","last_unstale":"2022-04-03T21:50:02.412069+0000","last_undegraded":"2022-04-03T21:50:02.412069+0000","last_fullsized":"2022-04-03T21:50:02.412069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:38.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411107+0000","last_change":"2022-04-03T21:49:58.415591+0000","last_active":"2022-04-03T21:50:02.411107+0000","last_peered":"2022-04-03T21:50:02.411107+0000","last_clean":"2022-04-03T21:50:02.411107+0000","last_became_active":"2022-04-03T21:49:58.415264+0000","last_became_peered":"2022-04-03T21:49:58.415264+0000","last_unstale":"2022-04-03T21:50:02.411107+0000","last_undegraded":"2022-04-03T21:50:02.411107+0000","last_fullsized":"2022-04-03T21:50:02.411107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:26:23.919459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411177+0000","last_change":"2022-04-03T21:49:58.415930+0000","last_active":"2022-04-03T21:50:02.411177+0000","last_peered":"2022-04-03T21:50:02.411177+0000","last_clean":"2022-04-03T21:50:02.411177+0000","last_became_active":"2022-04-03T21:49:58.415597+0000","last_became_peered":"2022-04-03T21:49:58.415597+0000","last_unstale":"2022-04-03T21:50:02.411177+0000","last_undegraded":"2022-04-03T21:50:02.411177+0000","last_fullsized":"2022-04-03T21:50:02.411177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:31:01.030066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409971+0000","last_change":"2022-04-03T21:49:58.425355+0000","last_active":"2022-04-03T21:50:02.409971+0000","last_peered":"2022-04-03T21:50:02.409971+0000","last_clean":"2022-04-03T21:50:02.409971+0000","last_became_active":"2022-04-03T21:49:58.425029+0000","last_became_peered":"2022-04-03T21:49:58.425029+0000","last_unstale":"2022-04-03T21:50:02.409971+0000","last_undegraded":"2022-04-03T21:50:02.409971+0000","last_fullsized":"2022-04-03T21:50:02.409971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:00:14.843110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403539+0000","last_change":"2022-04-03T21:49:58.399698+0000","last_active":"2022-04-03T21:50:02.403539+0000","last_peered":"2022-04-03T21:50:02.403539+0000","last_clean":"2022-04-03T21:50:02.403539+0000","last_became_active":"2022-04-03T21:49:58.399040+0000","last_became_peered":"2022-04-03T21:49:58.399040+0000","last_unstale":"2022-04-03T21:50:02.403539+0000","last_undegraded":"2022-04-03T21:50:02.403539+0000","last_fullsized":"2022-04-03T21:50:02.403539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:27.438020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413919+0000","last_change":"2022-04-03T21:49:58.411470+0000","last_active":"2022-04-03T21:50:02.413919+0000","last_peered":"2022-04-03T21:50:02.413919+0000","last_clean":"2022-04-03T21:50:02.413919+0000","last_became_active":"2022-04-03T21:49:58.411181+0000","last_became_peered":"2022-04-03T21:49:58.411181+0000","last_unstale":"2022-04-03T21:50:02.413919+0000","last_undegraded":"2022-04-03T21:50:02.413919+0000","last_fullsized":"2022-04-03T21:50:02.413919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:12:21.980416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414197+0000","last_change":"2022-04-03T21:49:58.419342+0000","last_active":"2022-04-03T21:50:02.414197+0000","last_peered":"2022-04-03T21:50:02.414197+0000","last_clean":"2022-04-03T21:50:02.414197+0000","last_became_active":"2022-04-03T21:49:58.418928+0000","last_became_peered":"2022-04-03T21:49:58.418928+0000","last_unstale":"2022-04-03T21:50:02.414197+0000","last_undegraded":"2022-04-03T21:50:02.414197+0000","last_fullsized":"2022-04-03T21:50:02.414197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:02:42.663277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421690+0000","last_change":"2022-04-03T21:49:58.418714+0000","last_active":"2022-04-03T21:50:02.421690+0000","last_peered":"2022-04-03T21:50:02.421690+0000","last_clean":"2022-04-03T21:50:02.421690+0000","last_became_active":"2022-04-03T21:49:58.418401+0000","last_became_peered":"2022-04-03T21:49:58.418401+0000","last_unstale":"2022-04-03T21:50:02.421690+0000","last_undegraded":"2022-04-03T21:50:02.421690+0000","last_fullsized":"2022-04-03T21:50:02.421690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:34:59.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402148+0000","last_change":"2022-04-03T21:49:58.399093+0000","last_active":"2022-04-03T21:50:02.402148+0000","last_peered":"2022-04-03T21:50:02.402148+0000","last_clean":"2022-04-03T21:50:02.402148+0000","last_became_active":"2022-04-03T21:49:58.398799+0000","last_became_peered":"2022-04-03T21:49:58.398799+0000","last_unstale":"2022-04-03T21:50:02.402148+0000","last_undegraded":"2022-04-03T21:50:02.402148+0000","last_fullsized":"2022-04-03T21:50:02.402148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:49:12.002614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402064+0000","last_change":"2022-04-03T21:49:58.405030+0000","last_active":"2022-04-03T21:50:02.402064+0000","last_peered":"2022-04-03T21:50:02.402064+0000","last_clean":"2022-04-03T21:50:02.402064+0000","last_became_active":"2022-04-03T21:49:58.404727+0000","last_became_peered":"2022-04-03T21:49:58.404727+0000","last_unstale":"2022-04-03T21:50:02.402064+0000","last_undegraded":"2022-04-03T21:50:02.402064+0000","last_fullsized":"2022-04-03T21:50:02.402064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:36:14.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428065+0000","last_change":"2022-04-03T21:49:58.431718+0000","last_active":"2022-04-03T21:50:02.428065+0000","last_peered":"2022-04-03T21:50:02.428065+0000","last_clean":"2022-04-03T21:50:02.428065+0000","last_became_active":"2022-04-03T21:49:58.430872+0000","last_became_peered":"2022-04-03T21:49:58.430872+0000","last_unstale":"2022-04-03T21:50:02.428065+0000","last_undegraded":"2022-04-03T21:50:02.428065+0000","last_fullsized":"2022-04-03T21:50:02.428065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:36:47.428099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401931+0000","last_change":"2022-04-03T21:49:58.401404+0000","last_active":"2022-04-03T21:50:02.401931+0000","last_peered":"2022-04-03T21:50:02.401931+0000","last_clean":"2022-04-03T21:50:02.401931+0000","last_became_active":"2022-04-03T21:49:58.400233+0000","last_became_peered":"2022-04-03T21:49:58.400233+0000","last_unstale":"2022-04-03T21:50:02.401931+0000","last_undegraded":"2022-04-03T21:50:02.401931+0000","last_fullsized":"2022-04-03T21:50:02.401931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:19:42.193555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413456+0000","last_change":"2022-04-03T21:49:58.415652+0000","last_active":"2022-04-03T21:50:02.413456+0000","last_peered":"2022-04-03T21:50:02.413456+0000","last_clean":"2022-04-03T21:50:02.413456+0000","last_became_active":"2022-04-03T21:49:58.415309+0000","last_became_peered":"2022-04-03T21:49:58.415309+0000","last_unstale":"2022-04-03T21:50:02.413456+0000","last_undegraded":"2022-04-03T21:50:02.413456+0000","last_fullsized":"2022-04-03T21:50:02.413456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:58:49.731887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409358+0000","last_change":"2022-04-03T21:49:58.420076+0000","last_active":"2022-04-03T21:50:02.409358+0000","last_peered":"2022-04-03T21:50:02.409358+0000","last_clean":"2022-04-03T21:50:02.409358+0000","last_became_active":"2022-04-03T21:49:58.419652+0000","last_became_peered":"2022-04-03T21:49:58.419652+0000","last_unstale":"2022-04-03T21:50:02.409358+0000","last_undegraded":"2022-04-03T21:50:02.409358+0000","last_fullsized":"2022-04-03T21:50:02.409358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:09:13.184611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401797+0000","last_change":"2022-04-03T21:49:58.406560+0000","last_active":"2022-04-03T21:50:02.401797+0000","last_peered":"2022-04-03T21:50:02.401797+0000","last_clean":"2022-04-03T21:50:02.401797+0000","last_became_active":"2022-04-03T21:49:58.406160+0000","last_became_peered":"2022-04-03T21:49:58.406160+0000","last_unstale":"2022-04-03T21:50:02.401797+0000","last_undegraded":"2022-04-03T21:50:02.401797+0000","last_fullsized":"2022-04-03T21:50:02.401797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:10:20.264129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408532+0000","last_change":"2022-04-03T21:49:58.407401+0000","last_active":"2022-04-03T21:50:02.408532+0000","last_peered":"2022-04-03T21:50:02.408532+0000","last_clean":"2022-04-03T21:50:02.408532+0000","last_became_active":"2022-04-03T21:49:58.407125+0000","last_became_peered":"2022-04-03T21:49:58.407125+0000","last_unstale":"2022-04-03T21:50:02.408532+0000","last_undegraded":"2022-04-03T21:50:02.408532+0000","last_fullsized":"2022-04-03T21:50:02.408532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:19.614490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412027+0000","last_change":"2022-04-03T21:49:58.419741+0000","last_active":"2022-04-03T21:50:02.412027+0000","last_peered":"2022-04-03T21:50:02.412027+0000","last_clean":"2022-04-03T21:50:02.412027+0000","last_became_active":"2022-04-03T21:49:58.419026+0000","last_became_peered":"2022-04-03T21:49:58.419026+0000","last_unstale":"2022-04-03T21:50:02.412027+0000","last_undegraded":"2022-04-03T21:50:02.412027+0000","last_fullsized":"2022-04-03T21:50:02.412027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:37.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409777+0000","last_change":"2022-04-03T21:49:58.403630+0000","last_active":"2022-04-03T21:50:02.409777+0000","last_peered":"2022-04-03T21:50:02.409777+0000","last_clean":"2022-04-03T21:50:02.409777+0000","last_became_active":"2022-04-03T21:49:58.403280+0000","last_became_peered":"2022-04-03T21:49:58.403280+0000","last_unstale":"2022-04-03T21:50:02.409777+0000","last_undegraded":"2022-04-03T21:50:02.409777+0000","last_fullsized":"2022-04-03T21:50:02.409777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:50:27.561349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402107+0000","last_change":"2022-04-03T21:49:58.406356+0000","last_active":"2022-04-03T21:50:02.402107+0000","last_peered":"2022-04-03T21:50:02.402107+0000","last_clean":"2022-04-03T21:50:02.402107+0000","last_became_active":"2022-04-03T21:49:58.406008+0000","last_became_peered":"2022-04-03T21:49:58.406008+0000","last_unstale":"2022-04-03T21:50:02.402107+0000","last_undegraded":"2022-04-03T21:50:02.402107+0000","last_fullsized":"2022-04-03T21:50:02.402107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:09:59.484176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403238+0000","last_change":"2022-04-03T21:49:58.429551+0000","last_active":"2022-04-03T21:50:02.403238+0000","last_peered":"2022-04-03T21:50:02.403238+0000","last_clean":"2022-04-03T21:50:02.403238+0000","last_became_active":"2022-04-03T21:49:58.429168+0000","last_became_peered":"2022-04-03T21:49:58.429168+0000","last_unstale":"2022-04-03T21:50:02.403238+0000","last_undegraded":"2022-04-03T21:50:02.403238+0000","last_fullsized":"2022-04-03T21:50:02.403238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:25:21.039114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443702+0000","last_change":"2022-04-03T21:50:02.441183+0000","last_active":"2022-04-03T21:50:02.443702+0000","last_peered":"2022-04-03T21:50:02.443702+0000","last_clean":"2022-04-03T21:50:02.443702+0000","last_became_active":"2022-04-03T21:50:02.440742+0000","last_became_peered":"2022-04-03T21:50:02.440742+0000","last_unstale":"2022-04-03T21:50:02.443702+0000","last_undegraded":"2022-04-03T21:50:02.443702+0000","last_fullsized":"2022-04-03T21:50:02.443702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:34:43.602016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414305+0000","last_change":"2022-04-03T21:49:57.860784+0000","last_active":"2022-04-03T21:50:02.414305+0000","last_peered":"2022-04-03T21:50:02.414305+0000","last_clean":"2022-04-03T21:50:02.414305+0000","last_became_active":"2022-04-03T21:49:57.858898+0000","last_became_peered":"2022-04-03T21:49:57.858898+0000","last_unstale":"2022-04-03T21:50:02.414305+0000","last_undegraded":"2022-04-03T21:50:02.414305+0000","last_fullsized":"2022-04-03T21:50:02.414305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:47:21.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402796+0000","last_change":"2022-04-03T21:49:58.408237+0000","last_active":"2022-04-03T21:50:02.402796+0000","last_peered":"2022-04-03T21:50:02.402796+0000","last_clean":"2022-04-03T21:50:02.402796+0000","last_became_active":"2022-04-03T21:49:58.407955+0000","last_became_peered":"2022-04-03T21:49:58.407955+0000","last_unstale":"2022-04-03T21:50:02.402796+0000","last_undegraded":"2022-04-03T21:50:02.402796+0000","last_fullsized":"2022-04-03T21:50:02.402796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:39:07.361273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436868+0000","last_change":"2022-04-03T21:50:02.431994+0000","last_active":"2022-04-03T21:50:02.436868+0000","last_peered":"2022-04-03T21:50:02.436868+0000","last_clean":"2022-04-03T21:50:02.436868+0000","last_became_active":"2022-04-03T21:50:02.431584+0000","last_became_peered":"2022-04-03T21:50:02.431584+0000","last_unstale":"2022-04-03T21:50:02.436868+0000","last_undegraded":"2022-04-03T21:50:02.436868+0000","last_fullsized":"2022-04-03T21:50:02.436868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:07:15.227915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408396+0000","last_change":"2022-04-03T21:49:57.866074+0000","last_active":"2022-04-03T21:50:02.408396+0000","last_peered":"2022-04-03T21:50:02.408396+0000","last_clean":"2022-04-03T21:50:02.408396+0000","last_became_active":"2022-04-03T21:49:57.865799+0000","last_became_peered":"2022-04-03T21:49:57.865799+0000","last_unstale":"2022-04-03T21:50:02.408396+0000","last_undegraded":"2022-04-03T21:50:02.408396+0000","last_fullsized":"2022-04-03T21:50:02.408396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:23:38.859645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410453+0000","last_change":"2022-04-03T21:49:58.412549+0000","last_active":"2022-04-03T21:50:02.410453+0000","last_peered":"2022-04-03T21:50:02.410453+0000","last_clean":"2022-04-03T21:50:02.410453+0000","last_became_active":"2022-04-03T21:49:58.412221+0000","last_became_peered":"2022-04-03T21:49:58.412221+0000","last_unstale":"2022-04-03T21:50:02.410453+0000","last_undegraded":"2022-04-03T21:50:02.410453+0000","last_fullsized":"2022-04-03T21:50:02.410453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:46:32.727120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.433553+0000","last_change":"2022-04-03T21:50:02.430727+0000","last_active":"2022-04-03T21:50:02.433553+0000","last_peered":"2022-04-03T21:50:02.433553+0000","last_clean":"2022-04-03T21:50:02.433553+0000","last_became_active":"2022-04-03T21:50:02.430293+0000","last_became_peered":"2022-04-03T21:50:02.430293+0000","last_unstale":"2022-04-03T21:50:02.433553+0000","last_undegraded":"2022-04-03T21:50:02.433553+0000","last_fullsized":"2022-04-03T21:50:02.433553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:12:45.221200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402025+0000","last_change":"2022-04-03T21:49:57.857793+0000","last_active":"2022-04-03T21:50:02.402025+0000","last_peered":"2022-04-03T21:50:02.402025+0000","last_clean":"2022-04-03T21:50:02.402025+0000","last_became_active":"2022-04-03T21:49:57.857477+0000","last_became_peered":"2022-04-03T21:49:57.857477+0000","last_unstale":"2022-04-03T21:50:02.402025+0000","last_undegraded":"2022-04-03T21:50:02.402025+0000","last_fullsized":"2022-04-03T21:50:02.402025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:58:12.643379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403732+0000","last_change":"2022-04-03T21:49:58.410021+0000","last_active":"2022-04-03T21:50:02.403732+0000","last_peered":"2022-04-03T21:50:02.403732+0000","last_clean":"2022-04-03T21:50:02.403732+0000","last_became_active":"2022-04-03T21:49:58.409644+0000","last_became_peered":"2022-04-03T21:49:58.409644+0000","last_unstale":"2022-04-03T21:50:02.403732+0000","last_undegraded":"2022-04-03T21:50:02.403732+0000","last_fullsized":"2022-04-03T21:50:02.403732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:26:07.839515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430122+0000","last_change":"2022-04-03T21:50:02.418006+0000","last_active":"2022-04-03T21:50:02.430122+0000","last_peered":"2022-04-03T21:50:02.430122+0000","last_clean":"2022-04-03T21:50:02.430122+0000","last_became_active":"2022-04-03T21:50:02.417522+0000","last_became_peered":"2022-04-03T21:50:02.417522+0000","last_unstale":"2022-04-03T21:50:02.430122+0000","last_undegraded":"2022-04-03T21:50:02.430122+0000","last_fullsized":"2022-04-03T21:50:02.430122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:40:39.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402342+0000","last_change":"2022-04-03T21:49:57.870805+0000","last_active":"2022-04-03T21:50:02.402342+0000","last_peered":"2022-04-03T21:50:02.402342+0000","last_clean":"2022-04-03T21:50:02.402342+0000","last_became_active":"2022-04-03T21:49:57.870504+0000","last_became_peered":"2022-04-03T21:49:57.870504+0000","last_unstale":"2022-04-03T21:50:02.402342+0000","last_undegraded":"2022-04-03T21:50:02.402342+0000","last_fullsized":"2022-04-03T21:50:02.402342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:41.062419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402628+0000","last_change":"2022-04-03T21:49:58.411420+0000","last_active":"2022-04-03T21:50:02.402628+0000","last_peered":"2022-04-03T21:50:02.402628+0000","last_clean":"2022-04-03T21:50:02.402628+0000","last_became_active":"2022-04-03T21:49:58.411046+0000","last_became_peered":"2022-04-03T21:49:58.411046+0000","last_unstale":"2022-04-03T21:50:02.402628+0000","last_undegraded":"2022-04-03T21:50:02.402628+0000","last_fullsized":"2022-04-03T21:50:02.402628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:59:39.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.439955+0000","last_change":"2022-04-03T21:50:02.438123+0000","last_active":"2022-04-03T21:50:02.439955+0000","last_peered":"2022-04-03T21:50:02.439955+0000","last_clean":"2022-04-03T21:50:02.439955+0000","last_became_active":"2022-04-03T21:50:02.437671+0000","last_became_peered":"2022-04-03T21:50:02.437671+0000","last_unstale":"2022-04-03T21:50:02.439955+0000","last_undegraded":"2022-04-03T21:50:02.439955+0000","last_fullsized":"2022-04-03T21:50:02.439955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:02:58.397104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.407995+0000","last_change":"2022-04-03T21:49:57.874098+0000","last_active":"2022-04-03T21:50:02.407995+0000","last_peered":"2022-04-03T21:50:02.407995+0000","last_clean":"2022-04-03T21:50:02.407995+0000","last_became_active":"2022-04-03T21:49:57.873819+0000","last_became_peered":"2022-04-03T21:49:57.873819+0000","last_unstale":"2022-04-03T21:50:02.407995+0000","last_undegraded":"2022-04-03T21:50:02.407995+0000","last_fullsized":"2022-04-03T21:50:02.407995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:24.770645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408357+0000","last_change":"2022-04-03T21:49:58.422605+0000","last_active":"2022-04-03T21:50:02.408357+0000","last_peered":"2022-04-03T21:50:02.408357+0000","last_clean":"2022-04-03T21:50:02.408357+0000","last_became_active":"2022-04-03T21:49:58.422247+0000","last_became_peered":"2022-04-03T21:49:58.422247+0000","last_unstale":"2022-04-03T21:50:02.408357+0000","last_undegraded":"2022-04-03T21:50:02.408357+0000","last_fullsized":"2022-04-03T21:50:02.408357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:30.833260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423978+0000","last_change":"2022-04-03T21:50:02.422574+0000","last_active":"2022-04-03T21:50:02.423978+0000","last_peered":"2022-04-03T21:50:02.423978+0000","last_clean":"2022-04-03T21:50:02.423978+0000","last_became_active":"2022-04-03T21:50:02.422108+0000","last_became_peered":"2022-04-03T21:50:02.422108+0000","last_unstale":"2022-04-03T21:50:02.423978+0000","last_undegraded":"2022-04-03T21:50:02.423978+0000","last_fullsized":"2022-04-03T21:50:02.423978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:38:20.285542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421113+0000","last_change":"2022-04-03T21:49:57.862891+0000","last_active":"2022-04-03T21:50:02.421113+0000","last_peered":"2022-04-03T21:50:02.421113+0000","last_clean":"2022-04-03T21:50:02.421113+0000","last_became_active":"2022-04-03T21:49:57.862595+0000","last_became_peered":"2022-04-03T21:49:57.862595+0000","last_unstale":"2022-04-03T21:50:02.421113+0000","last_undegraded":"2022-04-03T21:50:02.421113+0000","last_fullsized":"2022-04-03T21:50:02.421113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:26:38.267269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405207+0000","last_change":"2022-04-03T21:49:58.405688+0000","last_active":"2022-04-03T21:50:02.405207+0000","last_peered":"2022-04-03T21:50:02.405207+0000","last_clean":"2022-04-03T21:50:02.405207+0000","last_became_active":"2022-04-03T21:49:58.405370+0000","last_became_peered":"2022-04-03T21:49:58.405370+0000","last_unstale":"2022-04-03T21:50:02.405207+0000","last_undegraded":"2022-04-03T21:50:02.405207+0000","last_fullsized":"2022-04-03T21:50:02.405207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:08:21.661666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430526+0000","last_change":"2022-04-03T21:50:02.426303+0000","last_active":"2022-04-03T21:50:02.430526+0000","last_peered":"2022-04-03T21:50:02.430526+0000","last_clean":"2022-04-03T21:50:02.430526+0000","last_became_active":"2022-04-03T21:50:02.425881+0000","last_became_peered":"2022-04-03T21:50:02.425881+0000","last_unstale":"2022-04-03T21:50:02.430526+0000","last_undegraded":"2022-04-03T21:50:02.430526+0000","last_fullsized":"2022-04-03T21:50:02.430526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:53:47.423488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-04-03T21:50:09.390123+0000","last_change":"2022-04-03T21:49:57.874385+0000","last_active":"2022-04-03T21:50:09.390123+0000","last_peered":"2022-04-03T21:50:09.390123+0000","last_clean":"2022-04-03T21:50:09.390123+0000","last_became_active":"2022-04-03T21:49:57.874015+0000","last_became_peered":"2022-04-03T21:49:57.874015+0000","last_unstale":"2022-04-03T21:50:09.390123+0000","last_undegraded":"2022-04-03T21:50:09.390123+0000","last_fullsized":"2022-04-03T21:50:09.390123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:15:01.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3748,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410683+0000","last_change":"2022-04-03T21:49:58.400492+0000","last_active":"2022-04-03T21:50:02.410683+0000","last_peered":"2022-04-03T21:50:02.410683+0000","last_clean":"2022-04-03T21:50:02.410683+0000","last_became_active":"2022-04-03T21:49:58.400197+0000","last_became_peered":"2022-04-03T21:49:58.400197+0000","last_unstale":"2022-04-03T21:50:02.410683+0000","last_undegraded":"2022-04-03T21:50:02.410683+0000","last_fullsized":"2022-04-03T21:50:02.410683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:33:29.265331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442907+0000","last_change":"2022-04-03T21:50:02.440881+0000","last_active":"2022-04-03T21:50:02.442907+0000","last_peered":"2022-04-03T21:50:02.442907+0000","last_clean":"2022-04-03T21:50:02.442907+0000","last_became_active":"2022-04-03T21:50:02.440422+0000","last_became_peered":"2022-04-03T21:50:02.440422+0000","last_unstale":"2022-04-03T21:50:02.442907+0000","last_undegraded":"2022-04-03T21:50:02.442907+0000","last_fullsized":"2022-04-03T21:50:02.442907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:42:18.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403406+0000","last_change":"2022-04-03T21:49:57.879838+0000","last_active":"2022-04-03T21:50:02.403406+0000","last_peered":"2022-04-03T21:50:02.403406+0000","last_clean":"2022-04-03T21:50:02.403406+0000","last_became_active":"2022-04-03T21:49:57.878024+0000","last_became_peered":"2022-04-03T21:49:57.878024+0000","last_unstale":"2022-04-03T21:50:02.403406+0000","last_undegraded":"2022-04-03T21:50:02.403406+0000","last_fullsized":"2022-04-03T21:50:02.403406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:47:30.622816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410468+0000","last_change":"2022-04-03T21:49:58.409677+0000","last_active":"2022-04-03T21:50:02.410468+0000","last_peered":"2022-04-03T21:50:02.410468+0000","last_clean":"2022-04-03T21:50:02.410468+0000","last_became_active":"2022-04-03T21:49:58.408823+0000","last_became_peered":"2022-04-03T21:49:58.408823+0000","last_unstale":"2022-04-03T21:50:02.410468+0000","last_undegraded":"2022-04-03T21:50:02.410468+0000","last_fullsized":"2022-04-03T21:50:02.410468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:29:30.293123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428383+0000","last_change":"2022-04-03T21:50:02.427323+0000","last_active":"2022-04-03T21:50:02.428383+0000","last_peered":"2022-04-03T21:50:02.428383+0000","last_clean":"2022-04-03T21:50:02.428383+0000","last_became_active":"2022-04-03T21:50:02.426904+0000","last_became_peered":"2022-04-03T21:50:02.426904+0000","last_unstale":"2022-04-03T21:50:02.428383+0000","last_undegraded":"2022-04-03T21:50:02.428383+0000","last_fullsized":"2022-04-03T21:50:02.428383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:17:10.401730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410537+0000","last_change":"2022-04-03T21:49:57.870926+0000","last_active":"2022-04-03T21:50:02.410537+0000","last_peered":"2022-04-03T21:50:02.410537+0000","last_clean":"2022-04-03T21:50:02.410537+0000","last_became_active":"2022-04-03T21:49:57.870492+0000","last_became_peered":"2022-04-03T21:49:57.870492+0000","last_unstale":"2022-04-03T21:50:02.410537+0000","last_undegraded":"2022-04-03T21:50:02.410537+0000","last_fullsized":"2022-04-03T21:50:02.410537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:31.021652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403960+0000","last_change":"2022-04-03T21:49:58.431705+0000","last_active":"2022-04-03T21:50:02.403960+0000","last_peered":"2022-04-03T21:50:02.403960+0000","last_clean":"2022-04-03T21:50:02.403960+0000","last_became_active":"2022-04-03T21:49:58.431415+0000","last_became_peered":"2022-04-03T21:49:58.431415+0000","last_unstale":"2022-04-03T21:50:02.403960+0000","last_undegraded":"2022-04-03T21:50:02.403960+0000","last_fullsized":"2022-04-03T21:50:02.403960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:33:36.410007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427780+0000","last_change":"2022-04-03T21:50:02.424166+0000","last_active":"2022-04-03T21:50:02.427780+0000","last_peered":"2022-04-03T21:50:02.427780+0000","last_clean":"2022-04-03T21:50:02.427780+0000","last_became_active":"2022-04-03T21:50:02.423793+0000","last_became_peered":"2022-04-03T21:50:02.423793+0000","last_unstale":"2022-04-03T21:50:02.427780+0000","last_undegraded":"2022-04-03T21:50:02.427780+0000","last_fullsized":"2022-04-03T21:50:02.427780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:34:55.173456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402364+0000","last_change":"2022-04-03T21:49:57.874464+0000","last_active":"2022-04-03T21:50:02.402364+0000","last_peered":"2022-04-03T21:50:02.402364+0000","last_clean":"2022-04-03T21:50:02.402364+0000","last_became_active":"2022-04-03T21:49:57.874181+0000","last_became_peered":"2022-04-03T21:49:57.874181+0000","last_unstale":"2022-04-03T21:50:02.402364+0000","last_undegraded":"2022-04-03T21:50:02.402364+0000","last_fullsized":"2022-04-03T21:50:02.402364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:51:13.600469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402062+0000","last_change":"2022-04-03T21:49:58.401185+0000","last_active":"2022-04-03T21:50:02.402062+0000","last_peered":"2022-04-03T21:50:02.402062+0000","last_clean":"2022-04-03T21:50:02.402062+0000","last_became_active":"2022-04-03T21:49:58.399966+0000","last_became_peered":"2022-04-03T21:49:58.399966+0000","last_unstale":"2022-04-03T21:50:02.402062+0000","last_undegraded":"2022-04-03T21:50:02.402062+0000","last_fullsized":"2022-04-03T21:50:02.402062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:43:46.604121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.437138+0000","last_change":"2022-04-03T21:50:02.432307+0000","last_active":"2022-04-03T21:50:02.437138+0000","last_peered":"2022-04-03T21:50:02.437138+0000","last_clean":"2022-04-03T21:50:02.437138+0000","last_became_active":"2022-04-03T21:50:02.431759+0000","last_became_peered":"2022-04-03T21:50:02.431759+0000","last_unstale":"2022-04-03T21:50:02.437138+0000","last_undegraded":"2022-04-03T21:50:02.437138+0000","last_fullsized":"2022-04-03T21:50:02.437138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:34:33.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411902+0000","last_change":"2022-04-03T21:49:57.864543+0000","last_active":"2022-04-03T21:50:02.411902+0000","last_peered":"2022-04-03T21:50:02.411902+0000","last_clean":"2022-04-03T21:50:02.411902+0000","last_became_active":"2022-04-03T21:49:57.864245+0000","last_became_peered":"2022-04-03T21:49:57.864245+0000","last_unstale":"2022-04-03T21:50:02.411902+0000","last_undegraded":"2022-04-03T21:50:02.411902+0000","last_fullsized":"2022-04-03T21:50:02.411902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:13:09.645048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402455+0000","last_change":"2022-04-03T21:49:58.419675+0000","last_active":"2022-04-03T21:50:02.402455+0000","last_peered":"2022-04-03T21:50:02.402455+0000","last_clean":"2022-04-03T21:50:02.402455+0000","last_became_active":"2022-04-03T21:49:58.419408+0000","last_became_peered":"2022-04-03T21:49:58.419408+0000","last_unstale":"2022-04-03T21:50:02.402455+0000","last_undegraded":"2022-04-03T21:50:02.402455+0000","last_fullsized":"2022-04-03T21:50:02.402455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:58:27.884413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427854+0000","last_change":"2022-04-03T21:50:02.425159+0000","last_active":"2022-04-03T21:50:02.427854+0000","last_peered":"2022-04-03T21:50:02.427854+0000","last_clean":"2022-04-03T21:50:02.427854+0000","last_became_active":"2022-04-03T21:50:02.424677+0000","last_became_peered":"2022-04-03T21:50:02.424677+0000","last_unstale":"2022-04-03T21:50:02.427854+0000","last_undegraded":"2022-04-03T21:50:02.427854+0000","last_fullsized":"2022-04-03T21:50:02.427854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:48.470775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421719+0000","last_change":"2022-04-03T21:49:57.866686+0000","last_active":"2022-04-03T21:50:02.421719+0000","last_peered":"2022-04-03T21:50:02.421719+0000","last_clean":"2022-04-03T21:50:02.421719+0000","last_became_active":"2022-04-03T21:49:57.866364+0000","last_became_peered":"2022-04-03T21:49:57.866364+0000","last_unstale":"2022-04-03T21:50:02.421719+0000","last_undegraded":"2022-04-03T21:50:02.421719+0000","last_fullsized":"2022-04-03T21:50:02.421719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:46:41.508964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402396+0000","last_change":"2022-04-03T21:49:58.420292+0000","last_active":"2022-04-03T21:50:02.402396+0000","last_peered":"2022-04-03T21:50:02.402396+0000","last_clean":"2022-04-03T21:50:02.402396+0000","last_became_active":"2022-04-03T21:49:58.419956+0000","last_became_peered":"2022-04-03T21:49:58.419956+0000","last_unstale":"2022-04-03T21:50:02.402396+0000","last_undegraded":"2022-04-03T21:50:02.402396+0000","last_fullsized":"2022-04-03T21:50:02.402396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:44:23.380819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436661+0000","last_change":"2022-04-03T21:50:02.431629+0000","last_active":"2022-04-03T21:50:02.436661+0000","last_peered":"2022-04-03T21:50:02.436661+0000","last_clean":"2022-04-03T21:50:02.436661+0000","last_became_active":"2022-04-03T21:50:02.431173+0000","last_became_peered":"2022-04-03T21:50:02.431173+0000","last_unstale":"2022-04-03T21:50:02.436661+0000","last_undegraded":"2022-04-03T21:50:02.436661+0000","last_fullsized":"2022-04-03T21:50:02.436661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:01:44.215650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408111+0000","last_change":"2022-04-03T21:49:57.877939+0000","last_active":"2022-04-03T21:50:02.408111+0000","last_peered":"2022-04-03T21:50:02.408111+0000","last_clean":"2022-04-03T21:50:02.408111+0000","last_became_active":"2022-04-03T21:49:57.877643+0000","last_became_peered":"2022-04-03T21:49:57.877643+0000","last_unstale":"2022-04-03T21:50:02.408111+0000","last_undegraded":"2022-04-03T21:50:02.408111+0000","last_fullsized":"2022-04-03T21:50:02.408111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T21:50:27.024213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410699+0000","last_change":"2022-04-03T21:49:58.421021+0000","last_active":"2022-04-03T21:50:02.410699+0000","last_peered":"2022-04-03T21:50:02.410699+0000","last_clean":"2022-04-03T21:50:02.410699+0000","last_became_active":"2022-04-03T21:49:58.420734+0000","last_became_peered":"2022-04-03T21:49:58.420734+0000","last_unstale":"2022-04-03T21:50:02.410699+0000","last_undegraded":"2022-04-03T21:50:02.410699+0000","last_fullsized":"2022-04-03T21:50:02.410699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:06:06.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423569+0000","last_change":"2022-04-03T21:50:02.417211+0000","last_active":"2022-04-03T21:50:02.423569+0000","last_peered":"2022-04-03T21:50:02.423569+0000","last_clean":"2022-04-03T21:50:02.423569+0000","last_became_active":"2022-04-03T21:50:02.416783+0000","last_became_peered":"2022-04-03T21:50:02.416783+0000","last_unstale":"2022-04-03T21:50:02.423569+0000","last_undegraded":"2022-04-03T21:50:02.423569+0000","last_fullsized":"2022-04-03T21:50:02.423569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:41:11.749073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403561+0000","last_change":"2022-04-03T21:49:57.872889+0000","last_active":"2022-04-03T21:50:02.403561+0000","last_peered":"2022-04-03T21:50:02.403561+0000","last_clean":"2022-04-03T21:50:02.403561+0000","last_became_active":"2022-04-03T21:49:57.872509+0000","last_became_peered":"2022-04-03T21:49:57.872509+0000","last_unstale":"2022-04-03T21:50:02.403561+0000","last_undegraded":"2022-04-03T21:50:02.403561+0000","last_fullsized":"2022-04-03T21:50:02.403561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:42.092697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413818+0000","last_change":"2022-04-03T21:49:58.399849+0000","last_active":"2022-04-03T21:50:02.413818+0000","last_peered":"2022-04-03T21:50:02.413818+0000","last_clean":"2022-04-03T21:50:02.413818+0000","last_became_active":"2022-04-03T21:49:58.399407+0000","last_became_peered":"2022-04-03T21:49:58.399407+0000","last_unstale":"2022-04-03T21:50:02.413818+0000","last_undegraded":"2022-04-03T21:50:02.413818+0000","last_fullsized":"2022-04-03T21:50:02.413818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:53:35.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.426414+0000","last_change":"2022-04-03T21:50:02.420577+0000","last_active":"2022-04-03T21:50:02.426414+0000","last_peered":"2022-04-03T21:50:02.426414+0000","last_clean":"2022-04-03T21:50:02.426414+0000","last_became_active":"2022-04-03T21:50:02.420023+0000","last_became_peered":"2022-04-03T21:50:02.420023+0000","last_unstale":"2022-04-03T21:50:02.426414+0000","last_undegraded":"2022-04-03T21:50:02.426414+0000","last_fullsized":"2022-04-03T21:50:02.426414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:56:20.520369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421514+0000","last_change":"2022-04-03T21:49:57.870171+0000","last_active":"2022-04-03T21:50:02.421514+0000","last_peered":"2022-04-03T21:50:02.421514+0000","last_clean":"2022-04-03T21:50:02.421514+0000","last_became_active":"2022-04-03T21:49:57.869887+0000","last_became_peered":"2022-04-03T21:49:57.869887+0000","last_unstale":"2022-04-03T21:50:02.421514+0000","last_undegraded":"2022-04-03T21:50:02.421514+0000","last_fullsized":"2022-04-03T21:50:02.421514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:40:24.182014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402693+0000","last_change":"2022-04-03T21:49:58.405990+0000","last_active":"2022-04-03T21:50:02.402693+0000","last_peered":"2022-04-03T21:50:02.402693+0000","last_clean":"2022-04-03T21:50:02.402693+0000","last_became_active":"2022-04-03T21:49:58.405686+0000","last_became_peered":"2022-04-03T21:49:58.405686+0000","last_unstale":"2022-04-03T21:50:02.402693+0000","last_undegraded":"2022-04-03T21:50:02.402693+0000","last_fullsized":"2022-04-03T21:50:02.402693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:45:30.673697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.441865+0000","last_change":"2022-04-03T21:50:02.436451+0000","last_active":"2022-04-03T21:50:02.441865+0000","last_peered":"2022-04-03T21:50:02.441865+0000","last_clean":"2022-04-03T21:50:02.441865+0000","last_became_active":"2022-04-03T21:50:02.435998+0000","last_became_peered":"2022-04-03T21:50:02.435998+0000","last_unstale":"2022-04-03T21:50:02.441865+0000","last_undegraded":"2022-04-03T21:50:02.441865+0000","last_fullsized":"2022-04-03T21:50:02.441865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:14:56.243368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401643+0000","last_change":"2022-04-03T21:49:57.861968+0000","last_active":"2022-04-03T21:50:02.401643+0000","last_peered":"2022-04-03T21:50:02.401643+0000","last_clean":"2022-04-03T21:50:02.401643+0000","last_became_active":"2022-04-03T21:49:57.861649+0000","last_became_peered":"2022-04-03T21:49:57.861649+0000","last_unstale":"2022-04-03T21:50:02.401643+0000","last_undegraded":"2022-04-03T21:50:02.401643+0000","last_fullsized":"2022-04-03T21:50:02.401643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:32:27.620549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421422+0000","last_change":"2022-04-03T21:49:58.417874+0000","last_active":"2022-04-03T21:50:02.421422+0000","last_peered":"2022-04-03T21:50:02.421422+0000","last_clean":"2022-04-03T21:50:02.421422+0000","last_became_active":"2022-04-03T21:49:58.417587+0000","last_became_peered":"2022-04-03T21:49:58.417587+0000","last_unstale":"2022-04-03T21:50:02.421422+0000","last_undegraded":"2022-04-03T21:50:02.421422+0000","last_fullsized":"2022-04-03T21:50:02.421422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:47:14.137789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428059+0000","last_change":"2022-04-03T21:50:02.425963+0000","last_active":"2022-04-03T21:50:02.428059+0000","last_peered":"2022-04-03T21:50:02.428059+0000","last_clean":"2022-04-03T21:50:02.428059+0000","last_became_active":"2022-04-03T21:50:02.425586+0000","last_became_peered":"2022-04-03T21:50:02.425586+0000","last_unstale":"2022-04-03T21:50:02.428059+0000","last_undegraded":"2022-04-03T21:50:02.428059+0000","last_fullsized":"2022-04-03T21:50:02.428059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:10:13.345349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403465+0000","last_change":"2022-04-03T21:49:57.870476+0000","last_active":"2022-04-03T21:50:02.403465+0000","last_peered":"2022-04-03T21:50:02.403465+0000","last_clean":"2022-04-03T21:50:02.403465+0000","last_became_active":"2022-04-03T21:49:57.870009+0000","last_became_peered":"2022-04-03T21:49:57.870009+0000","last_unstale":"2022-04-03T21:50:02.403465+0000","last_undegraded":"2022-04-03T21:50:02.403465+0000","last_fullsized":"2022-04-03T21:50:02.403465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:49:42.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403872+0000","last_change":"2022-04-03T21:49:58.421450+0000","last_active":"2022-04-03T21:50:02.403872+0000","last_peered":"2022-04-03T21:50:02.403872+0000","last_clean":"2022-04-03T21:50:02.403872+0000","last_became_active":"2022-04-03T21:49:58.421054+0000","last_became_peered":"2022-04-03T21:49:58.421054+0000","last_unstale":"2022-04-03T21:50:02.403872+0000","last_undegraded":"2022-04-03T21:50:02.403872+0000","last_fullsized":"2022-04-03T21:50:02.403872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:47:29.054190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442528+0000","last_change":"2022-04-03T21:50:02.434190+0000","last_active":"2022-04-03T21:50:02.442528+0000","last_peered":"2022-04-03T21:50:02.442528+0000","last_clean":"2022-04-03T21:50:02.442528+0000","last_became_active":"2022-04-03T21:50:02.433666+0000","last_became_peered":"2022-04-03T21:50:02.433666+0000","last_unstale":"2022-04-03T21:50:02.442528+0000","last_undegraded":"2022-04-03T21:50:02.442528+0000","last_fullsized":"2022-04-03T21:50:02.442528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:46.909616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402471+0000","last_change":"2022-04-03T21:49:57.863462+0000","last_active":"2022-04-03T21:50:02.402471+0000","last_peered":"2022-04-03T21:50:02.402471+0000","last_clean":"2022-04-03T21:50:02.402471+0000","last_became_active":"2022-04-03T21:49:57.863170+0000","last_became_peered":"2022-04-03T21:49:57.863170+0000","last_unstale":"2022-04-03T21:50:02.402471+0000","last_undegraded":"2022-04-03T21:50:02.402471+0000","last_fullsized":"2022-04-03T21:50:02.402471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:38:02.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408285+0000","last_change":"2022-04-03T21:49:58.401069+0000","last_active":"2022-04-03T21:50:02.408285+0000","last_peered":"2022-04-03T21:50:02.408285+0000","last_clean":"2022-04-03T21:50:02.408285+0000","last_became_active":"2022-04-03T21:49:58.400774+0000","last_became_peered":"2022-04-03T21:49:58.400774+0000","last_unstale":"2022-04-03T21:50:02.408285+0000","last_undegraded":"2022-04-03T21:50:02.408285+0000","last_fullsized":"2022-04-03T21:50:02.408285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:54.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429724+0000","last_change":"2022-04-03T21:50:02.420282+0000","last_active":"2022-04-03T21:50:02.429724+0000","last_peered":"2022-04-03T21:50:02.429724+0000","last_clean":"2022-04-03T21:50:02.429724+0000","last_became_active":"2022-04-03T21:50:02.419604+0000","last_became_peered":"2022-04-03T21:50:02.419604+0000","last_unstale":"2022-04-03T21:50:02.429724+0000","last_undegraded":"2022-04-03T21:50:02.429724+0000","last_fullsized":"2022-04-03T21:50:02.429724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:27:15.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406203+0000","last_change":"2022-04-03T21:49:57.859380+0000","last_active":"2022-04-03T21:50:02.406203+0000","last_peered":"2022-04-03T21:50:02.406203+0000","last_clean":"2022-04-03T21:50:02.406203+0000","last_became_active":"2022-04-03T21:49:57.859076+0000","last_became_peered":"2022-04-03T21:49:57.859076+0000","last_unstale":"2022-04-03T21:50:02.406203+0000","last_undegraded":"2022-04-03T21:50:02.406203+0000","last_fullsized":"2022-04-03T21:50:02.406203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:03:57.532989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401995+0000","last_change":"2022-04-03T21:49:58.408851+0000","last_active":"2022-04-03T21:50:02.401995+0000","last_peered":"2022-04-03T21:50:02.401995+0000","last_clean":"2022-04-03T21:50:02.401995+0000","last_became_active":"2022-04-03T21:49:58.408553+0000","last_became_peered":"2022-04-03T21:49:58.408553+0000","last_unstale":"2022-04-03T21:50:02.401995+0000","last_undegraded":"2022-04-03T21:50:02.401995+0000","last_fullsized":"2022-04-03T21:50:02.401995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:53:09.835987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423992+0000","last_change":"2022-04-03T21:50:02.422611+0000","last_active":"2022-04-03T21:50:02.423992+0000","last_peered":"2022-04-03T21:50:02.423992+0000","last_clean":"2022-04-03T21:50:02.423992+0000","last_became_active":"2022-04-03T21:50:02.422088+0000","last_became_peered":"2022-04-03T21:50:02.422088+0000","last_unstale":"2022-04-03T21:50:02.423992+0000","last_undegraded":"2022-04-03T21:50:02.423992+0000","last_fullsized":"2022-04-03T21:50:02.423992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:34:54.875279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403638+0000","last_change":"2022-04-03T21:49:51.950055+0000","last_active":"2022-04-03T21:50:02.403638+0000","last_peered":"2022-04-03T21:50:02.403638+0000","last_clean":"2022-04-03T21:50:02.403638+0000","last_became_active":"2022-04-03T21:49:51.949793+0000","last_became_peered":"2022-04-03T21:49:51.949793+0000","last_unstale":"2022-04-03T21:50:02.403638+0000","last_undegraded":"2022-04-03T21:50:02.403638+0000","last_fullsized":"2022-04-03T21:50:02.403638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:44:29.449323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409897+0000","last_change":"2022-04-03T21:49:57.872925+0000","last_active":"2022-04-03T21:50:02.409897+0000","last_peered":"2022-04-03T21:50:02.409897+0000","last_clean":"2022-04-03T21:50:02.409897+0000","last_became_active":"2022-04-03T21:49:57.872490+0000","last_became_peered":"2022-04-03T21:49:57.872490+0000","last_unstale":"2022-04-03T21:50:02.409897+0000","last_undegraded":"2022-04-03T21:50:02.409897+0000","last_fullsized":"2022-04-03T21:50:02.409897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:57:45.485657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410378+0000","last_change":"2022-04-03T21:49:58.409467+0000","last_active":"2022-04-03T21:50:02.410378+0000","last_peered":"2022-04-03T21:50:02.410378+0000","last_clean":"2022-04-03T21:50:02.410378+0000","last_became_active":"2022-04-03T21:49:58.409155+0000","last_became_peered":"2022-04-03T21:49:58.409155+0000","last_unstale":"2022-04-03T21:50:02.410378+0000","last_undegraded":"2022-04-03T21:50:02.410378+0000","last_fullsized":"2022-04-03T21:50:02.410378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:31.770696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430528+0000","last_change":"2022-04-03T21:50:02.426029+0000","last_active":"2022-04-03T21:50:02.430528+0000","last_peered":"2022-04-03T21:50:02.430528+0000","last_clean":"2022-04-03T21:50:02.430528+0000","last_became_active":"2022-04-03T21:50:02.425589+0000","last_became_peered":"2022-04-03T21:50:02.425589+0000","last_unstale":"2022-04-03T21:50:02.430528+0000","last_undegraded":"2022-04-03T21:50:02.430528+0000","last_fullsized":"2022-04-03T21:50:02.430528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:38:10.958633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403666+0000","last_change":"2022-04-03T21:49:51.950513+0000","last_active":"2022-04-03T21:50:02.403666+0000","last_peered":"2022-04-03T21:50:02.403666+0000","last_clean":"2022-04-03T21:50:02.403666+0000","last_became_active":"2022-04-03T21:49:51.950013+0000","last_became_peered":"2022-04-03T21:49:51.950013+0000","last_unstale":"2022-04-03T21:50:02.403666+0000","last_undegraded":"2022-04-03T21:50:02.403666+0000","last_fullsized":"2022-04-03T21:50:02.403666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:08:28.113081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.422489+0000","last_change":"2022-04-03T21:49:57.874953+0000","last_active":"2022-04-03T21:50:02.422489+0000","last_peered":"2022-04-03T21:50:02.422489+0000","last_clean":"2022-04-03T21:50:02.422489+0000","last_became_active":"2022-04-03T21:49:57.874653+0000","last_became_peered":"2022-04-03T21:49:57.874653+0000","last_unstale":"2022-04-03T21:50:02.422489+0000","last_undegraded":"2022-04-03T21:50:02.422489+0000","last_fullsized":"2022-04-03T21:50:02.422489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:18:20.066652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410625+0000","last_change":"2022-04-03T21:49:58.405360+0000","last_active":"2022-04-03T21:50:02.410625+0000","last_peered":"2022-04-03T21:50:02.410625+0000","last_clean":"2022-04-03T21:50:02.410625+0000","last_became_active":"2022-04-03T21:49:58.405077+0000","last_became_peered":"2022-04-03T21:49:58.405077+0000","last_unstale":"2022-04-03T21:50:02.410625+0000","last_undegraded":"2022-04-03T21:50:02.410625+0000","last_fullsized":"2022-04-03T21:50:02.410625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:50:01.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436762+0000","last_change":"2022-04-03T21:50:02.431834+0000","last_active":"2022-04-03T21:50:02.436762+0000","last_peered":"2022-04-03T21:50:02.436762+0000","last_clean":"2022-04-03T21:50:02.436762+0000","last_became_active":"2022-04-03T21:50:02.431250+0000","last_became_peered":"2022-04-03T21:50:02.431250+0000","last_unstale":"2022-04-03T21:50:02.436762+0000","last_undegraded":"2022-04-03T21:50:02.436762+0000","last_fullsized":"2022-04-03T21:50:02.436762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:32:53.927418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401614+0000","last_change":"2022-04-03T21:49:51.825451+0000","last_active":"2022-04-03T21:50:02.401614+0000","last_peered":"2022-04-03T21:50:02.401614+0000","last_clean":"2022-04-03T21:50:02.401614+0000","last_became_active":"2022-04-03T21:49:51.825101+0000","last_became_peered":"2022-04-03T21:49:51.825101+0000","last_unstale":"2022-04-03T21:50:02.401614+0000","last_undegraded":"2022-04-03T21:50:02.401614+0000","last_fullsized":"2022-04-03T21:50:02.401614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:14:58.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401859+0000","last_change":"2022-04-03T21:49:57.855929+0000","last_active":"2022-04-03T21:50:02.401859+0000","last_peered":"2022-04-03T21:50:02.401859+0000","last_clean":"2022-04-03T21:50:02.401859+0000","last_became_active":"2022-04-03T21:49:57.855618+0000","last_became_peered":"2022-04-03T21:49:57.855618+0000","last_unstale":"2022-04-03T21:50:02.401859+0000","last_undegraded":"2022-04-03T21:50:02.401859+0000","last_fullsized":"2022-04-03T21:50:02.401859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:15.342644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415411+0000","last_change":"2022-04-03T21:49:58.422027+0000","last_active":"2022-04-03T21:50:02.415411+0000","last_peered":"2022-04-03T21:50:02.415411+0000","last_clean":"2022-04-03T21:50:02.415411+0000","last_became_active":"2022-04-03T21:49:58.421718+0000","last_became_peered":"2022-04-03T21:49:58.421718+0000","last_unstale":"2022-04-03T21:50:02.415411+0000","last_undegraded":"2022-04-03T21:50:02.415411+0000","last_fullsized":"2022-04-03T21:50:02.415411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:15:09.949180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442797+0000","last_change":"2022-04-03T21:50:02.432280+0000","last_active":"2022-04-03T21:50:02.442797+0000","last_peered":"2022-04-03T21:50:02.442797+0000","last_clean":"2022-04-03T21:50:02.442797+0000","last_became_active":"2022-04-03T21:50:02.431805+0000","last_became_peered":"2022-04-03T21:50:02.431805+0000","last_unstale":"2022-04-03T21:50:02.442797+0000","last_undegraded":"2022-04-03T21:50:02.442797+0000","last_fullsized":"2022-04-03T21:50:02.442797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:33.634032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403212+0000","last_change":"2022-04-03T21:49:51.824294+0000","last_active":"2022-04-03T21:50:02.403212+0000","last_peered":"2022-04-03T21:50:02.403212+0000","last_clean":"2022-04-03T21:50:02.403212+0000","last_became_active":"2022-04-03T21:49:51.823893+0000","last_became_peered":"2022-04-03T21:49:51.823893+0000","last_unstale":"2022-04-03T21:50:02.403212+0000","last_undegraded":"2022-04-03T21:50:02.403212+0000","last_fullsized":"2022-04-03T21:50:02.403212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:36:52.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411821+0000","last_change":"2022-04-03T21:49:43.747755+0000","last_active":"2022-04-03T21:50:02.411821+0000","last_peered":"2022-04-03T21:50:02.411821+0000","last_clean":"2022-04-03T21:50:02.411821+0000","last_became_active":"2022-04-03T21:49:43.747384+0000","last_became_peered":"2022-04-03T21:49:43.747384+0000","last_unstale":"2022-04-03T21:50:02.411821+0000","last_undegraded":"2022-04-03T21:50:02.411821+0000","last_fullsized":"2022-04-03T21:50:02.411821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_clean_scrub_stamp":"2022-04-03T21:49:42.736782+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:38:50.071231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405095+0000","last_change":"2022-04-03T21:49:57.873204+0000","last_active":"2022-04-03T21:50:02.405095+0000","last_peered":"2022-04-03T21:50:02.405095+0000","last_clean":"2022-04-03T21:50:02.405095+0000","last_became_active":"2022-04-03T21:49:57.872943+0000","last_became_peered":"2022-04-03T21:49:57.872943+0000","last_unstale":"2022-04-03T21:50:02.405095+0000","last_undegraded":"2022-04-03T21:50:02.405095+0000","last_fullsized":"2022-04-03T21:50:02.405095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:40:34.165717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403936+0000","last_change":"2022-04-03T21:49:58.421243+0000","last_active":"2022-04-03T21:50:02.403936+0000","last_peered":"2022-04-03T21:50:02.403936+0000","last_clean":"2022-04-03T21:50:02.403936+0000","last_became_active":"2022-04-03T21:49:58.420761+0000","last_became_peered":"2022-04-03T21:49:58.420761+0000","last_unstale":"2022-04-03T21:50:02.403936+0000","last_undegraded":"2022-04-03T21:50:02.403936+0000","last_fullsized":"2022-04-03T21:50:02.403936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:06:23.093381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429963+0000","last_change":"2022-04-03T21:50:02.424398+0000","last_active":"2022-04-03T21:50:02.429963+0000","last_peered":"2022-04-03T21:50:02.429963+0000","last_clean":"2022-04-03T21:50:02.429963+0000","last_became_active":"2022-04-03T21:50:02.423977+0000","last_became_peered":"2022-04-03T21:50:02.423977+0000","last_unstale":"2022-04-03T21:50:02.429963+0000","last_undegraded":"2022-04-03T21:50:02.429963+0000","last_fullsized":"2022-04-03T21:50:02.429963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:42:14.704158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402275+0000","last_change":"2022-04-03T21:49:51.825761+0000","last_active":"2022-04-03T21:50:02.402275+0000","last_peered":"2022-04-03T21:50:02.402275+0000","last_clean":"2022-04-03T21:50:02.402275+0000","last_became_active":"2022-04-03T21:49:51.825341+0000","last_became_peered":"2022-04-03T21:49:51.825341+0000","last_unstale":"2022-04-03T21:50:02.402275+0000","last_undegraded":"2022-04-03T21:50:02.402275+0000","last_fullsized":"2022-04-03T21:50:02.402275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:05:18.628185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410188+0000","last_change":"2022-04-03T21:49:57.873682+0000","last_active":"2022-04-03T21:50:02.410188+0000","last_peered":"2022-04-03T21:50:02.410188+0000","last_clean":"2022-04-03T21:50:02.410188+0000","last_became_active":"2022-04-03T21:49:57.873471+0000","last_became_peered":"2022-04-03T21:49:57.873471+0000","last_unstale":"2022-04-03T21:50:02.410188+0000","last_undegraded":"2022-04-03T21:50:02.410188+0000","last_fullsized":"2022-04-03T21:50:02.410188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:49:58.621137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402322+0000","last_change":"2022-04-03T21:49:58.400547+0000","last_active":"2022-04-03T21:50:02.402322+0000","last_peered":"2022-04-03T21:50:02.402322+0000","last_clean":"2022-04-03T21:50:02.402322+0000","last_became_active":"2022-04-03T21:49:58.399645+0000","last_became_peered":"2022-04-03T21:49:58.399645+0000","last_unstale":"2022-04-03T21:50:02.402322+0000","last_undegraded":"2022-04-03T21:50:02.402322+0000","last_fullsized":"2022-04-03T21:50:02.402322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:11:49.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443304+0000","last_change":"2022-04-03T21:50:02.441051+0000","last_active":"2022-04-03T21:50:02.443304+0000","last_peered":"2022-04-03T21:50:02.443304+0000","last_clean":"2022-04-03T21:50:02.443304+0000","last_became_active":"2022-04-03T21:50:02.440145+0000","last_became_peered":"2022-04-03T21:50:02.440145+0000","last_unstale":"2022-04-03T21:50:02.443304+0000","last_undegraded":"2022-04-03T21:50:02.443304+0000","last_fullsized":"2022-04-03T21:50:02.443304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:48.125856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403762+0000","last_change":"2022-04-03T21:49:51.823192+0000","last_active":"2022-04-03T21:50:02.403762+0000","last_peered":"2022-04-03T21:50:02.403762+0000","last_clean":"2022-04-03T21:50:02.403762+0000","last_became_active":"2022-04-03T21:49:51.822812+0000","last_became_peered":"2022-04-03T21:49:51.822812+0000","last_unstale":"2022-04-03T21:50:02.403762+0000","last_undegraded":"2022-04-03T21:50:02.403762+0000","last_fullsized":"2022-04-03T21:50:02.403762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:56:34.679337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415772+0000","last_change":"2022-04-03T21:49:57.860388+0000","last_active":"2022-04-03T21:50:02.415772+0000","last_peered":"2022-04-03T21:50:02.415772+0000","last_clean":"2022-04-03T21:50:02.415772+0000","last_became_active":"2022-04-03T21:49:57.860088+0000","last_became_peered":"2022-04-03T21:49:57.860088+0000","last_unstale":"2022-04-03T21:50:02.415772+0000","last_undegraded":"2022-04-03T21:50:02.415772+0000","last_fullsized":"2022-04-03T21:50:02.415772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:52:22.536814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414020+0000","last_change":"2022-04-03T21:49:58.422161+0000","last_active":"2022-04-03T21:50:02.414020+0000","last_peered":"2022-04-03T21:50:02.414020+0000","last_clean":"2022-04-03T21:50:02.414020+0000","last_became_active":"2022-04-03T21:49:58.421791+0000","last_became_peered":"2022-04-03T21:49:58.421791+0000","last_unstale":"2022-04-03T21:50:02.414020+0000","last_undegraded":"2022-04-03T21:50:02.414020+0000","last_fullsized":"2022-04-03T21:50:02.414020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:16.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430144+0000","last_change":"2022-04-03T21:50:02.421849+0000","last_active":"2022-04-03T21:50:02.430144+0000","last_peered":"2022-04-03T21:50:02.430144+0000","last_clean":"2022-04-03T21:50:02.430144+0000","last_became_active":"2022-04-03T21:50:02.421341+0000","last_became_peered":"2022-04-03T21:50:02.421341+0000","last_unstale":"2022-04-03T21:50:02.430144+0000","last_undegraded":"2022-04-03T21:50:02.430144+0000","last_fullsized":"2022-04-03T21:50:02.430144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:27:53.495587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409689+0000","last_change":"2022-04-03T21:49:57.863910+0000","last_active":"2022-04-03T21:50:02.409689+0000","last_peered":"2022-04-03T21:50:02.409689+0000","last_clean":"2022-04-03T21:50:02.409689+0000","last_became_active":"2022-04-03T21:49:57.863574+0000","last_became_peered":"2022-04-03T21:49:57.863574+0000","last_unstale":"2022-04-03T21:50:02.409689+0000","last_undegraded":"2022-04-03T21:50:02.409689+0000","last_fullsized":"2022-04-03T21:50:02.409689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:13:36.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410534+0000","last_change":"2022-04-03T21:49:52.057999+0000","last_active":"2022-04-03T21:50:02.410534+0000","last_peered":"2022-04-03T21:50:02.410534+0000","last_clean":"2022-04-03T21:50:02.410534+0000","last_became_active":"2022-04-03T21:49:52.057739+0000","last_became_peered":"2022-04-03T21:49:52.057739+0000","last_unstale":"2022-04-03T21:50:02.410534+0000","last_undegraded":"2022-04-03T21:50:02.410534+0000","last_fullsized":"2022-04-03T21:50:02.410534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:44:05.676474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405131+0000","last_change":"2022-04-03T21:49:58.412468+0000","last_active":"2022-04-03T21:50:02.405131+0000","last_peered":"2022-04-03T21:50:02.405131+0000","last_clean":"2022-04-03T21:50:02.405131+0000","last_became_active":"2022-04-03T21:49:58.412157+0000","last_became_peered":"2022-04-03T21:49:58.412157+0000","last_unstale":"2022-04-03T21:50:02.405131+0000","last_undegraded":"2022-04-03T21:50:02.405131+0000","last_fullsized":"2022-04-03T21:50:02.405131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:22.481343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.418110+0000","last_change":"2022-04-03T21:50:02.416690+0000","last_active":"2022-04-03T21:50:02.418110+0000","last_peered":"2022-04-03T21:50:02.418110+0000","last_clean":"2022-04-03T21:50:02.418110+0000","last_became_active":"2022-04-03T21:50:02.416202+0000","last_became_peered":"2022-04-03T21:50:02.416202+0000","last_unstale":"2022-04-03T21:50:02.418110+0000","last_undegraded":"2022-04-03T21:50:02.418110+0000","last_fullsized":"2022-04-03T21:50:02.418110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:35:47.291508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403609+0000","last_change":"2022-04-03T21:49:52.058292+0000","last_active":"2022-04-03T21:50:02.403609+0000","last_peered":"2022-04-03T21:50:02.403609+0000","last_clean":"2022-04-03T21:50:02.403609+0000","last_became_active":"2022-04-03T21:49:52.057769+0000","last_became_peered":"2022-04-03T21:49:52.057769+0000","last_unstale":"2022-04-03T21:50:02.403609+0000","last_undegraded":"2022-04-03T21:50:02.403609+0000","last_fullsized":"2022-04-03T21:50:02.403609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:10:19.197449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410357+0000","last_change":"2022-04-03T21:49:57.858802+0000","last_active":"2022-04-03T21:50:02.410357+0000","last_peered":"2022-04-03T21:50:02.410357+0000","last_clean":"2022-04-03T21:50:02.410357+0000","last_became_active":"2022-04-03T21:49:57.858491+0000","last_became_peered":"2022-04-03T21:49:57.858491+0000","last_unstale":"2022-04-03T21:50:02.410357+0000","last_undegraded":"2022-04-03T21:50:02.410357+0000","last_fullsized":"2022-04-03T21:50:02.410357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:18:02.365918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409115+0000","last_change":"2022-04-03T21:49:58.400587+0000","last_active":"2022-04-03T21:50:02.409115+0000","last_peered":"2022-04-03T21:50:02.409115+0000","last_clean":"2022-04-03T21:50:02.409115+0000","last_became_active":"2022-04-03T21:49:58.400277+0000","last_became_peered":"2022-04-03T21:49:58.400277+0000","last_unstale":"2022-04-03T21:50:02.409115+0000","last_undegraded":"2022-04-03T21:50:02.409115+0000","last_fullsized":"2022-04-03T21:50:02.409115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:17:55.722041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428327+0000","last_change":"2022-04-03T21:50:02.424828+0000","last_active":"2022-04-03T21:50:02.428327+0000","last_peered":"2022-04-03T21:50:02.428327+0000","last_clean":"2022-04-03T21:50:02.428327+0000","last_became_active":"2022-04-03T21:50:02.424406+0000","last_became_peered":"2022-04-03T21:50:02.424406+0000","last_unstale":"2022-04-03T21:50:02.428327+0000","last_undegraded":"2022-04-03T21:50:02.428327+0000","last_fullsized":"2022-04-03T21:50:02.428327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:45.759593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405778+0000","last_change":"2022-04-03T21:49:57.870766+0000","last_active":"2022-04-03T21:50:02.405778+0000","last_peered":"2022-04-03T21:50:02.405778+0000","last_clean":"2022-04-03T21:50:02.405778+0000","last_became_active":"2022-04-03T21:49:57.870481+0000","last_became_peered":"2022-04-03T21:49:57.870481+0000","last_unstale":"2022-04-03T21:50:02.405778+0000","last_undegraded":"2022-04-03T21:50:02.405778+0000","last_fullsized":"2022-04-03T21:50:02.405778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:17.100943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406335+0000","last_change":"2022-04-03T21:49:58.402346+0000","last_active":"2022-04-03T21:50:02.406335+0000","last_peered":"2022-04-03T21:50:02.406335+0000","last_clean":"2022-04-03T21:50:02.406335+0000","last_became_active":"2022-04-03T21:49:58.401964+0000","last_became_peered":"2022-04-03T21:49:58.401964+0000","last_unstale":"2022-04-03T21:50:02.406335+0000","last_undegraded":"2022-04-03T21:50:02.406335+0000","last_fullsized":"2022-04-03T21:50:02.406335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:15:23.150292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442587+0000","last_change":"2022-04-03T21:50:02.436307+0000","last_active":"2022-04-03T21:50:02.442587+0000","last_peered":"2022-04-03T21:50:02.442587+0000","last_clean":"2022-04-03T21:50:02.442587+0000","last_became_active":"2022-04-03T21:50:02.435842+0000","last_became_peered":"2022-04-03T21:50:02.435842+0000","last_unstale":"2022-04-03T21:50:02.442587+0000","last_undegraded":"2022-04-03T21:50:02.442587+0000","last_fullsized":"2022-04-03T21:50:02.442587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:28:23.964940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413356+0000","last_change":"2022-04-03T21:49:57.873350+0000","last_active":"2022-04-03T21:50:02.413356+0000","last_peered":"2022-04-03T21:50:02.413356+0000","last_clean":"2022-04-03T21:50:02.413356+0000","last_became_active":"2022-04-03T21:49:57.873001+0000","last_became_peered":"2022-04-03T21:49:57.873001+0000","last_unstale":"2022-04-03T21:50:02.413356+0000","last_undegraded":"2022-04-03T21:50:02.413356+0000","last_fullsized":"2022-04-03T21:50:02.413356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:38:09.203088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410774+0000","last_change":"2022-04-03T21:49:58.415091+0000","last_active":"2022-04-03T21:50:02.410774+0000","last_peered":"2022-04-03T21:50:02.410774+0000","last_clean":"2022-04-03T21:50:02.410774+0000","last_became_active":"2022-04-03T21:49:58.414804+0000","last_became_peered":"2022-04-03T21:49:58.414804+0000","last_unstale":"2022-04-03T21:50:02.410774+0000","last_undegraded":"2022-04-03T21:50:02.410774+0000","last_fullsized":"2022-04-03T21:50:02.410774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:32:09.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436838+0000","last_change":"2022-04-03T21:50:02.431066+0000","last_active":"2022-04-03T21:50:02.436838+0000","last_peered":"2022-04-03T21:50:02.436838+0000","last_clean":"2022-04-03T21:50:02.436838+0000","last_became_active":"2022-04-03T21:50:02.430674+0000","last_became_peered":"2022-04-03T21:50:02.430674+0000","last_unstale":"2022-04-03T21:50:02.436838+0000","last_undegraded":"2022-04-03T21:50:02.436838+0000","last_fullsized":"2022-04-03T21:50:02.436838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:55:33.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403806+0000","last_change":"2022-04-03T21:49:57.878346+0000","last_active":"2022-04-03T21:50:02.403806+0000","last_peered":"2022-04-03T21:50:02.403806+0000","last_clean":"2022-04-03T21:50:02.403806+0000","last_became_active":"2022-04-03T21:49:57.877994+0000","last_became_peered":"2022-04-03T21:49:57.877994+0000","last_unstale":"2022-04-03T21:50:02.403806+0000","last_undegraded":"2022-04-03T21:50:02.403806+0000","last_fullsized":"2022-04-03T21:50:02.403806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:59:05.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413728+0000","last_change":"2022-04-03T21:49:58.402592+0000","last_active":"2022-04-03T21:50:02.413728+0000","last_peered":"2022-04-03T21:50:02.413728+0000","last_clean":"2022-04-03T21:50:02.413728+0000","last_became_active":"2022-04-03T21:49:58.402288+0000","last_became_peered":"2022-04-03T21:49:58.402288+0000","last_unstale":"2022-04-03T21:50:02.413728+0000","last_undegraded":"2022-04-03T21:50:02.413728+0000","last_fullsized":"2022-04-03T21:50:02.413728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:06:07.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442588+0000","last_change":"2022-04-03T21:50:02.434794+0000","last_active":"2022-04-03T21:50:02.442588+0000","last_peered":"2022-04-03T21:50:02.442588+0000","last_clean":"2022-04-03T21:50:02.442588+0000","last_became_active":"2022-04-03T21:50:02.434307+0000","last_became_peered":"2022-04-03T21:50:02.434307+0000","last_unstale":"2022-04-03T21:50:02.442588+0000","last_undegraded":"2022-04-03T21:50:02.442588+0000","last_fullsized":"2022-04-03T21:50:02.442588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:05:48.587273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402186+0000","last_change":"2022-04-03T21:49:57.872939+0000","last_active":"2022-04-03T21:50:02.402186+0000","last_peered":"2022-04-03T21:50:02.402186+0000","last_clean":"2022-04-03T21:50:02.402186+0000","last_became_active":"2022-04-03T21:49:57.872688+0000","last_became_peered":"2022-04-03T21:49:57.872688+0000","last_unstale":"2022-04-03T21:50:02.402186+0000","last_undegraded":"2022-04-03T21:50:02.402186+0000","last_fullsized":"2022-04-03T21:50:02.402186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:19:57.738611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401722+0000","last_change":"2022-04-03T21:49:58.405063+0000","last_active":"2022-04-03T21:50:02.401722+0000","last_peered":"2022-04-03T21:50:02.401722+0000","last_clean":"2022-04-03T21:50:02.401722+0000","last_became_active":"2022-04-03T21:49:58.404738+0000","last_became_peered":"2022-04-03T21:49:58.404738+0000","last_unstale":"2022-04-03T21:50:02.401722+0000","last_undegraded":"2022-04-03T21:50:02.401722+0000","last_fullsized":"2022-04-03T21:50:02.401722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:14:24.585390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436350+0000","last_change":"2022-04-03T21:50:02.429562+0000","last_active":"2022-04-03T21:50:02.436350+0000","last_peered":"2022-04-03T21:50:02.436350+0000","last_clean":"2022-04-03T21:50:02.436350+0000","last_became_active":"2022-04-03T21:50:02.429153+0000","last_became_peered":"2022-04-03T21:50:02.429153+0000","last_unstale":"2022-04-03T21:50:02.436350+0000","last_undegraded":"2022-04-03T21:50:02.436350+0000","last_fullsized":"2022-04-03T21:50:02.436350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:23:56.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402210+0000","last_change":"2022-04-03T21:49:57.865475+0000","last_active":"2022-04-03T21:50:02.402210+0000","last_peered":"2022-04-03T21:50:02.402210+0000","last_clean":"2022-04-03T21:50:02.402210+0000","last_became_active":"2022-04-03T21:49:57.865147+0000","last_became_peered":"2022-04-03T21:49:57.865147+0000","last_unstale":"2022-04-03T21:50:02.402210+0000","last_undegraded":"2022-04-03T21:50:02.402210+0000","last_fullsized":"2022-04-03T21:50:02.402210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:47:33.277925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411366+0000","last_change":"2022-04-03T21:49:58.407938+0000","last_active":"2022-04-03T21:50:02.411366+0000","last_peered":"2022-04-03T21:50:02.411366+0000","last_clean":"2022-04-03T21:50:02.411366+0000","last_became_active":"2022-04-03T21:49:58.407645+0000","last_became_peered":"2022-04-03T21:49:58.407645+0000","last_unstale":"2022-04-03T21:50:02.411366+0000","last_undegraded":"2022-04-03T21:50:02.411366+0000","last_fullsized":"2022-04-03T21:50:02.411366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:26:23.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411975+0000","last_change":"2022-04-03T21:49:58.417116+0000","last_active":"2022-04-03T21:50:02.411975+0000","last_peered":"2022-04-03T21:50:02.411975+0000","last_clean":"2022-04-03T21:50:02.411975+0000","last_became_active":"2022-04-03T21:49:58.416601+0000","last_became_peered":"2022-04-03T21:49:58.416601+0000","last_unstale":"2022-04-03T21:50:02.411975+0000","last_undegraded":"2022-04-03T21:50:02.411975+0000","last_fullsized":"2022-04-03T21:50:02.411975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:48:21.551919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410282+0000","last_change":"2022-04-03T21:49:58.406506+0000","last_active":"2022-04-03T21:50:02.410282+0000","last_peered":"2022-04-03T21:50:02.410282+0000","last_clean":"2022-04-03T21:50:02.410282+0000","last_became_active":"2022-04-03T21:49:58.406217+0000","last_became_peered":"2022-04-03T21:49:58.406217+0000","last_unstale":"2022-04-03T21:50:02.410282+0000","last_undegraded":"2022-04-03T21:50:02.410282+0000","last_fullsized":"2022-04-03T21:50:02.410282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:24:30.050855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421819+0000","last_change":"2022-04-03T21:49:58.424077+0000","last_active":"2022-04-03T21:50:02.421819+0000","last_peered":"2022-04-03T21:50:02.421819+0000","last_clean":"2022-04-03T21:50:02.421819+0000","last_became_active":"2022-04-03T21:49:58.423709+0000","last_became_peered":"2022-04-03T21:49:58.423709+0000","last_unstale":"2022-04-03T21:50:02.421819+0000","last_undegraded":"2022-04-03T21:50:02.421819+0000","last_fullsized":"2022-04-03T21:50:02.421819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:55:52.787385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402780+0000","last_change":"2022-04-03T21:49:58.419515+0000","last_active":"2022-04-03T21:50:02.402780+0000","last_peered":"2022-04-03T21:50:02.402780+0000","last_clean":"2022-04-03T21:50:02.402780+0000","last_became_active":"2022-04-03T21:49:58.419270+0000","last_became_peered":"2022-04-03T21:49:58.419270+0000","last_unstale":"2022-04-03T21:50:02.402780+0000","last_undegraded":"2022-04-03T21:50:02.402780+0000","last_fullsized":"2022-04-03T21:50:02.402780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:06:28.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403437+0000","last_change":"2022-04-03T21:49:58.402164+0000","last_active":"2022-04-03T21:50:02.403437+0000","last_peered":"2022-04-03T21:50:02.403437+0000","last_clean":"2022-04-03T21:50:02.403437+0000","last_became_active":"2022-04-03T21:49:58.401871+0000","last_became_peered":"2022-04-03T21:49:58.401871+0000","last_unstale":"2022-04-03T21:50:02.403437+0000","last_undegraded":"2022-04-03T21:50:02.403437+0000","last_fullsized":"2022-04-03T21:50:02.403437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:30:03.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4530,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476746,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":125436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9148,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362692,"statfs":{"total":96636764160,"available":96627396608,"internally_reserved":0,"allocated":839680,"data_stored":651170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9140,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362700,"statfs":{"total":96636764160,"available":96627404800,"internally_reserved":0,"allocated":831488,"data_stored":651078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":121674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8040,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363800,"statfs":{"total":96636764160,"available":96628531200,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":121730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-03T21:50:20.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-03T21:50:20.580 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.578+0000 7f8719e85700 1 Processor -- start 2022-04-03T21:50:20.580 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.578+0000 7f8719e85700 1 -- start start 2022-04-03T21:50:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.579+0000 7f8719e85700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f87140a73e0 0x7f8714156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.579+0000 7f8719e85700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140bda50 con 0x7f87140c2300 2022-04-03T21:50:20.582 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.579+0000 7f8719e85700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140bcd00 con 0x7f87140c1f30 2022-04-03T21:50:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.579+0000 7f8719e85700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140bca90 con 0x7f87140a73e0 2022-04-03T21:50:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f87137fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f87140c1f30 0x7f87140a4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47400/0 (socket says 172.21.15.49:47400) 2022-04-03T21:50:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f87137fe700 1 -- 172.21.15.49:0/3302446395 learned_addr learned my addr 172.21.15.49:0/3302446395 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f8713fff700 1 --2- 172.21.15.49:0/3302446395 >> v2:172.21.15.49:3300/0 conn(0x7f87140a73e0 0x7f8714156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.583 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225977431 0 0) 0x7f87140bcd00 con 0x7f87140c1f30 2022-04-03T21:50:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87000033f0 con 0x7f87140c1f30 2022-04-03T21:50:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276225137 0 0) 0x7f87140bda50 con 0x7f87140c2300 2022-04-03T21:50:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87140bcd00 con 0x7f87140c2300 2022-04-03T21:50:20.584 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f8713fff700 1 -- 172.21.15.49:0/3302446395 >> v1:172.21.15.117:6789/0 conn(0x7f87140c1f30 legacy=0x7f87140a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f8713fff700 1 -- 172.21.15.49:0/3302446395 >> v1:172.21.15.49:6789/0 conn(0x7f87140c2300 legacy=0x7f871414b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.585 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.580+0000 7f8713fff700 1 -- 172.21.15.49:0/3302446395 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140a4860 con 0x7f87140a73e0 2022-04-03T21:50:20.588 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.581+0000 7f8713fff700 1 --2- 172.21.15.49:0/3302446395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140a73e0 0x7f8714156b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f870c009e60 tx=0x7f870c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc090e8f7d4f6d3 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.581+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00e070 con 0x7f87140a73e0 2022-04-03T21:50:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.581+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00bab0 con 0x7f87140a73e0 2022-04-03T21:50:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.581+0000 7f87127fc700 1 -- 172.21.15.49:0/3302446395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00be70 con 0x7f87140a73e0 2022-04-03T21:50:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 -- 172.21.15.49:0/3302446395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140a73e0 msgr2=0x7f8714156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.589 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 --2- 172.21.15.49:0/3302446395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140a73e0 0x7f8714156b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f870c009e60 tx=0x7f870c009780 comp rx=0 tx=0).stop 2022-04-03T21:50:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 -- 172.21.15.49:0/3302446395 shutdown_connections 2022-04-03T21:50:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 --2- 172.21.15.49:0/3302446395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140a73e0 0x7f8714156b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 -- 172.21.15.49:0/3302446395 >> 172.21.15.49:0/3302446395 conn(0x7f871405dfd0 msgr2=0x7f87140c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:20.590 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 -- 172.21.15.49:0/3302446395 shutdown_connections 2022-04-03T21:50:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.582+0000 7f8719e85700 1 -- 172.21.15.49:0/3302446395 wait complete. 2022-04-03T21:50:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.583+0000 7f8719e85700 1 Processor -- start 2022-04-03T21:50:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.584+0000 7f8719e85700 1 -- start start 2022-04-03T21:50:20.591 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.584+0000 7f8719e85700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 0x7f871414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.584+0000 7f8719e85700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140c1f30 0x7f871415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8719e85700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 0x7f871415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8719e85700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140bdf60 con 0x7f87140c1f30 2022-04-03T21:50:20.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8719e85700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8714097680 con 0x7f87140a73e0 2022-04-03T21:50:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8719e85700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871415dfc0 con 0x7f87140c2300 2022-04-03T21:50:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f87137fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 0x7f871414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8713fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 0x7f871415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8712ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140c1f30 0x7f871415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8713fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 0x7f871415e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45772/0 (socket says 172.21.15.49:45772) 2022-04-03T21:50:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8713fff700 1 -- 172.21.15.49:0/3848653699 learned_addr learned my addr 172.21.15.49:0/3848653699 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f87137fe700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 0x7f871414a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35378/0 (socket says 172.21.15.49:35378) 2022-04-03T21:50:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8712ffd700 1 -- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 msgr2=0x7f871415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.594 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8712ffd700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 0x7f871415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8712ffd700 1 -- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 msgr2=0x7f871414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.585+0000 7f8712ffd700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 0x7f871414a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f8712ffd700 1 -- 172.21.15.49:0/3848653699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c009a20 con 0x7f87140c1f30 2022-04-03T21:50:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f87137fe700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 0x7f871414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:20.595 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f8713fff700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 0x7f871415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f8712ffd700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140c1f30 0x7f871415e220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f870800c410 tx=0x7f8708007bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080050d0 con 0x7f87140c1f30 2022-04-03T21:50:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708005250 con 0x7f87140c1f30 2022-04-03T21:50:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080053c0 con 0x7f87140c1f30 2022-04-03T21:50:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8714097280 con 0x7f87140c1f30 2022-04-03T21:50:20.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.586+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871415daa0 con 0x7f87140c1f30 2022-04-03T21:50:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.587+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8714070a20 con 0x7f87140c1f30 2022-04-03T21:50:20.598 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.588+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f8708019030 con 0x7f87140c1f30 2022-04-03T21:50:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.589+0000 7f86fb7fe700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f86f4063d10 0x7f86f40661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.589+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f870807f9f0 con 0x7f87140c1f30 2022-04-03T21:50:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.589+0000 7f87137fe700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f86f4063d10 0x7f86f40661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.590+0000 7f87137fe700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f86f4063d10 0x7f86f40661c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8704007fd0 tx=0x7f8704009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:20.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.593+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f8708081e60 con 0x7f87140c1f30 2022-04-03T21:50:20.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.798+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 --> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f871415daa0 con 0x7f86f4063d10 2022-04-03T21:50:20.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.809+0000 7f86fb7fe700 1 -- 172.21.15.49:0/3848653699 <== mgr.4101 v2:172.21.15.117:6832/26568 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+364876 (secure 0 0 0) 0x7f871415daa0 con 0x7f86f4063d10 2022-04-03T21:50:20.816 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f86f4063d10 msgr2=0x7f86f40661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f86f4063d10 0x7f86f40661c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8704007fd0 tx=0x7f8704009040 comp rx=0 tx=0).stop 2022-04-03T21:50:20.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140c1f30 msgr2=0x7f871415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:20.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140c1f30 0x7f871415e220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f870800c410 tx=0x7f8708007bb0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 shutdown_connections 2022-04-03T21:50:20.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f86f4063d10 0x7f86f40661c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140c2300 0x7f871415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87140a73e0 0x7f871414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 --2- 172.21.15.49:0/3848653699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87140c1f30 0x7f871415e220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:20.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.814+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 >> 172.21.15.49:0/3848653699 conn(0x7f871405dfd0 msgr2=0x7f87140bf540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:20.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.815+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 shutdown_connections 2022-04-03T21:50:20.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:20.815+0000 7f8719e85700 1 -- 172.21.15.49:0/3848653699 wait complete. 2022-04-03T21:50:20.822 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2022-04-03T21:50:20.841 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2022-04-03T21:50:20.093702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594898,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66960,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":63488,"kb_avail":754907760,"statfs":{"total":773094113280,"available":773025546240,"internally_reserved":0,"allocated":3489792,"data_stored":2039588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65011712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2200,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003863"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402622+0000","last_change":"2022-04-03T21:49:58.414058+0000","last_active":"2022-04-03T21:50:02.402622+0000","last_peered":"2022-04-03T21:50:02.402622+0000","last_clean":"2022-04-03T21:50:02.402622+0000","last_became_active":"2022-04-03T21:49:58.413775+0000","last_became_peered":"2022-04-03T21:49:58.413775+0000","last_unstale":"2022-04-03T21:50:02.402622+0000","last_undegraded":"2022-04-03T21:50:02.402622+0000","last_fullsized":"2022-04-03T21:50:02.402622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:53.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408368+0000","last_change":"2022-04-03T21:49:58.409713+0000","last_active":"2022-04-03T21:50:02.408368+0000","last_peered":"2022-04-03T21:50:02.408368+0000","last_clean":"2022-04-03T21:50:02.408368+0000","last_became_active":"2022-04-03T21:49:58.409410+0000","last_became_peered":"2022-04-03T21:49:58.409410+0000","last_unstale":"2022-04-03T21:50:02.408368+0000","last_undegraded":"2022-04-03T21:50:02.408368+0000","last_fullsized":"2022-04-03T21:50:02.408368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:10.539087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421211+0000","last_change":"2022-04-03T21:49:58.422325+0000","last_active":"2022-04-03T21:50:02.421211+0000","last_peered":"2022-04-03T21:50:02.421211+0000","last_clean":"2022-04-03T21:50:02.421211+0000","last_became_active":"2022-04-03T21:49:58.422026+0000","last_became_peered":"2022-04-03T21:49:58.422026+0000","last_unstale":"2022-04-03T21:50:02.421211+0000","last_undegraded":"2022-04-03T21:50:02.421211+0000","last_fullsized":"2022-04-03T21:50:02.421211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:09:11.502569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421334+0000","last_change":"2022-04-03T21:49:58.423449+0000","last_active":"2022-04-03T21:50:02.421334+0000","last_peered":"2022-04-03T21:50:02.421334+0000","last_clean":"2022-04-03T21:50:02.421334+0000","last_became_active":"2022-04-03T21:49:58.423128+0000","last_became_peered":"2022-04-03T21:49:58.423128+0000","last_unstale":"2022-04-03T21:50:02.421334+0000","last_undegraded":"2022-04-03T21:50:02.421334+0000","last_fullsized":"2022-04-03T21:50:02.421334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:02:31.777504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405877+0000","last_change":"2022-04-03T21:49:58.416006+0000","last_active":"2022-04-03T21:50:02.405877+0000","last_peered":"2022-04-03T21:50:02.405877+0000","last_clean":"2022-04-03T21:50:02.405877+0000","last_became_active":"2022-04-03T21:49:58.415782+0000","last_became_peered":"2022-04-03T21:49:58.415782+0000","last_unstale":"2022-04-03T21:50:02.405877+0000","last_undegraded":"2022-04-03T21:50:02.405877+0000","last_fullsized":"2022-04-03T21:50:02.405877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:27:40.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403571+0000","last_change":"2022-04-03T21:49:58.399107+0000","last_active":"2022-04-03T21:50:02.403571+0000","last_peered":"2022-04-03T21:50:02.403571+0000","last_clean":"2022-04-03T21:50:02.403571+0000","last_became_active":"2022-04-03T21:49:58.398700+0000","last_became_peered":"2022-04-03T21:49:58.398700+0000","last_unstale":"2022-04-03T21:50:02.403571+0000","last_undegraded":"2022-04-03T21:50:02.403571+0000","last_fullsized":"2022-04-03T21:50:02.403571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:39:58.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402584+0000","last_change":"2022-04-03T21:49:58.424480+0000","last_active":"2022-04-03T21:50:02.402584+0000","last_peered":"2022-04-03T21:50:02.402584+0000","last_clean":"2022-04-03T21:50:02.402584+0000","last_became_active":"2022-04-03T21:49:58.424164+0000","last_became_peered":"2022-04-03T21:49:58.424164+0000","last_unstale":"2022-04-03T21:50:02.402584+0000","last_undegraded":"2022-04-03T21:50:02.402584+0000","last_fullsized":"2022-04-03T21:50:02.402584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:05:12.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412069+0000","last_change":"2022-04-03T21:49:58.425384+0000","last_active":"2022-04-03T21:50:02.412069+0000","last_peered":"2022-04-03T21:50:02.412069+0000","last_clean":"2022-04-03T21:50:02.412069+0000","last_became_active":"2022-04-03T21:49:58.425084+0000","last_became_peered":"2022-04-03T21:49:58.425084+0000","last_unstale":"2022-04-03T21:50:02.412069+0000","last_undegraded":"2022-04-03T21:50:02.412069+0000","last_fullsized":"2022-04-03T21:50:02.412069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:38.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411107+0000","last_change":"2022-04-03T21:49:58.415591+0000","last_active":"2022-04-03T21:50:02.411107+0000","last_peered":"2022-04-03T21:50:02.411107+0000","last_clean":"2022-04-03T21:50:02.411107+0000","last_became_active":"2022-04-03T21:49:58.415264+0000","last_became_peered":"2022-04-03T21:49:58.415264+0000","last_unstale":"2022-04-03T21:50:02.411107+0000","last_undegraded":"2022-04-03T21:50:02.411107+0000","last_fullsized":"2022-04-03T21:50:02.411107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:26:23.919459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411177+0000","last_change":"2022-04-03T21:49:58.415930+0000","last_active":"2022-04-03T21:50:02.411177+0000","last_peered":"2022-04-03T21:50:02.411177+0000","last_clean":"2022-04-03T21:50:02.411177+0000","last_became_active":"2022-04-03T21:49:58.415597+0000","last_became_peered":"2022-04-03T21:49:58.415597+0000","last_unstale":"2022-04-03T21:50:02.411177+0000","last_undegraded":"2022-04-03T21:50:02.411177+0000","last_fullsized":"2022-04-03T21:50:02.411177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:31:01.030066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409971+0000","last_change":"2022-04-03T21:49:58.425355+0000","last_active":"2022-04-03T21:50:02.409971+0000","last_peered":"2022-04-03T21:50:02.409971+0000","last_clean":"2022-04-03T21:50:02.409971+0000","last_became_active":"2022-04-03T21:49:58.425029+0000","last_became_peered":"2022-04-03T21:49:58.425029+0000","last_unstale":"2022-04-03T21:50:02.409971+0000","last_undegraded":"2022-04-03T21:50:02.409971+0000","last_fullsized":"2022-04-03T21:50:02.409971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:00:14.843110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403539+0000","last_change":"2022-04-03T21:49:58.399698+0000","last_active":"2022-04-03T21:50:02.403539+0000","last_peered":"2022-04-03T21:50:02.403539+0000","last_clean":"2022-04-03T21:50:02.403539+0000","last_became_active":"2022-04-03T21:49:58.399040+0000","last_became_peered":"2022-04-03T21:49:58.399040+0000","last_unstale":"2022-04-03T21:50:02.403539+0000","last_undegraded":"2022-04-03T21:50:02.403539+0000","last_fullsized":"2022-04-03T21:50:02.403539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:27.438020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413919+0000","last_change":"2022-04-03T21:49:58.411470+0000","last_active":"2022-04-03T21:50:02.413919+0000","last_peered":"2022-04-03T21:50:02.413919+0000","last_clean":"2022-04-03T21:50:02.413919+0000","last_became_active":"2022-04-03T21:49:58.411181+0000","last_became_peered":"2022-04-03T21:49:58.411181+0000","last_unstale":"2022-04-03T21:50:02.413919+0000","last_undegraded":"2022-04-03T21:50:02.413919+0000","last_fullsized":"2022-04-03T21:50:02.413919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:12:21.980416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414197+0000","last_change":"2022-04-03T21:49:58.419342+0000","last_active":"2022-04-03T21:50:02.414197+0000","last_peered":"2022-04-03T21:50:02.414197+0000","last_clean":"2022-04-03T21:50:02.414197+0000","last_became_active":"2022-04-03T21:49:58.418928+0000","last_became_peered":"2022-04-03T21:49:58.418928+0000","last_unstale":"2022-04-03T21:50:02.414197+0000","last_undegraded":"2022-04-03T21:50:02.414197+0000","last_fullsized":"2022-04-03T21:50:02.414197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:02:42.663277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421690+0000","last_change":"2022-04-03T21:49:58.418714+0000","last_active":"2022-04-03T21:50:02.421690+0000","last_peered":"2022-04-03T21:50:02.421690+0000","last_clean":"2022-04-03T21:50:02.421690+0000","last_became_active":"2022-04-03T21:49:58.418401+0000","last_became_peered":"2022-04-03T21:49:58.418401+0000","last_unstale":"2022-04-03T21:50:02.421690+0000","last_undegraded":"2022-04-03T21:50:02.421690+0000","last_fullsized":"2022-04-03T21:50:02.421690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:34:59.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402148+0000","last_change":"2022-04-03T21:49:58.399093+0000","last_active":"2022-04-03T21:50:02.402148+0000","last_peered":"2022-04-03T21:50:02.402148+0000","last_clean":"2022-04-03T21:50:02.402148+0000","last_became_active":"2022-04-03T21:49:58.398799+0000","last_became_peered":"2022-04-03T21:49:58.398799+0000","last_unstale":"2022-04-03T21:50:02.402148+0000","last_undegraded":"2022-04-03T21:50:02.402148+0000","last_fullsized":"2022-04-03T21:50:02.402148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:49:12.002614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402064+0000","last_change":"2022-04-03T21:49:58.405030+0000","last_active":"2022-04-03T21:50:02.402064+0000","last_peered":"2022-04-03T21:50:02.402064+0000","last_clean":"2022-04-03T21:50:02.402064+0000","last_became_active":"2022-04-03T21:49:58.404727+0000","last_became_peered":"2022-04-03T21:49:58.404727+0000","last_unstale":"2022-04-03T21:50:02.402064+0000","last_undegraded":"2022-04-03T21:50:02.402064+0000","last_fullsized":"2022-04-03T21:50:02.402064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:36:14.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428065+0000","last_change":"2022-04-03T21:49:58.431718+0000","last_active":"2022-04-03T21:50:02.428065+0000","last_peered":"2022-04-03T21:50:02.428065+0000","last_clean":"2022-04-03T21:50:02.428065+0000","last_became_active":"2022-04-03T21:49:58.430872+0000","last_became_peered":"2022-04-03T21:49:58.430872+0000","last_unstale":"2022-04-03T21:50:02.428065+0000","last_undegraded":"2022-04-03T21:50:02.428065+0000","last_fullsized":"2022-04-03T21:50:02.428065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:36:47.428099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401931+0000","last_change":"2022-04-03T21:49:58.401404+0000","last_active":"2022-04-03T21:50:02.401931+0000","last_peered":"2022-04-03T21:50:02.401931+0000","last_clean":"2022-04-03T21:50:02.401931+0000","last_became_active":"2022-04-03T21:49:58.400233+0000","last_became_peered":"2022-04-03T21:49:58.400233+0000","last_unstale":"2022-04-03T21:50:02.401931+0000","last_undegraded":"2022-04-03T21:50:02.401931+0000","last_fullsized":"2022-04-03T21:50:02.401931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:19:42.193555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413456+0000","last_change":"2022-04-03T21:49:58.415652+0000","last_active":"2022-04-03T21:50:02.413456+0000","last_peered":"2022-04-03T21:50:02.413456+0000","last_clean":"2022-04-03T21:50:02.413456+0000","last_became_active":"2022-04-03T21:49:58.415309+0000","last_became_peered":"2022-04-03T21:49:58.415309+0000","last_unstale":"2022-04-03T21:50:02.413456+0000","last_undegraded":"2022-04-03T21:50:02.413456+0000","last_fullsized":"2022-04-03T21:50:02.413456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:58:49.731887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409358+0000","last_change":"2022-04-03T21:49:58.420076+0000","last_active":"2022-04-03T21:50:02.409358+0000","last_peered":"2022-04-03T21:50:02.409358+0000","last_clean":"2022-04-03T21:50:02.409358+0000","last_became_active":"2022-04-03T21:49:58.419652+0000","last_became_peered":"2022-04-03T21:49:58.419652+0000","last_unstale":"2022-04-03T21:50:02.409358+0000","last_undegraded":"2022-04-03T21:50:02.409358+0000","last_fullsized":"2022-04-03T21:50:02.409358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:09:13.184611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401797+0000","last_change":"2022-04-03T21:49:58.406560+0000","last_active":"2022-04-03T21:50:02.401797+0000","last_peered":"2022-04-03T21:50:02.401797+0000","last_clean":"2022-04-03T21:50:02.401797+0000","last_became_active":"2022-04-03T21:49:58.406160+0000","last_became_peered":"2022-04-03T21:49:58.406160+0000","last_unstale":"2022-04-03T21:50:02.401797+0000","last_undegraded":"2022-04-03T21:50:02.401797+0000","last_fullsized":"2022-04-03T21:50:02.401797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:10:20.264129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408532+0000","last_change":"2022-04-03T21:49:58.407401+0000","last_active":"2022-04-03T21:50:02.408532+0000","last_peered":"2022-04-03T21:50:02.408532+0000","last_clean":"2022-04-03T21:50:02.408532+0000","last_became_active":"2022-04-03T21:49:58.407125+0000","last_became_peered":"2022-04-03T21:49:58.407125+0000","last_unstale":"2022-04-03T21:50:02.408532+0000","last_undegraded":"2022-04-03T21:50:02.408532+0000","last_fullsized":"2022-04-03T21:50:02.408532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:19.614490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412027+0000","last_change":"2022-04-03T21:49:58.419741+0000","last_active":"2022-04-03T21:50:02.412027+0000","last_peered":"2022-04-03T21:50:02.412027+0000","last_clean":"2022-04-03T21:50:02.412027+0000","last_became_active":"2022-04-03T21:49:58.419026+0000","last_became_peered":"2022-04-03T21:49:58.419026+0000","last_unstale":"2022-04-03T21:50:02.412027+0000","last_undegraded":"2022-04-03T21:50:02.412027+0000","last_fullsized":"2022-04-03T21:50:02.412027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:37.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409777+0000","last_change":"2022-04-03T21:49:58.403630+0000","last_active":"2022-04-03T21:50:02.409777+0000","last_peered":"2022-04-03T21:50:02.409777+0000","last_clean":"2022-04-03T21:50:02.409777+0000","last_became_active":"2022-04-03T21:49:58.403280+0000","last_became_peered":"2022-04-03T21:49:58.403280+0000","last_unstale":"2022-04-03T21:50:02.409777+0000","last_undegraded":"2022-04-03T21:50:02.409777+0000","last_fullsized":"2022-04-03T21:50:02.409777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:50:27.561349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402107+0000","last_change":"2022-04-03T21:49:58.406356+0000","last_active":"2022-04-03T21:50:02.402107+0000","last_peered":"2022-04-03T21:50:02.402107+0000","last_clean":"2022-04-03T21:50:02.402107+0000","last_became_active":"2022-04-03T21:49:58.406008+0000","last_became_peered":"2022-04-03T21:49:58.406008+0000","last_unstale":"2022-04-03T21:50:02.402107+0000","last_undegraded":"2022-04-03T21:50:02.402107+0000","last_fullsized":"2022-04-03T21:50:02.402107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:09:59.484176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403238+0000","last_change":"2022-04-03T21:49:58.429551+0000","last_active":"2022-04-03T21:50:02.403238+0000","last_peered":"2022-04-03T21:50:02.403238+0000","last_clean":"2022-04-03T21:50:02.403238+0000","last_became_active":"2022-04-03T21:49:58.429168+0000","last_became_peered":"2022-04-03T21:49:58.429168+0000","last_unstale":"2022-04-03T21:50:02.403238+0000","last_undegraded":"2022-04-03T21:50:02.403238+0000","last_fullsized":"2022-04-03T21:50:02.403238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:25:21.039114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443702+0000","last_change":"2022-04-03T21:50:02.441183+0000","last_active":"2022-04-03T21:50:02.443702+0000","last_peered":"2022-04-03T21:50:02.443702+0000","last_clean":"2022-04-03T21:50:02.443702+0000","last_became_active":"2022-04-03T21:50:02.440742+0000","last_became_peered":"2022-04-03T21:50:02.440742+0000","last_unstale":"2022-04-03T21:50:02.443702+0000","last_undegraded":"2022-04-03T21:50:02.443702+0000","last_fullsized":"2022-04-03T21:50:02.443702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:34:43.602016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414305+0000","last_change":"2022-04-03T21:49:57.860784+0000","last_active":"2022-04-03T21:50:02.414305+0000","last_peered":"2022-04-03T21:50:02.414305+0000","last_clean":"2022-04-03T21:50:02.414305+0000","last_became_active":"2022-04-03T21:49:57.858898+0000","last_became_peered":"2022-04-03T21:49:57.858898+0000","last_unstale":"2022-04-03T21:50:02.414305+0000","last_undegraded":"2022-04-03T21:50:02.414305+0000","last_fullsized":"2022-04-03T21:50:02.414305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:47:21.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402796+0000","last_change":"2022-04-03T21:49:58.408237+0000","last_active":"2022-04-03T21:50:02.402796+0000","last_peered":"2022-04-03T21:50:02.402796+0000","last_clean":"2022-04-03T21:50:02.402796+0000","last_became_active":"2022-04-03T21:49:58.407955+0000","last_became_peered":"2022-04-03T21:49:58.407955+0000","last_unstale":"2022-04-03T21:50:02.402796+0000","last_undegraded":"2022-04-03T21:50:02.402796+0000","last_fullsized":"2022-04-03T21:50:02.402796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:39:07.361273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436868+0000","last_change":"2022-04-03T21:50:02.431994+0000","last_active":"2022-04-03T21:50:02.436868+0000","last_peered":"2022-04-03T21:50:02.436868+0000","last_clean":"2022-04-03T21:50:02.436868+0000","last_became_active":"2022-04-03T21:50:02.431584+0000","last_became_peered":"2022-04-03T21:50:02.431584+0000","last_unstale":"2022-04-03T21:50:02.436868+0000","last_undegraded":"2022-04-03T21:50:02.436868+0000","last_fullsized":"2022-04-03T21:50:02.436868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:07:15.227915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408396+0000","last_change":"2022-04-03T21:49:57.866074+0000","last_active":"2022-04-03T21:50:02.408396+0000","last_peered":"2022-04-03T21:50:02.408396+0000","last_clean":"2022-04-03T21:50:02.408396+0000","last_became_active":"2022-04-03T21:49:57.865799+0000","last_became_peered":"2022-04-03T21:49:57.865799+0000","last_unstale":"2022-04-03T21:50:02.408396+0000","last_undegraded":"2022-04-03T21:50:02.408396+0000","last_fullsized":"2022-04-03T21:50:02.408396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:23:38.859645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410453+0000","last_change":"2022-04-03T21:49:58.412549+0000","last_active":"2022-04-03T21:50:02.410453+0000","last_peered":"2022-04-03T21:50:02.410453+0000","last_clean":"2022-04-03T21:50:02.410453+0000","last_became_active":"2022-04-03T21:49:58.412221+0000","last_became_peered":"2022-04-03T21:49:58.412221+0000","last_unstale":"2022-04-03T21:50:02.410453+0000","last_undegraded":"2022-04-03T21:50:02.410453+0000","last_fullsized":"2022-04-03T21:50:02.410453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:46:32.727120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.433553+0000","last_change":"2022-04-03T21:50:02.430727+0000","last_active":"2022-04-03T21:50:02.433553+0000","last_peered":"2022-04-03T21:50:02.433553+0000","last_clean":"2022-04-03T21:50:02.433553+0000","last_became_active":"2022-04-03T21:50:02.430293+0000","last_became_peered":"2022-04-03T21:50:02.430293+0000","last_unstale":"2022-04-03T21:50:02.433553+0000","last_undegraded":"2022-04-03T21:50:02.433553+0000","last_fullsized":"2022-04-03T21:50:02.433553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:12:45.221200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402025+0000","last_change":"2022-04-03T21:49:57.857793+0000","last_active":"2022-04-03T21:50:02.402025+0000","last_peered":"2022-04-03T21:50:02.402025+0000","last_clean":"2022-04-03T21:50:02.402025+0000","last_became_active":"2022-04-03T21:49:57.857477+0000","last_became_peered":"2022-04-03T21:49:57.857477+0000","last_unstale":"2022-04-03T21:50:02.402025+0000","last_undegraded":"2022-04-03T21:50:02.402025+0000","last_fullsized":"2022-04-03T21:50:02.402025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:58:12.643379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403732+0000","last_change":"2022-04-03T21:49:58.410021+0000","last_active":"2022-04-03T21:50:02.403732+0000","last_peered":"2022-04-03T21:50:02.403732+0000","last_clean":"2022-04-03T21:50:02.403732+0000","last_became_active":"2022-04-03T21:49:58.409644+0000","last_became_peered":"2022-04-03T21:49:58.409644+0000","last_unstale":"2022-04-03T21:50:02.403732+0000","last_undegraded":"2022-04-03T21:50:02.403732+0000","last_fullsized":"2022-04-03T21:50:02.403732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:26:07.839515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430122+0000","last_change":"2022-04-03T21:50:02.418006+0000","last_active":"2022-04-03T21:50:02.430122+0000","last_peered":"2022-04-03T21:50:02.430122+0000","last_clean":"2022-04-03T21:50:02.430122+0000","last_became_active":"2022-04-03T21:50:02.417522+0000","last_became_peered":"2022-04-03T21:50:02.417522+0000","last_unstale":"2022-04-03T21:50:02.430122+0000","last_undegraded":"2022-04-03T21:50:02.430122+0000","last_fullsized":"2022-04-03T21:50:02.430122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:40:39.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402342+0000","last_change":"2022-04-03T21:49:57.870805+0000","last_active":"2022-04-03T21:50:02.402342+0000","last_peered":"2022-04-03T21:50:02.402342+0000","last_clean":"2022-04-03T21:50:02.402342+0000","last_became_active":"2022-04-03T21:49:57.870504+0000","last_became_peered":"2022-04-03T21:49:57.870504+0000","last_unstale":"2022-04-03T21:50:02.402342+0000","last_undegraded":"2022-04-03T21:50:02.402342+0000","last_fullsized":"2022-04-03T21:50:02.402342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:41.062419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402628+0000","last_change":"2022-04-03T21:49:58.411420+0000","last_active":"2022-04-03T21:50:02.402628+0000","last_peered":"2022-04-03T21:50:02.402628+0000","last_clean":"2022-04-03T21:50:02.402628+0000","last_became_active":"2022-04-03T21:49:58.411046+0000","last_became_peered":"2022-04-03T21:49:58.411046+0000","last_unstale":"2022-04-03T21:50:02.402628+0000","last_undegraded":"2022-04-03T21:50:02.402628+0000","last_fullsized":"2022-04-03T21:50:02.402628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:59:39.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.439955+0000","last_change":"2022-04-03T21:50:02.438123+0000","last_active":"2022-04-03T21:50:02.439955+0000","last_peered":"2022-04-03T21:50:02.439955+0000","last_clean":"2022-04-03T21:50:02.439955+0000","last_became_active":"2022-04-03T21:50:02.437671+0000","last_became_peered":"2022-04-03T21:50:02.437671+0000","last_unstale":"2022-04-03T21:50:02.439955+0000","last_undegraded":"2022-04-03T21:50:02.439955+0000","last_fullsized":"2022-04-03T21:50:02.439955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:02:58.397104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.407995+0000","last_change":"2022-04-03T21:49:57.874098+0000","last_active":"2022-04-03T21:50:02.407995+0000","last_peered":"2022-04-03T21:50:02.407995+0000","last_clean":"2022-04-03T21:50:02.407995+0000","last_became_active":"2022-04-03T21:49:57.873819+0000","last_became_peered":"2022-04-03T21:49:57.873819+0000","last_unstale":"2022-04-03T21:50:02.407995+0000","last_undegraded":"2022-04-03T21:50:02.407995+0000","last_fullsized":"2022-04-03T21:50:02.407995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:24.770645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408357+0000","last_change":"2022-04-03T21:49:58.422605+0000","last_active":"2022-04-03T21:50:02.408357+0000","last_peered":"2022-04-03T21:50:02.408357+0000","last_clean":"2022-04-03T21:50:02.408357+0000","last_became_active":"2022-04-03T21:49:58.422247+0000","last_became_peered":"2022-04-03T21:49:58.422247+0000","last_unstale":"2022-04-03T21:50:02.408357+0000","last_undegraded":"2022-04-03T21:50:02.408357+0000","last_fullsized":"2022-04-03T21:50:02.408357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:30.833260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423978+0000","last_change":"2022-04-03T21:50:02.422574+0000","last_active":"2022-04-03T21:50:02.423978+0000","last_peered":"2022-04-03T21:50:02.423978+0000","last_clean":"2022-04-03T21:50:02.423978+0000","last_became_active":"2022-04-03T21:50:02.422108+0000","last_became_peered":"2022-04-03T21:50:02.422108+0000","last_unstale":"2022-04-03T21:50:02.423978+0000","last_undegraded":"2022-04-03T21:50:02.423978+0000","last_fullsized":"2022-04-03T21:50:02.423978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:38:20.285542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421113+0000","last_change":"2022-04-03T21:49:57.862891+0000","last_active":"2022-04-03T21:50:02.421113+0000","last_peered":"2022-04-03T21:50:02.421113+0000","last_clean":"2022-04-03T21:50:02.421113+0000","last_became_active":"2022-04-03T21:49:57.862595+0000","last_became_peered":"2022-04-03T21:49:57.862595+0000","last_unstale":"2022-04-03T21:50:02.421113+0000","last_undegraded":"2022-04-03T21:50:02.421113+0000","last_fullsized":"2022-04-03T21:50:02.421113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:26:38.267269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405207+0000","last_change":"2022-04-03T21:49:58.405688+0000","last_active":"2022-04-03T21:50:02.405207+0000","last_peered":"2022-04-03T21:50:02.405207+0000","last_clean":"2022-04-03T21:50:02.405207+0000","last_became_active":"2022-04-03T21:49:58.405370+0000","last_became_peered":"2022-04-03T21:49:58.405370+0000","last_unstale":"2022-04-03T21:50:02.405207+0000","last_undegraded":"2022-04-03T21:50:02.405207+0000","last_fullsized":"2022-04-03T21:50:02.405207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:08:21.661666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430526+0000","last_change":"2022-04-03T21:50:02.426303+0000","last_active":"2022-04-03T21:50:02.430526+0000","last_peered":"2022-04-03T21:50:02.430526+0000","last_clean":"2022-04-03T21:50:02.430526+0000","last_became_active":"2022-04-03T21:50:02.425881+0000","last_became_peered":"2022-04-03T21:50:02.425881+0000","last_unstale":"2022-04-03T21:50:02.430526+0000","last_undegraded":"2022-04-03T21:50:02.430526+0000","last_fullsized":"2022-04-03T21:50:02.430526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:53:47.423488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-04-03T21:50:09.390123+0000","last_change":"2022-04-03T21:49:57.874385+0000","last_active":"2022-04-03T21:50:09.390123+0000","last_peered":"2022-04-03T21:50:09.390123+0000","last_clean":"2022-04-03T21:50:09.390123+0000","last_became_active":"2022-04-03T21:49:57.874015+0000","last_became_peered":"2022-04-03T21:49:57.874015+0000","last_unstale":"2022-04-03T21:50:09.390123+0000","last_undegraded":"2022-04-03T21:50:09.390123+0000","last_fullsized":"2022-04-03T21:50:09.390123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:15:01.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3748,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410683+0000","last_change":"2022-04-03T21:49:58.400492+0000","last_active":"2022-04-03T21:50:02.410683+0000","last_peered":"2022-04-03T21:50:02.410683+0000","last_clean":"2022-04-03T21:50:02.410683+0000","last_became_active":"2022-04-03T21:49:58.400197+0000","last_became_peered":"2022-04-03T21:49:58.400197+0000","last_unstale":"2022-04-03T21:50:02.410683+0000","last_undegraded":"2022-04-03T21:50:02.410683+0000","last_fullsized":"2022-04-03T21:50:02.410683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:33:29.265331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442907+0000","last_change":"2022-04-03T21:50:02.440881+0000","last_active":"2022-04-03T21:50:02.442907+0000","last_peered":"2022-04-03T21:50:02.442907+0000","last_clean":"2022-04-03T21:50:02.442907+0000","last_became_active":"2022-04-03T21:50:02.440422+0000","last_became_peered":"2022-04-03T21:50:02.440422+0000","last_unstale":"2022-04-03T21:50:02.442907+0000","last_undegraded":"2022-04-03T21:50:02.442907+0000","last_fullsized":"2022-04-03T21:50:02.442907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:42:18.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403406+0000","last_change":"2022-04-03T21:49:57.879838+0000","last_active":"2022-04-03T21:50:02.403406+0000","last_peered":"2022-04-03T21:50:02.403406+0000","last_clean":"2022-04-03T21:50:02.403406+0000","last_became_active":"2022-04-03T21:49:57.878024+0000","last_became_peered":"2022-04-03T21:49:57.878024+0000","last_unstale":"2022-04-03T21:50:02.403406+0000","last_undegraded":"2022-04-03T21:50:02.403406+0000","last_fullsized":"2022-04-03T21:50:02.403406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:47:30.622816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410468+0000","last_change":"2022-04-03T21:49:58.409677+0000","last_active":"2022-04-03T21:50:02.410468+0000","last_peered":"2022-04-03T21:50:02.410468+0000","last_clean":"2022-04-03T21:50:02.410468+0000","last_became_active":"2022-04-03T21:49:58.408823+0000","last_became_peered":"2022-04-03T21:49:58.408823+0000","last_unstale":"2022-04-03T21:50:02.410468+0000","last_undegraded":"2022-04-03T21:50:02.410468+0000","last_fullsized":"2022-04-03T21:50:02.410468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:29:30.293123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428383+0000","last_change":"2022-04-03T21:50:02.427323+0000","last_active":"2022-04-03T21:50:02.428383+0000","last_peered":"2022-04-03T21:50:02.428383+0000","last_clean":"2022-04-03T21:50:02.428383+0000","last_became_active":"2022-04-03T21:50:02.426904+0000","last_became_peered":"2022-04-03T21:50:02.426904+0000","last_unstale":"2022-04-03T21:50:02.428383+0000","last_undegraded":"2022-04-03T21:50:02.428383+0000","last_fullsized":"2022-04-03T21:50:02.428383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:17:10.401730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410537+0000","last_change":"2022-04-03T21:49:57.870926+0000","last_active":"2022-04-03T21:50:02.410537+0000","last_peered":"2022-04-03T21:50:02.410537+0000","last_clean":"2022-04-03T21:50:02.410537+0000","last_became_active":"2022-04-03T21:49:57.870492+0000","last_became_peered":"2022-04-03T21:49:57.870492+0000","last_unstale":"2022-04-03T21:50:02.410537+0000","last_undegraded":"2022-04-03T21:50:02.410537+0000","last_fullsized":"2022-04-03T21:50:02.410537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:31.021652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403960+0000","last_change":"2022-04-03T21:49:58.431705+0000","last_active":"2022-04-03T21:50:02.403960+0000","last_peered":"2022-04-03T21:50:02.403960+0000","last_clean":"2022-04-03T21:50:02.403960+0000","last_became_active":"2022-04-03T21:49:58.431415+0000","last_became_peered":"2022-04-03T21:49:58.431415+0000","last_unstale":"2022-04-03T21:50:02.403960+0000","last_undegraded":"2022-04-03T21:50:02.403960+0000","last_fullsized":"2022-04-03T21:50:02.403960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:33:36.410007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427780+0000","last_change":"2022-04-03T21:50:02.424166+0000","last_active":"2022-04-03T21:50:02.427780+0000","last_peered":"2022-04-03T21:50:02.427780+0000","last_clean":"2022-04-03T21:50:02.427780+0000","last_became_active":"2022-04-03T21:50:02.423793+0000","last_became_peered":"2022-04-03T21:50:02.423793+0000","last_unstale":"2022-04-03T21:50:02.427780+0000","last_undegraded":"2022-04-03T21:50:02.427780+0000","last_fullsized":"2022-04-03T21:50:02.427780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:34:55.173456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402364+0000","last_change":"2022-04-03T21:49:57.874464+0000","last_active":"2022-04-03T21:50:02.402364+0000","last_peered":"2022-04-03T21:50:02.402364+0000","last_clean":"2022-04-03T21:50:02.402364+0000","last_became_active":"2022-04-03T21:49:57.874181+0000","last_became_peered":"2022-04-03T21:49:57.874181+0000","last_unstale":"2022-04-03T21:50:02.402364+0000","last_undegraded":"2022-04-03T21:50:02.402364+0000","last_fullsized":"2022-04-03T21:50:02.402364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:51:13.600469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402062+0000","last_change":"2022-04-03T21:49:58.401185+0000","last_active":"2022-04-03T21:50:02.402062+0000","last_peered":"2022-04-03T21:50:02.402062+0000","last_clean":"2022-04-03T21:50:02.402062+0000","last_became_active":"2022-04-03T21:49:58.399966+0000","last_became_peered":"2022-04-03T21:49:58.399966+0000","last_unstale":"2022-04-03T21:50:02.402062+0000","last_undegraded":"2022-04-03T21:50:02.402062+0000","last_fullsized":"2022-04-03T21:50:02.402062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:43:46.604121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.437138+0000","last_change":"2022-04-03T21:50:02.432307+0000","last_active":"2022-04-03T21:50:02.437138+0000","last_peered":"2022-04-03T21:50:02.437138+0000","last_clean":"2022-04-03T21:50:02.437138+0000","last_became_active":"2022-04-03T21:50:02.431759+0000","last_became_peered":"2022-04-03T21:50:02.431759+0000","last_unstale":"2022-04-03T21:50:02.437138+0000","last_undegraded":"2022-04-03T21:50:02.437138+0000","last_fullsized":"2022-04-03T21:50:02.437138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:34:33.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411902+0000","last_change":"2022-04-03T21:49:57.864543+0000","last_active":"2022-04-03T21:50:02.411902+0000","last_peered":"2022-04-03T21:50:02.411902+0000","last_clean":"2022-04-03T21:50:02.411902+0000","last_became_active":"2022-04-03T21:49:57.864245+0000","last_became_peered":"2022-04-03T21:49:57.864245+0000","last_unstale":"2022-04-03T21:50:02.411902+0000","last_undegraded":"2022-04-03T21:50:02.411902+0000","last_fullsized":"2022-04-03T21:50:02.411902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:13:09.645048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402455+0000","last_change":"2022-04-03T21:49:58.419675+0000","last_active":"2022-04-03T21:50:02.402455+0000","last_peered":"2022-04-03T21:50:02.402455+0000","last_clean":"2022-04-03T21:50:02.402455+0000","last_became_active":"2022-04-03T21:49:58.419408+0000","last_became_peered":"2022-04-03T21:49:58.419408+0000","last_unstale":"2022-04-03T21:50:02.402455+0000","last_undegraded":"2022-04-03T21:50:02.402455+0000","last_fullsized":"2022-04-03T21:50:02.402455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:58:27.884413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427854+0000","last_change":"2022-04-03T21:50:02.425159+0000","last_active":"2022-04-03T21:50:02.427854+0000","last_peered":"2022-04-03T21:50:02.427854+0000","last_clean":"2022-04-03T21:50:02.427854+0000","last_became_active":"2022-04-03T21:50:02.424677+0000","last_became_peered":"2022-04-03T21:50:02.424677+0000","last_unstale":"2022-04-03T21:50:02.427854+0000","last_undegraded":"2022-04-03T21:50:02.427854+0000","last_fullsized":"2022-04-03T21:50:02.427854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:48.470775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421719+0000","last_change":"2022-04-03T21:49:57.866686+0000","last_active":"2022-04-03T21:50:02.421719+0000","last_peered":"2022-04-03T21:50:02.421719+0000","last_clean":"2022-04-03T21:50:02.421719+0000","last_became_active":"2022-04-03T21:49:57.866364+0000","last_became_peered":"2022-04-03T21:49:57.866364+0000","last_unstale":"2022-04-03T21:50:02.421719+0000","last_undegraded":"2022-04-03T21:50:02.421719+0000","last_fullsized":"2022-04-03T21:50:02.421719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:46:41.508964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402396+0000","last_change":"2022-04-03T21:49:58.420292+0000","last_active":"2022-04-03T21:50:02.402396+0000","last_peered":"2022-04-03T21:50:02.402396+0000","last_clean":"2022-04-03T21:50:02.402396+0000","last_became_active":"2022-04-03T21:49:58.419956+0000","last_became_peered":"2022-04-03T21:49:58.419956+0000","last_unstale":"2022-04-03T21:50:02.402396+0000","last_undegraded":"2022-04-03T21:50:02.402396+0000","last_fullsized":"2022-04-03T21:50:02.402396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:44:23.380819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436661+0000","last_change":"2022-04-03T21:50:02.431629+0000","last_active":"2022-04-03T21:50:02.436661+0000","last_peered":"2022-04-03T21:50:02.436661+0000","last_clean":"2022-04-03T21:50:02.436661+0000","last_became_active":"2022-04-03T21:50:02.431173+0000","last_became_peered":"2022-04-03T21:50:02.431173+0000","last_unstale":"2022-04-03T21:50:02.436661+0000","last_undegraded":"2022-04-03T21:50:02.436661+0000","last_fullsized":"2022-04-03T21:50:02.436661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:01:44.215650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408111+0000","last_change":"2022-04-03T21:49:57.877939+0000","last_active":"2022-04-03T21:50:02.408111+0000","last_peered":"2022-04-03T21:50:02.408111+0000","last_clean":"2022-04-03T21:50:02.408111+0000","last_became_active":"2022-04-03T21:49:57.877643+0000","last_became_peered":"2022-04-03T21:49:57.877643+0000","last_unstale":"2022-04-03T21:50:02.408111+0000","last_undegraded":"2022-04-03T21:50:02.408111+0000","last_fullsized":"2022-04-03T21:50:02.408111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T21:50:27.024213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410699+0000","last_change":"2022-04-03T21:49:58.421021+0000","last_active":"2022-04-03T21:50:02.410699+0000","last_peered":"2022-04-03T21:50:02.410699+0000","last_clean":"2022-04-03T21:50:02.410699+0000","last_became_active":"2022-04-03T21:49:58.420734+0000","last_became_peered":"2022-04-03T21:49:58.420734+0000","last_unstale":"2022-04-03T21:50:02.410699+0000","last_undegraded":"2022-04-03T21:50:02.410699+0000","last_fullsized":"2022-04-03T21:50:02.410699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:06:06.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423569+0000","last_change":"2022-04-03T21:50:02.417211+0000","last_active":"2022-04-03T21:50:02.423569+0000","last_peered":"2022-04-03T21:50:02.423569+0000","last_clean":"2022-04-03T21:50:02.423569+0000","last_became_active":"2022-04-03T21:50:02.416783+0000","last_became_peered":"2022-04-03T21:50:02.416783+0000","last_unstale":"2022-04-03T21:50:02.423569+0000","last_undegraded":"2022-04-03T21:50:02.423569+0000","last_fullsized":"2022-04-03T21:50:02.423569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:41:11.749073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403561+0000","last_change":"2022-04-03T21:49:57.872889+0000","last_active":"2022-04-03T21:50:02.403561+0000","last_peered":"2022-04-03T21:50:02.403561+0000","last_clean":"2022-04-03T21:50:02.403561+0000","last_became_active":"2022-04-03T21:49:57.872509+0000","last_became_peered":"2022-04-03T21:49:57.872509+0000","last_unstale":"2022-04-03T21:50:02.403561+0000","last_undegraded":"2022-04-03T21:50:02.403561+0000","last_fullsized":"2022-04-03T21:50:02.403561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:42.092697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413818+0000","last_change":"2022-04-03T21:49:58.399849+0000","last_active":"2022-04-03T21:50:02.413818+0000","last_peered":"2022-04-03T21:50:02.413818+0000","last_clean":"2022-04-03T21:50:02.413818+0000","last_became_active":"2022-04-03T21:49:58.399407+0000","last_became_peered":"2022-04-03T21:49:58.399407+0000","last_unstale":"2022-04-03T21:50:02.413818+0000","last_undegraded":"2022-04-03T21:50:02.413818+0000","last_fullsized":"2022-04-03T21:50:02.413818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:53:35.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.426414+0000","last_change":"2022-04-03T21:50:02.420577+0000","last_active":"2022-04-03T21:50:02.426414+0000","last_peered":"2022-04-03T21:50:02.426414+0000","last_clean":"2022-04-03T21:50:02.426414+0000","last_became_active":"2022-04-03T21:50:02.420023+0000","last_became_peered":"2022-04-03T21:50:02.420023+0000","last_unstale":"2022-04-03T21:50:02.426414+0000","last_undegraded":"2022-04-03T21:50:02.426414+0000","last_fullsized":"2022-04-03T21:50:02.426414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:56:20.520369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421514+0000","last_change":"2022-04-03T21:49:57.870171+0000","last_active":"2022-04-03T21:50:02.421514+0000","last_peered":"2022-04-03T21:50:02.421514+0000","last_clean":"2022-04-03T21:50:02.421514+0000","last_became_active":"2022-04-03T21:49:57.869887+0000","last_became_peered":"2022-04-03T21:49:57.869887+0000","last_unstale":"2022-04-03T21:50:02.421514+0000","last_undegraded":"2022-04-03T21:50:02.421514+0000","last_fullsized":"2022-04-03T21:50:02.421514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:40:24.182014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402693+0000","last_change":"2022-04-03T21:49:58.405990+0000","last_active":"2022-04-03T21:50:02.402693+0000","last_peered":"2022-04-03T21:50:02.402693+0000","last_clean":"2022-04-03T21:50:02.402693+0000","last_became_active":"2022-04-03T21:49:58.405686+0000","last_became_peered":"2022-04-03T21:49:58.405686+0000","last_unstale":"2022-04-03T21:50:02.402693+0000","last_undegraded":"2022-04-03T21:50:02.402693+0000","last_fullsized":"2022-04-03T21:50:02.402693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:45:30.673697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.441865+0000","last_change":"2022-04-03T21:50:02.436451+0000","last_active":"2022-04-03T21:50:02.441865+0000","last_peered":"2022-04-03T21:50:02.441865+0000","last_clean":"2022-04-03T21:50:02.441865+0000","last_became_active":"2022-04-03T21:50:02.435998+0000","last_became_peered":"2022-04-03T21:50:02.435998+0000","last_unstale":"2022-04-03T21:50:02.441865+0000","last_undegraded":"2022-04-03T21:50:02.441865+0000","last_fullsized":"2022-04-03T21:50:02.441865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:14:56.243368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401643+0000","last_change":"2022-04-03T21:49:57.861968+0000","last_active":"2022-04-03T21:50:02.401643+0000","last_peered":"2022-04-03T21:50:02.401643+0000","last_clean":"2022-04-03T21:50:02.401643+0000","last_became_active":"2022-04-03T21:49:57.861649+0000","last_became_peered":"2022-04-03T21:49:57.861649+0000","last_unstale":"2022-04-03T21:50:02.401643+0000","last_undegraded":"2022-04-03T21:50:02.401643+0000","last_fullsized":"2022-04-03T21:50:02.401643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:32:27.620549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421422+0000","last_change":"2022-04-03T21:49:58.417874+0000","last_active":"2022-04-03T21:50:02.421422+0000","last_peered":"2022-04-03T21:50:02.421422+0000","last_clean":"2022-04-03T21:50:02.421422+0000","last_became_active":"2022-04-03T21:49:58.417587+0000","last_became_peered":"2022-04-03T21:49:58.417587+0000","last_unstale":"2022-04-03T21:50:02.421422+0000","last_undegraded":"2022-04-03T21:50:02.421422+0000","last_fullsized":"2022-04-03T21:50:02.421422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:47:14.137789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428059+0000","last_change":"2022-04-03T21:50:02.425963+0000","last_active":"2022-04-03T21:50:02.428059+0000","last_peered":"2022-04-03T21:50:02.428059+0000","last_clean":"2022-04-03T21:50:02.428059+0000","last_became_active":"2022-04-03T21:50:02.425586+0000","last_became_peered":"2022-04-03T21:50:02.425586+0000","last_unstale":"2022-04-03T21:50:02.428059+0000","last_undegraded":"2022-04-03T21:50:02.428059+0000","last_fullsized":"2022-04-03T21:50:02.428059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:10:13.345349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403465+0000","last_change":"2022-04-03T21:49:57.870476+0000","last_active":"2022-04-03T21:50:02.403465+0000","last_peered":"2022-04-03T21:50:02.403465+0000","last_clean":"2022-04-03T21:50:02.403465+0000","last_became_active":"2022-04-03T21:49:57.870009+0000","last_became_peered":"2022-04-03T21:49:57.870009+0000","last_unstale":"2022-04-03T21:50:02.403465+0000","last_undegraded":"2022-04-03T21:50:02.403465+0000","last_fullsized":"2022-04-03T21:50:02.403465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:49:42.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403872+0000","last_change":"2022-04-03T21:49:58.421450+0000","last_active":"2022-04-03T21:50:02.403872+0000","last_peered":"2022-04-03T21:50:02.403872+0000","last_clean":"2022-04-03T21:50:02.403872+0000","last_became_active":"2022-04-03T21:49:58.421054+0000","last_became_peered":"2022-04-03T21:49:58.421054+0000","last_unstale":"2022-04-03T21:50:02.403872+0000","last_undegraded":"2022-04-03T21:50:02.403872+0000","last_fullsized":"2022-04-03T21:50:02.403872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:47:29.054190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442528+0000","last_change":"2022-04-03T21:50:02.434190+0000","last_active":"2022-04-03T21:50:02.442528+0000","last_peered":"2022-04-03T21:50:02.442528+0000","last_clean":"2022-04-03T21:50:02.442528+0000","last_became_active":"2022-04-03T21:50:02.433666+0000","last_became_peered":"2022-04-03T21:50:02.433666+0000","last_unstale":"2022-04-03T21:50:02.442528+0000","last_undegraded":"2022-04-03T21:50:02.442528+0000","last_fullsized":"2022-04-03T21:50:02.442528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:46.909616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402471+0000","last_change":"2022-04-03T21:49:57.863462+0000","last_active":"2022-04-03T21:50:02.402471+0000","last_peered":"2022-04-03T21:50:02.402471+0000","last_clean":"2022-04-03T21:50:02.402471+0000","last_became_active":"2022-04-03T21:49:57.863170+0000","last_became_peered":"2022-04-03T21:49:57.863170+0000","last_unstale":"2022-04-03T21:50:02.402471+0000","last_undegraded":"2022-04-03T21:50:02.402471+0000","last_fullsized":"2022-04-03T21:50:02.402471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:38:02.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408285+0000","last_change":"2022-04-03T21:49:58.401069+0000","last_active":"2022-04-03T21:50:02.408285+0000","last_peered":"2022-04-03T21:50:02.408285+0000","last_clean":"2022-04-03T21:50:02.408285+0000","last_became_active":"2022-04-03T21:49:58.400774+0000","last_became_peered":"2022-04-03T21:49:58.400774+0000","last_unstale":"2022-04-03T21:50:02.408285+0000","last_undegraded":"2022-04-03T21:50:02.408285+0000","last_fullsized":"2022-04-03T21:50:02.408285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:54.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429724+0000","last_change":"2022-04-03T21:50:02.420282+0000","last_active":"2022-04-03T21:50:02.429724+0000","last_peered":"2022-04-03T21:50:02.429724+0000","last_clean":"2022-04-03T21:50:02.429724+0000","last_became_active":"2022-04-03T21:50:02.419604+0000","last_became_peered":"2022-04-03T21:50:02.419604+0000","last_unstale":"2022-04-03T21:50:02.429724+0000","last_undegraded":"2022-04-03T21:50:02.429724+0000","last_fullsized":"2022-04-03T21:50:02.429724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:27:15.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406203+0000","last_change":"2022-04-03T21:49:57.859380+0000","last_active":"2022-04-03T21:50:02.406203+0000","last_peered":"2022-04-03T21:50:02.406203+0000","last_clean":"2022-04-03T21:50:02.406203+0000","last_became_active":"2022-04-03T21:49:57.859076+0000","last_became_peered":"2022-04-03T21:49:57.859076+0000","last_unstale":"2022-04-03T21:50:02.406203+0000","last_undegraded":"2022-04-03T21:50:02.406203+0000","last_fullsized":"2022-04-03T21:50:02.406203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:03:57.532989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401995+0000","last_change":"2022-04-03T21:49:58.408851+0000","last_active":"2022-04-03T21:50:02.401995+0000","last_peered":"2022-04-03T21:50:02.401995+0000","last_clean":"2022-04-03T21:50:02.401995+0000","last_became_active":"2022-04-03T21:49:58.408553+0000","last_became_peered":"2022-04-03T21:49:58.408553+0000","last_unstale":"2022-04-03T21:50:02.401995+0000","last_undegraded":"2022-04-03T21:50:02.401995+0000","last_fullsized":"2022-04-03T21:50:02.401995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:53:09.835987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423992+0000","last_change":"2022-04-03T21:50:02.422611+0000","last_active":"2022-04-03T21:50:02.423992+0000","last_peered":"2022-04-03T21:50:02.423992+0000","last_clean":"2022-04-03T21:50:02.423992+0000","last_became_active":"2022-04-03T21:50:02.422088+0000","last_became_peered":"2022-04-03T21:50:02.422088+0000","last_unstale":"2022-04-03T21:50:02.423992+0000","last_undegraded":"2022-04-03T21:50:02.423992+0000","last_fullsized":"2022-04-03T21:50:02.423992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:34:54.875279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403638+0000","last_change":"2022-04-03T21:49:51.950055+0000","last_active":"2022-04-03T21:50:02.403638+0000","last_peered":"2022-04-03T21:50:02.403638+0000","last_clean":"2022-04-03T21:50:02.403638+0000","last_became_active":"2022-04-03T21:49:51.949793+0000","last_became_peered":"2022-04-03T21:49:51.949793+0000","last_unstale":"2022-04-03T21:50:02.403638+0000","last_undegraded":"2022-04-03T21:50:02.403638+0000","last_fullsized":"2022-04-03T21:50:02.403638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:44:29.449323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409897+0000","last_change":"2022-04-03T21:49:57.872925+0000","last_active":"2022-04-03T21:50:02.409897+0000","last_peered":"2022-04-03T21:50:02.409897+0000","last_clean":"2022-04-03T21:50:02.409897+0000","last_became_active":"2022-04-03T21:49:57.872490+0000","last_became_peered":"2022-04-03T21:49:57.872490+0000","last_unstale":"2022-04-03T21:50:02.409897+0000","last_undegraded":"2022-04-03T21:50:02.409897+0000","last_fullsized":"2022-04-03T21:50:02.409897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:57:45.485657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410378+0000","last_change":"2022-04-03T21:49:58.409467+0000","last_active":"2022-04-03T21:50:02.410378+0000","last_peered":"2022-04-03T21:50:02.410378+0000","last_clean":"2022-04-03T21:50:02.410378+0000","last_became_active":"2022-04-03T21:49:58.409155+0000","last_became_peered":"2022-04-03T21:49:58.409155+0000","last_unstale":"2022-04-03T21:50:02.410378+0000","last_undegraded":"2022-04-03T21:50:02.410378+0000","last_fullsized":"2022-04-03T21:50:02.410378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:31.770696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430528+0000","last_change":"2022-04-03T21:50:02.426029+0000","last_active":"2022-04-03T21:50:02.430528+0000","last_peered":"2022-04-03T21:50:02.430528+0000","last_clean":"2022-04-03T21:50:02.430528+0000","last_became_active":"2022-04-03T21:50:02.425589+0000","last_became_peered":"2022-04-03T21:50:02.425589+0000","last_unstale":"2022-04-03T21:50:02.430528+0000","last_undegraded":"2022-04-03T21:50:02.430528+0000","last_fullsized":"2022-04-03T21:50:02.430528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:38:10.958633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403666+0000","last_change":"2022-04-03T21:49:51.950513+0000","last_active":"2022-04-03T21:50:02.403666+0000","last_peered":"2022-04-03T21:50:02.403666+0000","last_clean":"2022-04-03T21:50:02.403666+0000","last_became_active":"2022-04-03T21:49:51.950013+0000","last_became_peered":"2022-04-03T21:49:51.950013+0000","last_unstale":"2022-04-03T21:50:02.403666+0000","last_undegraded":"2022-04-03T21:50:02.403666+0000","last_fullsized":"2022-04-03T21:50:02.403666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:08:28.113081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.422489+0000","last_change":"2022-04-03T21:49:57.874953+0000","last_active":"2022-04-03T21:50:02.422489+0000","last_peered":"2022-04-03T21:50:02.422489+0000","last_clean":"2022-04-03T21:50:02.422489+0000","last_became_active":"2022-04-03T21:49:57.874653+0000","last_became_peered":"2022-04-03T21:49:57.874653+0000","last_unstale":"2022-04-03T21:50:02.422489+0000","last_undegraded":"2022-04-03T21:50:02.422489+0000","last_fullsized":"2022-04-03T21:50:02.422489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:18:20.066652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410625+0000","last_change":"2022-04-03T21:49:58.405360+0000","last_active":"2022-04-03T21:50:02.410625+0000","last_peered":"2022-04-03T21:50:02.410625+0000","last_clean":"2022-04-03T21:50:02.410625+0000","last_became_active":"2022-04-03T21:49:58.405077+0000","last_became_peered":"2022-04-03T21:49:58.405077+0000","last_unstale":"2022-04-03T21:50:02.410625+0000","last_undegraded":"2022-04-03T21:50:02.410625+0000","last_fullsized":"2022-04-03T21:50:02.410625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:50:01.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436762+0000","last_change":"2022-04-03T21:50:02.431834+0000","last_active":"2022-04-03T21:50:02.436762+0000","last_peered":"2022-04-03T21:50:02.436762+0000","last_clean":"2022-04-03T21:50:02.436762+0000","last_became_active":"2022-04-03T21:50:02.431250+0000","last_became_peered":"2022-04-03T21:50:02.431250+0000","last_unstale":"2022-04-03T21:50:02.436762+0000","last_undegraded":"2022-04-03T21:50:02.436762+0000","last_fullsized":"2022-04-03T21:50:02.436762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:32:53.927418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401614+0000","last_change":"2022-04-03T21:49:51.825451+0000","last_active":"2022-04-03T21:50:02.401614+0000","last_peered":"2022-04-03T21:50:02.401614+0000","last_clean":"2022-04-03T21:50:02.401614+0000","last_became_active":"2022-04-03T21:49:51.825101+0000","last_became_peered":"2022-04-03T21:49:51.825101+0000","last_unstale":"2022-04-03T21:50:02.401614+0000","last_undegraded":"2022-04-03T21:50:02.401614+0000","last_fullsized":"2022-04-03T21:50:02.401614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:14:58.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401859+0000","last_change":"2022-04-03T21:49:57.855929+0000","last_active":"2022-04-03T21:50:02.401859+0000","last_peered":"2022-04-03T21:50:02.401859+0000","last_clean":"2022-04-03T21:50:02.401859+0000","last_became_active":"2022-04-03T21:49:57.855618+0000","last_became_peered":"2022-04-03T21:49:57.855618+0000","last_unstale":"2022-04-03T21:50:02.401859+0000","last_undegraded":"2022-04-03T21:50:02.401859+0000","last_fullsized":"2022-04-03T21:50:02.401859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:15.342644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415411+0000","last_change":"2022-04-03T21:49:58.422027+0000","last_active":"2022-04-03T21:50:02.415411+0000","last_peered":"2022-04-03T21:50:02.415411+0000","last_clean":"2022-04-03T21:50:02.415411+0000","last_became_active":"2022-04-03T21:49:58.421718+0000","last_became_peered":"2022-04-03T21:49:58.421718+0000","last_unstale":"2022-04-03T21:50:02.415411+0000","last_undegraded":"2022-04-03T21:50:02.415411+0000","last_fullsized":"2022-04-03T21:50:02.415411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:15:09.949180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442797+0000","last_change":"2022-04-03T21:50:02.432280+0000","last_active":"2022-04-03T21:50:02.442797+0000","last_peered":"2022-04-03T21:50:02.442797+0000","last_clean":"2022-04-03T21:50:02.442797+0000","last_became_active":"2022-04-03T21:50:02.431805+0000","last_became_peered":"2022-04-03T21:50:02.431805+0000","last_unstale":"2022-04-03T21:50:02.442797+0000","last_undegraded":"2022-04-03T21:50:02.442797+0000","last_fullsized":"2022-04-03T21:50:02.442797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:33.634032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403212+0000","last_change":"2022-04-03T21:49:51.824294+0000","last_active":"2022-04-03T21:50:02.403212+0000","last_peered":"2022-04-03T21:50:02.403212+0000","last_clean":"2022-04-03T21:50:02.403212+0000","last_became_active":"2022-04-03T21:49:51.823893+0000","last_became_peered":"2022-04-03T21:49:51.823893+0000","last_unstale":"2022-04-03T21:50:02.403212+0000","last_undegraded":"2022-04-03T21:50:02.403212+0000","last_fullsized":"2022-04-03T21:50:02.403212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:36:52.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411821+0000","last_change":"2022-04-03T21:49:43.747755+0000","last_active":"2022-04-03T21:50:02.411821+0000","last_peered":"2022-04-03T21:50:02.411821+0000","last_clean":"2022-04-03T21:50:02.411821+0000","last_became_active":"2022-04-03T21:49:43.747384+0000","last_became_peered":"2022-04-03T21:49:43.747384+0000","last_unstale":"2022-04-03T21:50:02.411821+0000","last_undegraded":"2022-04-03T21:50:02.411821+0000","last_fullsized":"2022-04-03T21:50:02.411821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_clean_scrub_stamp":"2022-04-03T21:49:42.736782+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:38:50.071231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405095+0000","last_change":"2022-04-03T21:49:57.873204+0000","last_active":"2022-04-03T21:50:02.405095+0000","last_peered":"2022-04-03T21:50:02.405095+0000","last_clean":"2022-04-03T21:50:02.405095+0000","last_became_active":"2022-04-03T21:49:57.872943+0000","last_became_peered":"2022-04-03T21:49:57.872943+0000","last_unstale":"2022-04-03T21:50:02.405095+0000","last_undegraded":"2022-04-03T21:50:02.405095+0000","last_fullsized":"2022-04-03T21:50:02.405095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:40:34.165717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403936+0000","last_change":"2022-04-03T21:49:58.421243+0000","last_active":"2022-04-03T21:50:02.403936+0000","last_peered":"2022-04-03T21:50:02.403936+0000","last_clean":"2022-04-03T21:50:02.403936+0000","last_became_active":"2022-04-03T21:49:58.420761+0000","last_became_peered":"2022-04-03T21:49:58.420761+0000","last_unstale":"2022-04-03T21:50:02.403936+0000","last_undegraded":"2022-04-03T21:50:02.403936+0000","last_fullsized":"2022-04-03T21:50:02.403936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:06:23.093381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429963+0000","last_change":"2022-04-03T21:50:02.424398+0000","last_active":"2022-04-03T21:50:02.429963+0000","last_peered":"2022-04-03T21:50:02.429963+0000","last_clean":"2022-04-03T21:50:02.429963+0000","last_became_active":"2022-04-03T21:50:02.423977+0000","last_became_peered":"2022-04-03T21:50:02.423977+0000","last_unstale":"2022-04-03T21:50:02.429963+0000","last_undegraded":"2022-04-03T21:50:02.429963+0000","last_fullsized":"2022-04-03T21:50:02.429963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:42:14.704158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402275+0000","last_change":"2022-04-03T21:49:51.825761+0000","last_active":"2022-04-03T21:50:02.402275+0000","last_peered":"2022-04-03T21:50:02.402275+0000","last_clean":"2022-04-03T21:50:02.402275+0000","last_became_active":"2022-04-03T21:49:51.825341+0000","last_became_peered":"2022-04-03T21:49:51.825341+0000","last_unstale":"2022-04-03T21:50:02.402275+0000","last_undegraded":"2022-04-03T21:50:02.402275+0000","last_fullsized":"2022-04-03T21:50:02.402275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:05:18.628185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410188+0000","last_change":"2022-04-03T21:49:57.873682+0000","last_active":"2022-04-03T21:50:02.410188+0000","last_peered":"2022-04-03T21:50:02.410188+0000","last_clean":"2022-04-03T21:50:02.410188+0000","last_became_active":"2022-04-03T21:49:57.873471+0000","last_became_peered":"2022-04-03T21:49:57.873471+0000","last_unstale":"2022-04-03T21:50:02.410188+0000","last_undegraded":"2022-04-03T21:50:02.410188+0000","last_fullsized":"2022-04-03T21:50:02.410188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:49:58.621137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402322+0000","last_change":"2022-04-03T21:49:58.400547+0000","last_active":"2022-04-03T21:50:02.402322+0000","last_peered":"2022-04-03T21:50:02.402322+0000","last_clean":"2022-04-03T21:50:02.402322+0000","last_became_active":"2022-04-03T21:49:58.399645+0000","last_became_peered":"2022-04-03T21:49:58.399645+0000","last_unstale":"2022-04-03T21:50:02.402322+0000","last_undegraded":"2022-04-03T21:50:02.402322+0000","last_fullsized":"2022-04-03T21:50:02.402322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:11:49.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443304+0000","last_change":"2022-04-03T21:50:02.441051+0000","last_active":"2022-04-03T21:50:02.443304+0000","last_peered":"2022-04-03T21:50:02.443304+0000","last_clean":"2022-04-03T21:50:02.443304+0000","last_became_active":"2022-04-03T21:50:02.440145+0000","last_became_peered":"2022-04-03T21:50:02.440145+0000","last_unstale":"2022-04-03T21:50:02.443304+0000","last_undegraded":"2022-04-03T21:50:02.443304+0000","last_fullsized":"2022-04-03T21:50:02.443304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:48.125856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403762+0000","last_change":"2022-04-03T21:49:51.823192+0000","last_active":"2022-04-03T21:50:02.403762+0000","last_peered":"2022-04-03T21:50:02.403762+0000","last_clean":"2022-04-03T21:50:02.403762+0000","last_became_active":"2022-04-03T21:49:51.822812+0000","last_became_peered":"2022-04-03T21:49:51.822812+0000","last_unstale":"2022-04-03T21:50:02.403762+0000","last_undegraded":"2022-04-03T21:50:02.403762+0000","last_fullsized":"2022-04-03T21:50:02.403762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:56:34.679337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415772+0000","last_change":"2022-04-03T21:49:57.860388+0000","last_active":"2022-04-03T21:50:02.415772+0000","last_peered":"2022-04-03T21:50:02.415772+0000","last_clean":"2022-04-03T21:50:02.415772+0000","last_became_active":"2022-04-03T21:49:57.860088+0000","last_became_peered":"2022-04-03T21:49:57.860088+0000","last_unstale":"2022-04-03T21:50:02.415772+0000","last_undegraded":"2022-04-03T21:50:02.415772+0000","last_fullsized":"2022-04-03T21:50:02.415772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:52:22.536814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414020+0000","last_change":"2022-04-03T21:49:58.422161+0000","last_active":"2022-04-03T21:50:02.414020+0000","last_peered":"2022-04-03T21:50:02.414020+0000","last_clean":"2022-04-03T21:50:02.414020+0000","last_became_active":"2022-04-03T21:49:58.421791+0000","last_became_peered":"2022-04-03T21:49:58.421791+0000","last_unstale":"2022-04-03T21:50:02.414020+0000","last_undegraded":"2022-04-03T21:50:02.414020+0000","last_fullsized":"2022-04-03T21:50:02.414020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:16.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430144+0000","last_change":"2022-04-03T21:50:02.421849+0000","last_active":"2022-04-03T21:50:02.430144+0000","last_peered":"2022-04-03T21:50:02.430144+0000","last_clean":"2022-04-03T21:50:02.430144+0000","last_became_active":"2022-04-03T21:50:02.421341+0000","last_became_peered":"2022-04-03T21:50:02.421341+0000","last_unstale":"2022-04-03T21:50:02.430144+0000","last_undegraded":"2022-04-03T21:50:02.430144+0000","last_fullsized":"2022-04-03T21:50:02.430144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:27:53.495587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409689+0000","last_change":"2022-04-03T21:49:57.863910+0000","last_active":"2022-04-03T21:50:02.409689+0000","last_peered":"2022-04-03T21:50:02.409689+0000","last_clean":"2022-04-03T21:50:02.409689+0000","last_became_active":"2022-04-03T21:49:57.863574+0000","last_became_peered":"2022-04-03T21:49:57.863574+0000","last_unstale":"2022-04-03T21:50:02.409689+0000","last_undegraded":"2022-04-03T21:50:02.409689+0000","last_fullsized":"2022-04-03T21:50:02.409689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:13:36.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410534+0000","last_change":"2022-04-03T21:49:52.057999+0000","last_active":"2022-04-03T21:50:02.410534+0000","last_peered":"2022-04-03T21:50:02.410534+0000","last_clean":"2022-04-03T21:50:02.410534+0000","last_became_active":"2022-04-03T21:49:52.057739+0000","last_became_peered":"2022-04-03T21:49:52.057739+0000","last_unstale":"2022-04-03T21:50:02.410534+0000","last_undegraded":"2022-04-03T21:50:02.410534+0000","last_fullsized":"2022-04-03T21:50:02.410534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:44:05.676474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405131+0000","last_change":"2022-04-03T21:49:58.412468+0000","last_active":"2022-04-03T21:50:02.405131+0000","last_peered":"2022-04-03T21:50:02.405131+0000","last_clean":"2022-04-03T21:50:02.405131+0000","last_became_active":"2022-04-03T21:49:58.412157+0000","last_became_peered":"2022-04-03T21:49:58.412157+0000","last_unstale":"2022-04-03T21:50:02.405131+0000","last_undegraded":"2022-04-03T21:50:02.405131+0000","last_fullsized":"2022-04-03T21:50:02.405131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:22.481343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.418110+0000","last_change":"2022-04-03T21:50:02.416690+0000","last_active":"2022-04-03T21:50:02.418110+0000","last_peered":"2022-04-03T21:50:02.418110+0000","last_clean":"2022-04-03T21:50:02.418110+0000","last_became_active":"2022-04-03T21:50:02.416202+0000","last_became_peered":"2022-04-03T21:50:02.416202+0000","last_unstale":"2022-04-03T21:50:02.418110+0000","last_undegraded":"2022-04-03T21:50:02.418110+0000","last_fullsized":"2022-04-03T21:50:02.418110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:35:47.291508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403609+0000","last_change":"2022-04-03T21:49:52.058292+0000","last_active":"2022-04-03T21:50:02.403609+0000","last_peered":"2022-04-03T21:50:02.403609+0000","last_clean":"2022-04-03T21:50:02.403609+0000","last_became_active":"2022-04-03T21:49:52.057769+0000","last_became_peered":"2022-04-03T21:49:52.057769+0000","last_unstale":"2022-04-03T21:50:02.403609+0000","last_undegraded":"2022-04-03T21:50:02.403609+0000","last_fullsized":"2022-04-03T21:50:02.403609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:10:19.197449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410357+0000","last_change":"2022-04-03T21:49:57.858802+0000","last_active":"2022-04-03T21:50:02.410357+0000","last_peered":"2022-04-03T21:50:02.410357+0000","last_clean":"2022-04-03T21:50:02.410357+0000","last_became_active":"2022-04-03T21:49:57.858491+0000","last_became_peered":"2022-04-03T21:49:57.858491+0000","last_unstale":"2022-04-03T21:50:02.410357+0000","last_undegraded":"2022-04-03T21:50:02.410357+0000","last_fullsized":"2022-04-03T21:50:02.410357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:18:02.365918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409115+0000","last_change":"2022-04-03T21:49:58.400587+0000","last_active":"2022-04-03T21:50:02.409115+0000","last_peered":"2022-04-03T21:50:02.409115+0000","last_clean":"2022-04-03T21:50:02.409115+0000","last_became_active":"2022-04-03T21:49:58.400277+0000","last_became_peered":"2022-04-03T21:49:58.400277+0000","last_unstale":"2022-04-03T21:50:02.409115+0000","last_undegraded":"2022-04-03T21:50:02.409115+0000","last_fullsized":"2022-04-03T21:50:02.409115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:17:55.722041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428327+0000","last_change":"2022-04-03T21:50:02.424828+0000","last_active":"2022-04-03T21:50:02.428327+0000","last_peered":"2022-04-03T21:50:02.428327+0000","last_clean":"2022-04-03T21:50:02.428327+0000","last_became_active":"2022-04-03T21:50:02.424406+0000","last_became_peered":"2022-04-03T21:50:02.424406+0000","last_unstale":"2022-04-03T21:50:02.428327+0000","last_undegraded":"2022-04-03T21:50:02.428327+0000","last_fullsized":"2022-04-03T21:50:02.428327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:45.759593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405778+0000","last_change":"2022-04-03T21:49:57.870766+0000","last_active":"2022-04-03T21:50:02.405778+0000","last_peered":"2022-04-03T21:50:02.405778+0000","last_clean":"2022-04-03T21:50:02.405778+0000","last_became_active":"2022-04-03T21:49:57.870481+0000","last_became_peered":"2022-04-03T21:49:57.870481+0000","last_unstale":"2022-04-03T21:50:02.405778+0000","last_undegraded":"2022-04-03T21:50:02.405778+0000","last_fullsized":"2022-04-03T21:50:02.405778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:17.100943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406335+0000","last_change":"2022-04-03T21:49:58.402346+0000","last_active":"2022-04-03T21:50:02.406335+0000","last_peered":"2022-04-03T21:50:02.406335+0000","last_clean":"2022-04-03T21:50:02.406335+0000","last_became_active":"2022-04-03T21:49:58.401964+0000","last_became_peered":"2022-04-03T21:49:58.401964+0000","last_unstale":"2022-04-03T21:50:02.406335+0000","last_undegraded":"2022-04-03T21:50:02.406335+0000","last_fullsized":"2022-04-03T21:50:02.406335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:15:23.150292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442587+0000","last_change":"2022-04-03T21:50:02.436307+0000","last_active":"2022-04-03T21:50:02.442587+0000","last_peered":"2022-04-03T21:50:02.442587+0000","last_clean":"2022-04-03T21:50:02.442587+0000","last_became_active":"2022-04-03T21:50:02.435842+0000","last_became_peered":"2022-04-03T21:50:02.435842+0000","last_unstale":"2022-04-03T21:50:02.442587+0000","last_undegraded":"2022-04-03T21:50:02.442587+0000","last_fullsized":"2022-04-03T21:50:02.442587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:28:23.964940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413356+0000","last_change":"2022-04-03T21:49:57.873350+0000","last_active":"2022-04-03T21:50:02.413356+0000","last_peered":"2022-04-03T21:50:02.413356+0000","last_clean":"2022-04-03T21:50:02.413356+0000","last_became_active":"2022-04-03T21:49:57.873001+0000","last_became_peered":"2022-04-03T21:49:57.873001+0000","last_unstale":"2022-04-03T21:50:02.413356+0000","last_undegraded":"2022-04-03T21:50:02.413356+0000","last_fullsized":"2022-04-03T21:50:02.413356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:38:09.203088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410774+0000","last_change":"2022-04-03T21:49:58.415091+0000","last_active":"2022-04-03T21:50:02.410774+0000","last_peered":"2022-04-03T21:50:02.410774+0000","last_clean":"2022-04-03T21:50:02.410774+0000","last_became_active":"2022-04-03T21:49:58.414804+0000","last_became_peered":"2022-04-03T21:49:58.414804+0000","last_unstale":"2022-04-03T21:50:02.410774+0000","last_undegraded":"2022-04-03T21:50:02.410774+0000","last_fullsized":"2022-04-03T21:50:02.410774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:32:09.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436838+0000","last_change":"2022-04-03T21:50:02.431066+0000","last_active":"2022-04-03T21:50:02.436838+0000","last_peered":"2022-04-03T21:50:02.436838+0000","last_clean":"2022-04-03T21:50:02.436838+0000","last_became_active":"2022-04-03T21:50:02.430674+0000","last_became_peered":"2022-04-03T21:50:02.430674+0000","last_unstale":"2022-04-03T21:50:02.436838+0000","last_undegraded":"2022-04-03T21:50:02.436838+0000","last_fullsized":"2022-04-03T21:50:02.436838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:55:33.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403806+0000","last_change":"2022-04-03T21:49:57.878346+0000","last_active":"2022-04-03T21:50:02.403806+0000","last_peered":"2022-04-03T21:50:02.403806+0000","last_clean":"2022-04-03T21:50:02.403806+0000","last_became_active":"2022-04-03T21:49:57.877994+0000","last_became_peered":"2022-04-03T21:49:57.877994+0000","last_unstale":"2022-04-03T21:50:02.403806+0000","last_undegraded":"2022-04-03T21:50:02.403806+0000","last_fullsized":"2022-04-03T21:50:02.403806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:59:05.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413728+0000","last_change":"2022-04-03T21:49:58.402592+0000","last_active":"2022-04-03T21:50:02.413728+0000","last_peered":"2022-04-03T21:50:02.413728+0000","last_clean":"2022-04-03T21:50:02.413728+0000","last_became_active":"2022-04-03T21:49:58.402288+0000","last_became_peered":"2022-04-03T21:49:58.402288+0000","last_unstale":"2022-04-03T21:50:02.413728+0000","last_undegraded":"2022-04-03T21:50:02.413728+0000","last_fullsized":"2022-04-03T21:50:02.413728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:06:07.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442588+0000","last_change":"2022-04-03T21:50:02.434794+0000","last_active":"2022-04-03T21:50:02.442588+0000","last_peered":"2022-04-03T21:50:02.442588+0000","last_clean":"2022-04-03T21:50:02.442588+0000","last_became_active":"2022-04-03T21:50:02.434307+0000","last_became_peered":"2022-04-03T21:50:02.434307+0000","last_unstale":"2022-04-03T21:50:02.442588+0000","last_undegraded":"2022-04-03T21:50:02.442588+0000","last_fullsized":"2022-04-03T21:50:02.442588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:05:48.587273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402186+0000","last_change":"2022-04-03T21:49:57.872939+0000","last_active":"2022-04-03T21:50:02.402186+0000","last_peered":"2022-04-03T21:50:02.402186+0000","last_clean":"2022-04-03T21:50:02.402186+0000","last_became_active":"2022-04-03T21:49:57.872688+0000","last_became_peered":"2022-04-03T21:49:57.872688+0000","last_unstale":"2022-04-03T21:50:02.402186+0000","last_undegraded":"2022-04-03T21:50:02.402186+0000","last_fullsized":"2022-04-03T21:50:02.402186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:19:57.738611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401722+0000","last_change":"2022-04-03T21:49:58.405063+0000","last_active":"2022-04-03T21:50:02.401722+0000","last_peered":"2022-04-03T21:50:02.401722+0000","last_clean":"2022-04-03T21:50:02.401722+0000","last_became_active":"2022-04-03T21:49:58.404738+0000","last_became_peered":"2022-04-03T21:49:58.404738+0000","last_unstale":"2022-04-03T21:50:02.401722+0000","last_undegraded":"2022-04-03T21:50:02.401722+0000","last_fullsized":"2022-04-03T21:50:02.401722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:14:24.585390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436350+0000","last_change":"2022-04-03T21:50:02.429562+0000","last_active":"2022-04-03T21:50:02.436350+0000","last_peered":"2022-04-03T21:50:02.436350+0000","last_clean":"2022-04-03T21:50:02.436350+0000","last_became_active":"2022-04-03T21:50:02.429153+0000","last_became_peered":"2022-04-03T21:50:02.429153+0000","last_unstale":"2022-04-03T21:50:02.436350+0000","last_undegraded":"2022-04-03T21:50:02.436350+0000","last_fullsized":"2022-04-03T21:50:02.436350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:23:56.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402210+0000","last_change":"2022-04-03T21:49:57.865475+0000","last_active":"2022-04-03T21:50:02.402210+0000","last_peered":"2022-04-03T21:50:02.402210+0000","last_clean":"2022-04-03T21:50:02.402210+0000","last_became_active":"2022-04-03T21:49:57.865147+0000","last_became_peered":"2022-04-03T21:49:57.865147+0000","last_unstale":"2022-04-03T21:50:02.402210+0000","last_undegraded":"2022-04-03T21:50:02.402210+0000","last_fullsized":"2022-04-03T21:50:02.402210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:47:33.277925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411366+0000","last_change":"2022-04-03T21:49:58.407938+0000","last_active":"2022-04-03T21:50:02.411366+0000","last_peered":"2022-04-03T21:50:02.411366+0000","last_clean":"2022-04-03T21:50:02.411366+0000","last_became_active":"2022-04-03T21:49:58.407645+0000","last_became_peered":"2022-04-03T21:49:58.407645+0000","last_unstale":"2022-04-03T21:50:02.411366+0000","last_undegraded":"2022-04-03T21:50:02.411366+0000","last_fullsized":"2022-04-03T21:50:02.411366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:26:23.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411975+0000","last_change":"2022-04-03T21:49:58.417116+0000","last_active":"2022-04-03T21:50:02.411975+0000","last_peered":"2022-04-03T21:50:02.411975+0000","last_clean":"2022-04-03T21:50:02.411975+0000","last_became_active":"2022-04-03T21:49:58.416601+0000","last_became_peered":"2022-04-03T21:49:58.416601+0000","last_unstale":"2022-04-03T21:50:02.411975+0000","last_undegraded":"2022-04-03T21:50:02.411975+0000","last_fullsized":"2022-04-03T21:50:02.411975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:48:21.551919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410282+0000","last_change":"2022-04-03T21:49:58.406506+0000","last_active":"2022-04-03T21:50:02.410282+0000","last_peered":"2022-04-03T21:50:02.410282+0000","last_clean":"2022-04-03T21:50:02.410282+0000","last_became_active":"2022-04-03T21:49:58.406217+0000","last_became_peered":"2022-04-03T21:49:58.406217+0000","last_unstale":"2022-04-03T21:50:02.410282+0000","last_undegraded":"2022-04-03T21:50:02.410282+0000","last_fullsized":"2022-04-03T21:50:02.410282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:24:30.050855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421819+0000","last_change":"2022-04-03T21:49:58.424077+0000","last_active":"2022-04-03T21:50:02.421819+0000","last_peered":"2022-04-03T21:50:02.421819+0000","last_clean":"2022-04-03T21:50:02.421819+0000","last_became_active":"2022-04-03T21:49:58.423709+0000","last_became_peered":"2022-04-03T21:49:58.423709+0000","last_unstale":"2022-04-03T21:50:02.421819+0000","last_undegraded":"2022-04-03T21:50:02.421819+0000","last_fullsized":"2022-04-03T21:50:02.421819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:55:52.787385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402780+0000","last_change":"2022-04-03T21:49:58.419515+0000","last_active":"2022-04-03T21:50:02.402780+0000","last_peered":"2022-04-03T21:50:02.402780+0000","last_clean":"2022-04-03T21:50:02.402780+0000","last_became_active":"2022-04-03T21:49:58.419270+0000","last_became_peered":"2022-04-03T21:49:58.419270+0000","last_unstale":"2022-04-03T21:50:02.402780+0000","last_undegraded":"2022-04-03T21:50:02.402780+0000","last_fullsized":"2022-04-03T21:50:02.402780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:06:28.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403437+0000","last_change":"2022-04-03T21:49:58.402164+0000","last_active":"2022-04-03T21:50:02.403437+0000","last_peered":"2022-04-03T21:50:02.403437+0000","last_clean":"2022-04-03T21:50:02.403437+0000","last_became_active":"2022-04-03T21:49:58.401871+0000","last_became_peered":"2022-04-03T21:49:58.401871+0000","last_unstale":"2022-04-03T21:50:02.403437+0000","last_undegraded":"2022-04-03T21:50:02.403437+0000","last_fullsized":"2022-04-03T21:50:02.403437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:30:03.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4530,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476746,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":125436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9148,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362692,"statfs":{"total":96636764160,"available":96627396608,"internally_reserved":0,"allocated":839680,"data_stored":651170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9140,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362700,"statfs":{"total":96636764160,"available":96627404800,"internally_reserved":0,"allocated":831488,"data_stored":651078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":121674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8040,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363800,"statfs":{"total":96636764160,"available":96628531200,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":121730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-03T21:50:20.849 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-04-03T21:50:20.850 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-04-03T21:50:20.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-04-03T21:50:20.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-04-03T21:50:20.851 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-04-03T21:50:21.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.063+0000 7fc63a19e700 1 Processor -- start 2022-04-03T21:50:21.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.064+0000 7fc63a19e700 1 -- start start 2022-04-03T21:50:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc63a19e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6340c1f40 0x7fc6340bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc63a19e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc63a19e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6340a4720 con 0x7fc6340bdc00 2022-04-03T21:50:21.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc63a19e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6340a5980 con 0x7fc6340c1f40 2022-04-03T21:50:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc63a19e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340a5280 con 0x7fc6340c2310 2022-04-03T21:50:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc6337fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6340c1f40 0x7fc6340bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc6337fe700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc6340c1f40 0x7fc6340bd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34548/0 (socket says 172.21.15.49:34548) 2022-04-03T21:50:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc632ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.069 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc6337fe700 1 -- 172.21.15.49:0/2426891897 learned_addr learned my addr 172.21.15.49:0/2426891897 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:21.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.065+0000 7fc633fff700 1 --1- 172.21.15.49:0/2426891897 >> v1:172.21.15.117:6789/0 conn(0x7fc6340bdc00 0x7fc6341482f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47402/0 (socket says 172.21.15.49:47402) 2022-04-03T21:50:21.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc632ffd700 1 -- 172.21.15.49:0/2426891897 >> v2:172.21.15.49:3300/0 conn(0x7fc6340c1f40 msgr2=0x7fc6340bd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:21.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc632ffd700 1 --2- 172.21.15.49:0/2426891897 >> v2:172.21.15.49:3300/0 conn(0x7fc6340c1f40 0x7fc6340bd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.070 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc632ffd700 1 -- 172.21.15.49:0/2426891897 >> v1:172.21.15.117:6789/0 conn(0x7fc6340bdc00 legacy=0x7fc6341482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc632ffd700 1 -- 172.21.15.49:0/2426891897 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340a49e0 con 0x7fc6340c2310 2022-04-03T21:50:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc632ffd700 1 --2- 172.21.15.49:0/2426891897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340a6bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc628009760 tx=0x7fc628009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76e8d461843782c server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc6327fc700 1 -- 172.21.15.49:0/2426891897 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011630 con 0x7fc6340c2310 2022-04-03T21:50:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc6327fc700 1 -- 172.21.15.49:0/2426891897 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc628011790 con 0x7fc6340c2310 2022-04-03T21:50:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.066+0000 7fc6327fc700 1 -- 172.21.15.49:0/2426891897 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011b50 con 0x7fc6340c2310 2022-04-03T21:50:21.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 -- 172.21.15.49:0/2426891897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 msgr2=0x7fc6340a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2426891897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340a6bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc628009760 tx=0x7fc628009060 comp rx=0 tx=0).stop 2022-04-03T21:50:21.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 -- 172.21.15.49:0/2426891897 shutdown_connections 2022-04-03T21:50:21.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2426891897 >> v2:172.21.15.49:3300/0 conn(0x7fc6340c1f40 0x7fc6340bd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2426891897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340a6bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 -- 172.21.15.49:0/2426891897 >> 172.21.15.49:0/2426891897 conn(0x7fc63405e010 msgr2=0x7fc6340c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:21.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 -- 172.21.15.49:0/2426891897 shutdown_connections 2022-04-03T21:50:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.067+0000 7fc63a19e700 1 -- 172.21.15.49:0/2426891897 wait complete. 2022-04-03T21:50:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.068+0000 7fc63a19e700 1 Processor -- start 2022-04-03T21:50:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.069+0000 7fc63a19e700 1 -- start start 2022-04-03T21:50:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc63a19e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6340bdc00 0x7fc6340a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc63a19e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6340c1f40 0x7fc6340b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc63a19e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc63a19e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340a3200 con 0x7fc6340c1f40 2022-04-03T21:50:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc63a19e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340a2810 con 0x7fc6340bdc00 2022-04-03T21:50:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc63a19e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340a2440 con 0x7fc6340c2310 2022-04-03T21:50:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc632ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6340c1f40 0x7fc6340b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc633fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc6337fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6340bdc00 0x7fc6340a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc633fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340b89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45776/0 (socket says 172.21.15.49:45776) 2022-04-03T21:50:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc633fff700 1 -- 172.21.15.49:0/2692922489 learned_addr learned my addr 172.21.15.49:0/2692922489 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc632ffd700 1 -- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 msgr2=0x7fc6340b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc632ffd700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc632ffd700 1 -- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6340bdc00 msgr2=0x7fc6340a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc632ffd700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6340bdc00 0x7fc6340a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.070+0000 7fc632ffd700 1 -- 172.21.15.49:0/2692922489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6280092a0 con 0x7fc6340c1f40 2022-04-03T21:50:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc633fff700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc6337fe700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6340bdc00 0x7fc6340a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc632ffd700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6340c1f40 0x7fc6340b7d00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc628016000 tx=0x7fc628017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011900 con 0x7fc6340c1f40 2022-04-03T21:50:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc628011a80 con 0x7fc6340c1f40 2022-04-03T21:50:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280042a0 con 0x7fc6340c1f40 2022-04-03T21:50:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63415b170 con 0x7fc6340c1f40 2022-04-03T21:50:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.071+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6340b4e60 con 0x7fc6340c1f40 2022-04-03T21:50:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.072+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6340b5140 con 0x7fc6340c1f40 2022-04-03T21:50:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.073+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fc62802b030 con 0x7fc6340c1f40 2022-04-03T21:50:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.074+0000 7fc61b7fe700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc614063d10 0x7fc6140661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.074+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc6280820a0 con 0x7fc6340c1f40 2022-04-03T21:50:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.075+0000 7fc6337fe700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc614063d10 0x7fc6140661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.075+0000 7fc6337fe700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc614063d10 0x7fc6140661c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc624006bc0 tx=0x7fc6240090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.079+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fc6280508a0 con 0x7fc6340c1f40 2022-04-03T21:50:21.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.340+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc634070a20 con 0x7fc6340c1f40 2022-04-03T21:50:21.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.344+0000 7fc61b7fe700 1 -- 172.21.15.49:0/2692922489 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+158617 (secure 0 0 0) 0x7fc628029020 con 0x7fc6340c1f40 2022-04-03T21:50:21.347 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:21.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.347+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc614063d10 msgr2=0x7fc6140661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.347+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc614063d10 0x7fc6140661c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc624006bc0 tx=0x7fc6240090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.347+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6340c1f40 msgr2=0x7fc6340b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.347+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6340c1f40 0x7fc6340b7d00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc628016000 tx=0x7fc628017000 comp rx=0 tx=0).stop 2022-04-03T21:50:21.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 shutdown_connections 2022-04-03T21:50:21.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc614063d10 0x7fc6140661c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c2310 0x7fc6340b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6340bdc00 0x7fc6340a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 --2- 172.21.15.49:0/2692922489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6340c1f40 0x7fc6340b7d00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 >> 172.21.15.49:0/2692922489 conn(0x7fc63405e010 msgr2=0x7fc634068d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:21.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 shutdown_connections 2022-04-03T21:50:21.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.348+0000 7fc63a19e700 1 -- 172.21.15.49:0/2692922489 wait complete. 2022-04-03T21:50:21.373 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":26568},{"type":"v1","addr":"172.21.15.117:6833","nonce":26568}]},"active_addr":"172.21.15.117:6833/26568","active_change":"2022-04-03T21:49:36.076898+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3235714758}]},{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":376141407}]},{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":186061018}]},{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3177330647}]}]}} 2022-04-03T21:50:21.377 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-04-03T21:50:21.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-04-03T21:50:21.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.590+0000 7f97f3276700 1 Processor -- start 2022-04-03T21:50:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.591+0000 7f97f3276700 1 -- start start 2022-04-03T21:50:21.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f3276700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec06e7b0 0x7f97ec0bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f3276700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec148c40 con 0x7f97ec0bd8d0 2022-04-03T21:50:21.596 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f3276700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec14cc00 con 0x7f97ec149140 2022-04-03T21:50:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f3276700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0a06c0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f1012700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f97ec0bd8d0 0x7f97ec142ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50480/0 (socket says 172.21.15.49:50480) 2022-04-03T21:50:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f1012700 1 -- 172.21.15.49:0/3300088091 learned_addr learned my addr 172.21.15.49:0/3300088091 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:21.597 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.592+0000 7f97f0811700 1 --2- 172.21.15.49:0/3300088091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec06e7b0 0x7f97ec0bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.598 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97dbfff700 1 -- 172.21.15.49:0/3300088091 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252574757 0 0) 0x7f97ec148c40 con 0x7f97ec0bd8d0 2022-04-03T21:50:21.598 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97dbfff700 1 -- 172.21.15.49:0/3300088091 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d40033f0 con 0x7f97ec0bd8d0 2022-04-03T21:50:21.598 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97dbfff700 1 -- 172.21.15.49:0/3300088091 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467205856 0 0) 0x7f97ec14cc00 con 0x7f97ec149140 2022-04-03T21:50:21.598 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97f0811700 1 -- 172.21.15.49:0/3300088091 >> v1:172.21.15.117:6789/0 conn(0x7f97ec149140 legacy=0x7f97ec1495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97f0811700 1 -- 172.21.15.49:0/3300088091 >> v1:172.21.15.49:6789/0 conn(0x7f97ec0bd8d0 legacy=0x7f97ec142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97f0811700 1 -- 172.21.15.49:0/3300088091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec14cec0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97f0811700 1 --2- 172.21.15.49:0/3300088091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec06e7b0 0x7f97ec0bdca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009790 tx=0x7f97dc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a3b8b122d621e6a server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:21.599 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97dbfff700 1 -- 172.21.15.49:0/3300088091 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc011630 con 0x7f97ec06e7b0 2022-04-03T21:50:21.600 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97dbfff700 1 -- 172.21.15.49:0/3300088091 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc011790 con 0x7f97ec06e7b0 2022-04-03T21:50:21.600 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.593+0000 7f97dbfff700 1 -- 172.21.15.49:0/3300088091 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc011b30 con 0x7f97ec06e7b0 2022-04-03T21:50:21.600 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 -- 172.21.15.49:0/3300088091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec06e7b0 msgr2=0x7f97ec0bdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.600 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 --2- 172.21.15.49:0/3300088091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec06e7b0 0x7f97ec0bdca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009790 tx=0x7f97dc009060 comp rx=0 tx=0).stop 2022-04-03T21:50:21.601 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 -- 172.21.15.49:0/3300088091 shutdown_connections 2022-04-03T21:50:21.601 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 --2- 172.21.15.49:0/3300088091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec06e7b0 0x7f97ec0bdca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.601 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 -- 172.21.15.49:0/3300088091 >> 172.21.15.49:0/3300088091 conn(0x7f97ec067560 msgr2=0x7f97ec0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:21.601 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 -- 172.21.15.49:0/3300088091 shutdown_connections 2022-04-03T21:50:21.601 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.594+0000 7f97f3276700 1 -- 172.21.15.49:0/3300088091 wait complete. 2022-04-03T21:50:21.604 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.596+0000 7f97f3276700 1 Processor -- start 2022-04-03T21:50:21.605 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.596+0000 7f97f3276700 1 -- start start 2022-04-03T21:50:21.605 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f3276700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 0x7f97ec0b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.605 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f3276700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec0bd8d0 0x7f97ec09dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.605 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f3276700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ec149140 0x7f97ec09e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f3276700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0b3ab0 con 0x7f97ec149140 2022-04-03T21:50:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f3276700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0b65b0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f3276700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0b28c0 con 0x7f97ec0bd8d0 2022-04-03T21:50:21.606 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 0x7f97ec0b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1813700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ec149140 0x7f97ec09e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f0811700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec0bd8d0 0x7f97ec09dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 0x7f97ec0b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35382/0 (socket says 172.21.15.49:35382) 2022-04-03T21:50:21.607 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 -- 172.21.15.49:0/1489435866 learned_addr learned my addr 172.21.15.49:0/1489435866 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 -- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec0bd8d0 msgr2=0x7f97ec09dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec0bd8d0 0x7f97ec09dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 -- 172.21.15.49:0/1489435866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ec149140 msgr2=0x7f97ec09e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.597+0000 7f97f1012700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ec149140 0x7f97ec09e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.608 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97f1012700 1 -- 172.21.15.49:0/1489435866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0092a0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.609 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97f1012700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 0x7f97ec0b2380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97e800c470 tx=0x7f97e8007c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:21.609 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800ce20 con 0x7f97ec06e7b0 2022-04-03T21:50:21.609 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80072e0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.609 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0b32a0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8005780 con 0x7f97ec06e7b0 2022-04-03T21:50:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.598+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec0b37d0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.599+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec0a0450 con 0x7f97ec06e7b0 2022-04-03T21:50:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.600+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f97e8019030 con 0x7f97ec06e7b0 2022-04-03T21:50:21.610 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.601+0000 7f97d97fa700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f97cc063d10 0x7f97cc0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.601+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f97e807fcf0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.602+0000 7f97f0811700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f97cc063d10 0x7f97cc0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:21.611 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.602+0000 7f97f0811700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f97cc063d10 0x7f97cc0661c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0b0960 tx=0x7f97dc017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:21.612 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.606+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f97e804e5e0 con 0x7f97ec06e7b0 2022-04-03T21:50:21.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.817+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97ec070a20 con 0x7f97ec06e7b0 2022-04-03T21:50:21.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.818+0000 7f97d97fa700 1 -- 172.21.15.49:0/1489435866 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f97e8017030 con 0x7f97ec06e7b0 2022-04-03T21:50:21.820 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:21.821 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:21.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f97cc063d10 msgr2=0x7f97cc0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f97cc063d10 0x7f97cc0661c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0b0960 tx=0x7f97dc017000 comp rx=0 tx=0).stop 2022-04-03T21:50:21.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 msgr2=0x7f97ec0b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:21.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 0x7f97ec0b2380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97e800c470 tx=0x7f97e8007c30 comp rx=0 tx=0).stop 2022-04-03T21:50:21.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 shutdown_connections 2022-04-03T21:50:21.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f97cc063d10 0x7f97cc0661c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ec149140 0x7f97ec09e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97ec06e7b0 0x7f97ec0b2380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 --2- 172.21.15.49:0/1489435866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97ec0bd8d0 0x7f97ec09dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 >> 172.21.15.49:0/1489435866 conn(0x7f97ec067560 msgr2=0x7f97ec0a2060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 shutdown_connections 2022-04-03T21:50:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:21.821+0000 7f97f3276700 1 -- 172.21.15.49:0/1489435866 wait complete. 2022-04-03T21:50:21.848 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-04-03T21:50:21.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.062+0000 7f9c00c70700 1 Processor -- start 2022-04-03T21:50:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.062+0000 7f9c00c70700 1 -- start start 2022-04-03T21:50:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.063+0000 7f9c00c70700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c2300 0x7f9bfc14b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.063+0000 7f9c00c70700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 0x7f9bfc14be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.063+0000 7f9c00c70700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0bda50 con 0x7f9bfc0c1f30 2022-04-03T21:50:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.063+0000 7f9c00c70700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bfc0bca90 con 0x7f9bfc0a73e0 2022-04-03T21:50:22.066 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.063+0000 7f9c00c70700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0bdf60 con 0x7f9bfc0c2300 2022-04-03T21:50:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bfad9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 0x7f9bfc14be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bf3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c2300 0x7f9bfc14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bfad9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 0x7f9bfc14be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35384/0 (socket says 172.21.15.49:35384) 2022-04-03T21:50:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bfa59c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9bfc0c1f30 0x7f9bfc0a4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47408/0 (socket says 172.21.15.49:47408) 2022-04-03T21:50:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bfad9d700 1 -- 172.21.15.49:0/1532142080 learned_addr learned my addr 172.21.15.49:0/1532142080 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.071 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bf3fff700 1 -- 172.21.15.49:0/1532142080 >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 msgr2=0x7f9bfc14be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bf3fff700 1 --2- 172.21.15.49:0/1532142080 >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 0x7f9bfc14be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bf3fff700 1 -- 172.21.15.49:0/1532142080 >> v1:172.21.15.117:6789/0 conn(0x7f9bfc0c1f30 legacy=0x7f9bfc0a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bf3fff700 1 -- 172.21.15.49:0/1532142080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0bcd00 con 0x7f9bfc0c2300 2022-04-03T21:50:22.072 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bf9d9b700 1 -- 172.21.15.49:0/1532142080 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562733807 0 0) 0x7f9bfc0bda50 con 0x7f9bfc0c1f30 2022-04-03T21:50:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.064+0000 7f9bfad9d700 1 --2- 172.21.15.49:0/1532142080 >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 0x7f9bfc14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.065+0000 7f9bf3fff700 1 --2- 172.21.15.49:0/1532142080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c2300 0x7f9bfc14b950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009760 tx=0x7f9be4009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53132467cf2b19e0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.065+0000 7f9bf9d9b700 1 -- 172.21.15.49:0/1532142080 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4011630 con 0x7f9bfc0c2300 2022-04-03T21:50:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.065+0000 7f9bf9d9b700 1 -- 172.21.15.49:0/1532142080 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4011790 con 0x7f9bfc0c2300 2022-04-03T21:50:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.065+0000 7f9bf9d9b700 1 -- 172.21.15.49:0/1532142080 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4011b50 con 0x7f9bfc0c2300 2022-04-03T21:50:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 -- 172.21.15.49:0/1532142080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c2300 msgr2=0x7f9bfc14b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1532142080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c2300 0x7f9bfc14b950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009760 tx=0x7f9be4009060 comp rx=0 tx=0).stop 2022-04-03T21:50:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 -- 172.21.15.49:0/1532142080 shutdown_connections 2022-04-03T21:50:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1532142080 >> v2:172.21.15.117:3300/0 conn(0x7f9bfc0a73e0 0x7f9bfc14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1532142080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c2300 0x7f9bfc14b950 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 -- 172.21.15.49:0/1532142080 >> 172.21.15.49:0/1532142080 conn(0x7f9bfc05dfd0 msgr2=0x7f9bfc0c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 -- 172.21.15.49:0/1532142080 shutdown_connections 2022-04-03T21:50:22.075 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.066+0000 7f9c00c70700 1 -- 172.21.15.49:0/1532142080 wait complete. 2022-04-03T21:50:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.067+0000 7f9c00c70700 1 Processor -- start 2022-04-03T21:50:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 -- start start 2022-04-03T21:50:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bfc0a73e0 0x7f9bfc14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c1f30 0x7f9bfc0b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.076 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 0x7f9bfc15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0bb3b0 con 0x7f9bfc0c2300 2022-04-03T21:50:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc14a100 con 0x7f9bfc0a73e0 2022-04-03T21:50:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.068+0000 7f9c00c70700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc149b10 con 0x7f9bfc0c1f30 2022-04-03T21:50:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 0x7f9bfc15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.077 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfa59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bfc0a73e0 0x7f9bfc14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 0x7f9bfc15e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34554/0 (socket says 172.21.15.49:34554) 2022-04-03T21:50:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bf3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c1f30 0x7f9bfc0b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 -- 172.21.15.49:0/1437135449 learned_addr learned my addr 172.21.15.49:0/1437135449 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 -- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c1f30 msgr2=0x7f9bfc0b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.078 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c1f30 0x7f9bfc0b9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 -- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bfc0a73e0 msgr2=0x7f9bfc14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bfc0a73e0 0x7f9bfc14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfad9d700 1 -- 172.21.15.49:0/1437135449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4009ae0 con 0x7f9bfc0c2300 2022-04-03T21:50:22.079 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.069+0000 7f9bfa59c700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bfc0a73e0 0x7f9bfc14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:22.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.070+0000 7f9bfad9d700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 0x7f9bfc15e760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400c0c0 tx=0x7f9bf400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.070+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400c9f0 con 0x7f9bfc0c2300 2022-04-03T21:50:22.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.070+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf400f040 con 0x7f9bfc0c2300 2022-04-03T21:50:22.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.070+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400cda0 con 0x7f9bfc0c2300 2022-04-03T21:50:22.080 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.070+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be40092a0 con 0x7f9bfc0c2300 2022-04-03T21:50:22.081 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.070+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc15f2a0 con 0x7f9bfc0c2300 2022-04-03T21:50:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.071+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc070a20 con 0x7f9bfc0c2300 2022-04-03T21:50:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.072+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9bf4014690 con 0x7f9bfc0c2300 2022-04-03T21:50:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.073+0000 7f9bf27fc700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9be0063ce0 0x7f9be0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.073+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9bf4081450 con 0x7f9bfc0c2300 2022-04-03T21:50:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.073+0000 7f9bfa59c700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9be0063ce0 0x7f9be0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.074+0000 7f9bfa59c700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9be0063ce0 0x7f9be0066190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007990 tx=0x7f9bec007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.077+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9bf404fd40 con 0x7f9bfc0c2300 2022-04-03T21:50:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.284+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bfc14a240 con 0x7f9bfc0c2300 2022-04-03T21:50:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.285+0000 7f9bf27fc700 1 -- 172.21.15.49:0/1437135449 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f9bf4053360 con 0x7f9bfc0c2300 2022-04-03T21:50:22.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:22.287 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9be0063ce0 msgr2=0x7f9be0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9be0063ce0 0x7f9be0066190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007990 tx=0x7f9bec007bb0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 msgr2=0x7f9bfc15e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 0x7f9bfc15e760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400c0c0 tx=0x7f9bf400b040 comp rx=0 tx=0).stop 2022-04-03T21:50:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 shutdown_connections 2022-04-03T21:50:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9be0063ce0 0x7f9be0066190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bfc0c2300 0x7f9bfc15e760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bfc0a73e0 0x7f9bfc14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 --2- 172.21.15.49:0/1437135449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bfc0c1f30 0x7f9bfc0b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.287+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 >> 172.21.15.49:0/1437135449 conn(0x7f9bfc05dfd0 msgr2=0x7f9bfc148600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.288+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 shutdown_connections 2022-04-03T21:50:22.292 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.288+0000 7f9c00c70700 1 -- 172.21.15.49:0/1437135449 wait complete. 2022-04-03T21:50:22.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-04-03T21:50:22.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-04-03T21:50:22.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-04-03T21:50:22.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-04-03T21:50:22.317 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-04-03T21:50:22.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-04-03T21:50:22.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-04-03T21:50:22.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-04-03T21:50:22.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:50:22.523 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:50:22.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.736+0000 7f9ac0037700 1 Processor -- start 2022-04-03T21:50:22.738 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.736+0000 7f9ac0037700 1 -- start start 2022-04-03T21:50:22.744 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.738+0000 7f9ac0037700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9ab80b7aa0 0x7f9ab80b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.744 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.738+0000 7f9ac0037700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab806ed90 con 0x7f9ab80675f0 2022-04-03T21:50:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.738+0000 7f9ac0037700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80b8790 con 0x7f9ab80b94b0 2022-04-03T21:50:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.738+0000 7f9ac0037700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab806d720 con 0x7f9ab80b7aa0 2022-04-03T21:50:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.740+0000 7f9abddd3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9ab80675f0 0x7f9ab806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50482/0 (socket says 172.21.15.49:50482) 2022-04-03T21:50:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.740+0000 7f9abddd3700 1 -- 172.21.15.49:0/2632310841 learned_addr learned my addr 172.21.15.49:0/2632310841 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:22.746 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.740+0000 7f9abd5d2700 1 --2- 172.21.15.49:0/2632310841 >> v2:172.21.15.49:3300/0 conn(0x7f9ab80b7aa0 0x7f9ab80b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.746 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.739+0000 7fa542a17700 1 Processor -- start 2022-04-03T21:50:22.747 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.740+0000 7fa542a17700 1 -- start start 2022-04-03T21:50:22.747 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.741+0000 7fa542a17700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa53c0675f0 0x7fa53c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.747 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.741+0000 7fa542a17700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0b7aa0 0x7fa53c069a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.747 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.741+0000 7fa542a17700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c06ed90 con 0x7fa53c06c5b0 2022-04-03T21:50:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.741+0000 7fa542a17700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c06d720 con 0x7fa53c0675f0 2022-04-03T21:50:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.741+0000 7fa542a17700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0b8790 con 0x7fa53c0b7aa0 2022-04-03T21:50:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.742+0000 7fa53b7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa53c06c5b0 0x7fa53c069380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47412/0 (socket says 172.21.15.49:47412) 2022-04-03T21:50:22.748 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.742+0000 7fa53b7fe700 1 -- 172.21.15.49:0/3415272879 learned_addr learned my addr 172.21.15.49:0/3415272879 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.743+0000 7fa53bfff700 1 --2- 172.21.15.49:0/3415272879 >> v2:172.21.15.49:3300/0 conn(0x7fa53c0675f0 0x7fa53c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.743+0000 7fa53affd700 1 -- 172.21.15.49:0/3415272879 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783531467 0 0) 0x7fa53c06ed90 con 0x7fa53c06c5b0 2022-04-03T21:50:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.743+0000 7fa53affd700 1 -- 172.21.15.49:0/3415272879 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5280033f0 con 0x7fa53c06c5b0 2022-04-03T21:50:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.744+0000 7fa53bfff700 1 -- 172.21.15.49:0/3415272879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0b7aa0 msgr2=0x7fa53c069a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-04-03T21:50:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.744+0000 7fa53bfff700 1 --2- 172.21.15.49:0/3415272879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0b7aa0 0x7fa53c069a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.744+0000 7fa53bfff700 1 -- 172.21.15.49:0/3415272879 >> v1:172.21.15.117:6789/0 conn(0x7fa53c06c5b0 legacy=0x7fa53c069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.744+0000 7fa53bfff700 1 -- 172.21.15.49:0/3415272879 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0b84b0 con 0x7fa53c0675f0 2022-04-03T21:50:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.743+0000 7f9abd5d2700 1 -- 172.21.15.49:0/2632310841 >> v1:172.21.15.117:6789/0 conn(0x7f9ab80b94b0 legacy=0x7f9ab814aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.743+0000 7f9abd5d2700 1 -- 172.21.15.49:0/2632310841 >> v1:172.21.15.49:6789/0 conn(0x7f9ab80675f0 legacy=0x7f9ab806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.743+0000 7f9abd5d2700 1 -- 172.21.15.49:0/2632310841 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80b84b0 con 0x7f9ab80b7aa0 2022-04-03T21:50:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.745+0000 7f8c78720700 1 Processor -- start 2022-04-03T21:50:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.745+0000 7f9abd5d2700 1 --2- 172.21.15.49:0/2632310841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80b7aa0 0x7f9ab80b8f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009760 tx=0x7f9ab4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb906b4dbeab0e32 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.746+0000 7fa53bfff700 1 --2- 172.21.15.49:0/3415272879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0675f0 0x7fa53c06c070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa52c007fd0 tx=0x7fa52c00b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18297986352d4ed1 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.745+0000 7f8c78720700 1 -- start start 2022-04-03T21:50:22.753 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f8c78720700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c7006c230 0x7f8c700b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f8c78720700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7006ed90 con 0x7f8c7006c600 2022-04-03T21:50:22.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f8c78720700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7006a1a0 con 0x7f8c700b7aa0 2022-04-03T21:50:22.754 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f8c78720700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7006d720 con 0x7f8c7006c230 2022-04-03T21:50:22.755 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7fa53affd700 1 -- 172.21.15.49:0/3415272879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530001470 con 0x7fa53c0675f0 2022-04-03T21:50:22.755 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7fa53affd700 1 -- 172.21.15.49:0/3415272879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00bed0 con 0x7fa53c0675f0 2022-04-03T21:50:22.755 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7fa53affd700 1 -- 172.21.15.49:0/3415272879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c004260 con 0x7fa53c0675f0 2022-04-03T21:50:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f9abcdd1700 1 -- 172.21.15.49:0/2632310841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4004030 con 0x7f9ab80b7aa0 2022-04-03T21:50:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f9abcdd1700 1 -- 172.21.15.49:0/2632310841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4004190 con 0x7f9ab80b7aa0 2022-04-03T21:50:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.747+0000 7f9abcdd1700 1 -- 172.21.15.49:0/2632310841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011630 con 0x7f9ab80b7aa0 2022-04-03T21:50:22.757 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.748+0000 7fa542a17700 1 -- 172.21.15.49:0/3415272879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0675f0 msgr2=0x7fa53c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.757 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.748+0000 7fa542a17700 1 --2- 172.21.15.49:0/3415272879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0675f0 0x7fa53c06c070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa52c007fd0 tx=0x7fa52c00b2f0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.757 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.749+0000 7fa542a17700 1 -- 172.21.15.49:0/3415272879 shutdown_connections 2022-04-03T21:50:22.758 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.749+0000 7fa542a17700 1 --2- 172.21.15.49:0/3415272879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0b7aa0 0x7fa53c069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.758 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.749+0000 7fa542a17700 1 --2- 172.21.15.49:0/3415272879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0675f0 0x7fa53c06c070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.758 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.749+0000 7fa542a17700 1 -- 172.21.15.49:0/3415272879 >> 172.21.15.49:0/3415272879 conn(0x7fa53c066ae0 msgr2=0x7fa53c066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.759 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.749+0000 7f05d4623700 1 Processor -- start 2022-04-03T21:50:22.759 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.748+0000 7f8c764bc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c7006c230 0x7f8c700b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.759 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.748+0000 7f8c764bc700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8c7006c230 0x7f8c700b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34560/0 (socket says 172.21.15.49:34560) 2022-04-03T21:50:22.759 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.748+0000 7f8c764bc700 1 -- 172.21.15.49:0/2350134224 learned_addr learned my addr 172.21.15.49:0/2350134224 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.760 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.749+0000 7f05d4623700 1 -- start start 2022-04-03T21:50:22.760 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.750+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430167179 0 0) 0x7f8c7006a1a0 con 0x7f8c700b7aa0 2022-04-03T21:50:22.761 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.750+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c580033f0 con 0x7f8c700b7aa0 2022-04-03T21:50:22.761 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f9ac0037700 1 -- 172.21.15.49:0/2632310841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80b7aa0 msgr2=0x7f9ab80b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.761 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f9ac0037700 1 --2- 172.21.15.49:0/2632310841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80b7aa0 0x7f9ab80b8f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009760 tx=0x7f9ab4009060 comp rx=0 tx=0).stop 2022-04-03T21:50:22.762 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f9ac0037700 1 -- 172.21.15.49:0/2632310841 shutdown_connections 2022-04-03T21:50:22.762 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f9ac0037700 1 --2- 172.21.15.49:0/2632310841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80b7aa0 0x7f9ab80b8f70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.762 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f9ac0037700 1 -- 172.21.15.49:0/2632310841 >> 172.21.15.49:0/2632310841 conn(0x7f9ab8066ae0 msgr2=0x7f9ab8066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.763 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2066896903 0 0) 0x7f8c580033f0 con 0x7f8c700b7aa0 2022-04-03T21:50:22.763 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 >> v2:172.21.15.49:3300/0 conn(0x7f8c7006c230 msgr2=0x7f8c700b8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.764 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 --2- 172.21.15.49:0/2350134224 >> v2:172.21.15.49:3300/0 conn(0x7f8c7006c230 0x7f8c700b8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.764 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 >> v1:172.21.15.49:6789/0 conn(0x7f8c7006c600 legacy=0x7f8c70069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.764 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700b8790 con 0x7f8c700b7aa0 2022-04-03T21:50:22.764 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 18272773 0 0) 0x7f8c60001470 con 0x7f8c700b7aa0 2022-04-03T21:50:22.765 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 >> v1:172.21.15.117:6789/0 conn(0x7f8c700b7aa0 legacy=0x7f8c70069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.765 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58003960 0x7f8c58003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.765 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c58004690 0x7f8c58004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.765 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c58005090 0x7f8c5800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.765 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7006d720 con 0x7f8c58005090 2022-04-03T21:50:22.766 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5800c060 con 0x7f8c58003960 2022-04-03T21:50:22.766 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5800c220 con 0x7f8c58004690 2022-04-03T21:50:22.766 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f05d4623700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f05cc0b7aa0 0x7f05cc0b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f05d4623700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0b94b0 0x7f05cc14aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f05d4623700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc06ed90 con 0x7f05cc0675f0 2022-04-03T21:50:22.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f05d4623700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc06d720 con 0x7f05cc0b7aa0 2022-04-03T21:50:22.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.751+0000 7f05d4623700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0b8790 con 0x7f05cc0b94b0 2022-04-03T21:50:22.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.752+0000 7f05d23bf700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f05cc0675f0 0x7f05cc06c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47416/0 (socket says 172.21.15.49:47416) 2022-04-03T21:50:22.768 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.752+0000 7f05d23bf700 1 -- 172.21.15.49:0/1300616702 learned_addr learned my addr 172.21.15.49:0/1300616702 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:22.768 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.752+0000 7f3ab793b700 1 Processor -- start 2022-04-03T21:50:22.768 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.752+0000 7f3ab793b700 1 -- start start 2022-04-03T21:50:22.769 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.752+0000 7f8c764bc700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58003960 0x7f8c58003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.769 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f8c75cbb700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c58004690 0x7f8c58004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.770 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f05d1bbe700 1 --2- 172.21.15.49:0/1300616702 >> v2:172.21.15.49:3300/0 conn(0x7f05cc0b7aa0 0x7f05cc0b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.770 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f05d13bd700 1 -- 172.21.15.49:0/1300616702 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715020348 0 0) 0x7f05cc06ed90 con 0x7f05cc0675f0 2022-04-03T21:50:22.770 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f05d13bd700 1 -- 172.21.15.49:0/1300616702 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b40033f0 con 0x7f05cc0675f0 2022-04-03T21:50:22.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f05d1bbe700 1 -- 172.21.15.49:0/1300616702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0b94b0 msgr2=0x7f05cc14aa90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-04-03T21:50:22.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f05d1bbe700 1 --2- 172.21.15.49:0/1300616702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0b94b0 0x7f05cc14aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f05d1bbe700 1 -- 172.21.15.49:0/1300616702 >> v1:172.21.15.117:6789/0 conn(0x7f05cc0675f0 legacy=0x7f05cc06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f05d1bbe700 1 -- 172.21.15.49:0/1300616702 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0b98f0 con 0x7f05cc0b7aa0 2022-04-03T21:50:22.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f3ab793b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069540 0x7f3ab00a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f3ab793b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ab0069910 0x7f3ab00a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f3ab793b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab006c070 con 0x7f3ab00b7aa0 2022-04-03T21:50:22.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f3ab793b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab006cab0 con 0x7f3ab0069910 2022-04-03T21:50:22.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f3ab793b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab006c350 con 0x7f3ab0069540 2022-04-03T21:50:22.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f3ab56d7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069540 0x7f3ab00a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f3ab5ed8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3ab00b7aa0 0x7f3ab00aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50486/0 (socket says 172.21.15.49:50486) 2022-04-03T21:50:22.774 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f3ab5ed8700 1 -- 172.21.15.49:0/2642316228 learned_addr learned my addr 172.21.15.49:0/2642316228 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:22.774 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f05d1bbe700 1 --2- 172.21.15.49:0/1300616702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 0x7f05cc0b8f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009760 tx=0x7f05bc009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c091903628c339 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f8c75cbb700 1 -- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58003960 msgr2=0x7f8c58003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f8c75cbb700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58003960 0x7f8c58003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f8c75cbb700 1 -- 172.21.15.49:0/2350134224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c58005090 msgr2=0x7f8c5800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f8c75cbb700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c58005090 0x7f8c5800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.753+0000 7f8c75cbb700 1 -- 172.21.15.49:0/2350134224 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700b8790 con 0x7f8c58004690 2022-04-03T21:50:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f8c75cbb700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c58004690 0x7f8c58004b00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004610 tx=0x7f8c6c007c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de909c22d5b67fe7 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.754+0000 7f8c76cbd700 1 -- 172.21.15.49:0/2350134224 reap_dead start 2022-04-03T21:50:22.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c013070 con 0x7f8c58004690 2022-04-03T21:50:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00e110 con 0x7f8c58004690 2022-04-03T21:50:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.755+0000 7f8c754ba700 1 -- 172.21.15.49:0/2350134224 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0050f0 con 0x7f8c58004690 2022-04-03T21:50:22.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f3ab56d7700 1 -- 172.21.15.49:0/2642316228 >> v2:172.21.15.117:3300/0 conn(0x7f3ab0069910 msgr2=0x7f3ab00a13f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-04-03T21:50:22.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f3ab56d7700 1 --2- 172.21.15.49:0/2642316228 >> v2:172.21.15.117:3300/0 conn(0x7f3ab0069910 0x7f3ab00a13f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f3ab56d7700 1 -- 172.21.15.49:0/2642316228 >> v1:172.21.15.49:6789/0 conn(0x7f3ab00b7aa0 legacy=0x7f3ab00aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f8c78720700 1 -- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c58004690 msgr2=0x7f8c58004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.779 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f8c78720700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c58004690 0x7f8c58004b00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004610 tx=0x7f8c6c007c40 comp rx=0 tx=0).stop 2022-04-03T21:50:22.779 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f3ab56d7700 1 -- 172.21.15.49:0/2642316228 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0069e10 con 0x7f3ab0069540 2022-04-03T21:50:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f3ab56d7700 1 --2- 172.21.15.49:0/2642316228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069540 0x7f3ab00a0eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009760 tx=0x7f3aac009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc03bd87831491d6 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f8c78720700 1 -- 172.21.15.49:0/2350134224 shutdown_connections 2022-04-03T21:50:22.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f8c78720700 1 --2- 172.21.15.49:0/2350134224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c58004690 0x7f8c58004b00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f8c78720700 1 -- 172.21.15.49:0/2350134224 >> 172.21.15.49:0/2350134224 conn(0x7f8c70066ae0 msgr2=0x7f8c70066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f05d13bd700 1 -- 172.21.15.49:0/1300616702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc011630 con 0x7f05cc0b7aa0 2022-04-03T21:50:22.781 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f05d13bd700 1 -- 172.21.15.49:0/1300616702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc011790 con 0x7f05cc0b7aa0 2022-04-03T21:50:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f05d13bd700 1 -- 172.21.15.49:0/1300616702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc011b30 con 0x7f05cc0b7aa0 2022-04-03T21:50:22.782 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f8c78720700 1 -- 172.21.15.49:0/2350134224 shutdown_connections 2022-04-03T21:50:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f9ac0037700 1 -- 172.21.15.49:0/2632310841 shutdown_connections 2022-04-03T21:50:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.756+0000 7f3aa7fff700 1 -- 172.21.15.49:0/2642316228 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011630 con 0x7f3ab0069540 2022-04-03T21:50:22.783 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f3aa7fff700 1 -- 172.21.15.49:0/2642316228 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac011790 con 0x7f3ab0069540 2022-04-03T21:50:22.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f3aa7fff700 1 -- 172.21.15.49:0/2642316228 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011b30 con 0x7f3ab0069540 2022-04-03T21:50:22.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f9ac0037700 1 -- 172.21.15.49:0/2632310841 wait complete. 2022-04-03T21:50:22.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7fa542a17700 1 -- 172.21.15.49:0/3415272879 shutdown_connections 2022-04-03T21:50:22.785 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f05d4623700 1 -- 172.21.15.49:0/1300616702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 msgr2=0x7f05cc0b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.785 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f05d4623700 1 --2- 172.21.15.49:0/1300616702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 0x7f05cc0b8f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009760 tx=0x7f05bc009060 comp rx=0 tx=0).stop 2022-04-03T21:50:22.786 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7fa542a17700 1 -- 172.21.15.49:0/3415272879 wait complete. 2022-04-03T21:50:22.786 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f05d4623700 1 -- 172.21.15.49:0/1300616702 shutdown_connections 2022-04-03T21:50:22.786 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f05d4623700 1 --2- 172.21.15.49:0/1300616702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0b94b0 0x7f05cc14aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f05d4623700 1 --2- 172.21.15.49:0/1300616702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 0x7f05cc0b8f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f05d4623700 1 -- 172.21.15.49:0/1300616702 >> 172.21.15.49:0/1300616702 conn(0x7f05cc066ae0 msgr2=0x7f05cc066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.787 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f3ab793b700 1 -- 172.21.15.49:0/2642316228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069540 msgr2=0x7f3ab00a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.788 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f3ab793b700 1 --2- 172.21.15.49:0/2642316228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069540 0x7f3ab00a0eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009760 tx=0x7f3aac009060 comp rx=0 tx=0).stop 2022-04-03T21:50:22.788 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.760+0000 7fa542a17700 1 Processor -- start 2022-04-03T21:50:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.757+0000 7f8c78720700 1 -- 172.21.15.49:0/2350134224 wait complete. 2022-04-03T21:50:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f8c78720700 1 Processor -- start 2022-04-03T21:50:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.760+0000 7f8c78720700 1 -- start start 2022-04-03T21:50:22.789 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.760+0000 7fa542a17700 1 -- start start 2022-04-03T21:50:22.790 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.759+0000 7f9ac0037700 1 Processor -- start 2022-04-03T21:50:22.791 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7fa542a17700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0675f0 0x7fa53c162730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.791 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7fa542a17700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c06c5b0 0x7fa53c162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.791 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7fa542a17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0b7aa0 0x7fa53c143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.792 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7fa542a17700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0b3460 con 0x7fa53c0b7aa0 2022-04-03T21:50:22.792 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7fa542a17700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0b2790 con 0x7fa53c06c5b0 2022-04-03T21:50:22.792 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7fa542a17700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0b1010 con 0x7fa53c0675f0 2022-04-03T21:50:22.792 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7fa53b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c06c5b0 0x7fa53c162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.792 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7fa53b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c06c5b0 0x7fa53c162c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35392/0 (socket says 172.21.15.49:35392) 2022-04-03T21:50:22.793 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7fa53b7fe700 1 -- 172.21.15.49:0/1477471348 learned_addr learned my addr 172.21.15.49:0/1477471348 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.793 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7fa540fb4700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0b7aa0 0x7fa53c143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.793 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7f8c78720700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58004690 0x7f8c7009f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.794 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7f8c78720700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c7015e8f0 0x7f8c7015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.794 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7f8c78720700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7015f2a0 0x7f8c701613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.794 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7f8c78720700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70142dc0 con 0x7f8c7015f2a0 2022-04-03T21:50:22.794 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7f8c78720700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70159100 con 0x7f8c58004690 2022-04-03T21:50:22.795 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.761+0000 7f8c78720700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70143480 con 0x7f8c7015e8f0 2022-04-03T21:50:22.795 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f8c75cbb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c7015e8f0 0x7f8c7015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.795 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f8c75cbb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c7015e8f0 0x7f8c7015ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45796/0 (socket says 172.21.15.49:45796) 2022-04-03T21:50:22.796 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f3ab793b700 1 -- 172.21.15.49:0/2642316228 shutdown_connections 2022-04-03T21:50:22.796 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f3ab793b700 1 --2- 172.21.15.49:0/2642316228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069540 0x7f3ab00a0eb0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009760 tx=0x7f3aac009060 comp rx=0 tx=0).stop 2022-04-03T21:50:22.796 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f3ab793b700 1 --2- 172.21.15.49:0/2642316228 >> v2:172.21.15.117:3300/0 conn(0x7f3ab0069910 0x7f3ab00a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.796 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f3ab793b700 1 -- 172.21.15.49:0/2642316228 >> 172.21.15.49:0/2642316228 conn(0x7f3ab0066ae0 msgr2=0x7f3ab0066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.797 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f8c75cbb700 1 -- 172.21.15.49:0/2561979266 learned_addr learned my addr 172.21.15.49:0/2561979266 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.797 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f8c764bc700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58004690 0x7f8c7009f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.798 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fa53bfff700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0675f0 0x7fa53c162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.798 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fa53b7fe700 1 -- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0675f0 msgr2=0x7fa53c162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.798 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fa53b7fe700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0675f0 0x7fa53c162730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fa53b7fe700 1 -- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0b7aa0 msgr2=0x7fa53c143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fa53b7fe700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa53c0b7aa0 0x7fa53c143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fdfefc93700 1 Processor -- start 2022-04-03T21:50:22.800 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fa53b7fe700 1 -- 172.21.15.49:0/1477471348 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c00b550 con 0x7fa53c06c5b0 2022-04-03T21:50:22.800 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f05d4623700 1 -- 172.21.15.49:0/1300616702 shutdown_connections 2022-04-03T21:50:22.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7fa53bfff700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa53c0675f0 0x7fa53c162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-04-03T21:50:22.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f9ac0037700 1 -- start start 2022-04-03T21:50:22.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f9ac0037700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80675f0 0x7f9ab8096440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f9ac0037700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b7aa0 0x7f9ab80b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f9ac0037700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80b94b0 0x7f9ab80989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.802 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f8c764bc700 1 -- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c7015e8f0 msgr2=0x7f8c7015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f8c764bc700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c7015e8f0 0x7f8c7015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f8c764bc700 1 -- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7015f2a0 msgr2=0x7f8c701613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.803 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f8c764bc700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7015f2a0 0x7f8c701613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f9ac0037700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8099530 con 0x7f9ab80675f0 2022-04-03T21:50:22.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f9ac0037700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8097280 con 0x7f9ab80b94b0 2022-04-03T21:50:22.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f8c764bc700 1 -- 172.21.15.49:0/2561979266 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7009ec50 con 0x7f8c58004690 2022-04-03T21:50:22.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f8c764bc700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58004690 0x7f8c7009f400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c68004770 tx=0x7f8c68007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68010040 con 0x7f8c58004690 2022-04-03T21:50:22.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f9ac0037700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8096f50 con 0x7f9ab80b7aa0 2022-04-03T21:50:22.806 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68016470 con 0x7f8c58004690 2022-04-03T21:50:22.806 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680167f0 con 0x7f8c58004690 2022-04-03T21:50:22.807 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7fdfefc93700 1 -- start start 2022-04-03T21:50:22.807 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7fdfefc93700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 0x7fdfe80a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.807 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7f9abddd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80675f0 0x7f9ab8096440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.808 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7fdfefc93700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdfe80c22d0 0x7fdfe80a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.808 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7fdfefc93700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe80bdee0 con 0x7fdfe80bc010 2022-04-03T21:50:22.808 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7f9abddd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80675f0 0x7f9ab8096440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34572/0 (socket says 172.21.15.49:34572) 2022-04-03T21:50:22.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7f9abddd3700 1 -- 172.21.15.49:0/3955765008 learned_addr learned my addr 172.21.15.49:0/3955765008 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7fdfefc93700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80bc900 con 0x7fdfe80c22d0 2022-04-03T21:50:22.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7fdfefc93700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80a5040 con 0x7fdfe80c1f00 2022-04-03T21:50:22.810 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fa53b7fe700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c06c5b0 0x7fa53c162c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa530001eb0 tx=0x7fa530001bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fdfeda2f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 0x7fdfe80a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fdfeda2f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 0x7fdfe80a68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45802/0 (socket says 172.21.15.49:45802) 2022-04-03T21:50:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fdfeda2f700 1 -- 172.21.15.49:0/1411602270 learned_addr learned my addr 172.21.15.49:0/1411602270 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c701431a0 con 0x7f8c58004690 2022-04-03T21:50:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c70162b80 con 0x7f8c58004690 2022-04-03T21:50:22.812 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fdfeda2f700 1 -- 172.21.15.49:0/1411602270 >> v2:172.21.15.49:3300/0 conn(0x7fdfe80c22d0 msgr2=0x7fdfe80a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.813 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fdfeda2f700 1 --2- 172.21.15.49:0/1411602270 >> v2:172.21.15.49:3300/0 conn(0x7fdfe80c22d0 0x7fdfe80a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.813 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7fdfeda2f700 1 -- 172.21.15.49:0/1411602270 >> v1:172.21.15.49:6789/0 conn(0x7fdfe80bc010 legacy=0x7fdfe814e900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-03T21:50:22.813 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7f9abd5d2700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b7aa0 0x7f9ab80b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.813 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f9abe5d4700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80b94b0 0x7f9ab80989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f9abddd3700 1 -- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b7aa0 msgr2=0x7f9ab80b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f9abddd3700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b7aa0 0x7f9ab80b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f9abddd3700 1 -- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80b94b0 msgr2=0x7f9ab80989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f9abddd3700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80b94b0 0x7f9ab80989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f9abddd3700 1 -- 172.21.15.49:0/3955765008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40092a0 con 0x7f9ab80675f0 2022-04-03T21:50:22.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000ce40 con 0x7fa53c06c5b0 2022-04-03T21:50:22.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530007360 con 0x7fa53c06c5b0 2022-04-03T21:50:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300046b0 con 0x7fa53c06c5b0 2022-04-03T21:50:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7f05d4623700 1 -- 172.21.15.49:0/1300616702 wait complete. 2022-04-03T21:50:22.816 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f05d4623700 1 Processor -- start 2022-04-03T21:50:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f3ab793b700 1 -- 172.21.15.49:0/2642316228 shutdown_connections 2022-04-03T21:50:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7fdfeda2f700 1 -- 172.21.15.49:0/1411602270 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80bd640 con 0x7fdfe80c1f00 2022-04-03T21:50:22.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7fdfeda2f700 1 --2- 172.21.15.49:0/1411602270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 0x7fdfe80a68a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009f20 tx=0x7fdfe0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2f9023a882d564 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7f9abddd3700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80675f0 0x7f9ab8096440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000cb90 tx=0x7f9ab0001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.818 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0004c40 con 0x7f9ab80675f0 2022-04-03T21:50:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0004dc0 con 0x7f9ab80675f0 2022-04-03T21:50:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00073a0 con 0x7f9ab80675f0 2022-04-03T21:50:22.819 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c0b3bd0 con 0x7fa53c06c5b0 2022-04-03T21:50:22.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c14d7d0 con 0x7fa53c06c5b0 2022-04-03T21:50:22.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa53c070a20 con 0x7fa53c06c5b0 2022-04-03T21:50:22.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7f05d4623700 1 -- start start 2022-04-03T21:50:22.820 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d4623700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0675f0 0x7f05cc15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d4623700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 0x7f05cc0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d4623700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0b94b0 0x7f05cc0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d4623700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc158c30 con 0x7f05cc0b7aa0 2022-04-03T21:50:22.821 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d4623700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0b3730 con 0x7f05cc0b94b0 2022-04-03T21:50:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d4623700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0b63f0 con 0x7f05cc0675f0 2022-04-03T21:50:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7fdfeca2d700 1 -- 172.21.15.49:0/1411602270 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000e070 con 0x7fdfe80c1f00 2022-04-03T21:50:22.822 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7fdfeca2d700 1 -- 172.21.15.49:0/1411602270 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000bad0 con 0x7fdfe80c1f00 2022-04-03T21:50:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.768+0000 7fdfeca2d700 1 -- 172.21.15.49:0/1411602270 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00092e0 con 0x7fdfe80c1f00 2022-04-03T21:50:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7fdfefc93700 1 -- 172.21.15.49:0/1411602270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 msgr2=0x7fdfe80a68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7fdfefc93700 1 --2- 172.21.15.49:0/1411602270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 0x7fdfe80a68a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009f20 tx=0x7fdfe0009840 comp rx=0 tx=0).stop 2022-04-03T21:50:22.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7fdfefc93700 1 -- 172.21.15.49:0/1411602270 shutdown_connections 2022-04-03T21:50:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7fdfefc93700 1 --2- 172.21.15.49:0/1411602270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c1f00 0x7fdfe80a68a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7fdfefc93700 1 --2- 172.21.15.49:0/1411602270 >> v2:172.21.15.49:3300/0 conn(0x7fdfe80c22d0 0x7fdfe80a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7fdfefc93700 1 -- 172.21.15.49:0/1411602270 >> 172.21.15.49:0/1411602270 conn(0x7fdfe805e010 msgr2=0x7fdfe80c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.762+0000 7f32adf17700 1 Processor -- start 2022-04-03T21:50:22.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.763+0000 7f32adf17700 1 -- start start 2022-04-03T21:50:22.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32adf17700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f32a8069540 0x7f32a8069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32adf17700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a806e310 0x7f32a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32adf17700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a80b7aa0 con 0x7f32a8069e50 2022-04-03T21:50:22.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32adf17700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a806d490 con 0x7f32a8069540 2022-04-03T21:50:22.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32adf17700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a806c630 con 0x7f32a806e310 2022-04-03T21:50:22.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32a6ffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f32a8069e50 0x7f32a806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47418/0 (socket says 172.21.15.49:47418) 2022-04-03T21:50:22.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.764+0000 7f32a6ffd700 1 -- 172.21.15.49:0/3677899711 learned_addr learned my addr 172.21.15.49:0/3677899711 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:22.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7f32a7fff700 1 --2- 172.21.15.49:0/3677899711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a806e310 0x7f32a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.827 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.765+0000 7f32a67fc700 1 -- 172.21.15.49:0/3677899711 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652200118 0 0) 0x7f32a80b7aa0 con 0x7f32a8069e50 2022-04-03T21:50:22.827 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f32a67fc700 1 -- 172.21.15.49:0/3677899711 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32900033d0 con 0x7f32a8069e50 2022-04-03T21:50:22.827 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.766+0000 7f32a77fe700 1 --2- 172.21.15.49:0/3677899711 >> v2:172.21.15.49:3300/0 conn(0x7f32a8069540 0x7f32a8069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.827 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f32a7fff700 1 -- 172.21.15.49:0/3677899711 >> v2:172.21.15.49:3300/0 conn(0x7f32a8069540 msgr2=0x7f32a8069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.828 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f32a7fff700 1 --2- 172.21.15.49:0/3677899711 >> v2:172.21.15.49:3300/0 conn(0x7f32a8069540 0x7f32a8069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.828 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f32a7fff700 1 -- 172.21.15.49:0/3677899711 >> v1:172.21.15.117:6789/0 conn(0x7f32a8069e50 legacy=0x7f32a806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.828 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f67c55a5700 1 Processor -- start 2022-04-03T21:50:22.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f32a7fff700 1 -- 172.21.15.49:0/3677899711 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80baab0 con 0x7f32a806e310 2022-04-03T21:50:22.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f32a7fff700 1 --2- 172.21.15.49:0/3677899711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a806e310 0x7f32a806e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d50 tx=0x7f32a0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f148a8b7f047c6 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d2bc0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0b94b0 0x7f05cc0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.830 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f05d2bc0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0b94b0 0x7f05cc0b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35398/0 (socket says 172.21.15.49:35398) 2022-04-03T21:50:22.830 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f05d2bc0700 1 -- 172.21.15.49:0/2934544183 learned_addr learned my addr 172.21.15.49:0/2934544183 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.830 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f05d1bbe700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 0x7f05cc0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.831 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f32a67fc700 1 -- 172.21.15.49:0/3677899711 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0009e50 con 0x7f32a806e310 2022-04-03T21:50:22.831 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f32a67fc700 1 -- 172.21.15.49:0/3677899711 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000cc70 con 0x7f32a806e310 2022-04-03T21:50:22.831 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f32a67fc700 1 -- 172.21.15.49:0/3677899711 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00159e0 con 0x7f32a806e310 2022-04-03T21:50:22.832 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.769+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab8099780 con 0x7f9ab80675f0 2022-04-03T21:50:22.832 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab8099a60 con 0x7f9ab80675f0 2022-04-03T21:50:22.832 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f05d2bc0700 1 -- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0675f0 msgr2=0x7f05cc15a230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-04-03T21:50:22.832 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f05d2bc0700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc0675f0 0x7f05cc15a230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.833 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f05d2bc0700 1 -- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 msgr2=0x7f05cc0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.833 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f05d2bc0700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05cc0b7aa0 0x7f05cc0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.833 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f05d2bc0700 1 -- 172.21.15.49:0/2934544183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0092a0 con 0x7f05cc0b94b0 2022-04-03T21:50:22.834 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f8c68016c20 con 0x7f8c58004690 2022-04-03T21:50:22.834 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c70162da0 con 0x7f8c58004690 2022-04-03T21:50:22.834 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.771+0000 7f8c5e7fc700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8c50063e30 0x7f8c500662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.834 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8c68081af0 con 0x7f8c58004690 2022-04-03T21:50:22.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f8c5e7fc700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] conn(0x7f8c5006dba0 0x7f8c5006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 --> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c500706a0 con 0x7f8c5006dba0 2022-04-03T21:50:22.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f32adf17700 1 -- 172.21.15.49:0/3677899711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a806e310 msgr2=0x7f32a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.835 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f32adf17700 1 --2- 172.21.15.49:0/3677899711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a806e310 0x7f32a806e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d50 tx=0x7f32a0009780 comp rx=0 tx=0).stop 2022-04-03T21:50:22.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.767+0000 7f3ab793b700 1 -- 172.21.15.49:0/2642316228 wait complete. 2022-04-03T21:50:22.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f32adf17700 1 -- 172.21.15.49:0/3677899711 shutdown_connections 2022-04-03T21:50:22.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.770+0000 7f67c55a5700 1 -- start start 2022-04-03T21:50:22.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f32adf17700 1 --2- 172.21.15.49:0/3677899711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a806e310 0x7f32a806e770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.838 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a94000fd0 con 0x7f9ab80675f0 2022-04-03T21:50:22.838 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f32adf17700 1 --2- 172.21.15.49:0/3677899711 >> v2:172.21.15.49:3300/0 conn(0x7f32a8069540 0x7f32a8069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.838 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f32adf17700 1 -- 172.21.15.49:0/3677899711 >> 172.21.15.49:0/3677899711 conn(0x7f32a8066ae0 msgr2=0x7f32a8066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.839 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f67c55a5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c230 0x7f67c00b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.839 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f67c55a5700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f67c00b7aa0 0x7f67c00b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.839 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f67c55a5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c006ed90 con 0x7f67c006c600 2022-04-03T21:50:22.840 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f67c55a5700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c006d720 con 0x7f67c00b7aa0 2022-04-03T21:50:22.840 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f05d2bc0700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0b94b0 0x7f05cc0b6dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f05c400b840 tx=0x7f05c4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.841 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.772+0000 7f67c55a5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00b8790 con 0x7f67c006c230 2022-04-03T21:50:22.841 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f32adf17700 1 -- 172.21.15.49:0/3677899711 shutdown_connections 2022-04-03T21:50:22.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f32adf17700 1 -- 172.21.15.49:0/3677899711 wait complete. 2022-04-03T21:50:22.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40106f0 con 0x7f05cc0b94b0 2022-04-03T21:50:22.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4010850 con 0x7f05cc0b94b0 2022-04-03T21:50:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4010c10 con 0x7f05cc0b94b0 2022-04-03T21:50:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f3ab793b700 1 Processor -- start 2022-04-03T21:50:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f67be7fc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f67c006c600 0x7f67c0069380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47420/0 (socket says 172.21.15.49:47420) 2022-04-03T21:50:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.773+0000 7f67be7fc700 1 -- 172.21.15.49:0/59092213 learned_addr learned my addr 172.21.15.49:0/59092213 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f67beffd700 1 --2- 172.21.15.49:0/59092213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c230 0x7f67c00b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f3ab793b700 1 -- start start 2022-04-03T21:50:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7fdfefc93700 1 -- 172.21.15.49:0/1411602270 shutdown_connections 2022-04-03T21:50:22.845 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f67bdffb700 1 -- 172.21.15.49:0/59092213 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259591371 0 0) 0x7f67c006ed90 con 0x7f67c006c600 2022-04-03T21:50:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f67bdffb700 1 -- 172.21.15.49:0/59092213 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67ac0033f0 con 0x7f67c006c600 2022-04-03T21:50:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f67beffd700 1 -- 172.21.15.49:0/59092213 >> v2:172.21.15.49:3300/0 conn(0x7f67c00b7aa0 msgr2=0x7f67c00b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.774+0000 7f67bf7fe700 1 --2- 172.21.15.49:0/59092213 >> v2:172.21.15.49:3300/0 conn(0x7f67c00b7aa0 0x7f67c00b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.846 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f67beffd700 1 --2- 172.21.15.49:0/59092213 >> v2:172.21.15.49:3300/0 conn(0x7f67c00b7aa0 0x7f67c00b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f67beffd700 1 -- 172.21.15.49:0/59092213 >> v1:172.21.15.117:6789/0 conn(0x7f67c006c600 legacy=0x7f67c0069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f67beffd700 1 -- 172.21.15.49:0/59092213 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c00b81d0 con 0x7f67c006c230 2022-04-03T21:50:22.847 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f67bf7fe700 1 --2- 172.21.15.49:0/59092213 >> v2:172.21.15.49:3300/0 conn(0x7f67c00b7aa0 0x7f67c00b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-04-03T21:50:22.848 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9ab001a030 con 0x7f9ab80675f0 2022-04-03T21:50:22.848 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f3ab793b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069910 0x7f3ab014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.848 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f3ab793b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ab00b7aa0 0x7f3ab0162860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.849 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f3ab793b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ab014f4c0 0x7f3ab0162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.849 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f3ab793b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00ac1d0 con 0x7f3ab00b7aa0 2022-04-03T21:50:22.849 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f3ab793b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b4d00 con 0x7f3ab014f4c0 2022-04-03T21:50:22.849 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f3ab793b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0163380 con 0x7f3ab0069910 2022-04-03T21:50:22.850 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f67beffd700 1 --2- 172.21.15.49:0/59092213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c230 0x7f67c00b8f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67b4007fd0 tx=0x7f67b400b2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7900f76678e2bb7e server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.850 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f8c75cbb700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8c50063e30 0x7f8c500662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.851 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7fdfefc93700 1 -- 172.21.15.49:0/1411602270 wait complete. 2022-04-03T21:50:22.851 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f32adf17700 1 Processor -- start 2022-04-03T21:50:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f67bdffb700 1 -- 172.21.15.49:0/59092213 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0004ce0 con 0x7f67c006c230 2022-04-03T21:50:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f67bdffb700 1 -- 172.21.15.49:0/59092213 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b400bed0 con 0x7f67c006c230 2022-04-03T21:50:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f67bdffb700 1 -- 172.21.15.49:0/59092213 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4004260 con 0x7f67c006c230 2022-04-03T21:50:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f9aa5ffb700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9a98063db0 0x7f9a98066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9ab0080ac0 con 0x7f9ab80675f0 2022-04-03T21:50:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f9aa5ffb700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] conn(0x7f9a9806dba0 0x7f9a9806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 --> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a980706a0 con 0x7f9a9806dba0 2022-04-03T21:50:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab0080db0 con 0x7f9ab80675f0 2022-04-03T21:50:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f9abd5d2700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9a98063db0 0x7f9a98066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.854 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.775+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc0bb9f0 con 0x7f05cc0b94b0 2022-04-03T21:50:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc0b3c60 con 0x7f05cc0b94b0 2022-04-03T21:50:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f8c76cbd700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] conn(0x7f8c5006dba0 0x7f8c5006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c68050370 con 0x7f8c58004690 2022-04-03T21:50:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f3ab56d7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069910 0x7f3ab014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f3ab56d7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069910 0x7f3ab014ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45808/0 (socket says 172.21.15.49:45808) 2022-04-03T21:50:22.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f3ab56d7700 1 -- 172.21.15.49:0/3355661695 learned_addr learned my addr 172.21.15.49:0/3355661695 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f3ab5ed8700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ab014f4c0 0x7f3ab0162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f3ab56d7700 1 -- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ab014f4c0 msgr2=0x7f3ab0162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f3ab56d7700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ab014f4c0 0x7f3ab0162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f3ab56d7700 1 -- 172.21.15.49:0/3355661695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ab00b7aa0 msgr2=0x7f3ab0162860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-03T21:50:22.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f3ab56d7700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ab00b7aa0 0x7f3ab0162860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f3ab56d7700 1 -- 172.21.15.49:0/3355661695 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0092a0 con 0x7f3ab0069910 2022-04-03T21:50:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f3ab56d7700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069910 0x7f3ab014ea60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009270 tx=0x7f3aac017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7fdfefc93700 1 Processor -- start 2022-04-03T21:50:22.859 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.776+0000 7f32adf17700 1 -- start start 2022-04-03T21:50:22.859 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f32adf17700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a8069540 0x7f32a817bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.859 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f32adf17700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a8069e50 0x7f32a80b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.860 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f32adf17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a806e310 0x7f32a80b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.860 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f32adf17700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a8099b40 con 0x7f32a806e310 2022-04-03T21:50:22.860 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f32adf17700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b6690 con 0x7f32a8069540 2022-04-03T21:50:22.860 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f32adf17700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80675b0 con 0x7f32a8069e50 2022-04-03T21:50:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.777+0000 7f67c55a5700 1 -- 172.21.15.49:0/59092213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c230 msgr2=0x7f67c00b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f67c55a5700 1 --2- 172.21.15.49:0/59092213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c230 0x7f67c00b8f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f67b4007fd0 tx=0x7f67b400b2f0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7f9abe5d4700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] conn(0x7f9a9806dba0 0x7f9a9806ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7f32a6ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a8069e50 0x7f32a80b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7f32a6ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a8069e50 0x7f32a80b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45810/0 (socket says 172.21.15.49:45810) 2022-04-03T21:50:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7f32a6ffd700 1 -- 172.21.15.49:0/3955530324 learned_addr learned my addr 172.21.15.49:0/3955530324 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac006970 con 0x7f3ab0069910 2022-04-03T21:50:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac000cc0 con 0x7f3ab0069910 2022-04-03T21:50:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac025420 con 0x7f3ab0069910 2022-04-03T21:50:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab0163660 con 0x7f3ab0069910 2022-04-03T21:50:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00b4990 con 0x7f3ab0069910 2022-04-03T21:50:22.865 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7fdfefc93700 1 -- start start 2022-04-03T21:50:22.865 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fdfefc93700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfe80bc010 0x7fdfe81444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.865 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fdfefc93700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe80c1f00 0x7fdfe81466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fdfefc93700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c22d0 0x7fdfe80a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fdfefc93700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8145fd0 con 0x7fdfe80c1f00 2022-04-03T21:50:22.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fdfefc93700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8145200 con 0x7fdfe80bc010 2022-04-03T21:50:22.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fdfefc93700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8068730 con 0x7fdfe80c22d0 2022-04-03T21:50:22.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfe80bc010 0x7fdfe81444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfe80bc010 0x7fdfe81444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35404/0 (socket says 172.21.15.49:35404) 2022-04-03T21:50:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 -- 172.21.15.49:0/979501171 learned_addr learned my addr 172.21.15.49:0/979501171 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7f9abd5d2700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9a98063db0 0x7f9a98066260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80b6ea0 tx=0x7f9ab4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7f9abe5d4700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] conn(0x7f9a9806dba0 0x7f9a9806ffd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.778+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fa530024070 con 0x7fa53c06c5b0 2022-04-03T21:50:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fa523fff700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa51c063e30 0x7fa51c0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.779+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa530080d40 con 0x7fa53c06c5b0 2022-04-03T21:50:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fa523fff700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] conn(0x7fa51c06dc20 0x7fa51c070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 --> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa51c070720 con 0x7fa51c06dc20 2022-04-03T21:50:22.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa530081070 con 0x7fa53c06c5b0 2022-04-03T21:50:22.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfee230700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c22d0 0x7fdfe80a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 -- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c22d0 msgr2=0x7fdfe80a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfe80c22d0 0x7fdfe80a2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 -- 172.21.15.49:0/979501171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe80c1f00 msgr2=0x7fdfe81466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.780+0000 7fdfeda2f700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe80c1f00 0x7fdfe81466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7fdfeda2f700 1 -- 172.21.15.49:0/979501171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0009ae0 con 0x7fdfe80bc010 2022-04-03T21:50:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f67c55a5700 1 -- 172.21.15.49:0/59092213 shutdown_connections 2022-04-03T21:50:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f67c55a5700 1 --2- 172.21.15.49:0/59092213 >> v2:172.21.15.49:3300/0 conn(0x7f67c00b7aa0 0x7f67c00b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f67c55a5700 1 --2- 172.21.15.49:0/59092213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c230 0x7f67c00b8f70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f67c55a5700 1 -- 172.21.15.49:0/59092213 >> 172.21.15.49:0/59092213 conn(0x7f67c0066ae0 msgr2=0x7f67c0066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7fa53bfff700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa51c063e30 0x7fa51c0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7fa540fb4700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] conn(0x7fa51c06dc20 0x7fa51c070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05cc070a20 con 0x7f05cc0b94b0 2022-04-03T21:50:22.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f8c76cbd700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] conn(0x7f8c5006dba0 0x7f8c5006ffd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7fdfeda2f700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfe80bc010 0x7fdfe81444a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009430 tx=0x7fdfe0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f32a6ffd700 1 -- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a8069540 msgr2=0x7f32a817bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f32a6ffd700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32a8069540 0x7f32a817bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f32a6ffd700 1 -- 172.21.15.49:0/3955530324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a806e310 msgr2=0x7f32a80b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f32a6ffd700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a806e310 0x7f32a80b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f32a6ffd700 1 -- 172.21.15.49:0/3955530324 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a000d040 con 0x7f32a8069e50 2022-04-03T21:50:22.877 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.781+0000 7f67c55a5700 1 -- 172.21.15.49:0/59092213 shutdown_connections 2022-04-03T21:50:22.877 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7f67c55a5700 1 -- 172.21.15.49:0/59092213 wait complete. 2022-04-03T21:50:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7f32a6ffd700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a8069e50 0x7f32a80b6b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c490 tx=0x7f329c007c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7fa53bfff700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa51c063e30 0x7fa51c0662e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b330 tx=0x7fa52c01a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== osd.0 v2:172.21.15.49:6824/21712 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f9a980706a0 con 0x7f9a9806dba0 2022-04-03T21:50:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== osd.3 v2:172.21.15.49:6808/21715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f8c500706a0 con 0x7f8c5006dba0 2022-04-03T21:50:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0004030 con 0x7fdfe80bc010 2022-04-03T21:50:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ab0070a20 con 0x7f3ab0069910 2022-04-03T21:50:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe00041b0 con 0x7fdfe80bc010 2022-04-03T21:50:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.782+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0004570 con 0x7fdfe80bc010 2022-04-03T21:50:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe80b9ac0 con 0x7fdfe80bc010 2022-04-03T21:50:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0072e0 con 0x7f32a8069e50 2022-04-03T21:50:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c007460 con 0x7f32a8069e50 2022-04-03T21:50:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0059d0 con 0x7f32a8069e50 2022-04-03T21:50:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.784+0000 7f67c55a5700 1 Processor -- start 2022-04-03T21:50:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.784+0000 7f8c75cbb700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8c50063e30 0x7f8c500662e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e7a0 tx=0x7f8c6c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.784+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe8068940 con 0x7fdfe80bc010 2022-04-03T21:50:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7fa540fb4700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] conn(0x7fa51c06dc20 0x7fa51c070050 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.784+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a817c580 con 0x7f32a8069e50 2022-04-03T21:50:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.784+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a8096050 con 0x7f32a8069e50 2022-04-03T21:50:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.783+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f3aac02c030 con 0x7f3ab0069910 2022-04-03T21:50:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7f3aa57fa700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3a98063e30 0x7f3a980662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.885 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3aac0821a0 con 0x7f3ab0069910 2022-04-03T21:50:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32a8070a20 con 0x7f32a8069e50 2022-04-03T21:50:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7f3aa57fa700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] conn(0x7f3a9806dc20 0x7f3a98070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 --> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a98070720 con 0x7f3a9806dc20 2022-04-03T21:50:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.785+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3aac084680 con 0x7f3ab0069910 2022-04-03T21:50:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f3ab4ed6700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3a98063e30 0x7f3a980662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f3ab5ed8700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] conn(0x7f3a9806dc20 0x7f3a98070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.888 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.784+0000 7f67c55a5700 1 -- start start 2022-04-03T21:50:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f67c55a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c006c230 0x7f67c00b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f67c55a5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c600 0x7f67c00b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f67c55a5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c00b7aa0 0x7f67c00b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f67c55a5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00b4cd0 con 0x7f67c006c230 2022-04-03T21:50:22.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f67c55a5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00b44c0 con 0x7f67c00b7aa0 2022-04-03T21:50:22.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f67c55a5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00b4710 con 0x7f67c006c600 2022-04-03T21:50:22.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f67bf7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c00b7aa0 0x7f67c00b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f67bf7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c00b7aa0 0x7f67c00b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35406/0 (socket says 172.21.15.49:35406) 2022-04-03T21:50:22.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f67bf7fe700 1 -- 172.21.15.49:0/3957027753 learned_addr learned my addr 172.21.15.49:0/3957027753 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:22.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f67beffd700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c006c230 0x7f67c00b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f67be7fc700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c600 0x7f67c00b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.786+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f05c401f070 con 0x7f05cc0b94b0 2022-04-03T21:50:22.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f05ba7fc700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f05ac063e30 0x7f05ac0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f05c40809a0 con 0x7f05cc0b94b0 2022-04-03T21:50:22.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f05ba7fc700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] conn(0x7f05ac06dc20 0x7f05ac070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 --> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05ac070720 con 0x7f05ac06dc20 2022-04-03T21:50:22.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c4085220 con 0x7f05cc0b94b0 2022-04-03T21:50:22.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== osd.1 v2:172.21.15.49:6800/21710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fa51c070720 con 0x7fa51c06dc20 2022-04-03T21:50:22.894 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f3ab4ed6700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3a98063e30 0x7f3a980662e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00afdd0 tx=0x7f3aa0006ae0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.894 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f3ab5ed8700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] conn(0x7f3a9806dc20 0x7f3a98070050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.787+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f329c019030 con 0x7f32a8069e50 2022-04-03T21:50:22.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f328f7fe700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3288063e30 0x7f32880662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.895 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f67bf7fe700 1 -- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c600 msgr2=0x7f67c00b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f67bf7fe700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67c006c600 0x7f67c00b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f67bf7fe700 1 -- 172.21.15.49:0/3957027753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c006c230 msgr2=0x7f67c00b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f67bf7fe700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67c006c230 0x7f67c00b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.896 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7f67bf7fe700 1 -- 172.21.15.49:0/3957027753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b400b550 con 0x7f67c00b7aa0 2022-04-03T21:50:22.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f67bf7fe700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c00b7aa0 0x7f67c00b2190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67b800cef0 tx=0x7f67b8007860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b800add0 con 0x7f67c00b7aa0 2022-04-03T21:50:22.897 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.790+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== osd.4 v2:172.21.15.117:6800/27219 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f3a98070720 con 0x7f3a9806dc20 2022-04-03T21:50:22.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.788+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfe81462a0 con 0x7fdfe80bc010 2022-04-03T21:50:22.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8016420 con 0x7f67c00b7aa0 2022-04-03T21:50:22.898 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c00b49f0 con 0x7f67c00b7aa0 2022-04-03T21:50:22.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80167e0 con 0x7f67c00b7aa0 2022-04-03T21:50:22.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c00b3020 con 0x7f67c00b7aa0 2022-04-03T21:50:22.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.792+0000 7f05d23bf700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f05ac063e30 0x7f05ac0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.792+0000 7f05d1bbe700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] conn(0x7f05ac06dc20 0x7f05ac070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.789+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f329c080730 con 0x7f32a8069e50 2022-04-03T21:50:22.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.790+0000 7f328f7fe700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] conn(0x7f328806dc20 0x7f3288070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.790+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 --> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3288070720 con 0x7f328806dc20 2022-04-03T21:50:22.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.790+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f329c080a60 con 0x7f32a8069e50 2022-04-03T21:50:22.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.791+0000 7f32a7fff700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] conn(0x7f328806dc20 0x7f3288070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.791+0000 7f32a77fe700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3288063e30 0x7f32880662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.792+0000 7f32a7fff700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] conn(0x7f328806dc20 0x7f3288070050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.793+0000 7f32a77fe700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3288063e30 0x7f32880662e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f329800d870 tx=0x7f3298005880 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.793+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fdfe001e430 con 0x7fdfe80bc010 2022-04-03T21:50:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.794+0000 7fdfd5ffb700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fdfc8063e30 0x7fdfc80662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.794+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdfe00830b0 con 0x7fdfe80bc010 2022-04-03T21:50:22.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.795+0000 7fdfd5ffb700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] conn(0x7fdfc806dc20 0x7fdfc8070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.904 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.795+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 --> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfc8070720 con 0x7fdfc806dc20 2022-04-03T21:50:22.904 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.795+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe00833e0 con 0x7fdfe80bc010 2022-04-03T21:50:22.904 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.793+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== osd.6 v2:172.21.15.117:6808/27220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f3288070720 con 0x7f328806dc20 2022-04-03T21:50:22.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.793+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f67b8016bd0 con 0x7f67c00b7aa0 2022-04-03T21:50:22.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.794+0000 7f67a6ffd700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f67a0063d60 0x7f67a0066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.794+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f67b8012070 con 0x7f67c00b7aa0 2022-04-03T21:50:22.906 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.795+0000 7f67c55a5700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] conn(0x7f679c0015f0 0x7f679c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:22.906 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.795+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 --> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f679c006a10 con 0x7f679c0015f0 2022-04-03T21:50:22.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.795+0000 7f67beffd700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f67a0063d60 0x7f67a0066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.796+0000 7f67beffd700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f67a0063d60 0x7f67a0066210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b330 tx=0x7f67b401a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.797+0000 7f05d1bbe700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] conn(0x7f05ac06dc20 0x7f05ac070050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.797+0000 7f05d23bf700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f05ac063e30 0x7f05ac0662e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001420 tx=0x7f05c8007790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.908 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.798+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== osd.2 v2:172.21.15.49:6809/21720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f05ac070720 con 0x7f05ac06dc20 2022-04-03T21:50:22.909 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.800+0000 7fdfed22e700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fdfc8063e30 0x7fdfc80662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.800+0000 7fdfee230700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] conn(0x7fdfc806dc20 0x7fdfc8070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.801+0000 7fdfee230700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] conn(0x7fdfc806dc20 0x7fdfc8070050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.802+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== osd.5 v2:172.21.15.117:6824/27252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fdfc8070720 con 0x7fdfc806dc20 2022-04-03T21:50:22.910 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.806+0000 7f67be7fc700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] conn(0x7f679c0015f0 0x7f679c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:22.911 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.806+0000 7fdfed22e700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fdfc8063e30 0x7fdfc80662e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80c04f0 tx=0x7fdfd8006bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.813+0000 7f67be7fc700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] conn(0x7f679c0015f0 0x7f679c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.814+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== osd.7 v2:172.21.15.117:6816/27221 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f679c006a10 con 0x7f679c0015f0 2022-04-03T21:50:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.819+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 --> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a94002bb0 con 0x7f9a9806dba0 2022-04-03T21:50:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.820+0000 7f9aa5ffb700 1 -- 172.21.15.49:0/3955765008 <== osd.0 v2:172.21.15.49:6824/21712 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a94002bb0 con 0x7f9a9806dba0 2022-04-03T21:50:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.820+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 --> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c70070a20 con 0x7f8c5006dba0 2022-04-03T21:50:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.821+0000 7f8c5e7fc700 1 -- 172.21.15.49:0/2561979266 <== osd.3 v2:172.21.15.49:6808/21715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c70070a20 con 0x7f8c5006dba0 2022-04-03T21:50:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.821+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] conn(0x7f9a9806dba0 msgr2=0x7f9a9806ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.821+0000 7f9ac0037700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:6824/21712,v1:172.21.15.49:6825/21712] conn(0x7f9a9806dba0 0x7f9a9806ffd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.822+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9a98063db0 msgr2=0x7f9a98066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.822+0000 7f9ac0037700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9a98063db0 0x7f9a98066260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80b6ea0 tx=0x7f9ab4016000 comp rx=0 tx=0).stop 2022-04-03T21:50:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.822+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80675f0 msgr2=0x7f9ab8096440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.822+0000 7f9ac0037700 1 --2- 172.21.15.49:0/3955765008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ab80675f0 0x7f9ab8096440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000cb90 tx=0x7f9ab0001770 comp rx=0 tx=0).stop 2022-04-03T21:50:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.822+0000 7f9abe5d4700 1 -- 172.21.15.49:0/3955765008 reap_dead start 2022-04-03T21:50:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] conn(0x7f8c5006dba0 msgr2=0x7f8c5006ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.49:6808/21715,v1:172.21.15.49:6810/21715] conn(0x7f8c5006dba0 0x7f8c5006ffd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8c50063e30 msgr2=0x7f8c500662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f8c50063e30 0x7f8c500662e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e7a0 tx=0x7f8c6c018000 comp rx=0 tx=0).stop 2022-04-03T21:50:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58004690 msgr2=0x7f8c7009f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 --2- 172.21.15.49:0/2561979266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c58004690 0x7f8c7009f400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c68004770 tx=0x7f8c68007690 comp rx=0 tx=0).stop 2022-04-03T21:50:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c76cbd700 1 -- 172.21.15.49:0/2561979266 reap_dead start 2022-04-03T21:50:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 shutdown_connections 2022-04-03T21:50:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 >> 172.21.15.49:0/3955765008 conn(0x7f9ab8066ae0 msgr2=0x7f9ab80b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 shutdown_connections 2022-04-03T21:50:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 >> 172.21.15.49:0/2561979266 conn(0x7f8c70066ae0 msgr2=0x7f8c7014a300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.823+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 --> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa53c0a26c0 con 0x7fa51c06dc20 2022-04-03T21:50:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.824+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 shutdown_connections 2022-04-03T21:50:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.824+0000 7f9ac0037700 1 -- 172.21.15.49:0/3955765008 wait complete. 2022-04-03T21:50:22.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.824+0000 7fa523fff700 1 -- 172.21.15.49:0/1477471348 <== osd.1 v2:172.21.15.49:6800/21710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa53c0a26c0 con 0x7fa51c06dc20 2022-04-03T21:50:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.825+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] conn(0x7fa51c06dc20 msgr2=0x7fa51c070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.825+0000 7fa542a17700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.49:6800/21710,v1:172.21.15.49:6801/21710] conn(0x7fa51c06dc20 0x7fa51c070050 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.825+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa51c063e30 msgr2=0x7fa51c0662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.826+0000 7fa542a17700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa51c063e30 0x7fa51c0662e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b330 tx=0x7fa52c01a000 comp rx=0 tx=0).stop 2022-04-03T21:50:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.826+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c06c5b0 msgr2=0x7fa53c162c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.826+0000 7fa542a17700 1 --2- 172.21.15.49:0/1477471348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c06c5b0 0x7fa53c162c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa530001eb0 tx=0x7fa530001bd0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.826+0000 7fa540fb4700 1 -- 172.21.15.49:0/1477471348 reap_dead start 2022-04-03T21:50:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.826+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 --> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfe8070a20 con 0x7fdfc806dc20 2022-04-03T21:50:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.824+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 shutdown_connections 2022-04-03T21:50:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.826+0000 7fdfd5ffb700 1 -- 172.21.15.49:0/979501171 <== osd.5 v2:172.21.15.117:6824/27252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdfe8070a20 con 0x7fdfc806dc20 2022-04-03T21:50:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] conn(0x7fdfc806dc20 msgr2=0x7fdfc8070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfefc93700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6824/27252,v1:172.21.15.117:6825/27252] conn(0x7fdfc806dc20 0x7fdfc8070050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fdfc8063e30 msgr2=0x7fdfc80662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfefc93700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fdfc8063e30 0x7fdfc80662e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80c04f0 tx=0x7fdfd8006bb0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfe80bc010 msgr2=0x7fdfe81444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.927 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfefc93700 1 --2- 172.21.15.49:0/979501171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfe80bc010 0x7fdfe81444a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009430 tx=0x7fdfe0017000 comp rx=0 tx=0).stop 2022-04-03T21:50:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.827+0000 7fdfee230700 1 -- 172.21.15.49:0/979501171 reap_dead start 2022-04-03T21:50:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 shutdown_connections 2022-04-03T21:50:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 >> 172.21.15.49:0/979501171 conn(0x7fdfe805e010 msgr2=0x7fdfe814d230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.928 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7f8c78720700 1 -- 172.21.15.49:0/2561979266 wait complete. 2022-04-03T21:50:22.929 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 shutdown_connections 2022-04-03T21:50:22.929 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7fdfefc93700 1 -- 172.21.15.49:0/979501171 wait complete. 2022-04-03T21:50:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 shutdown_connections 2022-04-03T21:50:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 >> 172.21.15.49:0/1477471348 conn(0x7fa53c066ae0 msgr2=0x7fa53c0692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.828+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 --> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f32a80a1d50 con 0x7f328806dc20 2022-04-03T21:50:22.931 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.829+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 shutdown_connections 2022-04-03T21:50:22.931 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.829+0000 7fa542a17700 1 -- 172.21.15.49:0/1477471348 wait complete. 2022-04-03T21:50:22.932 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.829+0000 7f328f7fe700 1 -- 172.21.15.49:0/3955530324 <== osd.6 v2:172.21.15.117:6808/27220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f32a80a1d50 con 0x7f328806dc20 2022-04-03T21:50:22.932 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.830+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 --> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ab006a780 con 0x7f3a9806dc20 2022-04-03T21:50:22.933 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.830+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] conn(0x7f328806dc20 msgr2=0x7f3288070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.933 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.830+0000 7f32adf17700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6808/27220,v1:172.21.15.117:6809/27220] conn(0x7f328806dc20 0x7f3288070050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.934 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.831+0000 7f3aa57fa700 1 -- 172.21.15.49:0/3355661695 <== osd.4 v2:172.21.15.117:6800/27219 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ab006a780 con 0x7f3a9806dc20 2022-04-03T21:50:22.934 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.831+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3288063e30 msgr2=0x7f32880662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.935 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.831+0000 7f32adf17700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3288063e30 0x7f32880662e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f329800d870 tx=0x7f3298005880 comp rx=0 tx=0).stop 2022-04-03T21:50:22.935 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.831+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a8069e50 msgr2=0x7f32a80b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.935 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.831+0000 7f32adf17700 1 --2- 172.21.15.49:0/3955530324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32a8069e50 0x7f32a80b6b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c490 tx=0x7f329c007c70 comp rx=0 tx=0).stop 2022-04-03T21:50:22.936 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] conn(0x7f3a9806dc20 msgr2=0x7f3a98070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.936 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab793b700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6800/27219,v1:172.21.15.117:6801/27219] conn(0x7f3a9806dc20 0x7f3a98070050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.936 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3a98063e30 msgr2=0x7f3a980662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.936 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab793b700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f3a98063e30 0x7f3a980662e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00afdd0 tx=0x7f3aa0006ae0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.937 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069910 msgr2=0x7f3ab014ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.937 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab793b700 1 --2- 172.21.15.49:0/3355661695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ab0069910 0x7f3ab014ea60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009270 tx=0x7f3aac017000 comp rx=0 tx=0).stop 2022-04-03T21:50:22.937 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f3ab5ed8700 1 -- 172.21.15.49:0/3355661695 reap_dead start 2022-04-03T21:50:22.938 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f32a7fff700 1 -- 172.21.15.49:0/3955530324 reap_dead start 2022-04-03T21:50:22.938 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 shutdown_connections 2022-04-03T21:50:22.938 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 >> 172.21.15.49:0/3955530324 conn(0x7f32a8066ae0 msgr2=0x7f32a80bdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.938 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 shutdown_connections 2022-04-03T21:50:22.939 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.832+0000 7f32adf17700 1 -- 172.21.15.49:0/3955530324 wait complete. 2022-04-03T21:50:22.939 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.833+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 shutdown_connections 2022-04-03T21:50:22.939 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.833+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 >> 172.21.15.49:0/3355661695 conn(0x7f3ab0066ae0 msgr2=0x7f3ab00b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.940 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.833+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 shutdown_connections 2022-04-03T21:50:22.940 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.833+0000 7f3ab793b700 1 -- 172.21.15.49:0/3355661695 wait complete. 2022-04-03T21:50:22.941 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.834+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 --> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05cc0bbf40 con 0x7f05ac06dc20 2022-04-03T21:50:22.941 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.835+0000 7f05ba7fc700 1 -- 172.21.15.49:0/2934544183 <== osd.2 v2:172.21.15.49:6809/21720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05cc0bbf40 con 0x7f05ac06dc20 2022-04-03T21:50:22.942 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] conn(0x7f05ac06dc20 msgr2=0x7f05ac070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.942 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d4623700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.49:6809/21720,v1:172.21.15.49:6811/21720] conn(0x7f05ac06dc20 0x7f05ac070050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f05ac063e30 msgr2=0x7f05ac0662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d4623700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f05ac063e30 0x7f05ac0662e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001420 tx=0x7f05c8007790 comp rx=0 tx=0).stop 2022-04-03T21:50:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0b94b0 msgr2=0x7f05cc0b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d4623700 1 --2- 172.21.15.49:0/2934544183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0b94b0 0x7f05cc0b6dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f05c400b840 tx=0x7f05c4009310 comp rx=0 tx=0).stop 2022-04-03T21:50:22.943 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.836+0000 7f05d2bc0700 1 -- 172.21.15.49:0/2934544183 reap_dead start 2022-04-03T21:50:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.837+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 shutdown_connections 2022-04-03T21:50:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.837+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 >> 172.21.15.49:0/2934544183 conn(0x7f05cc066ae0 msgr2=0x7f05cc15e680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.837+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 shutdown_connections 2022-04-03T21:50:22.944 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.837+0000 7f05d4623700 1 -- 172.21.15.49:0/2934544183 wait complete. 2022-04-03T21:50:22.945 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.845+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 --> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f679c005aa0 con 0x7f679c0015f0 2022-04-03T21:50:22.945 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.846+0000 7f67a6ffd700 1 -- 172.21.15.49:0/3957027753 <== osd.7 v2:172.21.15.117:6816/27221 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f679c005aa0 con 0x7f679c0015f0 2022-04-03T21:50:22.946 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.848+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] conn(0x7f679c0015f0 msgr2=0x7f679c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.947 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.848+0000 7f67c55a5700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6816/27221,v1:172.21.15.117:6817/27221] conn(0x7f679c0015f0 0x7f679c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:22.947 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.849+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f67a0063d60 msgr2=0x7f67a0066210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.947 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.849+0000 7f67c55a5700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f67a0063d60 0x7f67a0066210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b330 tx=0x7f67b401a000 comp rx=0 tx=0).stop 2022-04-03T21:50:22.947 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.849+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c00b7aa0 msgr2=0x7f67c00b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:22.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.849+0000 7f67c55a5700 1 --2- 172.21.15.49:0/3957027753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c00b7aa0 0x7f67c00b2190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67b800cef0 tx=0x7f67b8007860 comp rx=0 tx=0).stop 2022-04-03T21:50:22.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.851+0000 7f67bf7fe700 1 -- 172.21.15.49:0/3957027753 reap_dead start 2022-04-03T21:50:22.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.861+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 shutdown_connections 2022-04-03T21:50:22.948 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.861+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 >> 172.21.15.49:0/3957027753 conn(0x7f67c0066ae0 msgr2=0x7f67c006e010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:22.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.862+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 shutdown_connections 2022-04-03T21:50:22.949 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:22.862+0000 7f67c55a5700 1 -- 172.21.15.49:0/3957027753 wait complete. 2022-04-03T21:50:22.950 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2022-04-03T21:50:22.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-03T21:50:22.951 INFO:teuthology.orchestra.run.smithi049.stdout:60129542155 2022-04-03T21:50:22.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-04-03T21:50:22.953 INFO:teuthology.orchestra.run.smithi049.stdout:64424509452 2022-04-03T21:50:22.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-04-03T21:50:22.954 INFO:teuthology.orchestra.run.smithi049.stdout:60129542156 2022-04-03T21:50:22.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-04-03T21:50:22.956 INFO:teuthology.orchestra.run.smithi049.stdout:60129542157 2022-04-03T21:50:22.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-04-03T21:50:22.957 INFO:teuthology.orchestra.run.smithi049.stdout:68719476747 2022-04-03T21:50:22.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-04-03T21:50:22.959 INFO:teuthology.orchestra.run.smithi049.stdout:60129542155 2022-04-03T21:50:22.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T21:50:22.961 INFO:teuthology.orchestra.run.smithi049.stdout:60129542156 2022-04-03T21:50:22.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-04-03T21:50:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.386+0000 7fb1130e4700 1 Processor -- start 2022-04-03T21:50:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.385+0000 7f662bcf7700 1 Processor -- start 2022-04-03T21:50:23.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.385+0000 7f662bcf7700 1 -- start start 2022-04-03T21:50:23.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.387+0000 7f662bcf7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66240a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.387+0000 7f662bcf7700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66240b7aa0 0x7f66240b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.387+0000 7f662bcf7700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662406c070 con 0x7f6624069910 2022-04-03T21:50:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.387+0000 7f662bcf7700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662406cab0 con 0x7f66240b7aa0 2022-04-03T21:50:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.387+0000 7f662bcf7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662406c350 con 0x7f6624069540 2022-04-03T21:50:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.388+0000 7f662a294700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66240b7aa0 0x7f66240b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.388+0000 7f662a294700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66240b7aa0 0x7f66240b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35408/0 (socket says 172.21.15.49:35408) 2022-04-03T21:50:23.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.388+0000 7f662a294700 1 -- 172.21.15.49:0/2246340911 learned_addr learned my addr 172.21.15.49:0/2246340911 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7f6629a93700 1 --2- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66240a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7f662a294700 1 -- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 msgr2=0x7f66240a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7f662a294700 1 --2- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66240a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7f662a294700 1 -- 172.21.15.49:0/2246340911 >> v1:172.21.15.49:6789/0 conn(0x7f6624069910 legacy=0x7f66240aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7f662a294700 1 -- 172.21.15.49:0/2246340911 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624069e10 con 0x7f66240b7aa0 2022-04-03T21:50:23.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.391+0000 7f662a294700 1 --2- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f66240b06a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f661c009f20 tx=0x7f661c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb9ec296598d7d9 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.387+0000 7fb1130e4700 1 -- start start 2022-04-03T21:50:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.389+0000 7fb1130e4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb10c0c1f00 0x7fb10c0a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.389+0000 7fb1130e4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0bdee0 con 0x7fb10c0c22d0 2022-04-03T21:50:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.389+0000 7fb1130e4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0a5040 con 0x7fb10c0bc010 2022-04-03T21:50:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.389+0000 7fb1130e4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0bc900 con 0x7fb10c0c1f00 2022-04-03T21:50:23.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7fb111681700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb10c0bc010 0x7fb10c155930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47422/0 (socket says 172.21.15.49:47422) 2022-04-03T21:50:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7fb111681700 1 -- 172.21.15.49:0/1450458386 learned_addr learned my addr 172.21.15.49:0/1450458386 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.391+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473940519 0 0) 0x7fb10c0a5040 con 0x7fb10c0bc010 2022-04-03T21:50:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.391+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f00033f0 con 0x7fb10c0bc010 2022-04-03T21:50:23.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.391+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749369422 0 0) 0x7fb10c0bdee0 con 0x7fb10c0c22d0 2022-04-03T21:50:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.391+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb10c0a5040 con 0x7fb10c0c22d0 2022-04-03T21:50:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.390+0000 7f55d0c88700 1 Processor -- start 2022-04-03T21:50:23.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.391+0000 7f55d0c88700 1 -- start start 2022-04-03T21:50:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879354127 0 0) 0x7fb0f00033f0 con 0x7fb10c0bc010 2022-04-03T21:50:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 >> v2:172.21.15.117:3300/0 conn(0x7fb10c0c1f00 msgr2=0x7fb10c0a68a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-03T21:50:23.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 --2- 172.21.15.49:0/1450458386 >> v2:172.21.15.117:3300/0 conn(0x7fb10c0c1f00 0x7fb10c0a68a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 >> v1:172.21.15.49:6789/0 conn(0x7fb10c0c22d0 legacy=0x7fb10c14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0bd640 con 0x7fb10c0bc010 2022-04-03T21:50:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 18272773 0 0) 0x7fb1040017f0 con 0x7fb10c0bc010 2022-04-03T21:50:23.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 >> v1:172.21.15.117:6789/0 conn(0x7fb10c0bc010 legacy=0x7fb10c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7f55d0c88700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55cc0b7c80 0x7f55cc0b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7f55d0c88700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f55cc0b8050 0x7f55cc0b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7f55d0c88700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc06ec80 con 0x7f55cc069380 2022-04-03T21:50:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7f55d0c88700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc06ca90 con 0x7f55cc0b8050 2022-04-03T21:50:23.404 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7f55d0c88700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc06c180 con 0x7f55cc0b7c80 2022-04-03T21:50:23.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f0004b20 0x7fb0f0004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f0003630 0x7fb0f0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f00041e0 0x7fb0f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0bc900 con 0x7fb0f00041e0 2022-04-03T21:50:23.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f000c100 con 0x7fb0f0004b20 2022-04-03T21:50:23.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.392+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f000c2c0 con 0x7fb0f0003630 2022-04-03T21:50:23.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.393+0000 7fb110e80700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f0004b20 0x7fb0f0004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.407 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.393+0000 7f55ca59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55cc0b7c80 0x7f55cc0b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.407 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55ca59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55cc0b7c80 0x7f55cc0b9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35412/0 (socket says 172.21.15.49:35412) 2022-04-03T21:50:23.407 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55ca59c700 1 -- 172.21.15.49:0/2548714935 learned_addr learned my addr 172.21.15.49:0/2548714935 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.393+0000 7fb10bfff700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f0003630 0x7fb0f0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7fb110e80700 1 -- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f0003630 msgr2=0x7fb0f0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7fb110e80700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f0003630 0x7fb0f0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7fb110e80700 1 -- 172.21.15.49:0/1450458386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f00041e0 msgr2=0x7fb0f000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7fb110e80700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f00041e0 0x7fb0f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7fb110e80700 1 -- 172.21.15.49:0/1450458386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0bd640 con 0x7fb0f0004b20 2022-04-03T21:50:23.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7fb111681700 1 -- 172.21.15.49:0/1450458386 reap_dead start 2022-04-03T21:50:23.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55c959a700 1 -- 172.21.15.49:0/2548714935 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872668938 0 0) 0x7f55cc06ec80 con 0x7f55cc069380 2022-04-03T21:50:23.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55c959a700 1 -- 172.21.15.49:0/2548714935 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b00033f0 con 0x7f55cc069380 2022-04-03T21:50:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55ca59c700 1 -- 172.21.15.49:0/2548714935 >> v2:172.21.15.49:3300/0 conn(0x7f55cc0b8050 msgr2=0x7f55cc0b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55ca59c700 1 --2- 172.21.15.49:0/2548714935 >> v2:172.21.15.49:3300/0 conn(0x7f55cc0b8050 0x7f55cc0b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55ca59c700 1 -- 172.21.15.49:0/2548714935 >> v1:172.21.15.117:6789/0 conn(0x7f55cc069380 legacy=0x7f55cc069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.394+0000 7f55ca59c700 1 -- 172.21.15.49:0/2548714935 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc06c440 con 0x7f55cc0b7c80 2022-04-03T21:50:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.395+0000 7f55ca59c700 1 --2- 172.21.15.49:0/2548714935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b9070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06bb30 tx=0x7f55c4007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc8b2d2ab85be49d server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.395+0000 7fb110e80700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f0004b20 0x7fb0f0004f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b7a0 tx=0x7fb0f8006d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45838715e6265a9d server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7f55c959a700 1 -- 172.21.15.49:0/2548714935 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400dda0 con 0x7f55cc0b7c80 2022-04-03T21:50:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7f55c959a700 1 -- 172.21.15.49:0/2548714935 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4007b40 con 0x7f55cc0b7c80 2022-04-03T21:50:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7f55c959a700 1 -- 172.21.15.49:0/2548714935 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4003860 con 0x7f55cc0b7c80 2022-04-03T21:50:23.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7f55d0c88700 1 -- 172.21.15.49:0/2548714935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b7c80 msgr2=0x7f55cc0b9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7f55d0c88700 1 --2- 172.21.15.49:0/2548714935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b9070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06bb30 tx=0x7f55c4007690 comp rx=0 tx=0).stop 2022-04-03T21:50:23.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8011440 con 0x7fb0f0004b20 2022-04-03T21:50:23.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80115a0 con 0x7fb0f0004b20 2022-04-03T21:50:23.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.396+0000 7fb10b7fe700 1 -- 172.21.15.49:0/1450458386 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8011940 con 0x7fb0f0004b20 2022-04-03T21:50:23.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7fb1130e4700 1 -- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f0004b20 msgr2=0x7fb0f0004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f0004b20 0x7fb0f0004f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b7a0 tx=0x7fb0f8006d70 comp rx=0 tx=0).stop 2022-04-03T21:50:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7f55d0c88700 1 -- 172.21.15.49:0/2548714935 shutdown_connections 2022-04-03T21:50:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7f55d0c88700 1 --2- 172.21.15.49:0/2548714935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b9070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7f55d0c88700 1 --2- 172.21.15.49:0/2548714935 >> v2:172.21.15.49:3300/0 conn(0x7f55cc0b8050 0x7f55cc0b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7f55d0c88700 1 -- 172.21.15.49:0/2548714935 >> 172.21.15.49:0/2548714935 conn(0x7f55cc066ae0 msgr2=0x7f55cc066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7fb1130e4700 1 -- 172.21.15.49:0/1450458386 shutdown_connections 2022-04-03T21:50:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1450458386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f0004b20 0x7fb0f0004f10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.418 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7fb1130e4700 1 -- 172.21.15.49:0/1450458386 >> 172.21.15.49:0/1450458386 conn(0x7fb10c05e010 msgr2=0x7fb10c0c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.419 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.397+0000 7f93d3b18700 1 Processor -- start 2022-04-03T21:50:23.419 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.398+0000 7fb1130e4700 1 -- 172.21.15.49:0/1450458386 shutdown_connections 2022-04-03T21:50:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.398+0000 7fb1130e4700 1 -- 172.21.15.49:0/1450458386 wait complete. 2022-04-03T21:50:23.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.398+0000 7f93d3b18700 1 -- start start 2022-04-03T21:50:23.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.399+0000 7f6628a91700 1 -- 172.21.15.49:0/2246340911 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00e070 con 0x7f66240b7aa0 2022-04-03T21:50:23.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.399+0000 7f6628a91700 1 -- 172.21.15.49:0/2246340911 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00ba40 con 0x7f66240b7aa0 2022-04-03T21:50:23.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.399+0000 7f6628a91700 1 -- 172.21.15.49:0/2246340911 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c0092e0 con 0x7f66240b7aa0 2022-04-03T21:50:23.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f662bcf7700 1 -- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 msgr2=0x7f66240b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f662bcf7700 1 --2- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f66240b06a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f661c009f20 tx=0x7f661c009840 comp rx=0 tx=0).stop 2022-04-03T21:50:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f662bcf7700 1 -- 172.21.15.49:0/2246340911 shutdown_connections 2022-04-03T21:50:23.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f662bcf7700 1 --2- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f66240b06a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f662bcf7700 1 --2- 172.21.15.49:0/2246340911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66240a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f662bcf7700 1 -- 172.21.15.49:0/2246340911 >> 172.21.15.49:0/2246340911 conn(0x7f6624066ae0 msgr2=0x7f6624066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d3b18700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d3b18700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f93cc069910 0x7f93cc0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d3b18700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93cc0a0d70 0x7f93cc0a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d3b18700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc06c350 con 0x7f93cc069910 2022-04-03T21:50:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d3b18700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc06c070 con 0x7f93cc0a0d70 2022-04-03T21:50:23.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.399+0000 7f55d0c88700 1 -- 172.21.15.49:0/2548714935 shutdown_connections 2022-04-03T21:50:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d3b18700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc069da0 con 0x7f93cc069540 2022-04-03T21:50:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7f93d18b4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.401+0000 7f93d18b4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45820/0 (socket says 172.21.15.49:45820) 2022-04-03T21:50:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.401+0000 7f93d18b4700 1 -- 172.21.15.49:0/3699999469 learned_addr learned my addr 172.21.15.49:0/3699999469 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7fb1130e4700 1 Processor -- start 2022-04-03T21:50:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.400+0000 7fb1130e4700 1 -- start start 2022-04-03T21:50:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7fb1130e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0004b20 0x7fb10c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7fb1130e4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 0x7fb10c1478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7fb1130e4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb10c0a24f0 0x7fb10c147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7fb1130e4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c15eba0 con 0x7fb0f0004b20 2022-04-03T21:50:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7fb1130e4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0a29d0 con 0x7fb10c152250 2022-04-03T21:50:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7fb1130e4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c09fc50 con 0x7fb10c0a24f0 2022-04-03T21:50:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.402+0000 7f93d20b5700 1 --2- 172.21.15.49:0/3699999469 >> v2:172.21.15.117:3300/0 conn(0x7f93cc0a0d70 0x7f93cc0a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.402+0000 7f93d10b3700 1 --2- 172.21.15.49:0/3699999469 >> v2:172.21.15.49:3300/0 conn(0x7f93cc069910 0x7f93cc0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f93d20b5700 1 -- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 msgr2=0x7f93cc0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f93d20b5700 1 --2- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f93d20b5700 1 -- 172.21.15.49:0/3699999469 >> v2:172.21.15.49:3300/0 conn(0x7f93cc069910 msgr2=0x7f93cc0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f93d20b5700 1 --2- 172.21.15.49:0/3699999469 >> v2:172.21.15.49:3300/0 conn(0x7f93cc069910 0x7f93cc0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f93d20b5700 1 -- 172.21.15.49:0/3699999469 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0a1710 con 0x7f93cc0a0d70 2022-04-03T21:50:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.402+0000 7f39f82f0700 1 Processor -- start 2022-04-03T21:50:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f39f82f0700 1 -- start start 2022-04-03T21:50:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.402+0000 7f662bcf7700 1 -- 172.21.15.49:0/2246340911 shutdown_connections 2022-04-03T21:50:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.402+0000 7f662bcf7700 1 -- 172.21.15.49:0/2246340911 wait complete. 2022-04-03T21:50:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f93d20b5700 1 --2- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc0a0d70 0x7f93cc0a11d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0bb0c0 tx=0x7f93c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db61d50cfa50ae47 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f39f82f0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 0x7f39f0069750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f39f82f0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f39f006dc00 0x7f39f006e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f39f82f0700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f00b7aa0 con 0x7f39f006e550 2022-04-03T21:50:23.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f39f82f0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f006d490 con 0x7f39f006dc00 2022-04-03T21:50:23.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f39f82f0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f006c630 con 0x7f39f0069380 2022-04-03T21:50:23.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f39f608c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 0x7f39f0069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f39f608c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 0x7f39f0069750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45822/0 (socket says 172.21.15.49:45822) 2022-04-03T21:50:23.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f39f608c700 1 -- 172.21.15.49:0/2123585731 learned_addr learned my addr 172.21.15.49:0/2123585731 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f93d08b2700 1 -- 172.21.15.49:0/3699999469 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400e070 con 0x7f93cc0a0d70 2022-04-03T21:50:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f93d08b2700 1 -- 172.21.15.49:0/3699999469 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400bb60 con 0x7f93cc0a0d70 2022-04-03T21:50:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f93d08b2700 1 -- 172.21.15.49:0/3699999469 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4012430 con 0x7f93cc0a0d70 2022-04-03T21:50:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f39f588b700 1 --2- 172.21.15.49:0/2123585731 >> v2:172.21.15.117:3300/0 conn(0x7f39f006dc00 0x7f39f006e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7fb10bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 0x7fb10c1478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7fb10bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 0x7fb10c1478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35418/0 (socket says 172.21.15.49:35418) 2022-04-03T21:50:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7fb10bfff700 1 -- 172.21.15.49:0/1610479689 learned_addr learned my addr 172.21.15.49:0/1610479689 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f93d3b18700 1 -- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc0a0d70 msgr2=0x7f93cc0a11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc0a0d70 0x7f93cc0a11d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0bb0c0 tx=0x7f93c4009780 comp rx=0 tx=0).stop 2022-04-03T21:50:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7fb111681700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb10c0a24f0 0x7fb10c147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f662bcf7700 1 Processor -- start 2022-04-03T21:50:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f662bcf7700 1 -- start start 2022-04-03T21:50:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f662bcf7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66241400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f662bcf7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624069910 0x7f6624140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f662bcf7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f6624159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f662bcf7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624154250 con 0x7f6624069910 2022-04-03T21:50:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f662bcf7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662413f3c0 con 0x7f66240b7aa0 2022-04-03T21:50:23.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f662bcf7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662413fc60 con 0x7f6624069540 2022-04-03T21:50:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f662a294700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f6624159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f662a294700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f6624159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35420/0 (socket says 172.21.15.49:35420) 2022-04-03T21:50:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f662a294700 1 -- 172.21.15.49:0/1083149781 learned_addr learned my addr 172.21.15.49:0/1083149781 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 -- 172.21.15.49:0/3699999469 shutdown_connections 2022-04-03T21:50:23.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc0a0d70 0x7f93cc0a11d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3699999469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3699999469 >> v2:172.21.15.49:3300/0 conn(0x7f93cc069910 0x7f93cc0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 -- 172.21.15.49:0/3699999469 >> 172.21.15.49:0/3699999469 conn(0x7f93cc066ae0 msgr2=0x7f93cc066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 -- 172.21.15.49:0/3699999469 shutdown_connections 2022-04-03T21:50:23.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f6629292700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624069910 0x7f6624140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7f662a294700 1 -- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 msgr2=0x7f66241400f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-04-03T21:50:23.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7fb10bfff700 1 -- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb10c0a24f0 msgr2=0x7fb10c147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7fb10bfff700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb10c0a24f0 0x7fb10c147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7fb10bfff700 1 -- 172.21.15.49:0/1610479689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0004b20 msgr2=0x7fb10c151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7fb10bfff700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0004b20 0x7fb10c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7fb10bfff700 1 -- 172.21.15.49:0/1610479689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c09ff30 con 0x7fb10c152250 2022-04-03T21:50:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.401+0000 7f55d0c88700 1 -- 172.21.15.49:0/2548714935 wait complete. 2022-04-03T21:50:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.403+0000 7f55d0c88700 1 Processor -- start 2022-04-03T21:50:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.404+0000 7f55d0c88700 1 -- start start 2022-04-03T21:50:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f55d0c88700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 0x7f55cc0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.405+0000 7f55d0c88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7f662a294700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66241400f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7f662a294700 1 -- 172.21.15.49:0/1083149781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624069910 msgr2=0x7f6624140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7f662a294700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624069910 0x7f6624140630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7f662a294700 1 -- 172.21.15.49:0/1083149781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c009ae0 con 0x7f66240b7aa0 2022-04-03T21:50:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7f662a294700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f6624159a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f662406b9c0 tx=0x7f661c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7f55ca59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 0x7f55cc0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7f55ca59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 0x7f55cc0b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45830/0 (socket says 172.21.15.49:45830) 2022-04-03T21:50:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c0092e0 con 0x7f66240b7aa0 2022-04-03T21:50:23.451 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c004030 con 0x7f66240b7aa0 2022-04-03T21:50:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c0043d0 con 0x7f66240b7aa0 2022-04-03T21:50:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7f662bcf7700 1 -- 172.21.15.49:0/1083149781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66240b4680 con 0x7f66240b7aa0 2022-04-03T21:50:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.408+0000 7fb10bfff700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 0x7fb10c1478a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb10000f880 tx=0x7fb100009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000052e0 con 0x7fb10c152250 2022-04-03T21:50:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000034c0 con 0x7fb10c152250 2022-04-03T21:50:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.409+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000038c0 con 0x7fb10c152250 2022-04-03T21:50:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c0a0210 con 0x7fb10c152250 2022-04-03T21:50:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c0a0620 con 0x7fb10c152250 2022-04-03T21:50:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f93d3b18700 1 -- 172.21.15.49:0/3699999469 wait complete. 2022-04-03T21:50:23.454 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f93d3b18700 1 Processor -- start 2022-04-03T21:50:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f39f608c700 1 -- 172.21.15.49:0/2123585731 >> v2:172.21.15.117:3300/0 conn(0x7f39f006dc00 msgr2=0x7f39f006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f39f608c700 1 --2- 172.21.15.49:0/2123585731 >> v2:172.21.15.117:3300/0 conn(0x7f39f006dc00 0x7f39f006e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f39f608c700 1 -- 172.21.15.49:0/2123585731 >> v1:172.21.15.117:6789/0 conn(0x7f39f006e550 legacy=0x7f39f0161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.455 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.406+0000 7f39f608c700 1 -- 172.21.15.49:0/2123585731 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0086ca0 con 0x7f39f0069380 2022-04-03T21:50:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f39f608c700 1 --2- 172.21.15.49:0/2123585731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 0x7f39f0069750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009f20 tx=0x7f39e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14dc241a2e1c5636 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f39f508a700 1 -- 172.21.15.49:0/2123585731 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e800e070 con 0x7f39f0069380 2022-04-03T21:50:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f39f508a700 1 -- 172.21.15.49:0/2123585731 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e800ba40 con 0x7f39f0069380 2022-04-03T21:50:23.456 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.407+0000 7f39f508a700 1 -- 172.21.15.49:0/2123585731 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80092e0 con 0x7f39f0069380 2022-04-03T21:50:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f39f82f0700 1 -- 172.21.15.49:0/2123585731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 msgr2=0x7f39f0069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2123585731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 0x7f39f0069750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009f20 tx=0x7f39e8009840 comp rx=0 tx=0).stop 2022-04-03T21:50:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f39f82f0700 1 -- 172.21.15.49:0/2123585731 shutdown_connections 2022-04-03T21:50:23.457 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2123585731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f0069380 0x7f39f0069750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2123585731 >> v2:172.21.15.117:3300/0 conn(0x7f39f006dc00 0x7f39f006e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f39f82f0700 1 -- 172.21.15.49:0/2123585731 >> 172.21.15.49:0/2123585731 conn(0x7f39f0066ae0 msgr2=0x7f39f0066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.458 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f662bcf7700 1 -- 172.21.15.49:0/1083149781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662413f8f0 con 0x7f66240b7aa0 2022-04-03T21:50:23.459 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.411+0000 7f39f82f0700 1 -- 172.21.15.49:0/2123585731 shutdown_connections 2022-04-03T21:50:23.459 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.411+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f8005130 con 0x7f66240b7aa0 2022-04-03T21:50:23.460 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.411+0000 7f62086ec700 1 Processor -- start 2022-04-03T21:50:23.460 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f62086ec700 1 -- start start 2022-04-03T21:50:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f39f82f0700 1 -- 172.21.15.49:0/2123585731 wait complete. 2022-04-03T21:50:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.410+0000 7f93d3b18700 1 -- start start 2022-04-03T21:50:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d3b18700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d3b18700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 0x7f93cc14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d3b18700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93cc0a0d70 0x7f93cc14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d3b18700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0b4520 con 0x7f93cc0a0d70 2022-04-03T21:50:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d3b18700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0b69c0 con 0x7f93cc069910 2022-04-03T21:50:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d3b18700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0b17b0 con 0x7f93cc069540 2022-04-03T21:50:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d10b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 0x7f93cc14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d10b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 0x7f93cc14da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35422/0 (socket says 172.21.15.49:35422) 2022-04-03T21:50:23.464 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.412+0000 7f93d10b3700 1 -- 172.21.15.49:0/3400622634 learned_addr learned my addr 172.21.15.49:0/3400622634 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.464 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.413+0000 7f93d18b4700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.464 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f62086ec700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f620006e520 0x7f620014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f62086ec700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6200069dd0 0x7f6200149590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f62086ec700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6200149100 con 0x7f620006e8f0 2022-04-03T21:50:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f62086ec700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000a0910 con 0x7f6200069dd0 2022-04-03T21:50:23.465 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f62086ec700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620014d160 con 0x7f620006e520 2022-04-03T21:50:23.466 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f93d10b3700 1 -- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 msgr2=0x7f93cc1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.466 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f93d10b3700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.466 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f93d10b3700 1 -- 172.21.15.49:0/3400622634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93cc0a0d70 msgr2=0x7f93cc14df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.466 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f93d10b3700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93cc0a0d70 0x7f93cc14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f93d10b3700 1 -- 172.21.15.49:0/3400622634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009a20 con 0x7f93cc069910 2022-04-03T21:50:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f93d10b3700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 0x7f93cc14da50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d890 tx=0x7f93c8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.467 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f55d0c88700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b8050 0x7f55cc09ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f55d0c88700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc153520 con 0x7f55cc0b7c80 2022-04-03T21:50:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f55d0c88700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc157500 con 0x7f55cc0b8050 2022-04-03T21:50:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f55d0c88700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc153d80 con 0x7f55cc069380 2022-04-03T21:50:23.468 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f55ca59c700 1 -- 172.21.15.49:0/188795912 learned_addr learned my addr 172.21.15.49:0/188795912 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f55c9d9b700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fb100003cf0 con 0x7fb10c152250 2022-04-03T21:50:23.469 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f39f82f0700 1 Processor -- start 2022-04-03T21:50:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.414+0000 7f6206488700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f620006e520 0x7f620014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f6206488700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f620006e520 0x7f620014cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35426/0 (socket says 172.21.15.49:35426) 2022-04-03T21:50:23.470 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f6206488700 1 -- 172.21.15.49:0/2499503181 learned_addr learned my addr 172.21.15.49:0/2499503181 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55ca59c700 1 -- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b8050 msgr2=0x7f55cc09ef10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-04-03T21:50:23.471 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55ca59c700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b8050 0x7f55cc09ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55ca59c700 1 -- 172.21.15.49:0/188795912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55cc0b7c80 msgr2=0x7f55cc0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55ca59c700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55ca59c700 1 -- 172.21.15.49:0/188795912 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c400be70 con 0x7f55cc069380 2022-04-03T21:50:23.472 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55c9d9b700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-03T21:50:23.473 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f55ca59c700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 0x7f55cc0b4520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06c2c0 tx=0x7f55c4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.473 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c0a03a0 con 0x7fb10c152250 2022-04-03T21:50:23.473 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7fb108ff9700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb0f4063e30 0x7fb0f40662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb100080c10 con 0x7fb10c152250 2022-04-03T21:50:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7fb110e80700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb0f4063e30 0x7fb0f40662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.474 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4010030 con 0x7f55cc069380 2022-04-03T21:50:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c40046a0 con 0x7f55cc069380 2022-04-03T21:50:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc14da30 con 0x7f55cc069380 2022-04-03T21:50:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40256c0 con 0x7f55cc069380 2022-04-03T21:50:23.475 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc153730 con 0x7f55cc069380 2022-04-03T21:50:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f39f82f0700 1 -- start start 2022-04-03T21:50:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f82f0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0069380 0x7f39f00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f82f0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f006dc00 0x7f39f01677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.476 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f82f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f006e550 0x7f39f0167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f82f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0158b50 con 0x7f39f006e550 2022-04-03T21:50:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f82f0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00b5fd0 con 0x7f39f0069380 2022-04-03T21:50:23.477 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f82f0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00b5cb0 con 0x7f39f006dc00 2022-04-03T21:50:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f6206488700 1 -- 172.21.15.49:0/2499503181 >> v2:172.21.15.49:3300/0 conn(0x7f6200069dd0 msgr2=0x7f6200149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f6206488700 1 --2- 172.21.15.49:0/2499503181 >> v2:172.21.15.49:3300/0 conn(0x7f6200069dd0 0x7f6200149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f6206488700 1 -- 172.21.15.49:0/2499503181 >> v1:172.21.15.117:6789/0 conn(0x7f620006e8f0 legacy=0x7f6200142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.478 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.416+0000 7f6206488700 1 -- 172.21.15.49:0/2499503181 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6200148dd0 con 0x7f620006e520 2022-04-03T21:50:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f6206488700 1 --2- 172.21.15.49:0/2499503181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 0x7f620014cc20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f620006bb30 tx=0x7f61f00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0291132efaed3a1 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f688d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f006e550 0x7f39f0167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f688d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f006e550 0x7f39f0167d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34604/0 (socket says 172.21.15.49:34604) 2022-04-03T21:50:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f39f688d700 1 -- 172.21.15.49:0/2607505128 learned_addr learned my addr 172.21.15.49:0/2607505128 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc0bc120 con 0x7f55cc069380 2022-04-03T21:50:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f39f608c700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0069380 0x7f39f00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8004240 con 0x7f93cc069910 2022-04-03T21:50:23.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c80043a0 con 0x7f93cc069910 2022-04-03T21:50:23.482 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80036f0 con 0x7f93cc069910 2022-04-03T21:50:23.482 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f39f588b700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f006dc00 0x7f39f01677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.483 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc155080 con 0x7f93cc069910 2022-04-03T21:50:23.483 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.415+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f661c028460 con 0x7f66240b7aa0 2022-04-03T21:50:23.483 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f6619ffb700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f660c063e30 0x7f660c0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.417+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f661c082fe0 con 0x7f66240b7aa0 2022-04-03T21:50:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f6629a93700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f660c063e30 0x7f660c0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f661c051880 con 0x7f66240b7aa0 2022-04-03T21:50:23.484 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7fb110e80700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb0f4063e30 0x7fb0f40662e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb10c14e5c0 tx=0x7fb0f8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.485 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc15f9e0 con 0x7f93cc069910 2022-04-03T21:50:23.485 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f608c700 1 -- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f006dc00 msgr2=0x7f39f01677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f608c700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f006dc00 0x7f39f01677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f608c700 1 -- 172.21.15.49:0/2607505128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f006e550 msgr2=0x7f39f0167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f608c700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f006e550 0x7f39f0167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.486 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f608c700 1 -- 172.21.15.49:0/2607505128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8009ae0 con 0x7f39f0069380 2022-04-03T21:50:23.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f588b700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f006dc00 0x7f39f01677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-04-03T21:50:23.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f39f608c700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0069380 0x7f39f00b6460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39f0086320 tx=0x7f39e801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.418+0000 7f9ae4c59700 1 Processor -- start 2022-04-03T21:50:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.419+0000 7f9ae4c59700 1 -- start start 2022-04-03T21:50:23.488 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.420+0000 7f6629a93700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f660c063e30 0x7f660c0662e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f661400b850 tx=0x7f6614008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7fc21d926700 1 Processor -- start 2022-04-03T21:50:23.489 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8005130 con 0x7f93cc069910 2022-04-03T21:50:23.490 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9ae4c59700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ae006e480 0x7f9ae005d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9ae4c59700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9ae4c59700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00b8f60 con 0x7f9ae006e0b0 2022-04-03T21:50:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9ae4c59700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00b83e0 con 0x7f9ae006e480 2022-04-03T21:50:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9ae4c59700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00b86c0 con 0x7f9ae0067560 2022-04-03T21:50:23.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9aded9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9aded9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45838/0 (socket says 172.21.15.49:45838) 2022-04-03T21:50:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f9aded9d700 1 -- 172.21.15.49:0/3037746024 learned_addr learned my addr 172.21.15.49:0/3037746024 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f9addd9b700 1 --2- 172.21.15.49:0/3037746024 >> v2:172.21.15.117:3300/0 conn(0x7f9ae006e480 0x7f9ae005d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f6205486700 1 -- 172.21.15.49:0/2499503181 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0004030 con 0x7f620006e520 2022-04-03T21:50:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f9aded9d700 1 -- 172.21.15.49:0/3037746024 >> v2:172.21.15.117:3300/0 conn(0x7f9ae006e480 msgr2=0x7f9ae005d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f9aded9d700 1 --2- 172.21.15.49:0/3037746024 >> v2:172.21.15.117:3300/0 conn(0x7f9ae006e480 0x7f9ae005d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.494 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f9aded9d700 1 -- 172.21.15.49:0/3037746024 >> v1:172.21.15.117:6789/0 conn(0x7f9ae006e0b0 legacy=0x7f9ae0066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.494 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7fc21d926700 1 -- start start 2022-04-03T21:50:23.494 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.421+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f55c401c410 con 0x7f55cc069380 2022-04-03T21:50:23.495 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f9aded9d700 1 -- 172.21.15.49:0/3037746024 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00b89a0 con 0x7f9ae0067560 2022-04-03T21:50:23.495 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fb10004f490 con 0x7fb10c152250 2022-04-03T21:50:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7f6205486700 1 -- 172.21.15.49:0/2499503181 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f0004190 con 0x7f620006e520 2022-04-03T21:50:23.496 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7f6205486700 1 -- 172.21.15.49:0/2499503181 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0011630 con 0x7f620006e520 2022-04-03T21:50:23.497 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8004240 con 0x7f39f0069380 2022-04-03T21:50:23.497 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e80043a0 con 0x7f39f0069380 2022-04-03T21:50:23.497 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.422+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8004740 con 0x7f39f0069380 2022-04-03T21:50:23.498 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f0158590 con 0x7f39f0069380 2022-04-03T21:50:23.498 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f00b69a0 con 0x7f39f0069380 2022-04-03T21:50:23.498 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7fc21d926700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2180c1f00 0x7fc2180a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7fc21d926700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180bc010 0x7fc2180a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7fc21d926700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2180bdee0 con 0x7fc2180c22d0 2022-04-03T21:50:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7fc21d926700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2180bc900 con 0x7fc2180c1f00 2022-04-03T21:50:23.499 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7fc21d926700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180a5040 con 0x7fc2180bc010 2022-04-03T21:50:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 -- 172.21.15.49:0/2499503181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 msgr2=0x7f620014cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.500 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 --2- 172.21.15.49:0/2499503181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 0x7f620014cc20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f620006bb30 tx=0x7f61f00090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7f55ba7fc700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f55a8063e30 0x7f55a80662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.501 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.423+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f55c4011070 con 0x7f55cc069380 2022-04-03T21:50:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 -- 172.21.15.49:0/2499503181 shutdown_connections 2022-04-03T21:50:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 --2- 172.21.15.49:0/2499503181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 0x7f620014cc20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 --2- 172.21.15.49:0/2499503181 >> v2:172.21.15.49:3300/0 conn(0x7f6200069dd0 0x7f6200149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.502 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 -- 172.21.15.49:0/2499503181 >> 172.21.15.49:0/2499503181 conn(0x7f6200066ae0 msgr2=0x7f6200066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f9aded9d700 1 --2- 172.21.15.49:0/3037746024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b6ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009f20 tx=0x7f9ad8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c4c47ce36ccd277 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.503 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f62086ec700 1 -- 172.21.15.49:0/2499503181 shutdown_connections 2022-04-03T21:50:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7f9add59a700 1 -- 172.21.15.49:0/3037746024 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800e070 con 0x7f9ae0067560 2022-04-03T21:50:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7f9add59a700 1 -- 172.21.15.49:0/3037746024 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad800b9d0 con 0x7f9ae0067560 2022-04-03T21:50:23.504 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7f62086ec700 1 -- 172.21.15.49:0/2499503181 wait complete. 2022-04-03T21:50:23.505 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7fc216ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2180c1f00 0x7fc2180a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7fc216ffd700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc2180c1f00 0x7fc2180a68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34606/0 (socket says 172.21.15.49:34606) 2022-04-03T21:50:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7fc216ffd700 1 -- 172.21.15.49:0/1040317520 learned_addr learned my addr 172.21.15.49:0/1040317520 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.506 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.424+0000 7fc2177fe700 1 --2- 172.21.15.49:0/1040317520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180bc010 0x7fc2180a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7fc2177fe700 1 -- 172.21.15.49:0/1040317520 >> v2:172.21.15.49:3300/0 conn(0x7fc2180c1f00 msgr2=0x7fc2180a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7fc2177fe700 1 --2- 172.21.15.49:0/1040317520 >> v2:172.21.15.49:3300/0 conn(0x7fc2180c1f00 0x7fc2180a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7fc2177fe700 1 -- 172.21.15.49:0/1040317520 >> v1:172.21.15.49:6789/0 conn(0x7fc2180c22d0 legacy=0x7fc21814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:23.507 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7fc2177fe700 1 -- 172.21.15.49:0/1040317520 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180bd640 con 0x7fc2180bc010 2022-04-03T21:50:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7f9add59a700 1 -- 172.21.15.49:0/3037746024 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80092e0 con 0x7f9ae0067560 2022-04-03T21:50:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7f9ae4c59700 1 -- 172.21.15.49:0/3037746024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 msgr2=0x7f9ae00b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.508 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7fc2177fe700 1 --2- 172.21.15.49:0/1040317520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180bc010 0x7fc2180a6de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc210009e60 tx=0x7fc210009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952a43abbedaf845 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/3037746024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b6ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009f20 tx=0x7f9ad8009840 comp rx=0 tx=0).stop 2022-04-03T21:50:23.509 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.425+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f0070a20 con 0x7f39f0069380 2022-04-03T21:50:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7fc215ffb700 1 -- 172.21.15.49:0/1040317520 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000e070 con 0x7fc2180bc010 2022-04-03T21:50:23.510 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7fc215ffb700 1 -- 172.21.15.49:0/1040317520 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000bc80 con 0x7fc2180bc010 2022-04-03T21:50:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7fc215ffb700 1 -- 172.21.15.49:0/1040317520 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210003860 con 0x7fc2180bc010 2022-04-03T21:50:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7f9ae4c59700 1 -- 172.21.15.49:0/3037746024 shutdown_connections 2022-04-03T21:50:23.511 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/3037746024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b6ff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/3037746024 >> v2:172.21.15.117:3300/0 conn(0x7f9ae006e480 0x7f9ae005d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7f9ae4c59700 1 -- 172.21.15.49:0/3037746024 >> 172.21.15.49:0/3037746024 conn(0x7f9ae00ba530 msgr2=0x7f9ae00ba930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.427+0000 7fc21d926700 1 -- 172.21.15.49:0/1040317520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180bc010 msgr2=0x7fc2180a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.512 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.427+0000 7fc21d926700 1 --2- 172.21.15.49:0/1040317520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180bc010 0x7fc2180a6de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc210009e60 tx=0x7fc210009780 comp rx=0 tx=0).stop 2022-04-03T21:50:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.426+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f93c8003a60 con 0x7f93cc069910 2022-04-03T21:50:23.513 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.427+0000 7f62086ec700 1 Processor -- start 2022-04-03T21:50:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7f9ae4c59700 1 -- 172.21.15.49:0/3037746024 shutdown_connections 2022-04-03T21:50:23.514 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7f9ae4c59700 1 -- 172.21.15.49:0/3037746024 wait complete. 2022-04-03T21:50:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7fc21d926700 1 -- 172.21.15.49:0/1040317520 shutdown_connections 2022-04-03T21:50:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7fc21d926700 1 --2- 172.21.15.49:0/1040317520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180bc010 0x7fc2180a6de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.515 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7fc21d926700 1 --2- 172.21.15.49:0/1040317520 >> v2:172.21.15.49:3300/0 conn(0x7fc2180c1f00 0x7fc2180a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7fc21d926700 1 -- 172.21.15.49:0/1040317520 >> 172.21.15.49:0/1040317520 conn(0x7fc21805e010 msgr2=0x7fc2180c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7f93b9ffb700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93ac063e30 0x7f93ac0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.516 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.428+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f93c8081790 con 0x7f93cc069910 2022-04-03T21:50:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.429+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f93c8050030 con 0x7f93cc069910 2022-04-03T21:50:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.429+0000 7f93d18b4700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93ac063e30 0x7f93ac0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.429+0000 7fc21d926700 1 -- 172.21.15.49:0/1040317520 shutdown_connections 2022-04-03T21:50:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.430+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f39e8025030 con 0x7f39f0069380 2022-04-03T21:50:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.429+0000 7fc21d926700 1 -- 172.21.15.49:0/1040317520 wait complete. 2022-04-03T21:50:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.430+0000 7f9ae4c59700 1 Processor -- start 2022-04-03T21:50:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.429+0000 7f62086ec700 1 -- start start 2022-04-03T21:50:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f62086ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6200069dd0 0x7f620015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f62086ec700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 0x7f620013ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f62086ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 0x7f62000ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f62086ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620015ef70 con 0x7f620006e8f0 2022-04-03T21:50:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f62086ec700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000b2c80 con 0x7f620006e520 2022-04-03T21:50:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f62086ec700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620015ea10 con 0x7f6200069dd0 2022-04-03T21:50:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f39de7fc700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f39d0063e30 0x7f39d00662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f39e8081e50 con 0x7f39f0069380 2022-04-03T21:50:23.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7fc21d926700 1 Processor -- start 2022-04-03T21:50:23.522 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f39f588b700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f39d0063e30 0x7f39d00662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f6206c89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 0x7f62000ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f6206c89700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 0x7f62000ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34608/0 (socket says 172.21.15.49:34608) 2022-04-03T21:50:23.523 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7fc21d926700 1 -- start start 2022-04-03T21:50:23.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f6206c89700 1 -- 172.21.15.49:0/1923726194 learned_addr learned my addr 172.21.15.49:0/1923726194 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.524 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f55c9d9b700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f55a8063e30 0x7f55a80662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.525 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f6206c89700 1 -- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6200069dd0 msgr2=0x7f620015aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-03T21:50:23.525 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f6206c89700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6200069dd0 0x7f620015aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.526 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f6206c89700 1 -- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 msgr2=0x7f620013ad40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-03T21:50:23.526 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f6206c89700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 0x7f620013ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.526 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f6206c89700 1 -- 172.21.15.49:0/1923726194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009370 con 0x7f620006e8f0 2022-04-03T21:50:23.527 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.431+0000 7f9ae4c59700 1 -- start start 2022-04-03T21:50:23.527 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f9ae4c59700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.527 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f9ae4c59700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ae006e0b0 0x7f9ae0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.528 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f9ae4c59700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ae006e480 0x7f9ae0140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.528 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f9ae4c59700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0142ef0 con 0x7f9ae006e0b0 2022-04-03T21:50:23.528 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f9ae4c59700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0141c60 con 0x7f9ae006e480 2022-04-03T21:50:23.528 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.432+0000 7f9ae4c59700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00b3be0 con 0x7f9ae0067560 2022-04-03T21:50:23.529 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f6206c89700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 0x7f62000ad7e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61f800c7c0 tx=0x7f61f8001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.529 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f39e80506f0 con 0x7f39f0069380 2022-04-03T21:50:23.530 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7f39f588b700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f39d0063e30 0x7f39d00662e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39f00b6d80 tx=0x7f39e000d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.530 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7f55c9d9b700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f55a8063e30 0x7f55a80662e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0b09f0 tx=0x7f55c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45842/0 (socket says 172.21.15.49:45842) 2022-04-03T21:50:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7fc21d926700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 0x7fc2180ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.531 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7fc21d926700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2180c1f00 0x7fc2180bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7fc21d926700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180c22d0 0x7fc2180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7fc21d926700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b9880 con 0x7fc2180c1f00 2022-04-03T21:50:23.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7fc21d926700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815fb40 con 0x7fc2180bc010 2022-04-03T21:50:23.532 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.433+0000 7fc21d926700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b9510 con 0x7fc2180c22d0 2022-04-03T21:50:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7fc216ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 0x7fc2180ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7fc216ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 0x7fc2180ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35434/0 (socket says 172.21.15.49:35434) 2022-04-03T21:50:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7fc216ffd700 1 -- 172.21.15.49:0/2853328683 learned_addr learned my addr 172.21.15.49:0/2853328683 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7f9ade59c700 1 -- 172.21.15.49:0/4175535372 learned_addr learned my addr 172.21.15.49:0/4175535372 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7f9aded9d700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ae006e480 0x7f9ae0140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.534 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.434+0000 7fc2177fe700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180c22d0 0x7fc2180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7fc216ffd700 1 -- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180c22d0 msgr2=0x7fc2180b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7fc216ffd700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180c22d0 0x7fc2180b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7fc216ffd700 1 -- 172.21.15.49:0/2853328683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2180c1f00 msgr2=0x7fc2180bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7fc216ffd700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2180c1f00 0x7fc2180bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.536 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7fc216ffd700 1 -- 172.21.15.49:0/2853328683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009a20 con 0x7fc2180bc010 2022-04-03T21:50:23.536 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8003840 con 0x7f620006e8f0 2022-04-03T21:50:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7fc216ffd700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 0x7fc2180ba470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc20800d860 tx=0x7fc208008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f9aded9d700 1 -- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 msgr2=0x7f9ae00b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f9aded9d700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f9aded9d700 1 -- 172.21.15.49:0/4175535372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ae006e0b0 msgr2=0x7f9ae0140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f9aded9d700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ae006e0b0 0x7f9ae0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.538 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f9aded9d700 1 -- 172.21.15.49:0/4175535372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009ae0 con 0x7f9ae006e480 2022-04-03T21:50:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f9aded9d700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ae006e480 0x7f9ae0140fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8015000 tx=0x7f9ad8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208014620 con 0x7fc2180bc010 2022-04-03T21:50:23.539 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208014780 con 0x7fc2180bc010 2022-04-03T21:50:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208014b40 con 0x7fc2180bc010 2022-04-03T21:50:23.540 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004040 con 0x7f9ae006e480 2022-04-03T21:50:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad80041a0 con 0x7f9ae006e480 2022-04-03T21:50:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004540 con 0x7f9ae006e480 2022-04-03T21:50:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00b3ec0 con 0x7f9ae006e480 2022-04-03T21:50:23.541 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00b2fa0 con 0x7f9ae006e480 2022-04-03T21:50:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f80039a0 con 0x7f620006e8f0 2022-04-03T21:50:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8003d20 con 0x7f620006e8f0 2022-04-03T21:50:23.542 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.435+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620015ec90 con 0x7f620006e8f0 2022-04-03T21:50:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.436+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62000b29a0 con 0x7f620006e8f0 2022-04-03T21:50:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.437+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21815f840 con 0x7fc2180bc010 2022-04-03T21:50:23.543 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.437+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2180b8fe0 con 0x7fc2180bc010 2022-04-03T21:50:23.544 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.437+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f55c4050fb0 con 0x7f55cc069380 2022-04-03T21:50:23.545 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.438+0000 7f93d18b4700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93ac063e30 0x7f93ac0662e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006bc0 tx=0x7f93bc0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.545 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.439+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0142140 con 0x7f9ae006e480 2022-04-03T21:50:23.545 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.440+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9ad801d420 con 0x7f9ae006e480 2022-04-03T21:50:23.546 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.442+0000 7f9ace7fc700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9abc063e60 0x7f9abc066310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.546 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.442+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9ad8082940 con 0x7f9ae006e480 2022-04-03T21:50:23.546 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.443+0000 7f9ade59c700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9abc063e60 0x7f9abc066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.441+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f61f8010050 con 0x7f620006e8f0 2022-04-03T21:50:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.443+0000 7f61ee7fc700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f61e0063e30 0x7f61e00662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.443+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f61f80805d0 con 0x7f620006e8f0 2022-04-03T21:50:23.548 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.444+0000 7f9ade59c700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9abc063e60 0x7f9abc066310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0001920 tx=0x7f9ad0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.548 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.444+0000 7f6206488700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f61e0063e30 0x7f61e00662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.549 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.445+0000 7f6206488700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f61e0063e30 0x7f61e00662e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009fd0 tx=0x7f61f0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.549 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.445+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2180b96d0 con 0x7fc2180bc010 2022-04-03T21:50:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.445+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9ad8051160 con 0x7f9ae006e480 2022-04-03T21:50:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.447+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fc208024070 con 0x7fc2180bc010 2022-04-03T21:50:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.448+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6200070a20 con 0x7f620006e8f0 2022-04-03T21:50:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.449+0000 7fc1feffd700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc204063f10 0x7fc2040663c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.449+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc2080817b0 con 0x7fc2180bc010 2022-04-03T21:50:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.449+0000 7fc2167fc700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc204063f10 0x7fc2040663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.450+0000 7fc2167fc700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc204063f10 0x7fc2040663c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc218141e60 tx=0x7fc20c006ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.451+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fc2080501c0 con 0x7fc2180bc010 2022-04-03T21:50:23.553 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.459+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f61f804ee50 con 0x7f620006e8f0 2022-04-03T21:50:23.849 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.847+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65f80056b0 con 0x7f66240b7aa0 2022-04-03T21:50:23.853 INFO:teuthology.orchestra.run.smithi049.stdout:64424509450 2022-04-03T21:50:23.853 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.848+0000 7f6619ffb700 1 -- 172.21.15.49:0/1083149781 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f661c0047c0 con 0x7f66240b7aa0 2022-04-03T21:50:23.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f660c063e30 msgr2=0x7f660c0662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f660c063e30 0x7f660c0662e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f661400b850 tx=0x7f6614008040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 msgr2=0x7f6624159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.855 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f6624159a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f662406b9c0 tx=0x7f661c017000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 shutdown_connections 2022-04-03T21:50:23.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f660c063e30 0x7f660c0662e0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f661400b850 tx=0x7f6614008040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66240b7aa0 0x7f6624159a30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6624069540 0x7f66241400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.856 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 --2- 172.21.15.49:0/1083149781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624069910 0x7f6624140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.853+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 >> 172.21.15.49:0/1083149781 conn(0x7f6624066ae0 msgr2=0x7f66240b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.857 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.854+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb10c0a2b10 con 0x7fb10c152250 2022-04-03T21:50:23.858 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.854+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 shutdown_connections 2022-04-03T21:50:23.858 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.854+0000 7f66077fe700 1 -- 172.21.15.49:0/1083149781 wait complete. 2022-04-03T21:50:23.859 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.855+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f55cc070a20 con 0x7f55cc069380 2022-04-03T21:50:23.859 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.856+0000 7f55ba7fc700 1 -- 172.21.15.49:0/188795912 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f55c40545d0 con 0x7f55cc069380 2022-04-03T21:50:23.859 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.856+0000 7fb108ff9700 1 -- 172.21.15.49:0/1610479689 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb100052ab0 con 0x7fb10c152250 2022-04-03T21:50:23.860 INFO:teuthology.orchestra.run.smithi049.stdout:60129542154 2022-04-03T21:50:23.863 INFO:teuthology.orchestra.run.smithi049.stdout:60129542153 2022-04-03T21:50:23.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93a80056b0 con 0x7f93cc069910 2022-04-03T21:50:23.864 INFO:teuthology.orchestra.run.smithi049.stdout:60129542155 2022-04-03T21:50:23.865 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f39f00b62b0 con 0x7f39f0069380 2022-04-03T21:50:23.865 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.862+0000 7f39de7fc700 1 -- 172.21.15.49:0/2607505128 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39e8023090 con 0x7f39f0069380 2022-04-03T21:50:23.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.860+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f55a8063e30 msgr2=0x7f55a80662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.866 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.860+0000 7f55d0c88700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f55a8063e30 0x7f55a80662e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0b09f0 tx=0x7f55c0008040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.860+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 msgr2=0x7f55cc0b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.860+0000 7f55d0c88700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 0x7f55cc0b4520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06c2c0 tx=0x7f55c4019000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 shutdown_connections 2022-04-03T21:50:23.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f55d0c88700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f55a8063e30 0x7f55a80662e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f55d0c88700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55cc0b8050 0x7f55cc09ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f55d0c88700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55cc069380 0x7f55cc0b4520 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06c2c0 tx=0x7f55c4019000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f55d0c88700 1 --2- 172.21.15.49:0/188795912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55cc0b7c80 0x7f55cc0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.861+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 >> 172.21.15.49:0/188795912 conn(0x7f55cc066ae0 msgr2=0x7f55cc066eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 shutdown_connections 2022-04-03T21:50:23.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7f55d0c88700 1 -- 172.21.15.49:0/188795912 wait complete. 2022-04-03T21:50:23.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb0f4063e30 msgr2=0x7fb0f40662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb0f4063e30 0x7fb0f40662e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb10c14e5c0 tx=0x7fb0f8016000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 msgr2=0x7fb10c1478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 0x7fb10c1478a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb10000f880 tx=0x7fb100009040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.863+0000 7f93b9ffb700 1 -- 172.21.15.49:0/3400622634 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c8053650 con 0x7f93cc069910 2022-04-03T21:50:23.871 INFO:teuthology.orchestra.run.smithi049.stdout:64424509451 2022-04-03T21:50:23.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.864+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 shutdown_connections 2022-04-03T21:50:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.864+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb0f4063e30 0x7fb0f40662e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.864+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb10c0a24f0 0x7fb10c147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.864+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0004b20 0x7fb10c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.864+0000 7fb1130e4700 1 --2- 172.21.15.49:0/1610479689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb10c152250 0x7fb10c1478a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.864+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 >> 172.21.15.49:0/1610479689 conn(0x7fb10c05e010 msgr2=0x7fb10c0bf510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.865+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 shutdown_connections 2022-04-03T21:50:23.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.866+0000 7fb1130e4700 1 -- 172.21.15.49:0/1610479689 wait complete. 2022-04-03T21:50:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93ac063e30 msgr2=0x7f93ac0662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93ac063e30 0x7f93ac0662e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006bc0 tx=0x7f93bc0090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 msgr2=0x7f93cc14da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 0x7f93cc14da50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d890 tx=0x7f93c8008040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 shutdown_connections 2022-04-03T21:50:23.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93ac063e30 0x7f93ac0662e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93cc0a0d70 0x7f93cc14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93cc069540 0x7f93cc1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 --2- 172.21.15.49:0/3400622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93cc069910 0x7f93cc14da50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.868+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 >> 172.21.15.49:0/3400622634 conn(0x7f93cc066ae0 msgr2=0x7f93cc06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.869+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 shutdown_connections 2022-04-03T21:50:23.876 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.870+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f39d0063e30 msgr2=0x7f39d00662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.870+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f39d0063e30 0x7f39d00662e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39f00b6d80 tx=0x7f39e000d040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.870+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0069380 msgr2=0x7f39f00b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.870+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0069380 0x7f39f00b6460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39f0086320 tx=0x7f39e801b000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f93d3b18700 1 -- 172.21.15.49:0/3400622634 wait complete. 2022-04-03T21:50:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 shutdown_connections 2022-04-03T21:50:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f39d0063e30 0x7f39d00662e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39f006e550 0x7f39f0167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0069380 0x7f39f00b6460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f39f82f0700 1 --2- 172.21.15.49:0/2607505128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39f006dc00 0x7f39f01677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.872+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 >> 172.21.15.49:0/2607505128 conn(0x7f39f0066ae0 msgr2=0x7f39f00a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.875+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9ae0070a20 con 0x7f9ae006e480 2022-04-03T21:50:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.876+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 shutdown_connections 2022-04-03T21:50:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.876+0000 7f39f82f0700 1 -- 172.21.15.49:0/2607505128 wait complete. 2022-04-03T21:50:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.877+0000 7f9ace7fc700 1 -- 172.21.15.49:0/4175535372 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ad8054780 con 0x7f9ae006e480 2022-04-03T21:50:23.882 INFO:teuthology.orchestra.run.smithi049.stdout:60129542153 2022-04-03T21:50:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9abc063e60 msgr2=0x7f9abc066310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9abc063e60 0x7f9abc066310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0001920 tx=0x7f9ad0009040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ae006e480 msgr2=0x7f9ae0140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.890 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ae006e480 0x7f9ae0140fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8015000 tx=0x7f9ad8018000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 shutdown_connections 2022-04-03T21:50:23.891 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9abc063e60 0x7f9abc066310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ae006e480 0x7f9ae0140fe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ae0067560 0x7f9ae00b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 --2- 172.21.15.49:0/4175535372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ae006e0b0 0x7f9ae0140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.888+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 >> 172.21.15.49:0/4175535372 conn(0x7f9ae00ba530 msgr2=0x7f9ae005d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.889+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 shutdown_connections 2022-04-03T21:50:23.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.889+0000 7f9ae4c59700 1 -- 172.21.15.49:0/4175535372 wait complete. 2022-04-03T21:50:23.893 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.887+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc2180b9370 con 0x7fc2180bc010 2022-04-03T21:50:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.893+0000 7fc1feffd700 1 -- 172.21.15.49:0/2853328683 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2180b9370 con 0x7fc2180bc010 2022-04-03T21:50:23.898 INFO:teuthology.orchestra.run.smithi049.stdout:60129542154 2022-04-03T21:50:23.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2022-04-03T21:50:23.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.896+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f62000a2a90 con 0x7f620006e8f0 2022-04-03T21:50:23.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.897+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc204063f10 msgr2=0x7fc2040663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.899 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.897+0000 7fc21d926700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc204063f10 0x7fc2040663c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc218141e60 tx=0x7fc20c006ac0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.897+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 msgr2=0x7fc2180ba470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.897+0000 7fc21d926700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 0x7fc2180ba470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc20800d860 tx=0x7fc208008040 comp rx=0 tx=0).stop 2022-04-03T21:50:23.900 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.898+0000 7f61ee7fc700 1 -- 172.21.15.49:0/1923726194 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61f8052470 con 0x7f620006e8f0 2022-04-03T21:50:23.901 INFO:teuthology.orchestra.run.smithi049.stdout:68719476746 2022-04-03T21:50:23.901 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 shutdown_connections 2022-04-03T21:50:23.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fc204063f10 0x7fc2040663c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2180c22d0 0x7fc2180b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2180bc010 0x7fc2180ba470 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 --2- 172.21.15.49:0/2853328683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2180c1f00 0x7fc2180bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 >> 172.21.15.49:0/2853328683 conn(0x7fc21805e010 msgr2=0x7fc21814de70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 shutdown_connections 2022-04-03T21:50:23.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.899+0000 7fc21d926700 1 -- 172.21.15.49:0/2853328683 wait complete. 2022-04-03T21:50:23.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.903+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f61e0063e30 msgr2=0x7f61e00662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.903+0000 7f62086ec700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f61e0063e30 0x7f61e00662e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009fd0 tx=0x7f61f0016000 comp rx=0 tx=0).stop 2022-04-03T21:50:23.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.903+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 msgr2=0x7f62000ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:23.905 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.903+0000 7f62086ec700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 0x7f62000ad7e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61f800c7c0 tx=0x7f61f8001540 comp rx=0 tx=0).stop 2022-04-03T21:50:23.906 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.904+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 shutdown_connections 2022-04-03T21:50:23.906 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.904+0000 7f62086ec700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f61e0063e30 0x7f61e00662e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.904+0000 7f62086ec700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f620006e8f0 0x7f62000ad7e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.904+0000 7f62086ec700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6200069dd0 0x7f620015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.904+0000 7f62086ec700 1 --2- 172.21.15.49:0/1923726194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f620006e520 0x7f620013ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:23.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.904+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 >> 172.21.15.49:0/1923726194 conn(0x7f6200066ae0 msgr2=0x7f620013bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:23.907 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.905+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 shutdown_connections 2022-04-03T21:50:23.908 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:23.905+0000 7f62086ec700 1 -- 172.21.15.49:0/1923726194 wait complete. 2022-04-03T21:50:23.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.5 2022-04-03T21:50:23.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.1 2022-04-03T21:50:23.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.3 2022-04-03T21:50:23.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.7 2022-04-03T21:50:23.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542155 for osd.6 2022-04-03T21:50:23.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.4 2022-04-03T21:50:23.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476746 for osd.2 2022-04-03T21:50:24.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-03T21:50:24.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-04-03T21:50:24.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-04-03T21:50:24.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-04-03T21:50:24.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-04-03T21:50:24.933 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-04-03T21:50:24.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T21:50:24.940 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-04-03T21:50:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.289+0000 7f91ecc8b700 1 Processor -- start 2022-04-03T21:50:25.299 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.294+0000 7f91ecc8b700 1 -- start start 2022-04-03T21:50:25.299 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.295+0000 7f91ecc8b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91e806c600 0x7f91e814aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.299 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.296+0000 7f91ecc8b700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e806ed90 con 0x7f91e80b9680 2022-04-03T21:50:25.299 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.296+0000 7f91ecc8b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80b8790 con 0x7f91e806c230 2022-04-03T21:50:25.300 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.296+0000 7f91ecc8b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e806d720 con 0x7f91e806c600 2022-04-03T21:50:25.300 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.297+0000 7f91e5d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91e806c600 0x7f91e814aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.300 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.297+0000 7f91e5d9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91e806c600 0x7f91e814aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35436/0 (socket says 172.21.15.49:35436) 2022-04-03T21:50:25.300 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.297+0000 7f91e5d9b700 1 -- 172.21.15.49:0/3738350718 learned_addr learned my addr 172.21.15.49:0/3738350718 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.298+0000 7f91e5d9b700 1 -- 172.21.15.49:0/3738350718 >> v1:172.21.15.117:6789/0 conn(0x7f91e806c230 legacy=0x7f91e80b8f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-03T21:50:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.298+0000 7f91e5d9b700 1 -- 172.21.15.49:0/3738350718 >> v1:172.21.15.49:6789/0 conn(0x7f91e80b9680 legacy=0x7f91e814afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.298+0000 7f91e5d9b700 1 -- 172.21.15.49:0/3738350718 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80b81d0 con 0x7f91e806c600 2022-04-03T21:50:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.299+0000 7f91e5d9b700 1 --2- 172.21.15.49:0/3738350718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e814aa90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91dc006fd0 tx=0x7f91dc008190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95ddeaf3e1632bcd server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.303+0000 7f91e559a700 1 -- 172.21.15.49:0/3738350718 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc010070 con 0x7f91e806c600 2022-04-03T21:50:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.303+0000 7f91e559a700 1 -- 172.21.15.49:0/3738350718 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc004030 con 0x7f91e806c600 2022-04-03T21:50:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.303+0000 7f91e559a700 1 -- 172.21.15.49:0/3738350718 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0043d0 con 0x7f91e806c600 2022-04-03T21:50:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.304+0000 7f91ecc8b700 1 -- 172.21.15.49:0/3738350718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 msgr2=0x7f91e814aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.304+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/3738350718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e814aa90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91dc006fd0 tx=0x7f91dc008190 comp rx=0 tx=0).stop 2022-04-03T21:50:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.305+0000 7f91ecc8b700 1 -- 172.21.15.49:0/3738350718 shutdown_connections 2022-04-03T21:50:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.305+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/3738350718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e814aa90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.305+0000 7f91ecc8b700 1 -- 172.21.15.49:0/3738350718 >> 172.21.15.49:0/3738350718 conn(0x7f91e8066ae0 msgr2=0x7f91e8066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.305+0000 7f91ecc8b700 1 -- 172.21.15.49:0/3738350718 shutdown_connections 2022-04-03T21:50:25.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.305+0000 7f91ecc8b700 1 -- 172.21.15.49:0/3738350718 wait complete. 2022-04-03T21:50:25.311 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.307+0000 7f91ecc8b700 1 Processor -- start 2022-04-03T21:50:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.309+0000 7fa5bbfff700 1 Processor -- start 2022-04-03T21:50:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.308+0000 7f91ecc8b700 1 -- start start 2022-04-03T21:50:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.309+0000 7f91ecc8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e806c230 0x7f91e80a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.309+0000 7f91ecc8b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e80b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.309+0000 7f91ecc8b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91e80b9680 0x7f91e809e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.314 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.310+0000 7f91ecc8b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e809fde0 con 0x7f91e806c230 2022-04-03T21:50:25.314 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.310+0000 7f91ecc8b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e809fb00 con 0x7f91e806c600 2022-04-03T21:50:25.314 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.310+0000 7f91ecc8b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8160090 con 0x7f91e80b9680 2022-04-03T21:50:25.315 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.311+0000 7f91e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e806c230 0x7f91e80a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.315 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7f91e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e806c230 0x7f91e80a68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34614/0 (socket says 172.21.15.49:34614) 2022-04-03T21:50:25.315 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7f91e659c700 1 -- 172.21.15.49:0/898386840 learned_addr learned my addr 172.21.15.49:0/898386840 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7f91e6d9d700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91e80b9680 0x7f91e809e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.316 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7f91e5d9b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e80b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.310+0000 7fa5bbfff700 1 -- start start 2022-04-03T21:50:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 0x7fa5bc0a0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.319 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7fa5bbfff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0b9810 con 0x7fa5bc0bd990 2022-04-03T21:50:25.320 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7fa5bbfff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0a0840 con 0x7fa5bc0b8870 2022-04-03T21:50:25.320 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.312+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b91c0 con 0x7fa5bc0bdd60 2022-04-03T21:50:25.320 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fa5ba7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 0x7fa5bc0a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.320 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fa5ba7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 0x7fa5bc0a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45848/0 (socket says 172.21.15.49:45848) 2022-04-03T21:50:25.321 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/1480372209 learned_addr learned my addr 172.21.15.49:0/1480372209 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.321 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fa5b9ffb700 1 -- 172.21.15.49:0/1480372209 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834885784 0 0) 0x7fa5bc0b9810 con 0x7fa5bc0bd990 2022-04-03T21:50:25.321 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fa5b9ffb700 1 -- 172.21.15.49:0/1480372209 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a80033f0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.321 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/1480372209 >> v1:172.21.15.117:6789/0 conn(0x7fa5bc0b8870 legacy=0x7fa5bc0a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.321 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/1480372209 >> v1:172.21.15.49:6789/0 conn(0x7fa5bc0bd990 legacy=0x7fa5bc1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/1480372209 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0b94a0 con 0x7fa5bc0bdd60 2022-04-03T21:50:25.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.317+0000 7fa5ba7fc700 1 --2- 172.21.15.49:0/1480372209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 0x7fa5bc0a0260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac01a840 tx=0x7fa5ac01a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d67edd04ebe283d server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.311+0000 7fcc87473700 1 Processor -- start 2022-04-03T21:50:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.311+0000 7fcc87473700 1 -- start start 2022-04-03T21:50:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fcc87473700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc80069910 0x7fcc800aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fcc87473700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc800b7aa0 0x7fcc800b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fcc87473700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8006c070 con 0x7fcc80069540 2022-04-03T21:50:25.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fcc87473700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8006cab0 con 0x7fcc80069910 2022-04-03T21:50:25.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.313+0000 7fcc87473700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8006c350 con 0x7fcc800b7aa0 2022-04-03T21:50:25.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.314+0000 7fcc85a10700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc800b7aa0 0x7fcc800b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.314+0000 7fcc85a10700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc800b7aa0 0x7fcc800b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35442/0 (socket says 172.21.15.49:35442) 2022-04-03T21:50:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.314+0000 7fcc85a10700 1 -- 172.21.15.49:0/3057774288 learned_addr learned my addr 172.21.15.49:0/3057774288 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fcc84a0e700 1 --2- 172.21.15.49:0/3057774288 >> v2:172.21.15.49:3300/0 conn(0x7fcc80069910 0x7fcc800aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fcc85a10700 1 -- 172.21.15.49:0/3057774288 >> v2:172.21.15.49:3300/0 conn(0x7fcc80069910 msgr2=0x7fcc800aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.325 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fcc85a10700 1 --2- 172.21.15.49:0/3057774288 >> v2:172.21.15.49:3300/0 conn(0x7fcc80069910 0x7fcc800aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fcc85a10700 1 -- 172.21.15.49:0/3057774288 >> v1:172.21.15.117:6789/0 conn(0x7fcc80069540 legacy=0x7fcc800a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.315+0000 7fcc85a10700 1 -- 172.21.15.49:0/3057774288 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80069e10 con 0x7fcc800b7aa0 2022-04-03T21:50:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7fcc85a10700 1 --2- 172.21.15.49:0/3057774288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc800b04d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc800b42c0 tx=0x7fcc78009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca1e47b7eb999ff server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.326 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7fcc84a0e700 1 --2- 172.21.15.49:0/3057774288 >> v2:172.21.15.49:3300/0 conn(0x7fcc80069910 0x7fcc800aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-03T21:50:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7fcc73fff700 1 -- 172.21.15.49:0/3057774288 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800e070 con 0x7fcc800b7aa0 2022-04-03T21:50:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.317+0000 7fcc73fff700 1 -- 172.21.15.49:0/3057774288 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800ba10 con 0x7fcc800b7aa0 2022-04-03T21:50:25.327 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.317+0000 7fcc73fff700 1 -- 172.21.15.49:0/3057774288 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780092e0 con 0x7fcc800b7aa0 2022-04-03T21:50:25.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7f91e6d9d700 1 -- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 msgr2=0x7f91e80b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7f91e6d9d700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e80b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7f91e6d9d700 1 -- 172.21.15.49:0/898386840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e806c230 msgr2=0x7f91e80a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7f91e6d9d700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e806c230 0x7f91e80a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.316+0000 7f91e6d9d700 1 -- 172.21.15.49:0/898386840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0083f0 con 0x7f91e80b9680 2022-04-03T21:50:25.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7f91e6d9d700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91e80b9680 0x7f91e809e280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91e000b840 tx=0x7f91e00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fa5b9ffb700 1 -- 172.21.15.49:0/1480372209 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac004030 con 0x7fa5bc0bdd60 2022-04-03T21:50:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fa5b9ffb700 1 -- 172.21.15.49:0/1480372209 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac004190 con 0x7fa5bc0bdd60 2022-04-03T21:50:25.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fa5b9ffb700 1 -- 172.21.15.49:0/1480372209 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac005a90 con 0x7fa5bc0bdd60 2022-04-03T21:50:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.317+0000 7fcc87473700 1 -- 172.21.15.49:0/3057774288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 msgr2=0x7fcc800b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.317+0000 7fcc87473700 1 --2- 172.21.15.49:0/3057774288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc800b04d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc800b42c0 tx=0x7fcc78009840 comp rx=0 tx=0).stop 2022-04-03T21:50:25.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fcc87473700 1 -- 172.21.15.49:0/3057774288 shutdown_connections 2022-04-03T21:50:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fcc87473700 1 --2- 172.21.15.49:0/3057774288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc800b04d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fcc87473700 1 --2- 172.21.15.49:0/3057774288 >> v2:172.21.15.49:3300/0 conn(0x7fcc80069910 0x7fcc800aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.318+0000 7fcc87473700 1 -- 172.21.15.49:0/3057774288 >> 172.21.15.49:0/3057774288 conn(0x7fcc80066ae0 msgr2=0x7fcc80066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.319+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0011630 con 0x7f91e80b9680 2022-04-03T21:50:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.319+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00117d0 con 0x7f91e80b9680 2022-04-03T21:50:25.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.319+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0011b90 con 0x7f91e80b9680 2022-04-03T21:50:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.319+0000 7fa5bbfff700 1 -- 172.21.15.49:0/1480372209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 msgr2=0x7fa5bc0a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.319+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/1480372209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 0x7fa5bc0a0260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac01a840 tx=0x7fa5ac01a100 comp rx=0 tx=0).stop 2022-04-03T21:50:25.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fa5bbfff700 1 -- 172.21.15.49:0/1480372209 shutdown_connections 2022-04-03T21:50:25.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/1480372209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bdd60 0x7fa5bc0a0260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fa5bbfff700 1 -- 172.21.15.49:0/1480372209 >> 172.21.15.49:0/1480372209 conn(0x7fa5bc0675b0 msgr2=0x7fa5bc0bd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.336 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fcc87473700 1 -- 172.21.15.49:0/3057774288 shutdown_connections 2022-04-03T21:50:25.336 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fcc87473700 1 -- 172.21.15.49:0/3057774288 wait complete. 2022-04-03T21:50:25.337 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fa5bbfff700 1 -- 172.21.15.49:0/1480372209 shutdown_connections 2022-04-03T21:50:25.338 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.321+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e8160370 con 0x7f91e80b9680 2022-04-03T21:50:25.338 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.321+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e80a5ae0 con 0x7f91e80b9680 2022-04-03T21:50:25.339 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.323+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e80a5cd0 con 0x7f91e80b9680 2022-04-03T21:50:25.340 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.320+0000 7fa5bbfff700 1 -- 172.21.15.49:0/1480372209 wait complete. 2022-04-03T21:50:25.340 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.323+0000 7fa5bbfff700 1 Processor -- start 2022-04-03T21:50:25.340 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.323+0000 7fa5bbfff700 1 -- start start 2022-04-03T21:50:25.340 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc0b8870 0x7fa5bc13e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 0x7fa5bc146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5bc0bdd60 0x7fa5bc0b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b43e0 con 0x7fa5bc0bdd60 2022-04-03T21:50:25.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc13e020 con 0x7fa5bc0b8870 2022-04-03T21:50:25.341 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1486c0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.322+0000 7fcc87473700 1 Processor -- start 2022-04-03T21:50:25.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.323+0000 7fcc87473700 1 -- start start 2022-04-03T21:50:25.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fcc87473700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc80069540 0x7fcc800b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fcc87473700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc80069910 0x7fcc8015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fcc87473700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc8015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fcc87473700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800afe90 con 0x7fcc80069910 2022-04-03T21:50:25.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fcc87473700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800ad220 con 0x7fcc800b7aa0 2022-04-03T21:50:25.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.324+0000 7fcc87473700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800ad7e0 con 0x7fcc80069540 2022-04-03T21:50:25.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc8015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc8015fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35444/0 (socket says 172.21.15.49:35444) 2022-04-03T21:50:25.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 -- 172.21.15.49:0/3757771034 learned_addr learned my addr 172.21.15.49:0/3757771034 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 -- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc80069540 msgr2=0x7fcc800b6f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-03T21:50:25.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc80069540 0x7fcc800b6f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 -- 172.21.15.49:0/3757771034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc80069910 msgr2=0x7fcc8015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc80069910 0x7fcc8015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.325+0000 7fcc85a10700 1 -- 172.21.15.49:0/3757771034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009ae0 con 0x7fcc800b7aa0 2022-04-03T21:50:25.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.326+0000 7fa5ba7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 0x7fa5bc146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.326+0000 7fa5ba7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 0x7fa5bc146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45850/0 (socket says 172.21.15.49:45850) 2022-04-03T21:50:25.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.326+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/2468683147 learned_addr learned my addr 172.21.15.49:0/2468683147 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.326+0000 7fa5baffd700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc0b8870 0x7fa5bc13e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.326+0000 7fcc85a10700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc8015fb00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc78004000 tx=0x7fcc78017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc0b8870 msgr2=0x7fa5bc13e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fa5ba7fc700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc0b8870 0x7fa5bc13e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/2468683147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5bc0bdd60 msgr2=0x7fa5bc0b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fa5ba7fc700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5bc0bdd60 0x7fa5bc0b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fa5ba7fc700 1 -- 172.21.15.49:0/2468683147 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac01a3a0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.328+0000 7fa5ba7fc700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 0x7fa5bc146b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac01a840 tx=0x7fa5ac028000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780092e0 con 0x7fcc800b7aa0 2022-04-03T21:50:25.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78007000 con 0x7fcc800b7aa0 2022-04-03T21:50:25.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78004470 con 0x7fcc800b7aa0 2022-04-03T21:50:25.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7f8654b31700 1 Processor -- start 2022-04-03T21:50:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc800b6840 con 0x7fcc800b7aa0 2022-04-03T21:50:25.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc800ae5b0 con 0x7fcc800b7aa0 2022-04-03T21:50:25.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.327+0000 7f8654b31700 1 -- start start 2022-04-03T21:50:25.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac006540 con 0x7fa5bc0bd990 2022-04-03T21:50:25.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0066c0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0034e0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc1465e0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc148980 con 0x7fa5bc0bd990 2022-04-03T21:50:25.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7f8654b31700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86500675f0 0x7f865006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7f8654b31700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f865014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7f8654b31700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865006ed90 con 0x7f86500b7aa0 2022-04-03T21:50:25.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7f8654b31700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865006d720 con 0x7f86500675f0 2022-04-03T21:50:25.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.329+0000 7f8654b31700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500b8790 con 0x7f86500b9680 2022-04-03T21:50:25.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.330+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc800b69d0 con 0x7fcc800b7aa0 2022-04-03T21:50:25.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.330+0000 7f864ed9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f865014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.330+0000 7f864e59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86500675f0 0x7f865006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.330+0000 7f864ed9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f865014aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45852/0 (socket says 172.21.15.49:45852) 2022-04-03T21:50:25.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.330+0000 7f864ed9d700 1 -- 172.21.15.49:0/2894850680 learned_addr learned my addr 172.21.15.49:0/2894850680 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.331+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f91e000f050 con 0x7f91e80b9680 2022-04-03T21:50:25.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.332+0000 7f864e59c700 1 -- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 msgr2=0x7f865014aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.332+0000 7f864e59c700 1 --2- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f865014aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.332+0000 7f864e59c700 1 -- 172.21.15.49:0/2894850680 >> v1:172.21.15.49:6789/0 conn(0x7f86500b7aa0 legacy=0x7f86500b8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.332+0000 7f864e59c700 1 -- 172.21.15.49:0/2894850680 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500b81d0 con 0x7f86500675f0 2022-04-03T21:50:25.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.333+0000 7f91d67fc700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f91c4063e60 0x7f91c4066310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.359 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.333+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f91e0080cf0 con 0x7f91e80b9680 2022-04-03T21:50:25.359 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.334+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f91e0081180 con 0x7f91e80b9680 2022-04-03T21:50:25.359 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.333+0000 7f864e59c700 1 --2- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500675f0 0x7f865006c230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8644009760 tx=0x7f8644009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49f8b49fa687b91 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.360 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.333+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa598005130 con 0x7fa5bc0bd990 2022-04-03T21:50:25.360 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.334+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fa5ac03e070 con 0x7fa5bc0bd990 2022-04-03T21:50:25.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.335+0000 7f91e659c700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f91c4063e60 0x7f91c4066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.336+0000 7f91e659c700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f91c4063e60 0x7f91c4066310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f91d8006fd0 tx=0x7f91d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.335+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fcc7802c070 con 0x7fcc800b7aa0 2022-04-03T21:50:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.336+0000 7fcc717fa700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcc68063e30 0x7fcc680662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.336+0000 7f1b5faea700 1 Processor -- start 2022-04-03T21:50:25.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.337+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcc78081f90 con 0x7fcc800b7aa0 2022-04-03T21:50:25.363 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.335+0000 7fa5a2ffd700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa59c063e30 0x7fa59c0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.363 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.336+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa5ac0933a0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.363 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.336+0000 7fa5baffd700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa59c063e30 0x7fa59c0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.364 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.337+0000 7f1b5faea700 1 -- start start 2022-04-03T21:50:25.364 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.338+0000 7fa5baffd700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa59c063e30 0x7fa59c0662e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00016a0 tx=0x7fa5b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.338+0000 7f864d59a700 1 -- 172.21.15.49:0/2894850680 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644004030 con 0x7f86500675f0 2022-04-03T21:50:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.338+0000 7f864d59a700 1 -- 172.21.15.49:0/2894850680 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644004190 con 0x7f86500675f0 2022-04-03T21:50:25.365 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.338+0000 7f864d59a700 1 -- 172.21.15.49:0/2894850680 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644011630 con 0x7f86500675f0 2022-04-03T21:50:25.366 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.338+0000 7fcc8520f700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcc68063e30 0x7fcc680662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.366 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f8654b31700 1 -- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500675f0 msgr2=0x7f865006c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f8654b31700 1 --2- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500675f0 0x7f865006c230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8644009760 tx=0x7f8644009060 comp rx=0 tx=0).stop 2022-04-03T21:50:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fa5ac061c60 con 0x7fa5bc0bd990 2022-04-03T21:50:25.367 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f8654b31700 1 -- 172.21.15.49:0/2894850680 shutdown_connections 2022-04-03T21:50:25.368 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f8654b31700 1 --2- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f865014aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.368 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f8654b31700 1 --2- 172.21.15.49:0/2894850680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500675f0 0x7f865006c230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.368 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f8654b31700 1 -- 172.21.15.49:0/2894850680 >> 172.21.15.49:0/2894850680 conn(0x7f8650066ae0 msgr2=0x7f8650066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.369 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7fcc8520f700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcc68063e30 0x7fcc680662e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc74003a70 tx=0x7fcc740079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.369 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f1b5faea700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b580b7aa0 0x7f1b5814aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.339+0000 7f1b5faea700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b5814afd0 0x7f1b5814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5faea700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5814b910 con 0x7f1b580675f0 2022-04-03T21:50:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5faea700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5806d720 con 0x7f1b5814afd0 2022-04-03T21:50:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5faea700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5806ed90 con 0x7f1b580b7aa0 2022-04-03T21:50:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5d085700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b580b7aa0 0x7f1b5814aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5d085700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b580b7aa0 0x7f1b5814aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35450/0 (socket says 172.21.15.49:35450) 2022-04-03T21:50:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5e087700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b5814afd0 0x7f1b5814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.340+0000 7f1b5d085700 1 -- 172.21.15.49:0/3537162620 learned_addr learned my addr 172.21.15.49:0/3537162620 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f8654b31700 1 -- 172.21.15.49:0/2894850680 shutdown_connections 2022-04-03T21:50:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fcc78050890 con 0x7fcc800b7aa0 2022-04-03T21:50:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.342+0000 7f8654b31700 1 -- 172.21.15.49:0/2894850680 wait complete. 2022-04-03T21:50:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f1b5c884700 1 -- 172.21.15.49:0/3537162620 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335435178 0 0) 0x7f1b5814b910 con 0x7f1b580675f0 2022-04-03T21:50:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f1b5c884700 1 -- 172.21.15.49:0/3537162620 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b400033f0 con 0x7f1b580675f0 2022-04-03T21:50:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f1b5e087700 1 -- 172.21.15.49:0/3537162620 >> v2:172.21.15.117:3300/0 conn(0x7f1b580b7aa0 msgr2=0x7f1b5814aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f1b5e087700 1 --2- 172.21.15.49:0/3537162620 >> v2:172.21.15.117:3300/0 conn(0x7f1b580b7aa0 0x7f1b5814aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f1b5e087700 1 -- 172.21.15.49:0/3537162620 >> v1:172.21.15.49:6789/0 conn(0x7f1b580675f0 legacy=0x7f1b5806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.341+0000 7f1b5e087700 1 -- 172.21.15.49:0/3537162620 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580b8790 con 0x7f1b5814afd0 2022-04-03T21:50:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.342+0000 7f1b5e087700 1 --2- 172.21.15.49:0/3537162620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 0x7f1b5814b3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b5806bfe0 tx=0x7f1b50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e028429b670b75 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.342+0000 7f1b5c884700 1 -- 172.21.15.49:0/3537162620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000e070 con 0x7f1b5814afd0 2022-04-03T21:50:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.342+0000 7f1b5c884700 1 -- 172.21.15.49:0/3537162620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000bab0 con 0x7f1b5814afd0 2022-04-03T21:50:25.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.342+0000 7f1b5c884700 1 -- 172.21.15.49:0/3537162620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000be50 con 0x7f1b5814afd0 2022-04-03T21:50:25.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.343+0000 7f1b5faea700 1 -- 172.21.15.49:0/3537162620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 msgr2=0x7f1b5814b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.343+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3537162620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 0x7f1b5814b3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b5806bfe0 tx=0x7f1b50009780 comp rx=0 tx=0).stop 2022-04-03T21:50:25.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f93e7c0a700 1 Processor -- start 2022-04-03T21:50:25.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f1b5faea700 1 -- 172.21.15.49:0/3537162620 shutdown_connections 2022-04-03T21:50:25.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3537162620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 0x7f1b5814b3d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3537162620 >> v2:172.21.15.117:3300/0 conn(0x7f1b580b7aa0 0x7f1b5814aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f1b5faea700 1 -- 172.21.15.49:0/3537162620 >> 172.21.15.49:0/3537162620 conn(0x7f1b58066ae0 msgr2=0x7f1b58066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f8654b31700 1 Processor -- start 2022-04-03T21:50:25.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f8654b31700 1 -- start start 2022-04-03T21:50:25.379 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.345+0000 7f1b5faea700 1 -- 172.21.15.49:0/3537162620 shutdown_connections 2022-04-03T21:50:25.379 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f1b5faea700 1 -- 172.21.15.49:0/3537162620 wait complete. 2022-04-03T21:50:25.380 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f8654b31700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 0x7f8650159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f8654b31700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f86500b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f8654b31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8650097310 0x7f865009f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f8654b31700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650097a90 con 0x7f8650097310 2022-04-03T21:50:25.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f8654b31700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86501599d0 con 0x7f86500b7aa0 2022-04-03T21:50:25.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f8654b31700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500977b0 con 0x7f86500b9680 2022-04-03T21:50:25.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f864e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 0x7f8650159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f864e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 0x7f8650159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35452/0 (socket says 172.21.15.49:35452) 2022-04-03T21:50:25.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f864e59c700 1 -- 172.21.15.49:0/3700261336 learned_addr learned my addr 172.21.15.49:0/3700261336 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f864dd9b700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f86500b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.383 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f864ed9d700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8650097310 0x7f865009f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.383 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.344+0000 7f93e7c0a700 1 -- start start 2022-04-03T21:50:25.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f864e59c700 1 -- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 msgr2=0x7f86500b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f864e59c700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f86500b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f864e59c700 1 -- 172.21.15.49:0/3700261336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8650097310 msgr2=0x7f865009f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f864e59c700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8650097310 0x7f865009f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f864e59c700 1 -- 172.21.15.49:0/3700261336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440092a0 con 0x7f86500b7aa0 2022-04-03T21:50:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.349+0000 7f864e59c700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 0x7f8650159490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f865006ad20 tx=0x7f8644016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f1b5faea700 1 Processor -- start 2022-04-03T21:50:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f1b5faea700 1 -- start start 2022-04-03T21:50:25.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f93e7c0a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 0x7f93e00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f93e7c0a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93e0069910 0x7f93e00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f93e7c0a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e006c350 con 0x7f93e00a0d70 2022-04-03T21:50:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f93e7c0a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e006c070 con 0x7f93e0069910 2022-04-03T21:50:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.346+0000 7f93e7c0a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0069da0 con 0x7f93e0069540 2022-04-03T21:50:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f93e59a6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 0x7f93e00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f93e59a6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 0x7f93e00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45856/0 (socket says 172.21.15.49:45856) 2022-04-03T21:50:25.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.347+0000 7f93e59a6700 1 -- 172.21.15.49:0/2395857874 learned_addr learned my addr 172.21.15.49:0/2395857874 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f93e59a6700 1 -- 172.21.15.49:0/2395857874 >> v2:172.21.15.117:3300/0 conn(0x7f93e0069910 msgr2=0x7f93e00b0700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-03T21:50:25.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f93e59a6700 1 --2- 172.21.15.49:0/2395857874 >> v2:172.21.15.117:3300/0 conn(0x7f93e0069910 0x7f93e00b0700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f93e59a6700 1 -- 172.21.15.49:0/2395857874 >> v1:172.21.15.117:6789/0 conn(0x7f93e00a0d70 legacy=0x7f93e00a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.348+0000 7f93e59a6700 1 -- 172.21.15.49:0/2395857874 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00b7ac0 con 0x7f93e0069540 2022-04-03T21:50:25.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.349+0000 7f93e59a6700 1 --2- 172.21.15.49:0/2395857874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 0x7f93e00b01c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009f20 tx=0x7f93d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae4ec65cb259942 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.349+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644003660 con 0x7f86500b7aa0 2022-04-03T21:50:25.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.349+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644020070 con 0x7f86500b7aa0 2022-04-03T21:50:25.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.349+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644003a10 con 0x7f86500b7aa0 2022-04-03T21:50:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.349+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8650099290 con 0x7f86500b7aa0 2022-04-03T21:50:25.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8650099850 con 0x7f86500b7aa0 2022-04-03T21:50:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5faea700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 0x7f1b580b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5faea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 0x7f1b5816b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5faea700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b581452b0 0x7f1b580a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.391 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5faea700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580b7630 con 0x7f1b5814afd0 2022-04-03T21:50:25.392 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5faea700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5816a7b0 con 0x7f1b580675f0 2022-04-03T21:50:25.392 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5faea700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5816ad70 con 0x7f1b581452b0 2022-04-03T21:50:25.392 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5d886700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 0x7f1b580b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.392 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5d886700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 0x7f1b580b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35454/0 (socket says 172.21.15.49:35454) 2022-04-03T21:50:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5d886700 1 -- 172.21.15.49:0/3404351408 learned_addr learned my addr 172.21.15.49:0/3404351408 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.350+0000 7f1b5e087700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b581452b0 0x7f1b580a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.351+0000 7f1b5d886700 1 -- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b581452b0 msgr2=0x7f1b580a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.351+0000 7f1b5d886700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b581452b0 0x7f1b580a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.393 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.351+0000 7f1b5d886700 1 -- 172.21.15.49:0/3404351408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 msgr2=0x7f1b5816b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.351+0000 7f1b5d886700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 0x7f1b5816b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.351+0000 7f1b5d886700 1 -- 172.21.15.49:0/3404351408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50009a20 con 0x7f1b580675f0 2022-04-03T21:50:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.351+0000 7f1b5d886700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 0x7f1b580b5900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c4f0 tx=0x7f1b48007c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.352+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480050d0 con 0x7f1b580675f0 2022-04-03T21:50:25.394 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.352+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48005230 con 0x7f1b580675f0 2022-04-03T21:50:25.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.352+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480117e0 con 0x7f1b580675f0 2022-04-03T21:50:25.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.352+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b58144c10 con 0x7f1b580675f0 2022-04-03T21:50:25.395 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.352+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5816aa00 con 0x7f1b580675f0 2022-04-03T21:50:25.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.353+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f864402b020 con 0x7f86500b7aa0 2022-04-03T21:50:25.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.353+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8630005130 con 0x7f86500b7aa0 2022-04-03T21:50:25.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.354+0000 7f863e7fc700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f862c063d60 0x7f862c066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8644082800 con 0x7f86500b7aa0 2022-04-03T21:50:25.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58070a20 con 0x7f1b580675f0 2022-04-03T21:50:25.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7f864dd9b700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f862c063d60 0x7f862c066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7f93e49a4700 1 -- 172.21.15.49:0/2395857874 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800e070 con 0x7f93e0069540 2022-04-03T21:50:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7f93e49a4700 1 -- 172.21.15.49:0/2395857874 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800ba80 con 0x7f93e0069540 2022-04-03T21:50:25.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7f93e49a4700 1 -- 172.21.15.49:0/2395857874 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80092e0 con 0x7f93e0069540 2022-04-03T21:50:25.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.355+0000 7fb24f21f700 1 Processor -- start 2022-04-03T21:50:25.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f93e7c0a700 1 -- 172.21.15.49:0/2395857874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 msgr2=0x7f93e00b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/2395857874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 0x7f93e00b01c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009f20 tx=0x7f93d8009840 comp rx=0 tx=0).stop 2022-04-03T21:50:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.356+0000 7fb24f21f700 1 -- start start 2022-04-03T21:50:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f93e7c0a700 1 -- 172.21.15.49:0/2395857874 shutdown_connections 2022-04-03T21:50:25.400 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/2395857874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e0069540 0x7f93e00b01c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/2395857874 >> v2:172.21.15.117:3300/0 conn(0x7f93e0069910 0x7f93e00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f93e7c0a700 1 -- 172.21.15.49:0/2395857874 >> 172.21.15.49:0/2395857874 conn(0x7f93e0066ae0 msgr2=0x7f93e0066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.401 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7fb24f21f700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb24806c230 0x7fb2480b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7fb24f21f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb24806c600 0x7fb2480b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24f21f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24806ed90 con 0x7fb2480675f0 2022-04-03T21:50:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24f21f700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24806d720 con 0x7fb24806c230 2022-04-03T21:50:25.402 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24f21f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2480b8790 con 0x7fb24806c600 2022-04-03T21:50:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24cfbb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb24806c230 0x7fb2480b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb247fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb24806c600 0x7fb2480b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24cfbb700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb24806c230 0x7fb2480b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34628/0 (socket says 172.21.15.49:34628) 2022-04-03T21:50:25.403 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24cfbb700 1 -- 172.21.15.49:0/1854421057 learned_addr learned my addr 172.21.15.49:0/1854421057 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.404 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.358+0000 7fb24d7bc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb2480675f0 0x7fb248069380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47438/0 (socket says 172.21.15.49:47438) 2022-04-03T21:50:25.404 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.357+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f1b48019030 con 0x7f1b580675f0 2022-04-03T21:50:25.404 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.359+0000 7f1b45ffb700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1b38063e30 0x7f1b380662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.359+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1b48080220 con 0x7f1b580675f0 2022-04-03T21:50:25.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.359+0000 7fb24cfbb700 1 -- 172.21.15.49:0/1854421057 >> v2:172.21.15.117:3300/0 conn(0x7fb24806c600 msgr2=0x7fb2480b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.405 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.359+0000 7fb24cfbb700 1 --2- 172.21.15.49:0/1854421057 >> v2:172.21.15.117:3300/0 conn(0x7fb24806c600 0x7fb2480b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.359+0000 7fb24cfbb700 1 -- 172.21.15.49:0/1854421057 >> v1:172.21.15.117:6789/0 conn(0x7fb2480675f0 legacy=0x7fb248069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.359+0000 7fb24cfbb700 1 -- 172.21.15.49:0/1854421057 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480b81d0 con 0x7fb24806c230 2022-04-03T21:50:25.406 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.360+0000 7f1b5d085700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1b38063e30 0x7f1b380662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.407 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.360+0000 7f93e7c0a700 1 -- 172.21.15.49:0/2395857874 shutdown_connections 2022-04-03T21:50:25.407 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.360+0000 7fb24cfbb700 1 --2- 172.21.15.49:0/1854421057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c230 0x7fb2480b8f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb24806bfe0 tx=0x7fb2380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de437dfa48fd0e63 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.360+0000 7f864dd9b700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f862c063d60 0x7f862c066210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86500b73f0 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.361+0000 7f93e7c0a700 1 -- 172.21.15.49:0/2395857874 wait complete. 2022-04-03T21:50:25.408 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.361+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f8644051000 con 0x7f86500b7aa0 2022-04-03T21:50:25.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.361+0000 7fb2477fe700 1 -- 172.21.15.49:0/1854421057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238004030 con 0x7fb24806c230 2022-04-03T21:50:25.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.361+0000 7fb2477fe700 1 -- 172.21.15.49:0/1854421057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238004190 con 0x7fb24806c230 2022-04-03T21:50:25.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.361+0000 7fb2477fe700 1 -- 172.21.15.49:0/1854421057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238011630 con 0x7fb24806c230 2022-04-03T21:50:25.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.362+0000 7fb24f21f700 1 -- 172.21.15.49:0/1854421057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c230 msgr2=0x7fb2480b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.362+0000 7fb24f21f700 1 --2- 172.21.15.49:0/1854421057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c230 0x7fb2480b8f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb24806bfe0 tx=0x7fb2380090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.362+0000 7fb24f21f700 1 -- 172.21.15.49:0/1854421057 shutdown_connections 2022-04-03T21:50:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.362+0000 7fb24f21f700 1 --2- 172.21.15.49:0/1854421057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c230 0x7fb2480b8f70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.362+0000 7fb24f21f700 1 --2- 172.21.15.49:0/1854421057 >> v2:172.21.15.117:3300/0 conn(0x7fb24806c600 0x7fb2480b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.362+0000 7fb24f21f700 1 -- 172.21.15.49:0/1854421057 >> 172.21.15.49:0/1854421057 conn(0x7fb248066ae0 msgr2=0x7fb248066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.363+0000 7f93e7c0a700 1 Processor -- start 2022-04-03T21:50:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.363+0000 7f93e7c0a700 1 -- start start 2022-04-03T21:50:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e7c0a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e0069540 0x7f93e013df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e7c0a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93e0069910 0x7f93e00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e7c0a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 0x7f93e00b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e7c0a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00b48f0 con 0x7f93e0069910 2022-04-03T21:50:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e7c0a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00b4b10 con 0x7f93e0069540 2022-04-03T21:50:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e7c0a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0144960 con 0x7f93e00a0d70 2022-04-03T21:50:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e61a7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 0x7f93e00b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e61a7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 0x7f93e00b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45860/0 (socket says 172.21.15.49:45860) 2022-04-03T21:50:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.365+0000 7f93e61a7700 1 -- 172.21.15.49:0/3329590419 learned_addr learned my addr 172.21.15.49:0/3329590419 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f1b4804eb20 con 0x7f1b580675f0 2022-04-03T21:50:25.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f1b5d085700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1b38063e30 0x7f1b380662e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b580a1620 tx=0x7f1b540090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7f93e61a7700 1 -- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e0069540 msgr2=0x7f93e013df30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-04-03T21:50:25.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7f93e61a7700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e0069540 0x7f93e013df30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7f93e61a7700 1 -- 172.21.15.49:0/3329590419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93e0069910 msgr2=0x7f93e00b2490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-03T21:50:25.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7f93e61a7700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93e0069910 0x7f93e00b2490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7f93e61a7700 1 -- 172.21.15.49:0/3329590419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009ae0 con 0x7f93e00a0d70 2022-04-03T21:50:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f93e61a7700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 0x7f93e00b29d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c440 tx=0x7f93d0007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00050d0 con 0x7f93e00a0d70 2022-04-03T21:50:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0005230 con 0x7f93e00a0d70 2022-04-03T21:50:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0003730 con 0x7f93e00a0d70 2022-04-03T21:50:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e00b2000 con 0x7f93e00a0d70 2022-04-03T21:50:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7fb24f21f700 1 -- 172.21.15.49:0/1854421057 shutdown_connections 2022-04-03T21:50:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.368+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e013e890 con 0x7f93e00a0d70 2022-04-03T21:50:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.367+0000 7fb24f21f700 1 -- 172.21.15.49:0/1854421057 wait complete. 2022-04-03T21:50:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.369+0000 7fb24f21f700 1 Processor -- start 2022-04-03T21:50:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.370+0000 7fb24f21f700 1 -- start start 2022-04-03T21:50:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.371+0000 7fb24f21f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 0x7fb2480a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.371+0000 7fb24f21f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24806c230 0x7fb2480b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.371+0000 7fb24f21f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c600 0x7fb248158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.371+0000 7fb24f21f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24815fcb0 con 0x7fb24806c600 2022-04-03T21:50:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.371+0000 7fb24f21f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480a56a0 con 0x7fb2480675f0 2022-04-03T21:50:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.371+0000 7fb24f21f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24815f730 con 0x7fb24806c230 2022-04-03T21:50:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.372+0000 7fb24cfbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 0x7fb2480a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.372+0000 7fb24cfbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 0x7fb2480a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35460/0 (socket says 172.21.15.49:35460) 2022-04-03T21:50:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.372+0000 7fb24cfbb700 1 -- 172.21.15.49:0/4162989576 learned_addr learned my addr 172.21.15.49:0/4162989576 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.372+0000 7fb24d7bc700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c600 0x7fb248158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.373+0000 7fb24cfbb700 1 -- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24806c230 msgr2=0x7fb2480b6460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-04-03T21:50:25.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.373+0000 7fb24cfbb700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24806c230 0x7fb2480b6460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.373+0000 7fb24cfbb700 1 -- 172.21.15.49:0/4162989576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c600 msgr2=0x7fb248158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.373+0000 7fb24cfbb700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c600 0x7fb248158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.373+0000 7fb24cfbb700 1 -- 172.21.15.49:0/4162989576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238009370 con 0x7fb2480675f0 2022-04-03T21:50:25.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.373+0000 7fb24cfbb700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 0x7fb2480a6260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb24806ad20 tx=0x7fb238016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.376+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc005130 con 0x7f93e00a0d70 2022-04-03T21:50:25.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.377+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f93d0019030 con 0x7f93e00a0d70 2022-04-03T21:50:25.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.378+0000 7f93cdffb700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93c0063e30 0x7f93c00662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.378+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f93d007fd10 con 0x7f93e00a0d70 2022-04-03T21:50:25.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.376+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380037c0 con 0x7fb2480675f0 2022-04-03T21:50:25.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.377+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238003920 con 0x7fb2480675f0 2022-04-03T21:50:25.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.377+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238003ce0 con 0x7fb2480675f0 2022-04-03T21:50:25.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.377+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2480a5370 con 0x7fb2480675f0 2022-04-03T21:50:25.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.377+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24809f3b0 con 0x7fb2480675f0 2022-04-03T21:50:25.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.379+0000 7f93e59a6700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93c0063e30 0x7f93c00662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.380+0000 7f93e59a6700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93c0063e30 0x7f93c00662e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009880 tx=0x7f93d8018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.382+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f93d004e5b0 con 0x7f93e00a0d70 2022-04-03T21:50:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.381+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fb238017020 con 0x7fb2480675f0 2022-04-03T21:50:25.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.382+0000 7fb244ff9700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb228063e30 0x7fb2280662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.382+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb2380824c0 con 0x7fb2480675f0 2022-04-03T21:50:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.383+0000 7fb247fff700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb228063e30 0x7fb2280662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.384+0000 7fb247fff700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb228063e30 0x7fb2280662e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2480b08e0 tx=0x7fb23c009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.386+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224005130 con 0x7fb2480675f0 2022-04-03T21:50:25.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.392+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fb238050d40 con 0x7fb2480675f0 2022-04-03T21:50:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.407+0000 7f1cb9f01700 1 Processor -- start 2022-04-03T21:50:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.407+0000 7f1cb9f01700 1 -- start start 2022-04-03T21:50:25.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.410+0000 7f1cb9f01700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1cb4069540 0x7f1cb40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.410+0000 7f1cb9f01700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb406c350 con 0x7f1cb40a1480 2022-04-03T21:50:25.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.410+0000 7f1cb9f01700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb406c070 con 0x7f1cb4069910 2022-04-03T21:50:25.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.410+0000 7f1cb9f01700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb4069da0 con 0x7f1cb4069540 2022-04-03T21:50:25.433 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.411+0000 7f1cb3fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1cb40a1480 0x7f1cb4159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50506/0 (socket says 172.21.15.49:50506) 2022-04-03T21:50:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.411+0000 7f1cb3fff700 1 -- 172.21.15.49:0/365778975 learned_addr learned my addr 172.21.15.49:0/365778975 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.413+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171472006 0 0) 0x7f1cb406c350 con 0x7f1cb40a1480 2022-04-03T21:50:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.413+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca00033f0 con 0x7f1cb40a1480 2022-04-03T21:50:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.413+0000 7f1cb37fe700 1 --2- 172.21.15.49:0/365778975 >> v2:172.21.15.49:3300/0 conn(0x7f1cb4069540 0x7f1cb40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936725374 0 0) 0x7f1cb406c070 con 0x7f1cb4069910 2022-04-03T21:50:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb406c350 con 0x7f1cb4069910 2022-04-03T21:50:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2920257780 0 0) 0x7f1ca00033f0 con 0x7f1cb40a1480 2022-04-03T21:50:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 >> v2:172.21.15.49:3300/0 conn(0x7f1cb4069540 msgr2=0x7f1cb40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.435 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 --2- 172.21.15.49:0/365778975 >> v2:172.21.15.49:3300/0 conn(0x7f1cb4069540 0x7f1cb40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 >> v1:172.21.15.117:6789/0 conn(0x7f1cb4069910 legacy=0x7f1cb40a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40b7ac0 con 0x7f1cb40a1480 2022-04-03T21:50:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 18272773 0 0) 0x7f1ca80013f0 con 0x7f1cb40a1480 2022-04-03T21:50:25.436 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 >> v1:172.21.15.49:6789/0 conn(0x7f1cb40a1480 legacy=0x7f1cb4159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0003a70 0x7f1ca0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca0004690 0x7f1ca0004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca0005040 0x7f1ca000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb4069da0 con 0x7f1ca0005040 2022-04-03T21:50:25.437 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca000bf60 con 0x7f1ca0003a70 2022-04-03T21:50:25.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.414+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca000c120 con 0x7f1ca0004690 2022-04-03T21:50:25.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.415+0000 7f1cb37fe700 1 --2- 172.21.15.49:0/365778975 >> v2:172.21.15.49:3300/0 conn(0x7f1cb4069540 0x7f1cb40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-03T21:50:25.438 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.415+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca0004690 0x7f1ca0004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.439 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.416+0000 7f1cb37fe700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0003a70 0x7f1ca0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.439 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.416+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0003a70 msgr2=0x7f1ca0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.439 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.416+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0003a70 0x7f1ca0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.439 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.416+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/365778975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca0005040 msgr2=0x7f1ca000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:25.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.416+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca0005040 0x7f1ca000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.416+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/365778975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40b7ac0 con 0x7f1ca0004690 2022-04-03T21:50:25.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.417+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca0004690 0x7f1ca0004b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cac001ff0 tx=0x7f1cac007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fd90ea067760b7 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.417+0000 7f1cb3fff700 1 -- 172.21.15.49:0/365778975 reap_dead start 2022-04-03T21:50:25.440 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.418+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0018e0 con 0x7f1ca0004690 2022-04-03T21:50:25.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.418+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00c870 con 0x7f1ca0004690 2022-04-03T21:50:25.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.418+0000 7f1cb27fc700 1 -- 172.21.15.49:0/365778975 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00cc30 con 0x7f1ca0004690 2022-04-03T21:50:25.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.419+0000 7f1cb9f01700 1 -- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca0004690 msgr2=0x7f1ca0004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.441 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.419+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca0004690 0x7f1ca0004b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cac001ff0 tx=0x7f1cac007f10 comp rx=0 tx=0).stop 2022-04-03T21:50:25.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.419+0000 7f1cb9f01700 1 -- 172.21.15.49:0/365778975 shutdown_connections 2022-04-03T21:50:25.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.419+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/365778975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca0004690 0x7f1ca0004b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.419+0000 7f1cb9f01700 1 -- 172.21.15.49:0/365778975 >> 172.21.15.49:0/365778975 conn(0x7f1cb4066ae0 msgr2=0x7f1cb4066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.442 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.420+0000 7f1cb9f01700 1 -- 172.21.15.49:0/365778975 shutdown_connections 2022-04-03T21:50:25.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.420+0000 7f1cb9f01700 1 -- 172.21.15.49:0/365778975 wait complete. 2022-04-03T21:50:25.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.422+0000 7f1cb9f01700 1 Processor -- start 2022-04-03T21:50:25.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.423+0000 7f1cb9f01700 1 -- start start 2022-04-03T21:50:25.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.424+0000 7f1cb9f01700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0004690 0x7f1cb40bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.443 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.424+0000 7f1cb9f01700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 0x7f1cb415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.424+0000 7f1cb9f01700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cb415fa40 0x7f1cb414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.424+0000 7f1cb9f01700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40b3bc0 con 0x7f1cb415fa40 2022-04-03T21:50:25.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.424+0000 7f1cb9f01700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb415f0d0 con 0x7f1ca0004690 2022-04-03T21:50:25.444 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.424+0000 7f1cb9f01700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40b6900 con 0x7f1cb40b01a0 2022-04-03T21:50:25.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.425+0000 7f1cb2ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 0x7f1cb415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.425+0000 7f1cb2ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 0x7f1cb415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45866/0 (socket says 172.21.15.49:45866) 2022-04-03T21:50:25.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.425+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/2336957901 learned_addr learned my addr 172.21.15.49:0/2336957901 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:25.445 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.426+0000 7f1cb37fe700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0004690 0x7f1cb40bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.426+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0004690 msgr2=0x7f1cb40bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.426+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0004690 0x7f1cb40bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.426+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/2336957901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cb415fa40 msgr2=0x7f1cb414da50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-03T21:50:25.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.426+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cb415fa40 0x7f1cb414da50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.446 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.426+0000 7f1cb2ffd700 1 -- 172.21.15.49:0/2336957901 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40b70d0 con 0x7f1cb40b01a0 2022-04-03T21:50:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.427+0000 7f1cb2ffd700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 0x7f1cb415f500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cac003b50 tx=0x7f1cac017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.428+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0018e0 con 0x7f1cb40b01a0 2022-04-03T21:50:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.428+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00ce60 con 0x7f1cb40b01a0 2022-04-03T21:50:25.447 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.428+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac005500 con 0x7f1cb40b01a0 2022-04-03T21:50:25.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.428+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb415feb0 con 0x7f1cb40b01a0 2022-04-03T21:50:25.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.428+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb41632f0 con 0x7f1cb40b01a0 2022-04-03T21:50:25.448 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.431+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94005160 con 0x7f1cb40b01a0 2022-04-03T21:50:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.439+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f1cac025030 con 0x7f1cb40b01a0 2022-04-03T21:50:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.440+0000 7f1c9b7fe700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1ca00658e0 0x7f1ca0067d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.440+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1cac081910 con 0x7f1cb40b01a0 2022-04-03T21:50:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.441+0000 7f1cb37fe700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1ca00658e0 0x7f1ca0067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.443+0000 7f1cb37fe700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1ca00658e0 0x7f1ca0067d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4006c40 tx=0x7f1ca4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.444+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f1cac050240 con 0x7f1cb40b01a0 2022-04-03T21:50:25.769 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.767+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91e81601d0 con 0x7f91e80b9680 2022-04-03T21:50:25.772 INFO:teuthology.orchestra.run.smithi049.stdout:64424509452 2022-04-03T21:50:25.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.768+0000 7f91d67fc700 1 -- 172.21.15.49:0/898386840 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91e81601d0 con 0x7f91e80b9680 2022-04-03T21:50:25.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.769+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa5980053e0 con 0x7fa5bc0bd990 2022-04-03T21:50:25.774 INFO:teuthology.orchestra.run.smithi049.stdout:60129542156 2022-04-03T21:50:25.774 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.771+0000 7fa5a2ffd700 1 -- 172.21.15.49:0/2468683147 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5ac03c020 con 0x7fa5bc0bd990 2022-04-03T21:50:25.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.772+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f91c4063e60 msgr2=0x7f91c4066310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.772+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f91c4063e60 0x7f91c4066310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f91d8006fd0 tx=0x7f91d8008040 comp rx=0 tx=0).stop 2022-04-03T21:50:25.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.772+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91e80b9680 msgr2=0x7f91e809e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.775 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.772+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91e80b9680 0x7f91e809e280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91e000b840 tx=0x7f91e00091d0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.773+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 shutdown_connections 2022-04-03T21:50:25.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.773+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f91c4063e60 0x7f91c4066310 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.773+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91e80b9680 0x7f91e809e280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.776 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.773+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e806c230 0x7f91e80a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.773+0000 7f91ecc8b700 1 --2- 172.21.15.49:0/898386840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91e806c600 0x7f91e80b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.773+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 >> 172.21.15.49:0/898386840 conn(0x7f91e8066ae0 msgr2=0x7f91e80bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.777 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.774+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 shutdown_connections 2022-04-03T21:50:25.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.774+0000 7f91ecc8b700 1 -- 172.21.15.49:0/898386840 wait complete. 2022-04-03T21:50:25.778 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.775+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa59c063e30 msgr2=0x7fa59c0662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.775+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa59c063e30 0x7fa59c0662e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00016a0 tx=0x7fa5b0009040 comp rx=0 tx=0).stop 2022-04-03T21:50:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.775+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 msgr2=0x7fa5bc146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.775+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 0x7fa5bc146b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac01a840 tx=0x7fa5ac028000 comp rx=0 tx=0).stop 2022-04-03T21:50:25.779 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 shutdown_connections 2022-04-03T21:50:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fa59c063e30 0x7fa59c0662e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5bc0bdd60 0x7fa5bc0b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5bc0b8870 0x7fa5bc13e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.780 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 --2- 172.21.15.49:0/2468683147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5bc0bd990 0x7fa5bc146b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 >> 172.21.15.49:0/2468683147 conn(0x7fa5bc0675b0 msgr2=0x7fa5bc14d380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.781 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.775+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc800ad920 con 0x7fcc800b7aa0 2022-04-03T21:50:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 shutdown_connections 2022-04-03T21:50:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.776+0000 7fa5bbfff700 1 -- 172.21.15.49:0/2468683147 wait complete. 2022-04-03T21:50:25.782 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.777+0000 7fcc717fa700 1 -- 172.21.15.49:0/3757771034 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc7802a070 con 0x7fcc800b7aa0 2022-04-03T21:50:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:60129542155 2022-04-03T21:50:25.783 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.781+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcc68063e30 msgr2=0x7fcc680662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.781+0000 7fcc87473700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcc68063e30 0x7fcc680662e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc74003a70 tx=0x7fcc740079a0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.781+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 msgr2=0x7fcc8015fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.781+0000 7fcc87473700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc8015fb00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc78004000 tx=0x7fcc78017000 comp rx=0 tx=0).stop 2022-04-03T21:50:25.784 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.781+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 shutdown_connections 2022-04-03T21:50:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.781+0000 7fcc87473700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcc68063e30 0x7fcc680662e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.782+0000 7fcc87473700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc800b7aa0 0x7fcc8015fb00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.782+0000 7fcc87473700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc80069540 0x7fcc800b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.782+0000 7fcc87473700 1 --2- 172.21.15.49:0/3757771034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc80069910 0x7fcc8015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.782+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 >> 172.21.15.49:0/3757771034 conn(0x7fcc80066ae0 msgr2=0x7fcc80155190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.782+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 shutdown_connections 2022-04-03T21:50:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.783+0000 7fcc87473700 1 -- 172.21.15.49:0/3757771034 wait complete. 2022-04-03T21:50:25.787 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.785+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f86300053e0 con 0x7f86500b7aa0 2022-04-03T21:50:25.792 INFO:teuthology.orchestra.run.smithi049.stdout:64424509453 2022-04-03T21:50:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.786+0000 7f863e7fc700 1 -- 172.21.15.49:0/3700261336 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8644054620 con 0x7f86500b7aa0 2022-04-03T21:50:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.792+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f862c063d60 msgr2=0x7f862c066210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.792+0000 7f8654b31700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f862c063d60 0x7f862c066210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86500b73f0 tx=0x7f8640009040 comp rx=0 tx=0).stop 2022-04-03T21:50:25.795 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.792+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 msgr2=0x7f8650159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.795 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.792+0000 7f8654b31700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 0x7f8650159490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f865006ad20 tx=0x7f8644016000 comp rx=0 tx=0).stop 2022-04-03T21:50:25.795 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.792+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1b5806aae0 con 0x7f1b580675f0 2022-04-03T21:50:25.796 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f1b45ffb700 1 -- 172.21.15.49:0/3404351408 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b48017020 con 0x7f1b580675f0 2022-04-03T21:50:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 shutdown_connections 2022-04-03T21:50:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f8654b31700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f862c063d60 0x7f862c066210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f8654b31700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8650097310 0x7f865009f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f8654b31700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86500b7aa0 0x7f8650159490 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f8654b31700 1 --2- 172.21.15.49:0/3700261336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86500b9680 0x7f86500b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.799 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.793+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 >> 172.21.15.49:0/3700261336 conn(0x7f8650066ae0 msgr2=0x7f86500a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.800 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.794+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 shutdown_connections 2022-04-03T21:50:25.800 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.794+0000 7f8654b31700 1 -- 172.21.15.49:0/3700261336 wait complete. 2022-04-03T21:50:25.800 INFO:teuthology.orchestra.run.smithi049.stdout:60129542156 2022-04-03T21:50:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.799+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1b38063e30 msgr2=0x7f1b380662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.799+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1b38063e30 0x7f1b380662e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b580a1620 tx=0x7f1b540090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.799+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 msgr2=0x7f1b580b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.801 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.799+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 0x7f1b580b5900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c4f0 tx=0x7f1b48007c30 comp rx=0 tx=0).stop 2022-04-03T21:50:25.804 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.803+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 shutdown_connections 2022-04-03T21:50:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.803+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1b38063e30 0x7f1b380662e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.803+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b581452b0 0x7f1b580a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.803+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580675f0 0x7f1b580b5900 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.803+0000 7f1b5faea700 1 --2- 172.21.15.49:0/3404351408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b5814afd0 0x7f1b5816b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.805 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.803+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 >> 172.21.15.49:0/3404351408 conn(0x7f1b58066ae0 msgr2=0x7f1b580a03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.804+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 shutdown_connections 2022-04-03T21:50:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.804+0000 7f1b5faea700 1 -- 172.21.15.49:0/3404351408 wait complete. 2022-04-03T21:50:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.806+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f93bc0053e0 con 0x7f93e00a0d70 2022-04-03T21:50:25.809 INFO:teuthology.orchestra.run.smithi049.stdout:60129542157 2022-04-03T21:50:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.807+0000 7f93cdffb700 1 -- 172.21.15.49:0/3329590419 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93d0017020 con 0x7f93e00a0d70 2022-04-03T21:50:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.812+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93c0063e30 msgr2=0x7f93c00662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.812+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93c0063e30 0x7f93c00662e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009880 tx=0x7f93d8018000 comp rx=0 tx=0).stop 2022-04-03T21:50:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.812+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 msgr2=0x7f93e00b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.815 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.812+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 0x7f93e00b29d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c440 tx=0x7f93d0007d00 comp rx=0 tx=0).stop 2022-04-03T21:50:25.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.815+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb2240053e0 con 0x7fb2480675f0 2022-04-03T21:50:25.817 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.816+0000 7fb244ff9700 1 -- 172.21.15.49:0/4162989576 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb238054360 con 0x7fb2480675f0 2022-04-03T21:50:25.818 INFO:teuthology.orchestra.run.smithi049.stdout:60129542155 2022-04-03T21:50:25.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.0 2022-04-03T21:50:25.822 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 shutdown_connections 2022-04-03T21:50:25.823 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f93c0063e30 0x7f93c00662e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e00a0d70 0x7f93e00b29d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e0069540 0x7f93e013df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 --2- 172.21.15.49:0/3329590419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93e0069910 0x7f93e00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 >> 172.21.15.49:0/3329590419 conn(0x7f93e0066ae0 msgr2=0x7f93e00b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.824 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.821+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 shutdown_connections 2022-04-03T21:50:25.825 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.822+0000 7f93e7c0a700 1 -- 172.21.15.49:0/3329590419 wait complete. 2022-04-03T21:50:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.820+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb228063e30 msgr2=0x7fb2280662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.820+0000 7fb24f21f700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb228063e30 0x7fb2280662e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2480b08e0 tx=0x7fb23c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.820+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 msgr2=0x7fb2480a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.826 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.820+0000 7fb24f21f700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 0x7fb2480a6260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb24806ad20 tx=0x7fb238016000 comp rx=0 tx=0).stop 2022-04-03T21:50:25.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.5 2022-04-03T21:50:25.828 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.825+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 shutdown_connections 2022-04-03T21:50:25.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.826+0000 7fb24f21f700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fb228063e30 0x7fb2280662e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.826+0000 7fb24f21f700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24806c600 0x7fb248158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.829 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.826+0000 7fb24f21f700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2480675f0 0x7fb2480a6260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.830 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.826+0000 7fb24f21f700 1 --2- 172.21.15.49:0/4162989576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb24806c230 0x7fb2480b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.830 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.826+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 >> 172.21.15.49:0/4162989576 conn(0x7fb248066ae0 msgr2=0x7fb2480bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.830 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.827+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 shutdown_connections 2022-04-03T21:50:25.831 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.827+0000 7fb24f21f700 1 -- 172.21.15.49:0/4162989576 wait complete. 2022-04-03T21:50:25.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2022-04-03T21:50:25.832 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.3 2022-04-03T21:50:25.836 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.6 2022-04-03T21:50:25.854 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.7 2022-04-03T21:50:25.856 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2022-04-03T21:50:25.860 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.862+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c94005410 con 0x7f1cb40b01a0 2022-04-03T21:50:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.863+0000 7f1c9b7fe700 1 -- 172.21.15.49:0/2336957901 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cac023070 con 0x7f1cb40b01a0 2022-04-03T21:50:25.864 INFO:teuthology.orchestra.run.smithi049.stdout:68719476747 2022-04-03T21:50:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1ca00658e0 msgr2=0x7f1ca0067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.867 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1ca00658e0 0x7f1ca0067d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4006c40 tx=0x7f1ca4008040 comp rx=0 tx=0).stop 2022-04-03T21:50:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 msgr2=0x7f1cb415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 0x7f1cb415f500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cac003b50 tx=0x7f1cac017000 comp rx=0 tx=0).stop 2022-04-03T21:50:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 shutdown_connections 2022-04-03T21:50:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1ca00658e0 0x7f1ca0067d90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1cb415fa40 0x7f1cb414da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0004690 0x7f1cb40bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 --2- 172.21.15.49:0/2336957901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb40b01a0 0x7f1cb415f500 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 >> 172.21.15.49:0/2336957901 conn(0x7f1cb4066ae0 msgr2=0x7f1cb40ba340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 shutdown_connections 2022-04-03T21:50:25.870 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:25.865+0000 7f1cb9f01700 1 -- 172.21.15.49:0/2336957901 wait complete. 2022-04-03T21:50:25.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.2 2022-04-03T21:50:25.892 DEBUG:teuthology.parallel:result is None 2022-04-03T21:50:25.892 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-04-03T21:50:25.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-03T21:50:26.146 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.145+0000 7f1770c77700 1 Processor -- start 2022-04-03T21:50:26.147 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.145+0000 7f1770c77700 1 -- start start 2022-04-03T21:50:26.148 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1770c77700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c148590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.149 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1770c77700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f176c0b8290 0x7f176c0a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.149 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1770c77700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0b7e00 con 0x7f176c0b9030 2022-04-03T21:50:26.149 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1770c77700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c148ad0 con 0x7f176c0b8290 2022-04-03T21:50:26.149 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1770c77700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c06c5c0 con 0x7f176c141e80 2022-04-03T21:50:26.150 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f176ad9d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f176c0b8290 0x7f176c0a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.150 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1769d9b700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f176c0b9030 0x7f176c0bd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50508/0 (socket says 172.21.15.49:50508) 2022-04-03T21:50:26.150 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f1769d9b700 1 -- 172.21.15.49:0/3946685103 learned_addr learned my addr 172.21.15.49:0/3946685103 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:26.151 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.146+0000 7f176a59c700 1 --2- 172.21.15.49:0/3946685103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.151 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176ad9d700 1 -- 172.21.15.49:0/3946685103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 msgr2=0x7f176c148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:26.151 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176ad9d700 1 --2- 172.21.15.49:0/3946685103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.151 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176ad9d700 1 -- 172.21.15.49:0/3946685103 >> v1:172.21.15.49:6789/0 conn(0x7f176c0b9030 legacy=0x7f176c0bd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.152 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176959a700 1 -- 172.21.15.49:0/3946685103 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977302748 0 0) 0x7f176c0b7e00 con 0x7f176c0b9030 2022-04-03T21:50:26.152 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176ad9d700 1 -- 172.21.15.49:0/3946685103 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c06a780 con 0x7f176c0b8290 2022-04-03T21:50:26.152 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176ad9d700 1 --2- 172.21.15.49:0/3946685103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c0a2450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e60 tx=0x7f1764009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6315efc4de32081 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176959a700 1 -- 172.21.15.49:0/3946685103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176400e070 con 0x7f176c0b8290 2022-04-03T21:50:26.156 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176959a700 1 -- 172.21.15.49:0/3946685103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176400bb60 con 0x7f176c0b8290 2022-04-03T21:50:26.156 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.147+0000 7f176959a700 1 -- 172.21.15.49:0/3946685103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764012430 con 0x7f176c0b8290 2022-04-03T21:50:26.156 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 -- 172.21.15.49:0/3946685103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 msgr2=0x7f176c0a2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.156 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 --2- 172.21.15.49:0/3946685103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c0a2450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e60 tx=0x7f1764009780 comp rx=0 tx=0).stop 2022-04-03T21:50:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 -- 172.21.15.49:0/3946685103 shutdown_connections 2022-04-03T21:50:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 --2- 172.21.15.49:0/3946685103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c0a2450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 --2- 172.21.15.49:0/3946685103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.157 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 -- 172.21.15.49:0/3946685103 >> 172.21.15.49:0/3946685103 conn(0x7f176c067560 msgr2=0x7f176c0bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:26.158 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 -- 172.21.15.49:0/3946685103 shutdown_connections 2022-04-03T21:50:26.158 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.148+0000 7f1770c77700 1 -- 172.21.15.49:0/3946685103 wait complete. 2022-04-03T21:50:26.158 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.150+0000 7f1770c77700 1 Processor -- start 2022-04-03T21:50:26.158 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.150+0000 7f1770c77700 1 -- start start 2022-04-03T21:50:26.159 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1770c77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.159 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1770c77700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f176c0b9030 0x7f176c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.159 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1770c77700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.159 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1770c77700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c15ee00 con 0x7f176c0b8290 2022-04-03T21:50:26.160 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1770c77700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0bc050 con 0x7f176c0b9030 2022-04-03T21:50:26.160 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1770c77700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0b4980 con 0x7f176c141e80 2022-04-03T21:50:26.160 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.160 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f1769d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f176c0b9030 0x7f176c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.161 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34638/0 (socket says 172.21.15.49:34638) 2022-04-03T21:50:26.161 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 -- 172.21.15.49:0/1690905085 learned_addr learned my addr 172.21.15.49:0/1690905085 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:26.161 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176ad9d700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.161 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 -- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 msgr2=0x7f176c14b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.161 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c14b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.162 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 -- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f176c0b9030 msgr2=0x7f176c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.162 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f176c0b9030 0x7f176c14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.162 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.151+0000 7f176a59c700 1 -- 172.21.15.49:0/1690905085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764009a20 con 0x7f176c0b8290 2022-04-03T21:50:26.162 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.152+0000 7f176a59c700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c15e080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f175c00e930 tx=0x7f175c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:26.163 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.152+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c013680 con 0x7f176c0b8290 2022-04-03T21:50:26.163 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.152+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0137e0 con 0x7f176c0b8290 2022-04-03T21:50:26.163 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.152+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c15ea90 con 0x7f176c0b8290 2022-04-03T21:50:26.163 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.152+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c013b60 con 0x7f176c0b8290 2022-04-03T21:50:26.163 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.152+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0b3520 con 0x7f176c0b8290 2022-04-03T21:50:26.164 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.153+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c14aab0 con 0x7f176c0b8290 2022-04-03T21:50:26.165 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.155+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f175c019030 con 0x7f176c0b8290 2022-04-03T21:50:26.165 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.155+0000 7f175a7fc700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1748063ce0 0x7f1748066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.165 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.156+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f175c080a70 con 0x7f176c0b8290 2022-04-03T21:50:26.165 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.156+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1748063ce0 0x7f1748066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.166 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.157+0000 7f1769d9b700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1748063ce0 0x7f1748066190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f176c146480 tx=0x7f1760007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:26.166 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.160+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f175c04f300 con 0x7f176c0b8290 2022-04-03T21:50:26.366 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.364+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 --> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f176c0b4b40 con 0x7f1748063ce0 2022-04-03T21:50:26.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.376+0000 7f175a7fc700 1 -- 172.21.15.49:0/1690905085 <== mgr.4101 v2:172.21.15.117:6832/26568 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+364737 (secure 0 0 0) 0x7f176c0b4b40 con 0x7f1748063ce0 2022-04-03T21:50:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:26.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1748063ce0 msgr2=0x7f1748066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1748063ce0 0x7f1748066190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f176c146480 tx=0x7f1760007bb0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 msgr2=0x7f176c15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c15e080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f175c00e930 tx=0x7f175c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:26.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 shutdown_connections 2022-04-03T21:50:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f1748063ce0 0x7f1748066190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f176c141e80 0x7f176c14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f176c0b8290 0x7f176c15e080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 --2- 172.21.15.49:0/1690905085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f176c0b9030 0x7f176c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 >> 172.21.15.49:0/1690905085 conn(0x7f176c067560 msgr2=0x7f176c0b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:26.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.381+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 shutdown_connections 2022-04-03T21:50:26.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.382+0000 7f1770c77700 1 -- 172.21.15.49:0/1690905085 wait complete. 2022-04-03T21:50:26.389 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2022-04-03T21:50:26.407 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2022-04-03T21:50:26.095553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594898,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66960,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":63488,"kb_avail":754907760,"statfs":{"total":773094113280,"available":773025546240,"internally_reserved":0,"allocated":3489792,"data_stored":2039588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65011712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003770"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402622+0000","last_change":"2022-04-03T21:49:58.414058+0000","last_active":"2022-04-03T21:50:02.402622+0000","last_peered":"2022-04-03T21:50:02.402622+0000","last_clean":"2022-04-03T21:50:02.402622+0000","last_became_active":"2022-04-03T21:49:58.413775+0000","last_became_peered":"2022-04-03T21:49:58.413775+0000","last_unstale":"2022-04-03T21:50:02.402622+0000","last_undegraded":"2022-04-03T21:50:02.402622+0000","last_fullsized":"2022-04-03T21:50:02.402622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:53.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408368+0000","last_change":"2022-04-03T21:49:58.409713+0000","last_active":"2022-04-03T21:50:02.408368+0000","last_peered":"2022-04-03T21:50:02.408368+0000","last_clean":"2022-04-03T21:50:02.408368+0000","last_became_active":"2022-04-03T21:49:58.409410+0000","last_became_peered":"2022-04-03T21:49:58.409410+0000","last_unstale":"2022-04-03T21:50:02.408368+0000","last_undegraded":"2022-04-03T21:50:02.408368+0000","last_fullsized":"2022-04-03T21:50:02.408368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:10.539087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421211+0000","last_change":"2022-04-03T21:49:58.422325+0000","last_active":"2022-04-03T21:50:02.421211+0000","last_peered":"2022-04-03T21:50:02.421211+0000","last_clean":"2022-04-03T21:50:02.421211+0000","last_became_active":"2022-04-03T21:49:58.422026+0000","last_became_peered":"2022-04-03T21:49:58.422026+0000","last_unstale":"2022-04-03T21:50:02.421211+0000","last_undegraded":"2022-04-03T21:50:02.421211+0000","last_fullsized":"2022-04-03T21:50:02.421211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:09:11.502569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421334+0000","last_change":"2022-04-03T21:49:58.423449+0000","last_active":"2022-04-03T21:50:02.421334+0000","last_peered":"2022-04-03T21:50:02.421334+0000","last_clean":"2022-04-03T21:50:02.421334+0000","last_became_active":"2022-04-03T21:49:58.423128+0000","last_became_peered":"2022-04-03T21:49:58.423128+0000","last_unstale":"2022-04-03T21:50:02.421334+0000","last_undegraded":"2022-04-03T21:50:02.421334+0000","last_fullsized":"2022-04-03T21:50:02.421334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:02:31.777504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405877+0000","last_change":"2022-04-03T21:49:58.416006+0000","last_active":"2022-04-03T21:50:02.405877+0000","last_peered":"2022-04-03T21:50:02.405877+0000","last_clean":"2022-04-03T21:50:02.405877+0000","last_became_active":"2022-04-03T21:49:58.415782+0000","last_became_peered":"2022-04-03T21:49:58.415782+0000","last_unstale":"2022-04-03T21:50:02.405877+0000","last_undegraded":"2022-04-03T21:50:02.405877+0000","last_fullsized":"2022-04-03T21:50:02.405877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:27:40.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403571+0000","last_change":"2022-04-03T21:49:58.399107+0000","last_active":"2022-04-03T21:50:02.403571+0000","last_peered":"2022-04-03T21:50:02.403571+0000","last_clean":"2022-04-03T21:50:02.403571+0000","last_became_active":"2022-04-03T21:49:58.398700+0000","last_became_peered":"2022-04-03T21:49:58.398700+0000","last_unstale":"2022-04-03T21:50:02.403571+0000","last_undegraded":"2022-04-03T21:50:02.403571+0000","last_fullsized":"2022-04-03T21:50:02.403571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:39:58.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402584+0000","last_change":"2022-04-03T21:49:58.424480+0000","last_active":"2022-04-03T21:50:02.402584+0000","last_peered":"2022-04-03T21:50:02.402584+0000","last_clean":"2022-04-03T21:50:02.402584+0000","last_became_active":"2022-04-03T21:49:58.424164+0000","last_became_peered":"2022-04-03T21:49:58.424164+0000","last_unstale":"2022-04-03T21:50:02.402584+0000","last_undegraded":"2022-04-03T21:50:02.402584+0000","last_fullsized":"2022-04-03T21:50:02.402584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:05:12.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412069+0000","last_change":"2022-04-03T21:49:58.425384+0000","last_active":"2022-04-03T21:50:02.412069+0000","last_peered":"2022-04-03T21:50:02.412069+0000","last_clean":"2022-04-03T21:50:02.412069+0000","last_became_active":"2022-04-03T21:49:58.425084+0000","last_became_peered":"2022-04-03T21:49:58.425084+0000","last_unstale":"2022-04-03T21:50:02.412069+0000","last_undegraded":"2022-04-03T21:50:02.412069+0000","last_fullsized":"2022-04-03T21:50:02.412069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:38.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411107+0000","last_change":"2022-04-03T21:49:58.415591+0000","last_active":"2022-04-03T21:50:02.411107+0000","last_peered":"2022-04-03T21:50:02.411107+0000","last_clean":"2022-04-03T21:50:02.411107+0000","last_became_active":"2022-04-03T21:49:58.415264+0000","last_became_peered":"2022-04-03T21:49:58.415264+0000","last_unstale":"2022-04-03T21:50:02.411107+0000","last_undegraded":"2022-04-03T21:50:02.411107+0000","last_fullsized":"2022-04-03T21:50:02.411107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:26:23.919459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411177+0000","last_change":"2022-04-03T21:49:58.415930+0000","last_active":"2022-04-03T21:50:02.411177+0000","last_peered":"2022-04-03T21:50:02.411177+0000","last_clean":"2022-04-03T21:50:02.411177+0000","last_became_active":"2022-04-03T21:49:58.415597+0000","last_became_peered":"2022-04-03T21:49:58.415597+0000","last_unstale":"2022-04-03T21:50:02.411177+0000","last_undegraded":"2022-04-03T21:50:02.411177+0000","last_fullsized":"2022-04-03T21:50:02.411177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:31:01.030066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409971+0000","last_change":"2022-04-03T21:49:58.425355+0000","last_active":"2022-04-03T21:50:02.409971+0000","last_peered":"2022-04-03T21:50:02.409971+0000","last_clean":"2022-04-03T21:50:02.409971+0000","last_became_active":"2022-04-03T21:49:58.425029+0000","last_became_peered":"2022-04-03T21:49:58.425029+0000","last_unstale":"2022-04-03T21:50:02.409971+0000","last_undegraded":"2022-04-03T21:50:02.409971+0000","last_fullsized":"2022-04-03T21:50:02.409971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:00:14.843110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403539+0000","last_change":"2022-04-03T21:49:58.399698+0000","last_active":"2022-04-03T21:50:02.403539+0000","last_peered":"2022-04-03T21:50:02.403539+0000","last_clean":"2022-04-03T21:50:02.403539+0000","last_became_active":"2022-04-03T21:49:58.399040+0000","last_became_peered":"2022-04-03T21:49:58.399040+0000","last_unstale":"2022-04-03T21:50:02.403539+0000","last_undegraded":"2022-04-03T21:50:02.403539+0000","last_fullsized":"2022-04-03T21:50:02.403539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:27.438020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413919+0000","last_change":"2022-04-03T21:49:58.411470+0000","last_active":"2022-04-03T21:50:02.413919+0000","last_peered":"2022-04-03T21:50:02.413919+0000","last_clean":"2022-04-03T21:50:02.413919+0000","last_became_active":"2022-04-03T21:49:58.411181+0000","last_became_peered":"2022-04-03T21:49:58.411181+0000","last_unstale":"2022-04-03T21:50:02.413919+0000","last_undegraded":"2022-04-03T21:50:02.413919+0000","last_fullsized":"2022-04-03T21:50:02.413919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:12:21.980416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414197+0000","last_change":"2022-04-03T21:49:58.419342+0000","last_active":"2022-04-03T21:50:02.414197+0000","last_peered":"2022-04-03T21:50:02.414197+0000","last_clean":"2022-04-03T21:50:02.414197+0000","last_became_active":"2022-04-03T21:49:58.418928+0000","last_became_peered":"2022-04-03T21:49:58.418928+0000","last_unstale":"2022-04-03T21:50:02.414197+0000","last_undegraded":"2022-04-03T21:50:02.414197+0000","last_fullsized":"2022-04-03T21:50:02.414197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:02:42.663277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421690+0000","last_change":"2022-04-03T21:49:58.418714+0000","last_active":"2022-04-03T21:50:02.421690+0000","last_peered":"2022-04-03T21:50:02.421690+0000","last_clean":"2022-04-03T21:50:02.421690+0000","last_became_active":"2022-04-03T21:49:58.418401+0000","last_became_peered":"2022-04-03T21:49:58.418401+0000","last_unstale":"2022-04-03T21:50:02.421690+0000","last_undegraded":"2022-04-03T21:50:02.421690+0000","last_fullsized":"2022-04-03T21:50:02.421690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:34:59.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402148+0000","last_change":"2022-04-03T21:49:58.399093+0000","last_active":"2022-04-03T21:50:02.402148+0000","last_peered":"2022-04-03T21:50:02.402148+0000","last_clean":"2022-04-03T21:50:02.402148+0000","last_became_active":"2022-04-03T21:49:58.398799+0000","last_became_peered":"2022-04-03T21:49:58.398799+0000","last_unstale":"2022-04-03T21:50:02.402148+0000","last_undegraded":"2022-04-03T21:50:02.402148+0000","last_fullsized":"2022-04-03T21:50:02.402148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:49:12.002614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402064+0000","last_change":"2022-04-03T21:49:58.405030+0000","last_active":"2022-04-03T21:50:02.402064+0000","last_peered":"2022-04-03T21:50:02.402064+0000","last_clean":"2022-04-03T21:50:02.402064+0000","last_became_active":"2022-04-03T21:49:58.404727+0000","last_became_peered":"2022-04-03T21:49:58.404727+0000","last_unstale":"2022-04-03T21:50:02.402064+0000","last_undegraded":"2022-04-03T21:50:02.402064+0000","last_fullsized":"2022-04-03T21:50:02.402064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:36:14.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428065+0000","last_change":"2022-04-03T21:49:58.431718+0000","last_active":"2022-04-03T21:50:02.428065+0000","last_peered":"2022-04-03T21:50:02.428065+0000","last_clean":"2022-04-03T21:50:02.428065+0000","last_became_active":"2022-04-03T21:49:58.430872+0000","last_became_peered":"2022-04-03T21:49:58.430872+0000","last_unstale":"2022-04-03T21:50:02.428065+0000","last_undegraded":"2022-04-03T21:50:02.428065+0000","last_fullsized":"2022-04-03T21:50:02.428065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:36:47.428099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401931+0000","last_change":"2022-04-03T21:49:58.401404+0000","last_active":"2022-04-03T21:50:02.401931+0000","last_peered":"2022-04-03T21:50:02.401931+0000","last_clean":"2022-04-03T21:50:02.401931+0000","last_became_active":"2022-04-03T21:49:58.400233+0000","last_became_peered":"2022-04-03T21:49:58.400233+0000","last_unstale":"2022-04-03T21:50:02.401931+0000","last_undegraded":"2022-04-03T21:50:02.401931+0000","last_fullsized":"2022-04-03T21:50:02.401931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:19:42.193555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413456+0000","last_change":"2022-04-03T21:49:58.415652+0000","last_active":"2022-04-03T21:50:02.413456+0000","last_peered":"2022-04-03T21:50:02.413456+0000","last_clean":"2022-04-03T21:50:02.413456+0000","last_became_active":"2022-04-03T21:49:58.415309+0000","last_became_peered":"2022-04-03T21:49:58.415309+0000","last_unstale":"2022-04-03T21:50:02.413456+0000","last_undegraded":"2022-04-03T21:50:02.413456+0000","last_fullsized":"2022-04-03T21:50:02.413456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:58:49.731887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409358+0000","last_change":"2022-04-03T21:49:58.420076+0000","last_active":"2022-04-03T21:50:02.409358+0000","last_peered":"2022-04-03T21:50:02.409358+0000","last_clean":"2022-04-03T21:50:02.409358+0000","last_became_active":"2022-04-03T21:49:58.419652+0000","last_became_peered":"2022-04-03T21:49:58.419652+0000","last_unstale":"2022-04-03T21:50:02.409358+0000","last_undegraded":"2022-04-03T21:50:02.409358+0000","last_fullsized":"2022-04-03T21:50:02.409358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:09:13.184611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401797+0000","last_change":"2022-04-03T21:49:58.406560+0000","last_active":"2022-04-03T21:50:02.401797+0000","last_peered":"2022-04-03T21:50:02.401797+0000","last_clean":"2022-04-03T21:50:02.401797+0000","last_became_active":"2022-04-03T21:49:58.406160+0000","last_became_peered":"2022-04-03T21:49:58.406160+0000","last_unstale":"2022-04-03T21:50:02.401797+0000","last_undegraded":"2022-04-03T21:50:02.401797+0000","last_fullsized":"2022-04-03T21:50:02.401797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:10:20.264129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408532+0000","last_change":"2022-04-03T21:49:58.407401+0000","last_active":"2022-04-03T21:50:02.408532+0000","last_peered":"2022-04-03T21:50:02.408532+0000","last_clean":"2022-04-03T21:50:02.408532+0000","last_became_active":"2022-04-03T21:49:58.407125+0000","last_became_peered":"2022-04-03T21:49:58.407125+0000","last_unstale":"2022-04-03T21:50:02.408532+0000","last_undegraded":"2022-04-03T21:50:02.408532+0000","last_fullsized":"2022-04-03T21:50:02.408532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:19.614490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412027+0000","last_change":"2022-04-03T21:49:58.419741+0000","last_active":"2022-04-03T21:50:02.412027+0000","last_peered":"2022-04-03T21:50:02.412027+0000","last_clean":"2022-04-03T21:50:02.412027+0000","last_became_active":"2022-04-03T21:49:58.419026+0000","last_became_peered":"2022-04-03T21:49:58.419026+0000","last_unstale":"2022-04-03T21:50:02.412027+0000","last_undegraded":"2022-04-03T21:50:02.412027+0000","last_fullsized":"2022-04-03T21:50:02.412027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:37.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409777+0000","last_change":"2022-04-03T21:49:58.403630+0000","last_active":"2022-04-03T21:50:02.409777+0000","last_peered":"2022-04-03T21:50:02.409777+0000","last_clean":"2022-04-03T21:50:02.409777+0000","last_became_active":"2022-04-03T21:49:58.403280+0000","last_became_peered":"2022-04-03T21:49:58.403280+0000","last_unstale":"2022-04-03T21:50:02.409777+0000","last_undegraded":"2022-04-03T21:50:02.409777+0000","last_fullsized":"2022-04-03T21:50:02.409777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:50:27.561349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402107+0000","last_change":"2022-04-03T21:49:58.406356+0000","last_active":"2022-04-03T21:50:02.402107+0000","last_peered":"2022-04-03T21:50:02.402107+0000","last_clean":"2022-04-03T21:50:02.402107+0000","last_became_active":"2022-04-03T21:49:58.406008+0000","last_became_peered":"2022-04-03T21:49:58.406008+0000","last_unstale":"2022-04-03T21:50:02.402107+0000","last_undegraded":"2022-04-03T21:50:02.402107+0000","last_fullsized":"2022-04-03T21:50:02.402107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:09:59.484176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403238+0000","last_change":"2022-04-03T21:49:58.429551+0000","last_active":"2022-04-03T21:50:02.403238+0000","last_peered":"2022-04-03T21:50:02.403238+0000","last_clean":"2022-04-03T21:50:02.403238+0000","last_became_active":"2022-04-03T21:49:58.429168+0000","last_became_peered":"2022-04-03T21:49:58.429168+0000","last_unstale":"2022-04-03T21:50:02.403238+0000","last_undegraded":"2022-04-03T21:50:02.403238+0000","last_fullsized":"2022-04-03T21:50:02.403238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:25:21.039114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443702+0000","last_change":"2022-04-03T21:50:02.441183+0000","last_active":"2022-04-03T21:50:02.443702+0000","last_peered":"2022-04-03T21:50:02.443702+0000","last_clean":"2022-04-03T21:50:02.443702+0000","last_became_active":"2022-04-03T21:50:02.440742+0000","last_became_peered":"2022-04-03T21:50:02.440742+0000","last_unstale":"2022-04-03T21:50:02.443702+0000","last_undegraded":"2022-04-03T21:50:02.443702+0000","last_fullsized":"2022-04-03T21:50:02.443702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:34:43.602016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414305+0000","last_change":"2022-04-03T21:49:57.860784+0000","last_active":"2022-04-03T21:50:02.414305+0000","last_peered":"2022-04-03T21:50:02.414305+0000","last_clean":"2022-04-03T21:50:02.414305+0000","last_became_active":"2022-04-03T21:49:57.858898+0000","last_became_peered":"2022-04-03T21:49:57.858898+0000","last_unstale":"2022-04-03T21:50:02.414305+0000","last_undegraded":"2022-04-03T21:50:02.414305+0000","last_fullsized":"2022-04-03T21:50:02.414305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:47:21.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402796+0000","last_change":"2022-04-03T21:49:58.408237+0000","last_active":"2022-04-03T21:50:02.402796+0000","last_peered":"2022-04-03T21:50:02.402796+0000","last_clean":"2022-04-03T21:50:02.402796+0000","last_became_active":"2022-04-03T21:49:58.407955+0000","last_became_peered":"2022-04-03T21:49:58.407955+0000","last_unstale":"2022-04-03T21:50:02.402796+0000","last_undegraded":"2022-04-03T21:50:02.402796+0000","last_fullsized":"2022-04-03T21:50:02.402796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:39:07.361273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436868+0000","last_change":"2022-04-03T21:50:02.431994+0000","last_active":"2022-04-03T21:50:02.436868+0000","last_peered":"2022-04-03T21:50:02.436868+0000","last_clean":"2022-04-03T21:50:02.436868+0000","last_became_active":"2022-04-03T21:50:02.431584+0000","last_became_peered":"2022-04-03T21:50:02.431584+0000","last_unstale":"2022-04-03T21:50:02.436868+0000","last_undegraded":"2022-04-03T21:50:02.436868+0000","last_fullsized":"2022-04-03T21:50:02.436868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:07:15.227915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408396+0000","last_change":"2022-04-03T21:49:57.866074+0000","last_active":"2022-04-03T21:50:02.408396+0000","last_peered":"2022-04-03T21:50:02.408396+0000","last_clean":"2022-04-03T21:50:02.408396+0000","last_became_active":"2022-04-03T21:49:57.865799+0000","last_became_peered":"2022-04-03T21:49:57.865799+0000","last_unstale":"2022-04-03T21:50:02.408396+0000","last_undegraded":"2022-04-03T21:50:02.408396+0000","last_fullsized":"2022-04-03T21:50:02.408396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:23:38.859645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410453+0000","last_change":"2022-04-03T21:49:58.412549+0000","last_active":"2022-04-03T21:50:02.410453+0000","last_peered":"2022-04-03T21:50:02.410453+0000","last_clean":"2022-04-03T21:50:02.410453+0000","last_became_active":"2022-04-03T21:49:58.412221+0000","last_became_peered":"2022-04-03T21:49:58.412221+0000","last_unstale":"2022-04-03T21:50:02.410453+0000","last_undegraded":"2022-04-03T21:50:02.410453+0000","last_fullsized":"2022-04-03T21:50:02.410453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:46:32.727120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.433553+0000","last_change":"2022-04-03T21:50:02.430727+0000","last_active":"2022-04-03T21:50:02.433553+0000","last_peered":"2022-04-03T21:50:02.433553+0000","last_clean":"2022-04-03T21:50:02.433553+0000","last_became_active":"2022-04-03T21:50:02.430293+0000","last_became_peered":"2022-04-03T21:50:02.430293+0000","last_unstale":"2022-04-03T21:50:02.433553+0000","last_undegraded":"2022-04-03T21:50:02.433553+0000","last_fullsized":"2022-04-03T21:50:02.433553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:12:45.221200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402025+0000","last_change":"2022-04-03T21:49:57.857793+0000","last_active":"2022-04-03T21:50:02.402025+0000","last_peered":"2022-04-03T21:50:02.402025+0000","last_clean":"2022-04-03T21:50:02.402025+0000","last_became_active":"2022-04-03T21:49:57.857477+0000","last_became_peered":"2022-04-03T21:49:57.857477+0000","last_unstale":"2022-04-03T21:50:02.402025+0000","last_undegraded":"2022-04-03T21:50:02.402025+0000","last_fullsized":"2022-04-03T21:50:02.402025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:58:12.643379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403732+0000","last_change":"2022-04-03T21:49:58.410021+0000","last_active":"2022-04-03T21:50:02.403732+0000","last_peered":"2022-04-03T21:50:02.403732+0000","last_clean":"2022-04-03T21:50:02.403732+0000","last_became_active":"2022-04-03T21:49:58.409644+0000","last_became_peered":"2022-04-03T21:49:58.409644+0000","last_unstale":"2022-04-03T21:50:02.403732+0000","last_undegraded":"2022-04-03T21:50:02.403732+0000","last_fullsized":"2022-04-03T21:50:02.403732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:26:07.839515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430122+0000","last_change":"2022-04-03T21:50:02.418006+0000","last_active":"2022-04-03T21:50:02.430122+0000","last_peered":"2022-04-03T21:50:02.430122+0000","last_clean":"2022-04-03T21:50:02.430122+0000","last_became_active":"2022-04-03T21:50:02.417522+0000","last_became_peered":"2022-04-03T21:50:02.417522+0000","last_unstale":"2022-04-03T21:50:02.430122+0000","last_undegraded":"2022-04-03T21:50:02.430122+0000","last_fullsized":"2022-04-03T21:50:02.430122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:40:39.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402342+0000","last_change":"2022-04-03T21:49:57.870805+0000","last_active":"2022-04-03T21:50:02.402342+0000","last_peered":"2022-04-03T21:50:02.402342+0000","last_clean":"2022-04-03T21:50:02.402342+0000","last_became_active":"2022-04-03T21:49:57.870504+0000","last_became_peered":"2022-04-03T21:49:57.870504+0000","last_unstale":"2022-04-03T21:50:02.402342+0000","last_undegraded":"2022-04-03T21:50:02.402342+0000","last_fullsized":"2022-04-03T21:50:02.402342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:41.062419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402628+0000","last_change":"2022-04-03T21:49:58.411420+0000","last_active":"2022-04-03T21:50:02.402628+0000","last_peered":"2022-04-03T21:50:02.402628+0000","last_clean":"2022-04-03T21:50:02.402628+0000","last_became_active":"2022-04-03T21:49:58.411046+0000","last_became_peered":"2022-04-03T21:49:58.411046+0000","last_unstale":"2022-04-03T21:50:02.402628+0000","last_undegraded":"2022-04-03T21:50:02.402628+0000","last_fullsized":"2022-04-03T21:50:02.402628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:59:39.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.439955+0000","last_change":"2022-04-03T21:50:02.438123+0000","last_active":"2022-04-03T21:50:02.439955+0000","last_peered":"2022-04-03T21:50:02.439955+0000","last_clean":"2022-04-03T21:50:02.439955+0000","last_became_active":"2022-04-03T21:50:02.437671+0000","last_became_peered":"2022-04-03T21:50:02.437671+0000","last_unstale":"2022-04-03T21:50:02.439955+0000","last_undegraded":"2022-04-03T21:50:02.439955+0000","last_fullsized":"2022-04-03T21:50:02.439955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:02:58.397104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.407995+0000","last_change":"2022-04-03T21:49:57.874098+0000","last_active":"2022-04-03T21:50:02.407995+0000","last_peered":"2022-04-03T21:50:02.407995+0000","last_clean":"2022-04-03T21:50:02.407995+0000","last_became_active":"2022-04-03T21:49:57.873819+0000","last_became_peered":"2022-04-03T21:49:57.873819+0000","last_unstale":"2022-04-03T21:50:02.407995+0000","last_undegraded":"2022-04-03T21:50:02.407995+0000","last_fullsized":"2022-04-03T21:50:02.407995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:24.770645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408357+0000","last_change":"2022-04-03T21:49:58.422605+0000","last_active":"2022-04-03T21:50:02.408357+0000","last_peered":"2022-04-03T21:50:02.408357+0000","last_clean":"2022-04-03T21:50:02.408357+0000","last_became_active":"2022-04-03T21:49:58.422247+0000","last_became_peered":"2022-04-03T21:49:58.422247+0000","last_unstale":"2022-04-03T21:50:02.408357+0000","last_undegraded":"2022-04-03T21:50:02.408357+0000","last_fullsized":"2022-04-03T21:50:02.408357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:30.833260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423978+0000","last_change":"2022-04-03T21:50:02.422574+0000","last_active":"2022-04-03T21:50:02.423978+0000","last_peered":"2022-04-03T21:50:02.423978+0000","last_clean":"2022-04-03T21:50:02.423978+0000","last_became_active":"2022-04-03T21:50:02.422108+0000","last_became_peered":"2022-04-03T21:50:02.422108+0000","last_unstale":"2022-04-03T21:50:02.423978+0000","last_undegraded":"2022-04-03T21:50:02.423978+0000","last_fullsized":"2022-04-03T21:50:02.423978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:38:20.285542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421113+0000","last_change":"2022-04-03T21:49:57.862891+0000","last_active":"2022-04-03T21:50:02.421113+0000","last_peered":"2022-04-03T21:50:02.421113+0000","last_clean":"2022-04-03T21:50:02.421113+0000","last_became_active":"2022-04-03T21:49:57.862595+0000","last_became_peered":"2022-04-03T21:49:57.862595+0000","last_unstale":"2022-04-03T21:50:02.421113+0000","last_undegraded":"2022-04-03T21:50:02.421113+0000","last_fullsized":"2022-04-03T21:50:02.421113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:26:38.267269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405207+0000","last_change":"2022-04-03T21:49:58.405688+0000","last_active":"2022-04-03T21:50:02.405207+0000","last_peered":"2022-04-03T21:50:02.405207+0000","last_clean":"2022-04-03T21:50:02.405207+0000","last_became_active":"2022-04-03T21:49:58.405370+0000","last_became_peered":"2022-04-03T21:49:58.405370+0000","last_unstale":"2022-04-03T21:50:02.405207+0000","last_undegraded":"2022-04-03T21:50:02.405207+0000","last_fullsized":"2022-04-03T21:50:02.405207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:08:21.661666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430526+0000","last_change":"2022-04-03T21:50:02.426303+0000","last_active":"2022-04-03T21:50:02.430526+0000","last_peered":"2022-04-03T21:50:02.430526+0000","last_clean":"2022-04-03T21:50:02.430526+0000","last_became_active":"2022-04-03T21:50:02.425881+0000","last_became_peered":"2022-04-03T21:50:02.425881+0000","last_unstale":"2022-04-03T21:50:02.430526+0000","last_undegraded":"2022-04-03T21:50:02.430526+0000","last_fullsized":"2022-04-03T21:50:02.430526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:53:47.423488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-04-03T21:50:09.390123+0000","last_change":"2022-04-03T21:49:57.874385+0000","last_active":"2022-04-03T21:50:09.390123+0000","last_peered":"2022-04-03T21:50:09.390123+0000","last_clean":"2022-04-03T21:50:09.390123+0000","last_became_active":"2022-04-03T21:49:57.874015+0000","last_became_peered":"2022-04-03T21:49:57.874015+0000","last_unstale":"2022-04-03T21:50:09.390123+0000","last_undegraded":"2022-04-03T21:50:09.390123+0000","last_fullsized":"2022-04-03T21:50:09.390123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:15:01.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3748,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410683+0000","last_change":"2022-04-03T21:49:58.400492+0000","last_active":"2022-04-03T21:50:02.410683+0000","last_peered":"2022-04-03T21:50:02.410683+0000","last_clean":"2022-04-03T21:50:02.410683+0000","last_became_active":"2022-04-03T21:49:58.400197+0000","last_became_peered":"2022-04-03T21:49:58.400197+0000","last_unstale":"2022-04-03T21:50:02.410683+0000","last_undegraded":"2022-04-03T21:50:02.410683+0000","last_fullsized":"2022-04-03T21:50:02.410683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:33:29.265331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442907+0000","last_change":"2022-04-03T21:50:02.440881+0000","last_active":"2022-04-03T21:50:02.442907+0000","last_peered":"2022-04-03T21:50:02.442907+0000","last_clean":"2022-04-03T21:50:02.442907+0000","last_became_active":"2022-04-03T21:50:02.440422+0000","last_became_peered":"2022-04-03T21:50:02.440422+0000","last_unstale":"2022-04-03T21:50:02.442907+0000","last_undegraded":"2022-04-03T21:50:02.442907+0000","last_fullsized":"2022-04-03T21:50:02.442907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:42:18.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403406+0000","last_change":"2022-04-03T21:49:57.879838+0000","last_active":"2022-04-03T21:50:02.403406+0000","last_peered":"2022-04-03T21:50:02.403406+0000","last_clean":"2022-04-03T21:50:02.403406+0000","last_became_active":"2022-04-03T21:49:57.878024+0000","last_became_peered":"2022-04-03T21:49:57.878024+0000","last_unstale":"2022-04-03T21:50:02.403406+0000","last_undegraded":"2022-04-03T21:50:02.403406+0000","last_fullsized":"2022-04-03T21:50:02.403406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:47:30.622816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410468+0000","last_change":"2022-04-03T21:49:58.409677+0000","last_active":"2022-04-03T21:50:02.410468+0000","last_peered":"2022-04-03T21:50:02.410468+0000","last_clean":"2022-04-03T21:50:02.410468+0000","last_became_active":"2022-04-03T21:49:58.408823+0000","last_became_peered":"2022-04-03T21:49:58.408823+0000","last_unstale":"2022-04-03T21:50:02.410468+0000","last_undegraded":"2022-04-03T21:50:02.410468+0000","last_fullsized":"2022-04-03T21:50:02.410468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:29:30.293123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428383+0000","last_change":"2022-04-03T21:50:02.427323+0000","last_active":"2022-04-03T21:50:02.428383+0000","last_peered":"2022-04-03T21:50:02.428383+0000","last_clean":"2022-04-03T21:50:02.428383+0000","last_became_active":"2022-04-03T21:50:02.426904+0000","last_became_peered":"2022-04-03T21:50:02.426904+0000","last_unstale":"2022-04-03T21:50:02.428383+0000","last_undegraded":"2022-04-03T21:50:02.428383+0000","last_fullsized":"2022-04-03T21:50:02.428383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:17:10.401730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410537+0000","last_change":"2022-04-03T21:49:57.870926+0000","last_active":"2022-04-03T21:50:02.410537+0000","last_peered":"2022-04-03T21:50:02.410537+0000","last_clean":"2022-04-03T21:50:02.410537+0000","last_became_active":"2022-04-03T21:49:57.870492+0000","last_became_peered":"2022-04-03T21:49:57.870492+0000","last_unstale":"2022-04-03T21:50:02.410537+0000","last_undegraded":"2022-04-03T21:50:02.410537+0000","last_fullsized":"2022-04-03T21:50:02.410537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:31.021652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403960+0000","last_change":"2022-04-03T21:49:58.431705+0000","last_active":"2022-04-03T21:50:02.403960+0000","last_peered":"2022-04-03T21:50:02.403960+0000","last_clean":"2022-04-03T21:50:02.403960+0000","last_became_active":"2022-04-03T21:49:58.431415+0000","last_became_peered":"2022-04-03T21:49:58.431415+0000","last_unstale":"2022-04-03T21:50:02.403960+0000","last_undegraded":"2022-04-03T21:50:02.403960+0000","last_fullsized":"2022-04-03T21:50:02.403960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:33:36.410007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427780+0000","last_change":"2022-04-03T21:50:02.424166+0000","last_active":"2022-04-03T21:50:02.427780+0000","last_peered":"2022-04-03T21:50:02.427780+0000","last_clean":"2022-04-03T21:50:02.427780+0000","last_became_active":"2022-04-03T21:50:02.423793+0000","last_became_peered":"2022-04-03T21:50:02.423793+0000","last_unstale":"2022-04-03T21:50:02.427780+0000","last_undegraded":"2022-04-03T21:50:02.427780+0000","last_fullsized":"2022-04-03T21:50:02.427780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:34:55.173456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402364+0000","last_change":"2022-04-03T21:49:57.874464+0000","last_active":"2022-04-03T21:50:02.402364+0000","last_peered":"2022-04-03T21:50:02.402364+0000","last_clean":"2022-04-03T21:50:02.402364+0000","last_became_active":"2022-04-03T21:49:57.874181+0000","last_became_peered":"2022-04-03T21:49:57.874181+0000","last_unstale":"2022-04-03T21:50:02.402364+0000","last_undegraded":"2022-04-03T21:50:02.402364+0000","last_fullsized":"2022-04-03T21:50:02.402364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:51:13.600469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402062+0000","last_change":"2022-04-03T21:49:58.401185+0000","last_active":"2022-04-03T21:50:02.402062+0000","last_peered":"2022-04-03T21:50:02.402062+0000","last_clean":"2022-04-03T21:50:02.402062+0000","last_became_active":"2022-04-03T21:49:58.399966+0000","last_became_peered":"2022-04-03T21:49:58.399966+0000","last_unstale":"2022-04-03T21:50:02.402062+0000","last_undegraded":"2022-04-03T21:50:02.402062+0000","last_fullsized":"2022-04-03T21:50:02.402062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:43:46.604121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.437138+0000","last_change":"2022-04-03T21:50:02.432307+0000","last_active":"2022-04-03T21:50:02.437138+0000","last_peered":"2022-04-03T21:50:02.437138+0000","last_clean":"2022-04-03T21:50:02.437138+0000","last_became_active":"2022-04-03T21:50:02.431759+0000","last_became_peered":"2022-04-03T21:50:02.431759+0000","last_unstale":"2022-04-03T21:50:02.437138+0000","last_undegraded":"2022-04-03T21:50:02.437138+0000","last_fullsized":"2022-04-03T21:50:02.437138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:34:33.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411902+0000","last_change":"2022-04-03T21:49:57.864543+0000","last_active":"2022-04-03T21:50:02.411902+0000","last_peered":"2022-04-03T21:50:02.411902+0000","last_clean":"2022-04-03T21:50:02.411902+0000","last_became_active":"2022-04-03T21:49:57.864245+0000","last_became_peered":"2022-04-03T21:49:57.864245+0000","last_unstale":"2022-04-03T21:50:02.411902+0000","last_undegraded":"2022-04-03T21:50:02.411902+0000","last_fullsized":"2022-04-03T21:50:02.411902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:13:09.645048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402455+0000","last_change":"2022-04-03T21:49:58.419675+0000","last_active":"2022-04-03T21:50:02.402455+0000","last_peered":"2022-04-03T21:50:02.402455+0000","last_clean":"2022-04-03T21:50:02.402455+0000","last_became_active":"2022-04-03T21:49:58.419408+0000","last_became_peered":"2022-04-03T21:49:58.419408+0000","last_unstale":"2022-04-03T21:50:02.402455+0000","last_undegraded":"2022-04-03T21:50:02.402455+0000","last_fullsized":"2022-04-03T21:50:02.402455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:58:27.884413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427854+0000","last_change":"2022-04-03T21:50:02.425159+0000","last_active":"2022-04-03T21:50:02.427854+0000","last_peered":"2022-04-03T21:50:02.427854+0000","last_clean":"2022-04-03T21:50:02.427854+0000","last_became_active":"2022-04-03T21:50:02.424677+0000","last_became_peered":"2022-04-03T21:50:02.424677+0000","last_unstale":"2022-04-03T21:50:02.427854+0000","last_undegraded":"2022-04-03T21:50:02.427854+0000","last_fullsized":"2022-04-03T21:50:02.427854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:48.470775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421719+0000","last_change":"2022-04-03T21:49:57.866686+0000","last_active":"2022-04-03T21:50:02.421719+0000","last_peered":"2022-04-03T21:50:02.421719+0000","last_clean":"2022-04-03T21:50:02.421719+0000","last_became_active":"2022-04-03T21:49:57.866364+0000","last_became_peered":"2022-04-03T21:49:57.866364+0000","last_unstale":"2022-04-03T21:50:02.421719+0000","last_undegraded":"2022-04-03T21:50:02.421719+0000","last_fullsized":"2022-04-03T21:50:02.421719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:46:41.508964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402396+0000","last_change":"2022-04-03T21:49:58.420292+0000","last_active":"2022-04-03T21:50:02.402396+0000","last_peered":"2022-04-03T21:50:02.402396+0000","last_clean":"2022-04-03T21:50:02.402396+0000","last_became_active":"2022-04-03T21:49:58.419956+0000","last_became_peered":"2022-04-03T21:49:58.419956+0000","last_unstale":"2022-04-03T21:50:02.402396+0000","last_undegraded":"2022-04-03T21:50:02.402396+0000","last_fullsized":"2022-04-03T21:50:02.402396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:44:23.380819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436661+0000","last_change":"2022-04-03T21:50:02.431629+0000","last_active":"2022-04-03T21:50:02.436661+0000","last_peered":"2022-04-03T21:50:02.436661+0000","last_clean":"2022-04-03T21:50:02.436661+0000","last_became_active":"2022-04-03T21:50:02.431173+0000","last_became_peered":"2022-04-03T21:50:02.431173+0000","last_unstale":"2022-04-03T21:50:02.436661+0000","last_undegraded":"2022-04-03T21:50:02.436661+0000","last_fullsized":"2022-04-03T21:50:02.436661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:01:44.215650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408111+0000","last_change":"2022-04-03T21:49:57.877939+0000","last_active":"2022-04-03T21:50:02.408111+0000","last_peered":"2022-04-03T21:50:02.408111+0000","last_clean":"2022-04-03T21:50:02.408111+0000","last_became_active":"2022-04-03T21:49:57.877643+0000","last_became_peered":"2022-04-03T21:49:57.877643+0000","last_unstale":"2022-04-03T21:50:02.408111+0000","last_undegraded":"2022-04-03T21:50:02.408111+0000","last_fullsized":"2022-04-03T21:50:02.408111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T21:50:27.024213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410699+0000","last_change":"2022-04-03T21:49:58.421021+0000","last_active":"2022-04-03T21:50:02.410699+0000","last_peered":"2022-04-03T21:50:02.410699+0000","last_clean":"2022-04-03T21:50:02.410699+0000","last_became_active":"2022-04-03T21:49:58.420734+0000","last_became_peered":"2022-04-03T21:49:58.420734+0000","last_unstale":"2022-04-03T21:50:02.410699+0000","last_undegraded":"2022-04-03T21:50:02.410699+0000","last_fullsized":"2022-04-03T21:50:02.410699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:06:06.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423569+0000","last_change":"2022-04-03T21:50:02.417211+0000","last_active":"2022-04-03T21:50:02.423569+0000","last_peered":"2022-04-03T21:50:02.423569+0000","last_clean":"2022-04-03T21:50:02.423569+0000","last_became_active":"2022-04-03T21:50:02.416783+0000","last_became_peered":"2022-04-03T21:50:02.416783+0000","last_unstale":"2022-04-03T21:50:02.423569+0000","last_undegraded":"2022-04-03T21:50:02.423569+0000","last_fullsized":"2022-04-03T21:50:02.423569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:41:11.749073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403561+0000","last_change":"2022-04-03T21:49:57.872889+0000","last_active":"2022-04-03T21:50:02.403561+0000","last_peered":"2022-04-03T21:50:02.403561+0000","last_clean":"2022-04-03T21:50:02.403561+0000","last_became_active":"2022-04-03T21:49:57.872509+0000","last_became_peered":"2022-04-03T21:49:57.872509+0000","last_unstale":"2022-04-03T21:50:02.403561+0000","last_undegraded":"2022-04-03T21:50:02.403561+0000","last_fullsized":"2022-04-03T21:50:02.403561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:42.092697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413818+0000","last_change":"2022-04-03T21:49:58.399849+0000","last_active":"2022-04-03T21:50:02.413818+0000","last_peered":"2022-04-03T21:50:02.413818+0000","last_clean":"2022-04-03T21:50:02.413818+0000","last_became_active":"2022-04-03T21:49:58.399407+0000","last_became_peered":"2022-04-03T21:49:58.399407+0000","last_unstale":"2022-04-03T21:50:02.413818+0000","last_undegraded":"2022-04-03T21:50:02.413818+0000","last_fullsized":"2022-04-03T21:50:02.413818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:53:35.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.426414+0000","last_change":"2022-04-03T21:50:02.420577+0000","last_active":"2022-04-03T21:50:02.426414+0000","last_peered":"2022-04-03T21:50:02.426414+0000","last_clean":"2022-04-03T21:50:02.426414+0000","last_became_active":"2022-04-03T21:50:02.420023+0000","last_became_peered":"2022-04-03T21:50:02.420023+0000","last_unstale":"2022-04-03T21:50:02.426414+0000","last_undegraded":"2022-04-03T21:50:02.426414+0000","last_fullsized":"2022-04-03T21:50:02.426414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:56:20.520369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421514+0000","last_change":"2022-04-03T21:49:57.870171+0000","last_active":"2022-04-03T21:50:02.421514+0000","last_peered":"2022-04-03T21:50:02.421514+0000","last_clean":"2022-04-03T21:50:02.421514+0000","last_became_active":"2022-04-03T21:49:57.869887+0000","last_became_peered":"2022-04-03T21:49:57.869887+0000","last_unstale":"2022-04-03T21:50:02.421514+0000","last_undegraded":"2022-04-03T21:50:02.421514+0000","last_fullsized":"2022-04-03T21:50:02.421514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:40:24.182014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402693+0000","last_change":"2022-04-03T21:49:58.405990+0000","last_active":"2022-04-03T21:50:02.402693+0000","last_peered":"2022-04-03T21:50:02.402693+0000","last_clean":"2022-04-03T21:50:02.402693+0000","last_became_active":"2022-04-03T21:49:58.405686+0000","last_became_peered":"2022-04-03T21:49:58.405686+0000","last_unstale":"2022-04-03T21:50:02.402693+0000","last_undegraded":"2022-04-03T21:50:02.402693+0000","last_fullsized":"2022-04-03T21:50:02.402693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:45:30.673697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.441865+0000","last_change":"2022-04-03T21:50:02.436451+0000","last_active":"2022-04-03T21:50:02.441865+0000","last_peered":"2022-04-03T21:50:02.441865+0000","last_clean":"2022-04-03T21:50:02.441865+0000","last_became_active":"2022-04-03T21:50:02.435998+0000","last_became_peered":"2022-04-03T21:50:02.435998+0000","last_unstale":"2022-04-03T21:50:02.441865+0000","last_undegraded":"2022-04-03T21:50:02.441865+0000","last_fullsized":"2022-04-03T21:50:02.441865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:14:56.243368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401643+0000","last_change":"2022-04-03T21:49:57.861968+0000","last_active":"2022-04-03T21:50:02.401643+0000","last_peered":"2022-04-03T21:50:02.401643+0000","last_clean":"2022-04-03T21:50:02.401643+0000","last_became_active":"2022-04-03T21:49:57.861649+0000","last_became_peered":"2022-04-03T21:49:57.861649+0000","last_unstale":"2022-04-03T21:50:02.401643+0000","last_undegraded":"2022-04-03T21:50:02.401643+0000","last_fullsized":"2022-04-03T21:50:02.401643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:32:27.620549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421422+0000","last_change":"2022-04-03T21:49:58.417874+0000","last_active":"2022-04-03T21:50:02.421422+0000","last_peered":"2022-04-03T21:50:02.421422+0000","last_clean":"2022-04-03T21:50:02.421422+0000","last_became_active":"2022-04-03T21:49:58.417587+0000","last_became_peered":"2022-04-03T21:49:58.417587+0000","last_unstale":"2022-04-03T21:50:02.421422+0000","last_undegraded":"2022-04-03T21:50:02.421422+0000","last_fullsized":"2022-04-03T21:50:02.421422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:47:14.137789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428059+0000","last_change":"2022-04-03T21:50:02.425963+0000","last_active":"2022-04-03T21:50:02.428059+0000","last_peered":"2022-04-03T21:50:02.428059+0000","last_clean":"2022-04-03T21:50:02.428059+0000","last_became_active":"2022-04-03T21:50:02.425586+0000","last_became_peered":"2022-04-03T21:50:02.425586+0000","last_unstale":"2022-04-03T21:50:02.428059+0000","last_undegraded":"2022-04-03T21:50:02.428059+0000","last_fullsized":"2022-04-03T21:50:02.428059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:10:13.345349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403465+0000","last_change":"2022-04-03T21:49:57.870476+0000","last_active":"2022-04-03T21:50:02.403465+0000","last_peered":"2022-04-03T21:50:02.403465+0000","last_clean":"2022-04-03T21:50:02.403465+0000","last_became_active":"2022-04-03T21:49:57.870009+0000","last_became_peered":"2022-04-03T21:49:57.870009+0000","last_unstale":"2022-04-03T21:50:02.403465+0000","last_undegraded":"2022-04-03T21:50:02.403465+0000","last_fullsized":"2022-04-03T21:50:02.403465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:49:42.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403872+0000","last_change":"2022-04-03T21:49:58.421450+0000","last_active":"2022-04-03T21:50:02.403872+0000","last_peered":"2022-04-03T21:50:02.403872+0000","last_clean":"2022-04-03T21:50:02.403872+0000","last_became_active":"2022-04-03T21:49:58.421054+0000","last_became_peered":"2022-04-03T21:49:58.421054+0000","last_unstale":"2022-04-03T21:50:02.403872+0000","last_undegraded":"2022-04-03T21:50:02.403872+0000","last_fullsized":"2022-04-03T21:50:02.403872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:47:29.054190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442528+0000","last_change":"2022-04-03T21:50:02.434190+0000","last_active":"2022-04-03T21:50:02.442528+0000","last_peered":"2022-04-03T21:50:02.442528+0000","last_clean":"2022-04-03T21:50:02.442528+0000","last_became_active":"2022-04-03T21:50:02.433666+0000","last_became_peered":"2022-04-03T21:50:02.433666+0000","last_unstale":"2022-04-03T21:50:02.442528+0000","last_undegraded":"2022-04-03T21:50:02.442528+0000","last_fullsized":"2022-04-03T21:50:02.442528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:46.909616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402471+0000","last_change":"2022-04-03T21:49:57.863462+0000","last_active":"2022-04-03T21:50:02.402471+0000","last_peered":"2022-04-03T21:50:02.402471+0000","last_clean":"2022-04-03T21:50:02.402471+0000","last_became_active":"2022-04-03T21:49:57.863170+0000","last_became_peered":"2022-04-03T21:49:57.863170+0000","last_unstale":"2022-04-03T21:50:02.402471+0000","last_undegraded":"2022-04-03T21:50:02.402471+0000","last_fullsized":"2022-04-03T21:50:02.402471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:38:02.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408285+0000","last_change":"2022-04-03T21:49:58.401069+0000","last_active":"2022-04-03T21:50:02.408285+0000","last_peered":"2022-04-03T21:50:02.408285+0000","last_clean":"2022-04-03T21:50:02.408285+0000","last_became_active":"2022-04-03T21:49:58.400774+0000","last_became_peered":"2022-04-03T21:49:58.400774+0000","last_unstale":"2022-04-03T21:50:02.408285+0000","last_undegraded":"2022-04-03T21:50:02.408285+0000","last_fullsized":"2022-04-03T21:50:02.408285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:54.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429724+0000","last_change":"2022-04-03T21:50:02.420282+0000","last_active":"2022-04-03T21:50:02.429724+0000","last_peered":"2022-04-03T21:50:02.429724+0000","last_clean":"2022-04-03T21:50:02.429724+0000","last_became_active":"2022-04-03T21:50:02.419604+0000","last_became_peered":"2022-04-03T21:50:02.419604+0000","last_unstale":"2022-04-03T21:50:02.429724+0000","last_undegraded":"2022-04-03T21:50:02.429724+0000","last_fullsized":"2022-04-03T21:50:02.429724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:27:15.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406203+0000","last_change":"2022-04-03T21:49:57.859380+0000","last_active":"2022-04-03T21:50:02.406203+0000","last_peered":"2022-04-03T21:50:02.406203+0000","last_clean":"2022-04-03T21:50:02.406203+0000","last_became_active":"2022-04-03T21:49:57.859076+0000","last_became_peered":"2022-04-03T21:49:57.859076+0000","last_unstale":"2022-04-03T21:50:02.406203+0000","last_undegraded":"2022-04-03T21:50:02.406203+0000","last_fullsized":"2022-04-03T21:50:02.406203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:03:57.532989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401995+0000","last_change":"2022-04-03T21:49:58.408851+0000","last_active":"2022-04-03T21:50:02.401995+0000","last_peered":"2022-04-03T21:50:02.401995+0000","last_clean":"2022-04-03T21:50:02.401995+0000","last_became_active":"2022-04-03T21:49:58.408553+0000","last_became_peered":"2022-04-03T21:49:58.408553+0000","last_unstale":"2022-04-03T21:50:02.401995+0000","last_undegraded":"2022-04-03T21:50:02.401995+0000","last_fullsized":"2022-04-03T21:50:02.401995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:53:09.835987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423992+0000","last_change":"2022-04-03T21:50:02.422611+0000","last_active":"2022-04-03T21:50:02.423992+0000","last_peered":"2022-04-03T21:50:02.423992+0000","last_clean":"2022-04-03T21:50:02.423992+0000","last_became_active":"2022-04-03T21:50:02.422088+0000","last_became_peered":"2022-04-03T21:50:02.422088+0000","last_unstale":"2022-04-03T21:50:02.423992+0000","last_undegraded":"2022-04-03T21:50:02.423992+0000","last_fullsized":"2022-04-03T21:50:02.423992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:34:54.875279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403638+0000","last_change":"2022-04-03T21:49:51.950055+0000","last_active":"2022-04-03T21:50:02.403638+0000","last_peered":"2022-04-03T21:50:02.403638+0000","last_clean":"2022-04-03T21:50:02.403638+0000","last_became_active":"2022-04-03T21:49:51.949793+0000","last_became_peered":"2022-04-03T21:49:51.949793+0000","last_unstale":"2022-04-03T21:50:02.403638+0000","last_undegraded":"2022-04-03T21:50:02.403638+0000","last_fullsized":"2022-04-03T21:50:02.403638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:44:29.449323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409897+0000","last_change":"2022-04-03T21:49:57.872925+0000","last_active":"2022-04-03T21:50:02.409897+0000","last_peered":"2022-04-03T21:50:02.409897+0000","last_clean":"2022-04-03T21:50:02.409897+0000","last_became_active":"2022-04-03T21:49:57.872490+0000","last_became_peered":"2022-04-03T21:49:57.872490+0000","last_unstale":"2022-04-03T21:50:02.409897+0000","last_undegraded":"2022-04-03T21:50:02.409897+0000","last_fullsized":"2022-04-03T21:50:02.409897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:57:45.485657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410378+0000","last_change":"2022-04-03T21:49:58.409467+0000","last_active":"2022-04-03T21:50:02.410378+0000","last_peered":"2022-04-03T21:50:02.410378+0000","last_clean":"2022-04-03T21:50:02.410378+0000","last_became_active":"2022-04-03T21:49:58.409155+0000","last_became_peered":"2022-04-03T21:49:58.409155+0000","last_unstale":"2022-04-03T21:50:02.410378+0000","last_undegraded":"2022-04-03T21:50:02.410378+0000","last_fullsized":"2022-04-03T21:50:02.410378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:31.770696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430528+0000","last_change":"2022-04-03T21:50:02.426029+0000","last_active":"2022-04-03T21:50:02.430528+0000","last_peered":"2022-04-03T21:50:02.430528+0000","last_clean":"2022-04-03T21:50:02.430528+0000","last_became_active":"2022-04-03T21:50:02.425589+0000","last_became_peered":"2022-04-03T21:50:02.425589+0000","last_unstale":"2022-04-03T21:50:02.430528+0000","last_undegraded":"2022-04-03T21:50:02.430528+0000","last_fullsized":"2022-04-03T21:50:02.430528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:38:10.958633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403666+0000","last_change":"2022-04-03T21:49:51.950513+0000","last_active":"2022-04-03T21:50:02.403666+0000","last_peered":"2022-04-03T21:50:02.403666+0000","last_clean":"2022-04-03T21:50:02.403666+0000","last_became_active":"2022-04-03T21:49:51.950013+0000","last_became_peered":"2022-04-03T21:49:51.950013+0000","last_unstale":"2022-04-03T21:50:02.403666+0000","last_undegraded":"2022-04-03T21:50:02.403666+0000","last_fullsized":"2022-04-03T21:50:02.403666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:08:28.113081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.422489+0000","last_change":"2022-04-03T21:49:57.874953+0000","last_active":"2022-04-03T21:50:02.422489+0000","last_peered":"2022-04-03T21:50:02.422489+0000","last_clean":"2022-04-03T21:50:02.422489+0000","last_became_active":"2022-04-03T21:49:57.874653+0000","last_became_peered":"2022-04-03T21:49:57.874653+0000","last_unstale":"2022-04-03T21:50:02.422489+0000","last_undegraded":"2022-04-03T21:50:02.422489+0000","last_fullsized":"2022-04-03T21:50:02.422489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:18:20.066652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410625+0000","last_change":"2022-04-03T21:49:58.405360+0000","last_active":"2022-04-03T21:50:02.410625+0000","last_peered":"2022-04-03T21:50:02.410625+0000","last_clean":"2022-04-03T21:50:02.410625+0000","last_became_active":"2022-04-03T21:49:58.405077+0000","last_became_peered":"2022-04-03T21:49:58.405077+0000","last_unstale":"2022-04-03T21:50:02.410625+0000","last_undegraded":"2022-04-03T21:50:02.410625+0000","last_fullsized":"2022-04-03T21:50:02.410625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:50:01.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436762+0000","last_change":"2022-04-03T21:50:02.431834+0000","last_active":"2022-04-03T21:50:02.436762+0000","last_peered":"2022-04-03T21:50:02.436762+0000","last_clean":"2022-04-03T21:50:02.436762+0000","last_became_active":"2022-04-03T21:50:02.431250+0000","last_became_peered":"2022-04-03T21:50:02.431250+0000","last_unstale":"2022-04-03T21:50:02.436762+0000","last_undegraded":"2022-04-03T21:50:02.436762+0000","last_fullsized":"2022-04-03T21:50:02.436762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:32:53.927418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401614+0000","last_change":"2022-04-03T21:49:51.825451+0000","last_active":"2022-04-03T21:50:02.401614+0000","last_peered":"2022-04-03T21:50:02.401614+0000","last_clean":"2022-04-03T21:50:02.401614+0000","last_became_active":"2022-04-03T21:49:51.825101+0000","last_became_peered":"2022-04-03T21:49:51.825101+0000","last_unstale":"2022-04-03T21:50:02.401614+0000","last_undegraded":"2022-04-03T21:50:02.401614+0000","last_fullsized":"2022-04-03T21:50:02.401614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:14:58.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401859+0000","last_change":"2022-04-03T21:49:57.855929+0000","last_active":"2022-04-03T21:50:02.401859+0000","last_peered":"2022-04-03T21:50:02.401859+0000","last_clean":"2022-04-03T21:50:02.401859+0000","last_became_active":"2022-04-03T21:49:57.855618+0000","last_became_peered":"2022-04-03T21:49:57.855618+0000","last_unstale":"2022-04-03T21:50:02.401859+0000","last_undegraded":"2022-04-03T21:50:02.401859+0000","last_fullsized":"2022-04-03T21:50:02.401859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:15.342644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415411+0000","last_change":"2022-04-03T21:49:58.422027+0000","last_active":"2022-04-03T21:50:02.415411+0000","last_peered":"2022-04-03T21:50:02.415411+0000","last_clean":"2022-04-03T21:50:02.415411+0000","last_became_active":"2022-04-03T21:49:58.421718+0000","last_became_peered":"2022-04-03T21:49:58.421718+0000","last_unstale":"2022-04-03T21:50:02.415411+0000","last_undegraded":"2022-04-03T21:50:02.415411+0000","last_fullsized":"2022-04-03T21:50:02.415411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:15:09.949180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442797+0000","last_change":"2022-04-03T21:50:02.432280+0000","last_active":"2022-04-03T21:50:02.442797+0000","last_peered":"2022-04-03T21:50:02.442797+0000","last_clean":"2022-04-03T21:50:02.442797+0000","last_became_active":"2022-04-03T21:50:02.431805+0000","last_became_peered":"2022-04-03T21:50:02.431805+0000","last_unstale":"2022-04-03T21:50:02.442797+0000","last_undegraded":"2022-04-03T21:50:02.442797+0000","last_fullsized":"2022-04-03T21:50:02.442797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:33.634032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403212+0000","last_change":"2022-04-03T21:49:51.824294+0000","last_active":"2022-04-03T21:50:02.403212+0000","last_peered":"2022-04-03T21:50:02.403212+0000","last_clean":"2022-04-03T21:50:02.403212+0000","last_became_active":"2022-04-03T21:49:51.823893+0000","last_became_peered":"2022-04-03T21:49:51.823893+0000","last_unstale":"2022-04-03T21:50:02.403212+0000","last_undegraded":"2022-04-03T21:50:02.403212+0000","last_fullsized":"2022-04-03T21:50:02.403212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:36:52.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411821+0000","last_change":"2022-04-03T21:49:43.747755+0000","last_active":"2022-04-03T21:50:02.411821+0000","last_peered":"2022-04-03T21:50:02.411821+0000","last_clean":"2022-04-03T21:50:02.411821+0000","last_became_active":"2022-04-03T21:49:43.747384+0000","last_became_peered":"2022-04-03T21:49:43.747384+0000","last_unstale":"2022-04-03T21:50:02.411821+0000","last_undegraded":"2022-04-03T21:50:02.411821+0000","last_fullsized":"2022-04-03T21:50:02.411821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_clean_scrub_stamp":"2022-04-03T21:49:42.736782+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:38:50.071231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405095+0000","last_change":"2022-04-03T21:49:57.873204+0000","last_active":"2022-04-03T21:50:02.405095+0000","last_peered":"2022-04-03T21:50:02.405095+0000","last_clean":"2022-04-03T21:50:02.405095+0000","last_became_active":"2022-04-03T21:49:57.872943+0000","last_became_peered":"2022-04-03T21:49:57.872943+0000","last_unstale":"2022-04-03T21:50:02.405095+0000","last_undegraded":"2022-04-03T21:50:02.405095+0000","last_fullsized":"2022-04-03T21:50:02.405095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:40:34.165717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403936+0000","last_change":"2022-04-03T21:49:58.421243+0000","last_active":"2022-04-03T21:50:02.403936+0000","last_peered":"2022-04-03T21:50:02.403936+0000","last_clean":"2022-04-03T21:50:02.403936+0000","last_became_active":"2022-04-03T21:49:58.420761+0000","last_became_peered":"2022-04-03T21:49:58.420761+0000","last_unstale":"2022-04-03T21:50:02.403936+0000","last_undegraded":"2022-04-03T21:50:02.403936+0000","last_fullsized":"2022-04-03T21:50:02.403936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:06:23.093381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429963+0000","last_change":"2022-04-03T21:50:02.424398+0000","last_active":"2022-04-03T21:50:02.429963+0000","last_peered":"2022-04-03T21:50:02.429963+0000","last_clean":"2022-04-03T21:50:02.429963+0000","last_became_active":"2022-04-03T21:50:02.423977+0000","last_became_peered":"2022-04-03T21:50:02.423977+0000","last_unstale":"2022-04-03T21:50:02.429963+0000","last_undegraded":"2022-04-03T21:50:02.429963+0000","last_fullsized":"2022-04-03T21:50:02.429963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:42:14.704158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402275+0000","last_change":"2022-04-03T21:49:51.825761+0000","last_active":"2022-04-03T21:50:02.402275+0000","last_peered":"2022-04-03T21:50:02.402275+0000","last_clean":"2022-04-03T21:50:02.402275+0000","last_became_active":"2022-04-03T21:49:51.825341+0000","last_became_peered":"2022-04-03T21:49:51.825341+0000","last_unstale":"2022-04-03T21:50:02.402275+0000","last_undegraded":"2022-04-03T21:50:02.402275+0000","last_fullsized":"2022-04-03T21:50:02.402275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:05:18.628185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410188+0000","last_change":"2022-04-03T21:49:57.873682+0000","last_active":"2022-04-03T21:50:02.410188+0000","last_peered":"2022-04-03T21:50:02.410188+0000","last_clean":"2022-04-03T21:50:02.410188+0000","last_became_active":"2022-04-03T21:49:57.873471+0000","last_became_peered":"2022-04-03T21:49:57.873471+0000","last_unstale":"2022-04-03T21:50:02.410188+0000","last_undegraded":"2022-04-03T21:50:02.410188+0000","last_fullsized":"2022-04-03T21:50:02.410188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:49:58.621137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402322+0000","last_change":"2022-04-03T21:49:58.400547+0000","last_active":"2022-04-03T21:50:02.402322+0000","last_peered":"2022-04-03T21:50:02.402322+0000","last_clean":"2022-04-03T21:50:02.402322+0000","last_became_active":"2022-04-03T21:49:58.399645+0000","last_became_peered":"2022-04-03T21:49:58.399645+0000","last_unstale":"2022-04-03T21:50:02.402322+0000","last_undegraded":"2022-04-03T21:50:02.402322+0000","last_fullsized":"2022-04-03T21:50:02.402322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:11:49.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443304+0000","last_change":"2022-04-03T21:50:02.441051+0000","last_active":"2022-04-03T21:50:02.443304+0000","last_peered":"2022-04-03T21:50:02.443304+0000","last_clean":"2022-04-03T21:50:02.443304+0000","last_became_active":"2022-04-03T21:50:02.440145+0000","last_became_peered":"2022-04-03T21:50:02.440145+0000","last_unstale":"2022-04-03T21:50:02.443304+0000","last_undegraded":"2022-04-03T21:50:02.443304+0000","last_fullsized":"2022-04-03T21:50:02.443304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:48.125856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403762+0000","last_change":"2022-04-03T21:49:51.823192+0000","last_active":"2022-04-03T21:50:02.403762+0000","last_peered":"2022-04-03T21:50:02.403762+0000","last_clean":"2022-04-03T21:50:02.403762+0000","last_became_active":"2022-04-03T21:49:51.822812+0000","last_became_peered":"2022-04-03T21:49:51.822812+0000","last_unstale":"2022-04-03T21:50:02.403762+0000","last_undegraded":"2022-04-03T21:50:02.403762+0000","last_fullsized":"2022-04-03T21:50:02.403762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:56:34.679337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415772+0000","last_change":"2022-04-03T21:49:57.860388+0000","last_active":"2022-04-03T21:50:02.415772+0000","last_peered":"2022-04-03T21:50:02.415772+0000","last_clean":"2022-04-03T21:50:02.415772+0000","last_became_active":"2022-04-03T21:49:57.860088+0000","last_became_peered":"2022-04-03T21:49:57.860088+0000","last_unstale":"2022-04-03T21:50:02.415772+0000","last_undegraded":"2022-04-03T21:50:02.415772+0000","last_fullsized":"2022-04-03T21:50:02.415772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:52:22.536814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414020+0000","last_change":"2022-04-03T21:49:58.422161+0000","last_active":"2022-04-03T21:50:02.414020+0000","last_peered":"2022-04-03T21:50:02.414020+0000","last_clean":"2022-04-03T21:50:02.414020+0000","last_became_active":"2022-04-03T21:49:58.421791+0000","last_became_peered":"2022-04-03T21:49:58.421791+0000","last_unstale":"2022-04-03T21:50:02.414020+0000","last_undegraded":"2022-04-03T21:50:02.414020+0000","last_fullsized":"2022-04-03T21:50:02.414020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:16.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430144+0000","last_change":"2022-04-03T21:50:02.421849+0000","last_active":"2022-04-03T21:50:02.430144+0000","last_peered":"2022-04-03T21:50:02.430144+0000","last_clean":"2022-04-03T21:50:02.430144+0000","last_became_active":"2022-04-03T21:50:02.421341+0000","last_became_peered":"2022-04-03T21:50:02.421341+0000","last_unstale":"2022-04-03T21:50:02.430144+0000","last_undegraded":"2022-04-03T21:50:02.430144+0000","last_fullsized":"2022-04-03T21:50:02.430144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:27:53.495587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409689+0000","last_change":"2022-04-03T21:49:57.863910+0000","last_active":"2022-04-03T21:50:02.409689+0000","last_peered":"2022-04-03T21:50:02.409689+0000","last_clean":"2022-04-03T21:50:02.409689+0000","last_became_active":"2022-04-03T21:49:57.863574+0000","last_became_peered":"2022-04-03T21:49:57.863574+0000","last_unstale":"2022-04-03T21:50:02.409689+0000","last_undegraded":"2022-04-03T21:50:02.409689+0000","last_fullsized":"2022-04-03T21:50:02.409689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:13:36.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410534+0000","last_change":"2022-04-03T21:49:52.057999+0000","last_active":"2022-04-03T21:50:02.410534+0000","last_peered":"2022-04-03T21:50:02.410534+0000","last_clean":"2022-04-03T21:50:02.410534+0000","last_became_active":"2022-04-03T21:49:52.057739+0000","last_became_peered":"2022-04-03T21:49:52.057739+0000","last_unstale":"2022-04-03T21:50:02.410534+0000","last_undegraded":"2022-04-03T21:50:02.410534+0000","last_fullsized":"2022-04-03T21:50:02.410534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:44:05.676474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405131+0000","last_change":"2022-04-03T21:49:58.412468+0000","last_active":"2022-04-03T21:50:02.405131+0000","last_peered":"2022-04-03T21:50:02.405131+0000","last_clean":"2022-04-03T21:50:02.405131+0000","last_became_active":"2022-04-03T21:49:58.412157+0000","last_became_peered":"2022-04-03T21:49:58.412157+0000","last_unstale":"2022-04-03T21:50:02.405131+0000","last_undegraded":"2022-04-03T21:50:02.405131+0000","last_fullsized":"2022-04-03T21:50:02.405131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:22.481343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.418110+0000","last_change":"2022-04-03T21:50:02.416690+0000","last_active":"2022-04-03T21:50:02.418110+0000","last_peered":"2022-04-03T21:50:02.418110+0000","last_clean":"2022-04-03T21:50:02.418110+0000","last_became_active":"2022-04-03T21:50:02.416202+0000","last_became_peered":"2022-04-03T21:50:02.416202+0000","last_unstale":"2022-04-03T21:50:02.418110+0000","last_undegraded":"2022-04-03T21:50:02.418110+0000","last_fullsized":"2022-04-03T21:50:02.418110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:35:47.291508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403609+0000","last_change":"2022-04-03T21:49:52.058292+0000","last_active":"2022-04-03T21:50:02.403609+0000","last_peered":"2022-04-03T21:50:02.403609+0000","last_clean":"2022-04-03T21:50:02.403609+0000","last_became_active":"2022-04-03T21:49:52.057769+0000","last_became_peered":"2022-04-03T21:49:52.057769+0000","last_unstale":"2022-04-03T21:50:02.403609+0000","last_undegraded":"2022-04-03T21:50:02.403609+0000","last_fullsized":"2022-04-03T21:50:02.403609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:10:19.197449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410357+0000","last_change":"2022-04-03T21:49:57.858802+0000","last_active":"2022-04-03T21:50:02.410357+0000","last_peered":"2022-04-03T21:50:02.410357+0000","last_clean":"2022-04-03T21:50:02.410357+0000","last_became_active":"2022-04-03T21:49:57.858491+0000","last_became_peered":"2022-04-03T21:49:57.858491+0000","last_unstale":"2022-04-03T21:50:02.410357+0000","last_undegraded":"2022-04-03T21:50:02.410357+0000","last_fullsized":"2022-04-03T21:50:02.410357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:18:02.365918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409115+0000","last_change":"2022-04-03T21:49:58.400587+0000","last_active":"2022-04-03T21:50:02.409115+0000","last_peered":"2022-04-03T21:50:02.409115+0000","last_clean":"2022-04-03T21:50:02.409115+0000","last_became_active":"2022-04-03T21:49:58.400277+0000","last_became_peered":"2022-04-03T21:49:58.400277+0000","last_unstale":"2022-04-03T21:50:02.409115+0000","last_undegraded":"2022-04-03T21:50:02.409115+0000","last_fullsized":"2022-04-03T21:50:02.409115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:17:55.722041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428327+0000","last_change":"2022-04-03T21:50:02.424828+0000","last_active":"2022-04-03T21:50:02.428327+0000","last_peered":"2022-04-03T21:50:02.428327+0000","last_clean":"2022-04-03T21:50:02.428327+0000","last_became_active":"2022-04-03T21:50:02.424406+0000","last_became_peered":"2022-04-03T21:50:02.424406+0000","last_unstale":"2022-04-03T21:50:02.428327+0000","last_undegraded":"2022-04-03T21:50:02.428327+0000","last_fullsized":"2022-04-03T21:50:02.428327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:45.759593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405778+0000","last_change":"2022-04-03T21:49:57.870766+0000","last_active":"2022-04-03T21:50:02.405778+0000","last_peered":"2022-04-03T21:50:02.405778+0000","last_clean":"2022-04-03T21:50:02.405778+0000","last_became_active":"2022-04-03T21:49:57.870481+0000","last_became_peered":"2022-04-03T21:49:57.870481+0000","last_unstale":"2022-04-03T21:50:02.405778+0000","last_undegraded":"2022-04-03T21:50:02.405778+0000","last_fullsized":"2022-04-03T21:50:02.405778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:17.100943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406335+0000","last_change":"2022-04-03T21:49:58.402346+0000","last_active":"2022-04-03T21:50:02.406335+0000","last_peered":"2022-04-03T21:50:02.406335+0000","last_clean":"2022-04-03T21:50:02.406335+0000","last_became_active":"2022-04-03T21:49:58.401964+0000","last_became_peered":"2022-04-03T21:49:58.401964+0000","last_unstale":"2022-04-03T21:50:02.406335+0000","last_undegraded":"2022-04-03T21:50:02.406335+0000","last_fullsized":"2022-04-03T21:50:02.406335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:15:23.150292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442587+0000","last_change":"2022-04-03T21:50:02.436307+0000","last_active":"2022-04-03T21:50:02.442587+0000","last_peered":"2022-04-03T21:50:02.442587+0000","last_clean":"2022-04-03T21:50:02.442587+0000","last_became_active":"2022-04-03T21:50:02.435842+0000","last_became_peered":"2022-04-03T21:50:02.435842+0000","last_unstale":"2022-04-03T21:50:02.442587+0000","last_undegraded":"2022-04-03T21:50:02.442587+0000","last_fullsized":"2022-04-03T21:50:02.442587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:28:23.964940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413356+0000","last_change":"2022-04-03T21:49:57.873350+0000","last_active":"2022-04-03T21:50:02.413356+0000","last_peered":"2022-04-03T21:50:02.413356+0000","last_clean":"2022-04-03T21:50:02.413356+0000","last_became_active":"2022-04-03T21:49:57.873001+0000","last_became_peered":"2022-04-03T21:49:57.873001+0000","last_unstale":"2022-04-03T21:50:02.413356+0000","last_undegraded":"2022-04-03T21:50:02.413356+0000","last_fullsized":"2022-04-03T21:50:02.413356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:38:09.203088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410774+0000","last_change":"2022-04-03T21:49:58.415091+0000","last_active":"2022-04-03T21:50:02.410774+0000","last_peered":"2022-04-03T21:50:02.410774+0000","last_clean":"2022-04-03T21:50:02.410774+0000","last_became_active":"2022-04-03T21:49:58.414804+0000","last_became_peered":"2022-04-03T21:49:58.414804+0000","last_unstale":"2022-04-03T21:50:02.410774+0000","last_undegraded":"2022-04-03T21:50:02.410774+0000","last_fullsized":"2022-04-03T21:50:02.410774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:32:09.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436838+0000","last_change":"2022-04-03T21:50:02.431066+0000","last_active":"2022-04-03T21:50:02.436838+0000","last_peered":"2022-04-03T21:50:02.436838+0000","last_clean":"2022-04-03T21:50:02.436838+0000","last_became_active":"2022-04-03T21:50:02.430674+0000","last_became_peered":"2022-04-03T21:50:02.430674+0000","last_unstale":"2022-04-03T21:50:02.436838+0000","last_undegraded":"2022-04-03T21:50:02.436838+0000","last_fullsized":"2022-04-03T21:50:02.436838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:55:33.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403806+0000","last_change":"2022-04-03T21:49:57.878346+0000","last_active":"2022-04-03T21:50:02.403806+0000","last_peered":"2022-04-03T21:50:02.403806+0000","last_clean":"2022-04-03T21:50:02.403806+0000","last_became_active":"2022-04-03T21:49:57.877994+0000","last_became_peered":"2022-04-03T21:49:57.877994+0000","last_unstale":"2022-04-03T21:50:02.403806+0000","last_undegraded":"2022-04-03T21:50:02.403806+0000","last_fullsized":"2022-04-03T21:50:02.403806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:59:05.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413728+0000","last_change":"2022-04-03T21:49:58.402592+0000","last_active":"2022-04-03T21:50:02.413728+0000","last_peered":"2022-04-03T21:50:02.413728+0000","last_clean":"2022-04-03T21:50:02.413728+0000","last_became_active":"2022-04-03T21:49:58.402288+0000","last_became_peered":"2022-04-03T21:49:58.402288+0000","last_unstale":"2022-04-03T21:50:02.413728+0000","last_undegraded":"2022-04-03T21:50:02.413728+0000","last_fullsized":"2022-04-03T21:50:02.413728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:06:07.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442588+0000","last_change":"2022-04-03T21:50:02.434794+0000","last_active":"2022-04-03T21:50:02.442588+0000","last_peered":"2022-04-03T21:50:02.442588+0000","last_clean":"2022-04-03T21:50:02.442588+0000","last_became_active":"2022-04-03T21:50:02.434307+0000","last_became_peered":"2022-04-03T21:50:02.434307+0000","last_unstale":"2022-04-03T21:50:02.442588+0000","last_undegraded":"2022-04-03T21:50:02.442588+0000","last_fullsized":"2022-04-03T21:50:02.442588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:05:48.587273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402186+0000","last_change":"2022-04-03T21:49:57.872939+0000","last_active":"2022-04-03T21:50:02.402186+0000","last_peered":"2022-04-03T21:50:02.402186+0000","last_clean":"2022-04-03T21:50:02.402186+0000","last_became_active":"2022-04-03T21:49:57.872688+0000","last_became_peered":"2022-04-03T21:49:57.872688+0000","last_unstale":"2022-04-03T21:50:02.402186+0000","last_undegraded":"2022-04-03T21:50:02.402186+0000","last_fullsized":"2022-04-03T21:50:02.402186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:19:57.738611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401722+0000","last_change":"2022-04-03T21:49:58.405063+0000","last_active":"2022-04-03T21:50:02.401722+0000","last_peered":"2022-04-03T21:50:02.401722+0000","last_clean":"2022-04-03T21:50:02.401722+0000","last_became_active":"2022-04-03T21:49:58.404738+0000","last_became_peered":"2022-04-03T21:49:58.404738+0000","last_unstale":"2022-04-03T21:50:02.401722+0000","last_undegraded":"2022-04-03T21:50:02.401722+0000","last_fullsized":"2022-04-03T21:50:02.401722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:14:24.585390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436350+0000","last_change":"2022-04-03T21:50:02.429562+0000","last_active":"2022-04-03T21:50:02.436350+0000","last_peered":"2022-04-03T21:50:02.436350+0000","last_clean":"2022-04-03T21:50:02.436350+0000","last_became_active":"2022-04-03T21:50:02.429153+0000","last_became_peered":"2022-04-03T21:50:02.429153+0000","last_unstale":"2022-04-03T21:50:02.436350+0000","last_undegraded":"2022-04-03T21:50:02.436350+0000","last_fullsized":"2022-04-03T21:50:02.436350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:23:56.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402210+0000","last_change":"2022-04-03T21:49:57.865475+0000","last_active":"2022-04-03T21:50:02.402210+0000","last_peered":"2022-04-03T21:50:02.402210+0000","last_clean":"2022-04-03T21:50:02.402210+0000","last_became_active":"2022-04-03T21:49:57.865147+0000","last_became_peered":"2022-04-03T21:49:57.865147+0000","last_unstale":"2022-04-03T21:50:02.402210+0000","last_undegraded":"2022-04-03T21:50:02.402210+0000","last_fullsized":"2022-04-03T21:50:02.402210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:47:33.277925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411366+0000","last_change":"2022-04-03T21:49:58.407938+0000","last_active":"2022-04-03T21:50:02.411366+0000","last_peered":"2022-04-03T21:50:02.411366+0000","last_clean":"2022-04-03T21:50:02.411366+0000","last_became_active":"2022-04-03T21:49:58.407645+0000","last_became_peered":"2022-04-03T21:49:58.407645+0000","last_unstale":"2022-04-03T21:50:02.411366+0000","last_undegraded":"2022-04-03T21:50:02.411366+0000","last_fullsized":"2022-04-03T21:50:02.411366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:26:23.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411975+0000","last_change":"2022-04-03T21:49:58.417116+0000","last_active":"2022-04-03T21:50:02.411975+0000","last_peered":"2022-04-03T21:50:02.411975+0000","last_clean":"2022-04-03T21:50:02.411975+0000","last_became_active":"2022-04-03T21:49:58.416601+0000","last_became_peered":"2022-04-03T21:49:58.416601+0000","last_unstale":"2022-04-03T21:50:02.411975+0000","last_undegraded":"2022-04-03T21:50:02.411975+0000","last_fullsized":"2022-04-03T21:50:02.411975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:48:21.551919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410282+0000","last_change":"2022-04-03T21:49:58.406506+0000","last_active":"2022-04-03T21:50:02.410282+0000","last_peered":"2022-04-03T21:50:02.410282+0000","last_clean":"2022-04-03T21:50:02.410282+0000","last_became_active":"2022-04-03T21:49:58.406217+0000","last_became_peered":"2022-04-03T21:49:58.406217+0000","last_unstale":"2022-04-03T21:50:02.410282+0000","last_undegraded":"2022-04-03T21:50:02.410282+0000","last_fullsized":"2022-04-03T21:50:02.410282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:24:30.050855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421819+0000","last_change":"2022-04-03T21:49:58.424077+0000","last_active":"2022-04-03T21:50:02.421819+0000","last_peered":"2022-04-03T21:50:02.421819+0000","last_clean":"2022-04-03T21:50:02.421819+0000","last_became_active":"2022-04-03T21:49:58.423709+0000","last_became_peered":"2022-04-03T21:49:58.423709+0000","last_unstale":"2022-04-03T21:50:02.421819+0000","last_undegraded":"2022-04-03T21:50:02.421819+0000","last_fullsized":"2022-04-03T21:50:02.421819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:55:52.787385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402780+0000","last_change":"2022-04-03T21:49:58.419515+0000","last_active":"2022-04-03T21:50:02.402780+0000","last_peered":"2022-04-03T21:50:02.402780+0000","last_clean":"2022-04-03T21:50:02.402780+0000","last_became_active":"2022-04-03T21:49:58.419270+0000","last_became_peered":"2022-04-03T21:49:58.419270+0000","last_unstale":"2022-04-03T21:50:02.402780+0000","last_undegraded":"2022-04-03T21:50:02.402780+0000","last_fullsized":"2022-04-03T21:50:02.402780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:06:28.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403437+0000","last_change":"2022-04-03T21:49:58.402164+0000","last_active":"2022-04-03T21:50:02.403437+0000","last_peered":"2022-04-03T21:50:02.403437+0000","last_clean":"2022-04-03T21:50:02.403437+0000","last_became_active":"2022-04-03T21:49:58.401871+0000","last_became_peered":"2022-04-03T21:49:58.401871+0000","last_unstale":"2022-04-03T21:50:02.403437+0000","last_undegraded":"2022-04-03T21:50:02.403437+0000","last_fullsized":"2022-04-03T21:50:02.403437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:30:03.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4530,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476748,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":125436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9148,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362692,"statfs":{"total":96636764160,"available":96627396608,"internally_reserved":0,"allocated":839680,"data_stored":651170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.984}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7270000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9459999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5949999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9140,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362700,"statfs":{"total":96636764160,"available":96627404800,"internally_reserved":0,"allocated":831488,"data_stored":651078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":121674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8040,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363800,"statfs":{"total":96636764160,"available":96628531200,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":121730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.641}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-03T21:50:26.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-03T21:50:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.632+0000 7fe432281700 1 Processor -- start 2022-04-03T21:50:26.634 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.632+0000 7fe432281700 1 -- start start 2022-04-03T21:50:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.633+0000 7fe432281700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe42c0c1f40 0x7fe42c0bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.633+0000 7fe432281700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0c2310 0x7fe42c0a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.636 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.633+0000 7fe432281700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0a4720 con 0x7fe42c0bdc00 2022-04-03T21:50:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.633+0000 7fe432281700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0a5980 con 0x7fe42c0c1f40 2022-04-03T21:50:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.633+0000 7fe432281700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0a5280 con 0x7fe42c0c2310 2022-04-03T21:50:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe42c0c1f40 0x7fe42c0bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0c2310 0x7fe42c0a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.637 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe43081e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe42c0bdc00 0x7fe42c1482f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47442/0 (socket says 172.21.15.49:47442) 2022-04-03T21:50:26.638 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe43081e700 1 -- 172.21.15.49:0/190149483 learned_addr learned my addr 172.21.15.49:0/190149483 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:26.638 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42affd700 1 -- 172.21.15.49:0/190149483 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420868698 0 0) 0x7fe42c0a4720 con 0x7fe42c0bdc00 2022-04-03T21:50:26.638 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42affd700 1 -- 172.21.15.49:0/190149483 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4180033f0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.638 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42bfff700 1 -- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0c2310 msgr2=0x7fe42c0a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42bfff700 1 --2- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0c2310 0x7fe42c0a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42bfff700 1 -- 172.21.15.49:0/190149483 >> v1:172.21.15.117:6789/0 conn(0x7fe42c0bdc00 legacy=0x7fe42c1482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42bfff700 1 -- 172.21.15.49:0/190149483 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0a49e0 con 0x7fe42c0c1f40 2022-04-03T21:50:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.634+0000 7fe42b7fe700 1 --2- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0c2310 0x7fe42c0a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:26.639 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.635+0000 7fe42bfff700 1 --2- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0bd6c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009760 tx=0x7fe41c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fb16e7e550bdea server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.635+0000 7fe42affd700 1 -- 172.21.15.49:0/190149483 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0105b0 con 0x7fe42c0c1f40 2022-04-03T21:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.635+0000 7fe42affd700 1 -- 172.21.15.49:0/190149483 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c010710 con 0x7fe42c0c1f40 2022-04-03T21:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.635+0000 7fe42affd700 1 -- 172.21.15.49:0/190149483 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c010ab0 con 0x7fe42c0c1f40 2022-04-03T21:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.635+0000 7fe432281700 1 -- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 msgr2=0x7fe42c0bd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.635+0000 7fe432281700 1 --2- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0bd6c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009760 tx=0x7fe41c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.636+0000 7fe432281700 1 -- 172.21.15.49:0/190149483 shutdown_connections 2022-04-03T21:50:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.636+0000 7fe432281700 1 --2- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0bd6c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.636+0000 7fe432281700 1 --2- 172.21.15.49:0/190149483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0c2310 0x7fe42c0a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.636+0000 7fe432281700 1 -- 172.21.15.49:0/190149483 >> 172.21.15.49:0/190149483 conn(0x7fe42c05e010 msgr2=0x7fe42c0c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.636+0000 7fe432281700 1 -- 172.21.15.49:0/190149483 shutdown_connections 2022-04-03T21:50:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.636+0000 7fe432281700 1 -- 172.21.15.49:0/190149483 wait complete. 2022-04-03T21:50:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.638+0000 7fe432281700 1 Processor -- start 2022-04-03T21:50:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.638+0000 7fe432281700 1 -- start start 2022-04-03T21:50:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.639+0000 7fe432281700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 0x7fe42c1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.646 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.639+0000 7fe432281700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.646 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.639+0000 7fe432281700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe42c0c2310 0x7fe42c0a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.646 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.639+0000 7fe432281700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0bb490 con 0x7fe42c0c2310 2022-04-03T21:50:26.646 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.639+0000 7fe432281700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0bb770 con 0x7fe42c0c1f40 2022-04-03T21:50:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.639+0000 7fe432281700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0badb0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 0x7fe42c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 0x7fe42c1557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45874/0 (socket says 172.21.15.49:45874) 2022-04-03T21:50:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 -- 172.21.15.49:0/1169444028 learned_addr learned my addr 172.21.15.49:0/1169444028 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:26.647 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe43081e700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe42c0c2310 0x7fe42c0a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.648 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42b7fe700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.648 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 -- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 msgr2=0x7fe42c0b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.648 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.648 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 -- 172.21.15.49:0/1169444028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe42c0c2310 msgr2=0x7fe42c0a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe42c0c2310 0x7fe42c0a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.640+0000 7fe42bfff700 1 -- 172.21.15.49:0/1169444028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200092a0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.641+0000 7fe42bfff700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 0x7fe42c1557a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009d50 tx=0x7fe41c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:26.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.641+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c010a90 con 0x7fe42c0bdc00 2022-04-03T21:50:26.649 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.641+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c000c90 con 0x7fe42c0bdc00 2022-04-03T21:50:26.650 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.641+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0092a0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.650 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.641+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0042a0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.650 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.641+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c0bb050 con 0x7fe42c0bdc00 2022-04-03T21:50:26.651 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.642+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c1467a0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.651 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.643+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fe41c00f070 con 0x7fe42c0bdc00 2022-04-03T21:50:26.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.644+0000 7fe413fff700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe40c063ce0 0x7fe40c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:26.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.644+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe41c0826f0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.644+0000 7fe42b7fe700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe40c063ce0 0x7fe40c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:26.652 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.645+0000 7fe42b7fe700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe40c063ce0 0x7fe40c066190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe42c1466e0 tx=0x7fe420009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:26.653 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.649+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fe41c050fe0 con 0x7fe42c0bdc00 2022-04-03T21:50:26.852 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.850+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 --> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe42c146a00 con 0x7fe40c063ce0 2022-04-03T21:50:26.862 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.861+0000 7fe413fff700 1 -- 172.21.15.49:0/1169444028 <== mgr.4101 v2:172.21.15.117:6832/26568 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+364737 (secure 0 0 0) 0x7fe42c146a00 con 0x7fe40c063ce0 2022-04-03T21:50:26.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:26.871 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe40c063ce0 msgr2=0x7fe40c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe40c063ce0 0x7fe40c066190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe42c1466e0 tx=0x7fe420009060 comp rx=0 tx=0).stop 2022-04-03T21:50:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 msgr2=0x7fe42c1557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 0x7fe42c1557a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009d50 tx=0x7fe41c016000 comp rx=0 tx=0).stop 2022-04-03T21:50:26.872 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 shutdown_connections 2022-04-03T21:50:26.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe40c063ce0 0x7fe40c066190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.873 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe42c0c2310 0x7fe42c0a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c0bdc00 0x7fe42c1557a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 --2- 172.21.15.49:0/1169444028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0c1f40 0x7fe42c0b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:26.874 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 >> 172.21.15.49:0/1169444028 conn(0x7fe42c05e010 msgr2=0x7fe42c146db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 shutdown_connections 2022-04-03T21:50:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:26.866+0000 7fe432281700 1 -- 172.21.15.49:0/1169444028 wait complete. 2022-04-03T21:50:26.875 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2022-04-03T21:50:26.892 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2022-04-03T21:50:26.095553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594898,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66960,"kb_used_data":3408,"kb_used_omap":0,"kb_used_meta":63488,"kb_avail":754907760,"statfs":{"total":773094113280,"available":773025546240,"internally_reserved":0,"allocated":3489792,"data_stored":2039588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65011712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003770"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402622+0000","last_change":"2022-04-03T21:49:58.414058+0000","last_active":"2022-04-03T21:50:02.402622+0000","last_peered":"2022-04-03T21:50:02.402622+0000","last_clean":"2022-04-03T21:50:02.402622+0000","last_became_active":"2022-04-03T21:49:58.413775+0000","last_became_peered":"2022-04-03T21:49:58.413775+0000","last_unstale":"2022-04-03T21:50:02.402622+0000","last_undegraded":"2022-04-03T21:50:02.402622+0000","last_fullsized":"2022-04-03T21:50:02.402622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:53.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408368+0000","last_change":"2022-04-03T21:49:58.409713+0000","last_active":"2022-04-03T21:50:02.408368+0000","last_peered":"2022-04-03T21:50:02.408368+0000","last_clean":"2022-04-03T21:50:02.408368+0000","last_became_active":"2022-04-03T21:49:58.409410+0000","last_became_peered":"2022-04-03T21:49:58.409410+0000","last_unstale":"2022-04-03T21:50:02.408368+0000","last_undegraded":"2022-04-03T21:50:02.408368+0000","last_fullsized":"2022-04-03T21:50:02.408368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:10.539087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421211+0000","last_change":"2022-04-03T21:49:58.422325+0000","last_active":"2022-04-03T21:50:02.421211+0000","last_peered":"2022-04-03T21:50:02.421211+0000","last_clean":"2022-04-03T21:50:02.421211+0000","last_became_active":"2022-04-03T21:49:58.422026+0000","last_became_peered":"2022-04-03T21:49:58.422026+0000","last_unstale":"2022-04-03T21:50:02.421211+0000","last_undegraded":"2022-04-03T21:50:02.421211+0000","last_fullsized":"2022-04-03T21:50:02.421211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:09:11.502569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421334+0000","last_change":"2022-04-03T21:49:58.423449+0000","last_active":"2022-04-03T21:50:02.421334+0000","last_peered":"2022-04-03T21:50:02.421334+0000","last_clean":"2022-04-03T21:50:02.421334+0000","last_became_active":"2022-04-03T21:49:58.423128+0000","last_became_peered":"2022-04-03T21:49:58.423128+0000","last_unstale":"2022-04-03T21:50:02.421334+0000","last_undegraded":"2022-04-03T21:50:02.421334+0000","last_fullsized":"2022-04-03T21:50:02.421334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:02:31.777504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405877+0000","last_change":"2022-04-03T21:49:58.416006+0000","last_active":"2022-04-03T21:50:02.405877+0000","last_peered":"2022-04-03T21:50:02.405877+0000","last_clean":"2022-04-03T21:50:02.405877+0000","last_became_active":"2022-04-03T21:49:58.415782+0000","last_became_peered":"2022-04-03T21:49:58.415782+0000","last_unstale":"2022-04-03T21:50:02.405877+0000","last_undegraded":"2022-04-03T21:50:02.405877+0000","last_fullsized":"2022-04-03T21:50:02.405877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:27:40.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403571+0000","last_change":"2022-04-03T21:49:58.399107+0000","last_active":"2022-04-03T21:50:02.403571+0000","last_peered":"2022-04-03T21:50:02.403571+0000","last_clean":"2022-04-03T21:50:02.403571+0000","last_became_active":"2022-04-03T21:49:58.398700+0000","last_became_peered":"2022-04-03T21:49:58.398700+0000","last_unstale":"2022-04-03T21:50:02.403571+0000","last_undegraded":"2022-04-03T21:50:02.403571+0000","last_fullsized":"2022-04-03T21:50:02.403571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:39:58.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402584+0000","last_change":"2022-04-03T21:49:58.424480+0000","last_active":"2022-04-03T21:50:02.402584+0000","last_peered":"2022-04-03T21:50:02.402584+0000","last_clean":"2022-04-03T21:50:02.402584+0000","last_became_active":"2022-04-03T21:49:58.424164+0000","last_became_peered":"2022-04-03T21:49:58.424164+0000","last_unstale":"2022-04-03T21:50:02.402584+0000","last_undegraded":"2022-04-03T21:50:02.402584+0000","last_fullsized":"2022-04-03T21:50:02.402584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:05:12.441514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412069+0000","last_change":"2022-04-03T21:49:58.425384+0000","last_active":"2022-04-03T21:50:02.412069+0000","last_peered":"2022-04-03T21:50:02.412069+0000","last_clean":"2022-04-03T21:50:02.412069+0000","last_became_active":"2022-04-03T21:49:58.425084+0000","last_became_peered":"2022-04-03T21:49:58.425084+0000","last_unstale":"2022-04-03T21:50:02.412069+0000","last_undegraded":"2022-04-03T21:50:02.412069+0000","last_fullsized":"2022-04-03T21:50:02.412069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:38.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411107+0000","last_change":"2022-04-03T21:49:58.415591+0000","last_active":"2022-04-03T21:50:02.411107+0000","last_peered":"2022-04-03T21:50:02.411107+0000","last_clean":"2022-04-03T21:50:02.411107+0000","last_became_active":"2022-04-03T21:49:58.415264+0000","last_became_peered":"2022-04-03T21:49:58.415264+0000","last_unstale":"2022-04-03T21:50:02.411107+0000","last_undegraded":"2022-04-03T21:50:02.411107+0000","last_fullsized":"2022-04-03T21:50:02.411107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:26:23.919459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411177+0000","last_change":"2022-04-03T21:49:58.415930+0000","last_active":"2022-04-03T21:50:02.411177+0000","last_peered":"2022-04-03T21:50:02.411177+0000","last_clean":"2022-04-03T21:50:02.411177+0000","last_became_active":"2022-04-03T21:49:58.415597+0000","last_became_peered":"2022-04-03T21:49:58.415597+0000","last_unstale":"2022-04-03T21:50:02.411177+0000","last_undegraded":"2022-04-03T21:50:02.411177+0000","last_fullsized":"2022-04-03T21:50:02.411177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:31:01.030066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409971+0000","last_change":"2022-04-03T21:49:58.425355+0000","last_active":"2022-04-03T21:50:02.409971+0000","last_peered":"2022-04-03T21:50:02.409971+0000","last_clean":"2022-04-03T21:50:02.409971+0000","last_became_active":"2022-04-03T21:49:58.425029+0000","last_became_peered":"2022-04-03T21:49:58.425029+0000","last_unstale":"2022-04-03T21:50:02.409971+0000","last_undegraded":"2022-04-03T21:50:02.409971+0000","last_fullsized":"2022-04-03T21:50:02.409971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:00:14.843110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403539+0000","last_change":"2022-04-03T21:49:58.399698+0000","last_active":"2022-04-03T21:50:02.403539+0000","last_peered":"2022-04-03T21:50:02.403539+0000","last_clean":"2022-04-03T21:50:02.403539+0000","last_became_active":"2022-04-03T21:49:58.399040+0000","last_became_peered":"2022-04-03T21:49:58.399040+0000","last_unstale":"2022-04-03T21:50:02.403539+0000","last_undegraded":"2022-04-03T21:50:02.403539+0000","last_fullsized":"2022-04-03T21:50:02.403539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:27.438020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413919+0000","last_change":"2022-04-03T21:49:58.411470+0000","last_active":"2022-04-03T21:50:02.413919+0000","last_peered":"2022-04-03T21:50:02.413919+0000","last_clean":"2022-04-03T21:50:02.413919+0000","last_became_active":"2022-04-03T21:49:58.411181+0000","last_became_peered":"2022-04-03T21:49:58.411181+0000","last_unstale":"2022-04-03T21:50:02.413919+0000","last_undegraded":"2022-04-03T21:50:02.413919+0000","last_fullsized":"2022-04-03T21:50:02.413919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:12:21.980416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414197+0000","last_change":"2022-04-03T21:49:58.419342+0000","last_active":"2022-04-03T21:50:02.414197+0000","last_peered":"2022-04-03T21:50:02.414197+0000","last_clean":"2022-04-03T21:50:02.414197+0000","last_became_active":"2022-04-03T21:49:58.418928+0000","last_became_peered":"2022-04-03T21:49:58.418928+0000","last_unstale":"2022-04-03T21:50:02.414197+0000","last_undegraded":"2022-04-03T21:50:02.414197+0000","last_fullsized":"2022-04-03T21:50:02.414197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:02:42.663277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421690+0000","last_change":"2022-04-03T21:49:58.418714+0000","last_active":"2022-04-03T21:50:02.421690+0000","last_peered":"2022-04-03T21:50:02.421690+0000","last_clean":"2022-04-03T21:50:02.421690+0000","last_became_active":"2022-04-03T21:49:58.418401+0000","last_became_peered":"2022-04-03T21:49:58.418401+0000","last_unstale":"2022-04-03T21:50:02.421690+0000","last_undegraded":"2022-04-03T21:50:02.421690+0000","last_fullsized":"2022-04-03T21:50:02.421690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:34:59.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402148+0000","last_change":"2022-04-03T21:49:58.399093+0000","last_active":"2022-04-03T21:50:02.402148+0000","last_peered":"2022-04-03T21:50:02.402148+0000","last_clean":"2022-04-03T21:50:02.402148+0000","last_became_active":"2022-04-03T21:49:58.398799+0000","last_became_peered":"2022-04-03T21:49:58.398799+0000","last_unstale":"2022-04-03T21:50:02.402148+0000","last_undegraded":"2022-04-03T21:50:02.402148+0000","last_fullsized":"2022-04-03T21:50:02.402148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:49:12.002614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402064+0000","last_change":"2022-04-03T21:49:58.405030+0000","last_active":"2022-04-03T21:50:02.402064+0000","last_peered":"2022-04-03T21:50:02.402064+0000","last_clean":"2022-04-03T21:50:02.402064+0000","last_became_active":"2022-04-03T21:49:58.404727+0000","last_became_peered":"2022-04-03T21:49:58.404727+0000","last_unstale":"2022-04-03T21:50:02.402064+0000","last_undegraded":"2022-04-03T21:50:02.402064+0000","last_fullsized":"2022-04-03T21:50:02.402064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:36:14.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428065+0000","last_change":"2022-04-03T21:49:58.431718+0000","last_active":"2022-04-03T21:50:02.428065+0000","last_peered":"2022-04-03T21:50:02.428065+0000","last_clean":"2022-04-03T21:50:02.428065+0000","last_became_active":"2022-04-03T21:49:58.430872+0000","last_became_peered":"2022-04-03T21:49:58.430872+0000","last_unstale":"2022-04-03T21:50:02.428065+0000","last_undegraded":"2022-04-03T21:50:02.428065+0000","last_fullsized":"2022-04-03T21:50:02.428065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:36:47.428099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401931+0000","last_change":"2022-04-03T21:49:58.401404+0000","last_active":"2022-04-03T21:50:02.401931+0000","last_peered":"2022-04-03T21:50:02.401931+0000","last_clean":"2022-04-03T21:50:02.401931+0000","last_became_active":"2022-04-03T21:49:58.400233+0000","last_became_peered":"2022-04-03T21:49:58.400233+0000","last_unstale":"2022-04-03T21:50:02.401931+0000","last_undegraded":"2022-04-03T21:50:02.401931+0000","last_fullsized":"2022-04-03T21:50:02.401931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:19:42.193555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413456+0000","last_change":"2022-04-03T21:49:58.415652+0000","last_active":"2022-04-03T21:50:02.413456+0000","last_peered":"2022-04-03T21:50:02.413456+0000","last_clean":"2022-04-03T21:50:02.413456+0000","last_became_active":"2022-04-03T21:49:58.415309+0000","last_became_peered":"2022-04-03T21:49:58.415309+0000","last_unstale":"2022-04-03T21:50:02.413456+0000","last_undegraded":"2022-04-03T21:50:02.413456+0000","last_fullsized":"2022-04-03T21:50:02.413456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:58:49.731887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409358+0000","last_change":"2022-04-03T21:49:58.420076+0000","last_active":"2022-04-03T21:50:02.409358+0000","last_peered":"2022-04-03T21:50:02.409358+0000","last_clean":"2022-04-03T21:50:02.409358+0000","last_became_active":"2022-04-03T21:49:58.419652+0000","last_became_peered":"2022-04-03T21:49:58.419652+0000","last_unstale":"2022-04-03T21:50:02.409358+0000","last_undegraded":"2022-04-03T21:50:02.409358+0000","last_fullsized":"2022-04-03T21:50:02.409358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:09:13.184611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401797+0000","last_change":"2022-04-03T21:49:58.406560+0000","last_active":"2022-04-03T21:50:02.401797+0000","last_peered":"2022-04-03T21:50:02.401797+0000","last_clean":"2022-04-03T21:50:02.401797+0000","last_became_active":"2022-04-03T21:49:58.406160+0000","last_became_peered":"2022-04-03T21:49:58.406160+0000","last_unstale":"2022-04-03T21:50:02.401797+0000","last_undegraded":"2022-04-03T21:50:02.401797+0000","last_fullsized":"2022-04-03T21:50:02.401797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:10:20.264129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408532+0000","last_change":"2022-04-03T21:49:58.407401+0000","last_active":"2022-04-03T21:50:02.408532+0000","last_peered":"2022-04-03T21:50:02.408532+0000","last_clean":"2022-04-03T21:50:02.408532+0000","last_became_active":"2022-04-03T21:49:58.407125+0000","last_became_peered":"2022-04-03T21:49:58.407125+0000","last_unstale":"2022-04-03T21:50:02.408532+0000","last_undegraded":"2022-04-03T21:50:02.408532+0000","last_fullsized":"2022-04-03T21:50:02.408532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:19.614490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.412027+0000","last_change":"2022-04-03T21:49:58.419741+0000","last_active":"2022-04-03T21:50:02.412027+0000","last_peered":"2022-04-03T21:50:02.412027+0000","last_clean":"2022-04-03T21:50:02.412027+0000","last_became_active":"2022-04-03T21:49:58.419026+0000","last_became_peered":"2022-04-03T21:49:58.419026+0000","last_unstale":"2022-04-03T21:50:02.412027+0000","last_undegraded":"2022-04-03T21:50:02.412027+0000","last_fullsized":"2022-04-03T21:50:02.412027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:37.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409777+0000","last_change":"2022-04-03T21:49:58.403630+0000","last_active":"2022-04-03T21:50:02.409777+0000","last_peered":"2022-04-03T21:50:02.409777+0000","last_clean":"2022-04-03T21:50:02.409777+0000","last_became_active":"2022-04-03T21:49:58.403280+0000","last_became_peered":"2022-04-03T21:49:58.403280+0000","last_unstale":"2022-04-03T21:50:02.409777+0000","last_undegraded":"2022-04-03T21:50:02.409777+0000","last_fullsized":"2022-04-03T21:50:02.409777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:50:27.561349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402107+0000","last_change":"2022-04-03T21:49:58.406356+0000","last_active":"2022-04-03T21:50:02.402107+0000","last_peered":"2022-04-03T21:50:02.402107+0000","last_clean":"2022-04-03T21:50:02.402107+0000","last_became_active":"2022-04-03T21:49:58.406008+0000","last_became_peered":"2022-04-03T21:49:58.406008+0000","last_unstale":"2022-04-03T21:50:02.402107+0000","last_undegraded":"2022-04-03T21:50:02.402107+0000","last_fullsized":"2022-04-03T21:50:02.402107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:09:59.484176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403238+0000","last_change":"2022-04-03T21:49:58.429551+0000","last_active":"2022-04-03T21:50:02.403238+0000","last_peered":"2022-04-03T21:50:02.403238+0000","last_clean":"2022-04-03T21:50:02.403238+0000","last_became_active":"2022-04-03T21:49:58.429168+0000","last_became_peered":"2022-04-03T21:49:58.429168+0000","last_unstale":"2022-04-03T21:50:02.403238+0000","last_undegraded":"2022-04-03T21:50:02.403238+0000","last_fullsized":"2022-04-03T21:50:02.403238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:25:21.039114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443702+0000","last_change":"2022-04-03T21:50:02.441183+0000","last_active":"2022-04-03T21:50:02.443702+0000","last_peered":"2022-04-03T21:50:02.443702+0000","last_clean":"2022-04-03T21:50:02.443702+0000","last_became_active":"2022-04-03T21:50:02.440742+0000","last_became_peered":"2022-04-03T21:50:02.440742+0000","last_unstale":"2022-04-03T21:50:02.443702+0000","last_undegraded":"2022-04-03T21:50:02.443702+0000","last_fullsized":"2022-04-03T21:50:02.443702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:34:43.602016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414305+0000","last_change":"2022-04-03T21:49:57.860784+0000","last_active":"2022-04-03T21:50:02.414305+0000","last_peered":"2022-04-03T21:50:02.414305+0000","last_clean":"2022-04-03T21:50:02.414305+0000","last_became_active":"2022-04-03T21:49:57.858898+0000","last_became_peered":"2022-04-03T21:49:57.858898+0000","last_unstale":"2022-04-03T21:50:02.414305+0000","last_undegraded":"2022-04-03T21:50:02.414305+0000","last_fullsized":"2022-04-03T21:50:02.414305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:47:21.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402796+0000","last_change":"2022-04-03T21:49:58.408237+0000","last_active":"2022-04-03T21:50:02.402796+0000","last_peered":"2022-04-03T21:50:02.402796+0000","last_clean":"2022-04-03T21:50:02.402796+0000","last_became_active":"2022-04-03T21:49:58.407955+0000","last_became_peered":"2022-04-03T21:49:58.407955+0000","last_unstale":"2022-04-03T21:50:02.402796+0000","last_undegraded":"2022-04-03T21:50:02.402796+0000","last_fullsized":"2022-04-03T21:50:02.402796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:39:07.361273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436868+0000","last_change":"2022-04-03T21:50:02.431994+0000","last_active":"2022-04-03T21:50:02.436868+0000","last_peered":"2022-04-03T21:50:02.436868+0000","last_clean":"2022-04-03T21:50:02.436868+0000","last_became_active":"2022-04-03T21:50:02.431584+0000","last_became_peered":"2022-04-03T21:50:02.431584+0000","last_unstale":"2022-04-03T21:50:02.436868+0000","last_undegraded":"2022-04-03T21:50:02.436868+0000","last_fullsized":"2022-04-03T21:50:02.436868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:07:15.227915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408396+0000","last_change":"2022-04-03T21:49:57.866074+0000","last_active":"2022-04-03T21:50:02.408396+0000","last_peered":"2022-04-03T21:50:02.408396+0000","last_clean":"2022-04-03T21:50:02.408396+0000","last_became_active":"2022-04-03T21:49:57.865799+0000","last_became_peered":"2022-04-03T21:49:57.865799+0000","last_unstale":"2022-04-03T21:50:02.408396+0000","last_undegraded":"2022-04-03T21:50:02.408396+0000","last_fullsized":"2022-04-03T21:50:02.408396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:23:38.859645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410453+0000","last_change":"2022-04-03T21:49:58.412549+0000","last_active":"2022-04-03T21:50:02.410453+0000","last_peered":"2022-04-03T21:50:02.410453+0000","last_clean":"2022-04-03T21:50:02.410453+0000","last_became_active":"2022-04-03T21:49:58.412221+0000","last_became_peered":"2022-04-03T21:49:58.412221+0000","last_unstale":"2022-04-03T21:50:02.410453+0000","last_undegraded":"2022-04-03T21:50:02.410453+0000","last_fullsized":"2022-04-03T21:50:02.410453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:46:32.727120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.433553+0000","last_change":"2022-04-03T21:50:02.430727+0000","last_active":"2022-04-03T21:50:02.433553+0000","last_peered":"2022-04-03T21:50:02.433553+0000","last_clean":"2022-04-03T21:50:02.433553+0000","last_became_active":"2022-04-03T21:50:02.430293+0000","last_became_peered":"2022-04-03T21:50:02.430293+0000","last_unstale":"2022-04-03T21:50:02.433553+0000","last_undegraded":"2022-04-03T21:50:02.433553+0000","last_fullsized":"2022-04-03T21:50:02.433553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:12:45.221200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402025+0000","last_change":"2022-04-03T21:49:57.857793+0000","last_active":"2022-04-03T21:50:02.402025+0000","last_peered":"2022-04-03T21:50:02.402025+0000","last_clean":"2022-04-03T21:50:02.402025+0000","last_became_active":"2022-04-03T21:49:57.857477+0000","last_became_peered":"2022-04-03T21:49:57.857477+0000","last_unstale":"2022-04-03T21:50:02.402025+0000","last_undegraded":"2022-04-03T21:50:02.402025+0000","last_fullsized":"2022-04-03T21:50:02.402025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:58:12.643379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403732+0000","last_change":"2022-04-03T21:49:58.410021+0000","last_active":"2022-04-03T21:50:02.403732+0000","last_peered":"2022-04-03T21:50:02.403732+0000","last_clean":"2022-04-03T21:50:02.403732+0000","last_became_active":"2022-04-03T21:49:58.409644+0000","last_became_peered":"2022-04-03T21:49:58.409644+0000","last_unstale":"2022-04-03T21:50:02.403732+0000","last_undegraded":"2022-04-03T21:50:02.403732+0000","last_fullsized":"2022-04-03T21:50:02.403732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:26:07.839515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430122+0000","last_change":"2022-04-03T21:50:02.418006+0000","last_active":"2022-04-03T21:50:02.430122+0000","last_peered":"2022-04-03T21:50:02.430122+0000","last_clean":"2022-04-03T21:50:02.430122+0000","last_became_active":"2022-04-03T21:50:02.417522+0000","last_became_peered":"2022-04-03T21:50:02.417522+0000","last_unstale":"2022-04-03T21:50:02.430122+0000","last_undegraded":"2022-04-03T21:50:02.430122+0000","last_fullsized":"2022-04-03T21:50:02.430122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:40:39.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402342+0000","last_change":"2022-04-03T21:49:57.870805+0000","last_active":"2022-04-03T21:50:02.402342+0000","last_peered":"2022-04-03T21:50:02.402342+0000","last_clean":"2022-04-03T21:50:02.402342+0000","last_became_active":"2022-04-03T21:49:57.870504+0000","last_became_peered":"2022-04-03T21:49:57.870504+0000","last_unstale":"2022-04-03T21:50:02.402342+0000","last_undegraded":"2022-04-03T21:50:02.402342+0000","last_fullsized":"2022-04-03T21:50:02.402342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:41.062419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402628+0000","last_change":"2022-04-03T21:49:58.411420+0000","last_active":"2022-04-03T21:50:02.402628+0000","last_peered":"2022-04-03T21:50:02.402628+0000","last_clean":"2022-04-03T21:50:02.402628+0000","last_became_active":"2022-04-03T21:49:58.411046+0000","last_became_peered":"2022-04-03T21:49:58.411046+0000","last_unstale":"2022-04-03T21:50:02.402628+0000","last_undegraded":"2022-04-03T21:50:02.402628+0000","last_fullsized":"2022-04-03T21:50:02.402628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:59:39.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.439955+0000","last_change":"2022-04-03T21:50:02.438123+0000","last_active":"2022-04-03T21:50:02.439955+0000","last_peered":"2022-04-03T21:50:02.439955+0000","last_clean":"2022-04-03T21:50:02.439955+0000","last_became_active":"2022-04-03T21:50:02.437671+0000","last_became_peered":"2022-04-03T21:50:02.437671+0000","last_unstale":"2022-04-03T21:50:02.439955+0000","last_undegraded":"2022-04-03T21:50:02.439955+0000","last_fullsized":"2022-04-03T21:50:02.439955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:02:58.397104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.407995+0000","last_change":"2022-04-03T21:49:57.874098+0000","last_active":"2022-04-03T21:50:02.407995+0000","last_peered":"2022-04-03T21:50:02.407995+0000","last_clean":"2022-04-03T21:50:02.407995+0000","last_became_active":"2022-04-03T21:49:57.873819+0000","last_became_peered":"2022-04-03T21:49:57.873819+0000","last_unstale":"2022-04-03T21:50:02.407995+0000","last_undegraded":"2022-04-03T21:50:02.407995+0000","last_fullsized":"2022-04-03T21:50:02.407995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:24.770645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408357+0000","last_change":"2022-04-03T21:49:58.422605+0000","last_active":"2022-04-03T21:50:02.408357+0000","last_peered":"2022-04-03T21:50:02.408357+0000","last_clean":"2022-04-03T21:50:02.408357+0000","last_became_active":"2022-04-03T21:49:58.422247+0000","last_became_peered":"2022-04-03T21:49:58.422247+0000","last_unstale":"2022-04-03T21:50:02.408357+0000","last_undegraded":"2022-04-03T21:50:02.408357+0000","last_fullsized":"2022-04-03T21:50:02.408357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:52:30.833260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423978+0000","last_change":"2022-04-03T21:50:02.422574+0000","last_active":"2022-04-03T21:50:02.423978+0000","last_peered":"2022-04-03T21:50:02.423978+0000","last_clean":"2022-04-03T21:50:02.423978+0000","last_became_active":"2022-04-03T21:50:02.422108+0000","last_became_peered":"2022-04-03T21:50:02.422108+0000","last_unstale":"2022-04-03T21:50:02.423978+0000","last_undegraded":"2022-04-03T21:50:02.423978+0000","last_fullsized":"2022-04-03T21:50:02.423978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:38:20.285542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421113+0000","last_change":"2022-04-03T21:49:57.862891+0000","last_active":"2022-04-03T21:50:02.421113+0000","last_peered":"2022-04-03T21:50:02.421113+0000","last_clean":"2022-04-03T21:50:02.421113+0000","last_became_active":"2022-04-03T21:49:57.862595+0000","last_became_peered":"2022-04-03T21:49:57.862595+0000","last_unstale":"2022-04-03T21:50:02.421113+0000","last_undegraded":"2022-04-03T21:50:02.421113+0000","last_fullsized":"2022-04-03T21:50:02.421113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:26:38.267269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405207+0000","last_change":"2022-04-03T21:49:58.405688+0000","last_active":"2022-04-03T21:50:02.405207+0000","last_peered":"2022-04-03T21:50:02.405207+0000","last_clean":"2022-04-03T21:50:02.405207+0000","last_became_active":"2022-04-03T21:49:58.405370+0000","last_became_peered":"2022-04-03T21:49:58.405370+0000","last_unstale":"2022-04-03T21:50:02.405207+0000","last_undegraded":"2022-04-03T21:50:02.405207+0000","last_fullsized":"2022-04-03T21:50:02.405207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:08:21.661666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430526+0000","last_change":"2022-04-03T21:50:02.426303+0000","last_active":"2022-04-03T21:50:02.430526+0000","last_peered":"2022-04-03T21:50:02.430526+0000","last_clean":"2022-04-03T21:50:02.430526+0000","last_became_active":"2022-04-03T21:50:02.425881+0000","last_became_peered":"2022-04-03T21:50:02.425881+0000","last_unstale":"2022-04-03T21:50:02.430526+0000","last_undegraded":"2022-04-03T21:50:02.430526+0000","last_fullsized":"2022-04-03T21:50:02.430526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:53:47.423488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2022-04-03T21:50:09.390123+0000","last_change":"2022-04-03T21:49:57.874385+0000","last_active":"2022-04-03T21:50:09.390123+0000","last_peered":"2022-04-03T21:50:09.390123+0000","last_clean":"2022-04-03T21:50:09.390123+0000","last_became_active":"2022-04-03T21:49:57.874015+0000","last_became_peered":"2022-04-03T21:49:57.874015+0000","last_unstale":"2022-04-03T21:50:09.390123+0000","last_undegraded":"2022-04-03T21:50:09.390123+0000","last_fullsized":"2022-04-03T21:50:09.390123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:15:01.392538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3748,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410683+0000","last_change":"2022-04-03T21:49:58.400492+0000","last_active":"2022-04-03T21:50:02.410683+0000","last_peered":"2022-04-03T21:50:02.410683+0000","last_clean":"2022-04-03T21:50:02.410683+0000","last_became_active":"2022-04-03T21:49:58.400197+0000","last_became_peered":"2022-04-03T21:49:58.400197+0000","last_unstale":"2022-04-03T21:50:02.410683+0000","last_undegraded":"2022-04-03T21:50:02.410683+0000","last_fullsized":"2022-04-03T21:50:02.410683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:33:29.265331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442907+0000","last_change":"2022-04-03T21:50:02.440881+0000","last_active":"2022-04-03T21:50:02.442907+0000","last_peered":"2022-04-03T21:50:02.442907+0000","last_clean":"2022-04-03T21:50:02.442907+0000","last_became_active":"2022-04-03T21:50:02.440422+0000","last_became_peered":"2022-04-03T21:50:02.440422+0000","last_unstale":"2022-04-03T21:50:02.442907+0000","last_undegraded":"2022-04-03T21:50:02.442907+0000","last_fullsized":"2022-04-03T21:50:02.442907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:42:18.529114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403406+0000","last_change":"2022-04-03T21:49:57.879838+0000","last_active":"2022-04-03T21:50:02.403406+0000","last_peered":"2022-04-03T21:50:02.403406+0000","last_clean":"2022-04-03T21:50:02.403406+0000","last_became_active":"2022-04-03T21:49:57.878024+0000","last_became_peered":"2022-04-03T21:49:57.878024+0000","last_unstale":"2022-04-03T21:50:02.403406+0000","last_undegraded":"2022-04-03T21:50:02.403406+0000","last_fullsized":"2022-04-03T21:50:02.403406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:47:30.622816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410468+0000","last_change":"2022-04-03T21:49:58.409677+0000","last_active":"2022-04-03T21:50:02.410468+0000","last_peered":"2022-04-03T21:50:02.410468+0000","last_clean":"2022-04-03T21:50:02.410468+0000","last_became_active":"2022-04-03T21:49:58.408823+0000","last_became_peered":"2022-04-03T21:49:58.408823+0000","last_unstale":"2022-04-03T21:50:02.410468+0000","last_undegraded":"2022-04-03T21:50:02.410468+0000","last_fullsized":"2022-04-03T21:50:02.410468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:29:30.293123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428383+0000","last_change":"2022-04-03T21:50:02.427323+0000","last_active":"2022-04-03T21:50:02.428383+0000","last_peered":"2022-04-03T21:50:02.428383+0000","last_clean":"2022-04-03T21:50:02.428383+0000","last_became_active":"2022-04-03T21:50:02.426904+0000","last_became_peered":"2022-04-03T21:50:02.426904+0000","last_unstale":"2022-04-03T21:50:02.428383+0000","last_undegraded":"2022-04-03T21:50:02.428383+0000","last_fullsized":"2022-04-03T21:50:02.428383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:17:10.401730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410537+0000","last_change":"2022-04-03T21:49:57.870926+0000","last_active":"2022-04-03T21:50:02.410537+0000","last_peered":"2022-04-03T21:50:02.410537+0000","last_clean":"2022-04-03T21:50:02.410537+0000","last_became_active":"2022-04-03T21:49:57.870492+0000","last_became_peered":"2022-04-03T21:49:57.870492+0000","last_unstale":"2022-04-03T21:50:02.410537+0000","last_undegraded":"2022-04-03T21:50:02.410537+0000","last_fullsized":"2022-04-03T21:50:02.410537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:13:31.021652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403960+0000","last_change":"2022-04-03T21:49:58.431705+0000","last_active":"2022-04-03T21:50:02.403960+0000","last_peered":"2022-04-03T21:50:02.403960+0000","last_clean":"2022-04-03T21:50:02.403960+0000","last_became_active":"2022-04-03T21:49:58.431415+0000","last_became_peered":"2022-04-03T21:49:58.431415+0000","last_unstale":"2022-04-03T21:50:02.403960+0000","last_undegraded":"2022-04-03T21:50:02.403960+0000","last_fullsized":"2022-04-03T21:50:02.403960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:33:36.410007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427780+0000","last_change":"2022-04-03T21:50:02.424166+0000","last_active":"2022-04-03T21:50:02.427780+0000","last_peered":"2022-04-03T21:50:02.427780+0000","last_clean":"2022-04-03T21:50:02.427780+0000","last_became_active":"2022-04-03T21:50:02.423793+0000","last_became_peered":"2022-04-03T21:50:02.423793+0000","last_unstale":"2022-04-03T21:50:02.427780+0000","last_undegraded":"2022-04-03T21:50:02.427780+0000","last_fullsized":"2022-04-03T21:50:02.427780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:34:55.173456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402364+0000","last_change":"2022-04-03T21:49:57.874464+0000","last_active":"2022-04-03T21:50:02.402364+0000","last_peered":"2022-04-03T21:50:02.402364+0000","last_clean":"2022-04-03T21:50:02.402364+0000","last_became_active":"2022-04-03T21:49:57.874181+0000","last_became_peered":"2022-04-03T21:49:57.874181+0000","last_unstale":"2022-04-03T21:50:02.402364+0000","last_undegraded":"2022-04-03T21:50:02.402364+0000","last_fullsized":"2022-04-03T21:50:02.402364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:51:13.600469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402062+0000","last_change":"2022-04-03T21:49:58.401185+0000","last_active":"2022-04-03T21:50:02.402062+0000","last_peered":"2022-04-03T21:50:02.402062+0000","last_clean":"2022-04-03T21:50:02.402062+0000","last_became_active":"2022-04-03T21:49:58.399966+0000","last_became_peered":"2022-04-03T21:49:58.399966+0000","last_unstale":"2022-04-03T21:50:02.402062+0000","last_undegraded":"2022-04-03T21:50:02.402062+0000","last_fullsized":"2022-04-03T21:50:02.402062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:43:46.604121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.437138+0000","last_change":"2022-04-03T21:50:02.432307+0000","last_active":"2022-04-03T21:50:02.437138+0000","last_peered":"2022-04-03T21:50:02.437138+0000","last_clean":"2022-04-03T21:50:02.437138+0000","last_became_active":"2022-04-03T21:50:02.431759+0000","last_became_peered":"2022-04-03T21:50:02.431759+0000","last_unstale":"2022-04-03T21:50:02.437138+0000","last_undegraded":"2022-04-03T21:50:02.437138+0000","last_fullsized":"2022-04-03T21:50:02.437138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:34:33.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411902+0000","last_change":"2022-04-03T21:49:57.864543+0000","last_active":"2022-04-03T21:50:02.411902+0000","last_peered":"2022-04-03T21:50:02.411902+0000","last_clean":"2022-04-03T21:50:02.411902+0000","last_became_active":"2022-04-03T21:49:57.864245+0000","last_became_peered":"2022-04-03T21:49:57.864245+0000","last_unstale":"2022-04-03T21:50:02.411902+0000","last_undegraded":"2022-04-03T21:50:02.411902+0000","last_fullsized":"2022-04-03T21:50:02.411902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:13:09.645048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402455+0000","last_change":"2022-04-03T21:49:58.419675+0000","last_active":"2022-04-03T21:50:02.402455+0000","last_peered":"2022-04-03T21:50:02.402455+0000","last_clean":"2022-04-03T21:50:02.402455+0000","last_became_active":"2022-04-03T21:49:58.419408+0000","last_became_peered":"2022-04-03T21:49:58.419408+0000","last_unstale":"2022-04-03T21:50:02.402455+0000","last_undegraded":"2022-04-03T21:50:02.402455+0000","last_fullsized":"2022-04-03T21:50:02.402455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:58:27.884413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.427854+0000","last_change":"2022-04-03T21:50:02.425159+0000","last_active":"2022-04-03T21:50:02.427854+0000","last_peered":"2022-04-03T21:50:02.427854+0000","last_clean":"2022-04-03T21:50:02.427854+0000","last_became_active":"2022-04-03T21:50:02.424677+0000","last_became_peered":"2022-04-03T21:50:02.424677+0000","last_unstale":"2022-04-03T21:50:02.427854+0000","last_undegraded":"2022-04-03T21:50:02.427854+0000","last_fullsized":"2022-04-03T21:50:02.427854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:29:48.470775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421719+0000","last_change":"2022-04-03T21:49:57.866686+0000","last_active":"2022-04-03T21:50:02.421719+0000","last_peered":"2022-04-03T21:50:02.421719+0000","last_clean":"2022-04-03T21:50:02.421719+0000","last_became_active":"2022-04-03T21:49:57.866364+0000","last_became_peered":"2022-04-03T21:49:57.866364+0000","last_unstale":"2022-04-03T21:50:02.421719+0000","last_undegraded":"2022-04-03T21:50:02.421719+0000","last_fullsized":"2022-04-03T21:50:02.421719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:46:41.508964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402396+0000","last_change":"2022-04-03T21:49:58.420292+0000","last_active":"2022-04-03T21:50:02.402396+0000","last_peered":"2022-04-03T21:50:02.402396+0000","last_clean":"2022-04-03T21:50:02.402396+0000","last_became_active":"2022-04-03T21:49:58.419956+0000","last_became_peered":"2022-04-03T21:49:58.419956+0000","last_unstale":"2022-04-03T21:50:02.402396+0000","last_undegraded":"2022-04-03T21:50:02.402396+0000","last_fullsized":"2022-04-03T21:50:02.402396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:44:23.380819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436661+0000","last_change":"2022-04-03T21:50:02.431629+0000","last_active":"2022-04-03T21:50:02.436661+0000","last_peered":"2022-04-03T21:50:02.436661+0000","last_clean":"2022-04-03T21:50:02.436661+0000","last_became_active":"2022-04-03T21:50:02.431173+0000","last_became_peered":"2022-04-03T21:50:02.431173+0000","last_unstale":"2022-04-03T21:50:02.436661+0000","last_undegraded":"2022-04-03T21:50:02.436661+0000","last_fullsized":"2022-04-03T21:50:02.436661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:01:44.215650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408111+0000","last_change":"2022-04-03T21:49:57.877939+0000","last_active":"2022-04-03T21:50:02.408111+0000","last_peered":"2022-04-03T21:50:02.408111+0000","last_clean":"2022-04-03T21:50:02.408111+0000","last_became_active":"2022-04-03T21:49:57.877643+0000","last_became_peered":"2022-04-03T21:49:57.877643+0000","last_unstale":"2022-04-03T21:50:02.408111+0000","last_undegraded":"2022-04-03T21:50:02.408111+0000","last_fullsized":"2022-04-03T21:50:02.408111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T21:50:27.024213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410699+0000","last_change":"2022-04-03T21:49:58.421021+0000","last_active":"2022-04-03T21:50:02.410699+0000","last_peered":"2022-04-03T21:50:02.410699+0000","last_clean":"2022-04-03T21:50:02.410699+0000","last_became_active":"2022-04-03T21:49:58.420734+0000","last_became_peered":"2022-04-03T21:49:58.420734+0000","last_unstale":"2022-04-03T21:50:02.410699+0000","last_undegraded":"2022-04-03T21:50:02.410699+0000","last_fullsized":"2022-04-03T21:50:02.410699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:06:06.386429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423569+0000","last_change":"2022-04-03T21:50:02.417211+0000","last_active":"2022-04-03T21:50:02.423569+0000","last_peered":"2022-04-03T21:50:02.423569+0000","last_clean":"2022-04-03T21:50:02.423569+0000","last_became_active":"2022-04-03T21:50:02.416783+0000","last_became_peered":"2022-04-03T21:50:02.416783+0000","last_unstale":"2022-04-03T21:50:02.423569+0000","last_undegraded":"2022-04-03T21:50:02.423569+0000","last_fullsized":"2022-04-03T21:50:02.423569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:41:11.749073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403561+0000","last_change":"2022-04-03T21:49:57.872889+0000","last_active":"2022-04-03T21:50:02.403561+0000","last_peered":"2022-04-03T21:50:02.403561+0000","last_clean":"2022-04-03T21:50:02.403561+0000","last_became_active":"2022-04-03T21:49:57.872509+0000","last_became_peered":"2022-04-03T21:49:57.872509+0000","last_unstale":"2022-04-03T21:50:02.403561+0000","last_undegraded":"2022-04-03T21:50:02.403561+0000","last_fullsized":"2022-04-03T21:50:02.403561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:42.092697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413818+0000","last_change":"2022-04-03T21:49:58.399849+0000","last_active":"2022-04-03T21:50:02.413818+0000","last_peered":"2022-04-03T21:50:02.413818+0000","last_clean":"2022-04-03T21:50:02.413818+0000","last_became_active":"2022-04-03T21:49:58.399407+0000","last_became_peered":"2022-04-03T21:49:58.399407+0000","last_unstale":"2022-04-03T21:50:02.413818+0000","last_undegraded":"2022-04-03T21:50:02.413818+0000","last_fullsized":"2022-04-03T21:50:02.413818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:53:35.065189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.426414+0000","last_change":"2022-04-03T21:50:02.420577+0000","last_active":"2022-04-03T21:50:02.426414+0000","last_peered":"2022-04-03T21:50:02.426414+0000","last_clean":"2022-04-03T21:50:02.426414+0000","last_became_active":"2022-04-03T21:50:02.420023+0000","last_became_peered":"2022-04-03T21:50:02.420023+0000","last_unstale":"2022-04-03T21:50:02.426414+0000","last_undegraded":"2022-04-03T21:50:02.426414+0000","last_fullsized":"2022-04-03T21:50:02.426414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:56:20.520369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421514+0000","last_change":"2022-04-03T21:49:57.870171+0000","last_active":"2022-04-03T21:50:02.421514+0000","last_peered":"2022-04-03T21:50:02.421514+0000","last_clean":"2022-04-03T21:50:02.421514+0000","last_became_active":"2022-04-03T21:49:57.869887+0000","last_became_peered":"2022-04-03T21:49:57.869887+0000","last_unstale":"2022-04-03T21:50:02.421514+0000","last_undegraded":"2022-04-03T21:50:02.421514+0000","last_fullsized":"2022-04-03T21:50:02.421514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:40:24.182014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402693+0000","last_change":"2022-04-03T21:49:58.405990+0000","last_active":"2022-04-03T21:50:02.402693+0000","last_peered":"2022-04-03T21:50:02.402693+0000","last_clean":"2022-04-03T21:50:02.402693+0000","last_became_active":"2022-04-03T21:49:58.405686+0000","last_became_peered":"2022-04-03T21:49:58.405686+0000","last_unstale":"2022-04-03T21:50:02.402693+0000","last_undegraded":"2022-04-03T21:50:02.402693+0000","last_fullsized":"2022-04-03T21:50:02.402693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:45:30.673697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.441865+0000","last_change":"2022-04-03T21:50:02.436451+0000","last_active":"2022-04-03T21:50:02.441865+0000","last_peered":"2022-04-03T21:50:02.441865+0000","last_clean":"2022-04-03T21:50:02.441865+0000","last_became_active":"2022-04-03T21:50:02.435998+0000","last_became_peered":"2022-04-03T21:50:02.435998+0000","last_unstale":"2022-04-03T21:50:02.441865+0000","last_undegraded":"2022-04-03T21:50:02.441865+0000","last_fullsized":"2022-04-03T21:50:02.441865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:14:56.243368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401643+0000","last_change":"2022-04-03T21:49:57.861968+0000","last_active":"2022-04-03T21:50:02.401643+0000","last_peered":"2022-04-03T21:50:02.401643+0000","last_clean":"2022-04-03T21:50:02.401643+0000","last_became_active":"2022-04-03T21:49:57.861649+0000","last_became_peered":"2022-04-03T21:49:57.861649+0000","last_unstale":"2022-04-03T21:50:02.401643+0000","last_undegraded":"2022-04-03T21:50:02.401643+0000","last_fullsized":"2022-04-03T21:50:02.401643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:32:27.620549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421422+0000","last_change":"2022-04-03T21:49:58.417874+0000","last_active":"2022-04-03T21:50:02.421422+0000","last_peered":"2022-04-03T21:50:02.421422+0000","last_clean":"2022-04-03T21:50:02.421422+0000","last_became_active":"2022-04-03T21:49:58.417587+0000","last_became_peered":"2022-04-03T21:49:58.417587+0000","last_unstale":"2022-04-03T21:50:02.421422+0000","last_undegraded":"2022-04-03T21:50:02.421422+0000","last_fullsized":"2022-04-03T21:50:02.421422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:47:14.137789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428059+0000","last_change":"2022-04-03T21:50:02.425963+0000","last_active":"2022-04-03T21:50:02.428059+0000","last_peered":"2022-04-03T21:50:02.428059+0000","last_clean":"2022-04-03T21:50:02.428059+0000","last_became_active":"2022-04-03T21:50:02.425586+0000","last_became_peered":"2022-04-03T21:50:02.425586+0000","last_unstale":"2022-04-03T21:50:02.428059+0000","last_undegraded":"2022-04-03T21:50:02.428059+0000","last_fullsized":"2022-04-03T21:50:02.428059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:10:13.345349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403465+0000","last_change":"2022-04-03T21:49:57.870476+0000","last_active":"2022-04-03T21:50:02.403465+0000","last_peered":"2022-04-03T21:50:02.403465+0000","last_clean":"2022-04-03T21:50:02.403465+0000","last_became_active":"2022-04-03T21:49:57.870009+0000","last_became_peered":"2022-04-03T21:49:57.870009+0000","last_unstale":"2022-04-03T21:50:02.403465+0000","last_undegraded":"2022-04-03T21:50:02.403465+0000","last_fullsized":"2022-04-03T21:50:02.403465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:49:42.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403872+0000","last_change":"2022-04-03T21:49:58.421450+0000","last_active":"2022-04-03T21:50:02.403872+0000","last_peered":"2022-04-03T21:50:02.403872+0000","last_clean":"2022-04-03T21:50:02.403872+0000","last_became_active":"2022-04-03T21:49:58.421054+0000","last_became_peered":"2022-04-03T21:49:58.421054+0000","last_unstale":"2022-04-03T21:50:02.403872+0000","last_undegraded":"2022-04-03T21:50:02.403872+0000","last_fullsized":"2022-04-03T21:50:02.403872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:47:29.054190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442528+0000","last_change":"2022-04-03T21:50:02.434190+0000","last_active":"2022-04-03T21:50:02.442528+0000","last_peered":"2022-04-03T21:50:02.442528+0000","last_clean":"2022-04-03T21:50:02.442528+0000","last_became_active":"2022-04-03T21:50:02.433666+0000","last_became_peered":"2022-04-03T21:50:02.433666+0000","last_unstale":"2022-04-03T21:50:02.442528+0000","last_undegraded":"2022-04-03T21:50:02.442528+0000","last_fullsized":"2022-04-03T21:50:02.442528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:08:46.909616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402471+0000","last_change":"2022-04-03T21:49:57.863462+0000","last_active":"2022-04-03T21:50:02.402471+0000","last_peered":"2022-04-03T21:50:02.402471+0000","last_clean":"2022-04-03T21:50:02.402471+0000","last_became_active":"2022-04-03T21:49:57.863170+0000","last_became_peered":"2022-04-03T21:49:57.863170+0000","last_unstale":"2022-04-03T21:50:02.402471+0000","last_undegraded":"2022-04-03T21:50:02.402471+0000","last_fullsized":"2022-04-03T21:50:02.402471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:38:02.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.408285+0000","last_change":"2022-04-03T21:49:58.401069+0000","last_active":"2022-04-03T21:50:02.408285+0000","last_peered":"2022-04-03T21:50:02.408285+0000","last_clean":"2022-04-03T21:50:02.408285+0000","last_became_active":"2022-04-03T21:49:58.400774+0000","last_became_peered":"2022-04-03T21:49:58.400774+0000","last_unstale":"2022-04-03T21:50:02.408285+0000","last_undegraded":"2022-04-03T21:50:02.408285+0000","last_fullsized":"2022-04-03T21:50:02.408285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:54.416490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429724+0000","last_change":"2022-04-03T21:50:02.420282+0000","last_active":"2022-04-03T21:50:02.429724+0000","last_peered":"2022-04-03T21:50:02.429724+0000","last_clean":"2022-04-03T21:50:02.429724+0000","last_became_active":"2022-04-03T21:50:02.419604+0000","last_became_peered":"2022-04-03T21:50:02.419604+0000","last_unstale":"2022-04-03T21:50:02.429724+0000","last_undegraded":"2022-04-03T21:50:02.429724+0000","last_fullsized":"2022-04-03T21:50:02.429724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:27:15.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406203+0000","last_change":"2022-04-03T21:49:57.859380+0000","last_active":"2022-04-03T21:50:02.406203+0000","last_peered":"2022-04-03T21:50:02.406203+0000","last_clean":"2022-04-03T21:50:02.406203+0000","last_became_active":"2022-04-03T21:49:57.859076+0000","last_became_peered":"2022-04-03T21:49:57.859076+0000","last_unstale":"2022-04-03T21:50:02.406203+0000","last_undegraded":"2022-04-03T21:50:02.406203+0000","last_fullsized":"2022-04-03T21:50:02.406203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:03:57.532989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401995+0000","last_change":"2022-04-03T21:49:58.408851+0000","last_active":"2022-04-03T21:50:02.401995+0000","last_peered":"2022-04-03T21:50:02.401995+0000","last_clean":"2022-04-03T21:50:02.401995+0000","last_became_active":"2022-04-03T21:49:58.408553+0000","last_became_peered":"2022-04-03T21:49:58.408553+0000","last_unstale":"2022-04-03T21:50:02.401995+0000","last_undegraded":"2022-04-03T21:50:02.401995+0000","last_fullsized":"2022-04-03T21:50:02.401995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:53:09.835987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.423992+0000","last_change":"2022-04-03T21:50:02.422611+0000","last_active":"2022-04-03T21:50:02.423992+0000","last_peered":"2022-04-03T21:50:02.423992+0000","last_clean":"2022-04-03T21:50:02.423992+0000","last_became_active":"2022-04-03T21:50:02.422088+0000","last_became_peered":"2022-04-03T21:50:02.422088+0000","last_unstale":"2022-04-03T21:50:02.423992+0000","last_undegraded":"2022-04-03T21:50:02.423992+0000","last_fullsized":"2022-04-03T21:50:02.423992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:34:54.875279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403638+0000","last_change":"2022-04-03T21:49:51.950055+0000","last_active":"2022-04-03T21:50:02.403638+0000","last_peered":"2022-04-03T21:50:02.403638+0000","last_clean":"2022-04-03T21:50:02.403638+0000","last_became_active":"2022-04-03T21:49:51.949793+0000","last_became_peered":"2022-04-03T21:49:51.949793+0000","last_unstale":"2022-04-03T21:50:02.403638+0000","last_undegraded":"2022-04-03T21:50:02.403638+0000","last_fullsized":"2022-04-03T21:50:02.403638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:44:29.449323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409897+0000","last_change":"2022-04-03T21:49:57.872925+0000","last_active":"2022-04-03T21:50:02.409897+0000","last_peered":"2022-04-03T21:50:02.409897+0000","last_clean":"2022-04-03T21:50:02.409897+0000","last_became_active":"2022-04-03T21:49:57.872490+0000","last_became_peered":"2022-04-03T21:49:57.872490+0000","last_unstale":"2022-04-03T21:50:02.409897+0000","last_undegraded":"2022-04-03T21:50:02.409897+0000","last_fullsized":"2022-04-03T21:50:02.409897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:57:45.485657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410378+0000","last_change":"2022-04-03T21:49:58.409467+0000","last_active":"2022-04-03T21:50:02.410378+0000","last_peered":"2022-04-03T21:50:02.410378+0000","last_clean":"2022-04-03T21:50:02.410378+0000","last_became_active":"2022-04-03T21:49:58.409155+0000","last_became_peered":"2022-04-03T21:49:58.409155+0000","last_unstale":"2022-04-03T21:50:02.410378+0000","last_undegraded":"2022-04-03T21:50:02.410378+0000","last_fullsized":"2022-04-03T21:50:02.410378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:33:31.770696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430528+0000","last_change":"2022-04-03T21:50:02.426029+0000","last_active":"2022-04-03T21:50:02.430528+0000","last_peered":"2022-04-03T21:50:02.430528+0000","last_clean":"2022-04-03T21:50:02.430528+0000","last_became_active":"2022-04-03T21:50:02.425589+0000","last_became_peered":"2022-04-03T21:50:02.425589+0000","last_unstale":"2022-04-03T21:50:02.430528+0000","last_undegraded":"2022-04-03T21:50:02.430528+0000","last_fullsized":"2022-04-03T21:50:02.430528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:38:10.958633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403666+0000","last_change":"2022-04-03T21:49:51.950513+0000","last_active":"2022-04-03T21:50:02.403666+0000","last_peered":"2022-04-03T21:50:02.403666+0000","last_clean":"2022-04-03T21:50:02.403666+0000","last_became_active":"2022-04-03T21:49:51.950013+0000","last_became_peered":"2022-04-03T21:49:51.950013+0000","last_unstale":"2022-04-03T21:50:02.403666+0000","last_undegraded":"2022-04-03T21:50:02.403666+0000","last_fullsized":"2022-04-03T21:50:02.403666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T08:08:28.113081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.422489+0000","last_change":"2022-04-03T21:49:57.874953+0000","last_active":"2022-04-03T21:50:02.422489+0000","last_peered":"2022-04-03T21:50:02.422489+0000","last_clean":"2022-04-03T21:50:02.422489+0000","last_became_active":"2022-04-03T21:49:57.874653+0000","last_became_peered":"2022-04-03T21:49:57.874653+0000","last_unstale":"2022-04-03T21:50:02.422489+0000","last_undegraded":"2022-04-03T21:50:02.422489+0000","last_fullsized":"2022-04-03T21:50:02.422489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:18:20.066652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410625+0000","last_change":"2022-04-03T21:49:58.405360+0000","last_active":"2022-04-03T21:50:02.410625+0000","last_peered":"2022-04-03T21:50:02.410625+0000","last_clean":"2022-04-03T21:50:02.410625+0000","last_became_active":"2022-04-03T21:49:58.405077+0000","last_became_peered":"2022-04-03T21:49:58.405077+0000","last_unstale":"2022-04-03T21:50:02.410625+0000","last_undegraded":"2022-04-03T21:50:02.410625+0000","last_fullsized":"2022-04-03T21:50:02.410625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:50:01.996625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436762+0000","last_change":"2022-04-03T21:50:02.431834+0000","last_active":"2022-04-03T21:50:02.436762+0000","last_peered":"2022-04-03T21:50:02.436762+0000","last_clean":"2022-04-03T21:50:02.436762+0000","last_became_active":"2022-04-03T21:50:02.431250+0000","last_became_peered":"2022-04-03T21:50:02.431250+0000","last_unstale":"2022-04-03T21:50:02.436762+0000","last_undegraded":"2022-04-03T21:50:02.436762+0000","last_fullsized":"2022-04-03T21:50:02.436762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:32:53.927418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401614+0000","last_change":"2022-04-03T21:49:51.825451+0000","last_active":"2022-04-03T21:50:02.401614+0000","last_peered":"2022-04-03T21:50:02.401614+0000","last_clean":"2022-04-03T21:50:02.401614+0000","last_became_active":"2022-04-03T21:49:51.825101+0000","last_became_peered":"2022-04-03T21:49:51.825101+0000","last_unstale":"2022-04-03T21:50:02.401614+0000","last_undegraded":"2022-04-03T21:50:02.401614+0000","last_fullsized":"2022-04-03T21:50:02.401614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:14:58.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401859+0000","last_change":"2022-04-03T21:49:57.855929+0000","last_active":"2022-04-03T21:50:02.401859+0000","last_peered":"2022-04-03T21:50:02.401859+0000","last_clean":"2022-04-03T21:50:02.401859+0000","last_became_active":"2022-04-03T21:49:57.855618+0000","last_became_peered":"2022-04-03T21:49:57.855618+0000","last_unstale":"2022-04-03T21:50:02.401859+0000","last_undegraded":"2022-04-03T21:50:02.401859+0000","last_fullsized":"2022-04-03T21:50:02.401859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:30:15.342644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415411+0000","last_change":"2022-04-03T21:49:58.422027+0000","last_active":"2022-04-03T21:50:02.415411+0000","last_peered":"2022-04-03T21:50:02.415411+0000","last_clean":"2022-04-03T21:50:02.415411+0000","last_became_active":"2022-04-03T21:49:58.421718+0000","last_became_peered":"2022-04-03T21:49:58.421718+0000","last_unstale":"2022-04-03T21:50:02.415411+0000","last_undegraded":"2022-04-03T21:50:02.415411+0000","last_fullsized":"2022-04-03T21:50:02.415411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:15:09.949180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442797+0000","last_change":"2022-04-03T21:50:02.432280+0000","last_active":"2022-04-03T21:50:02.442797+0000","last_peered":"2022-04-03T21:50:02.442797+0000","last_clean":"2022-04-03T21:50:02.442797+0000","last_became_active":"2022-04-03T21:50:02.431805+0000","last_became_peered":"2022-04-03T21:50:02.431805+0000","last_unstale":"2022-04-03T21:50:02.442797+0000","last_undegraded":"2022-04-03T21:50:02.442797+0000","last_fullsized":"2022-04-03T21:50:02.442797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:33.634032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403212+0000","last_change":"2022-04-03T21:49:51.824294+0000","last_active":"2022-04-03T21:50:02.403212+0000","last_peered":"2022-04-03T21:50:02.403212+0000","last_clean":"2022-04-03T21:50:02.403212+0000","last_became_active":"2022-04-03T21:49:51.823893+0000","last_became_peered":"2022-04-03T21:49:51.823893+0000","last_unstale":"2022-04-03T21:50:02.403212+0000","last_undegraded":"2022-04-03T21:50:02.403212+0000","last_fullsized":"2022-04-03T21:50:02.403212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:36:52.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411821+0000","last_change":"2022-04-03T21:49:43.747755+0000","last_active":"2022-04-03T21:50:02.411821+0000","last_peered":"2022-04-03T21:50:02.411821+0000","last_clean":"2022-04-03T21:50:02.411821+0000","last_became_active":"2022-04-03T21:49:43.747384+0000","last_became_peered":"2022-04-03T21:49:43.747384+0000","last_unstale":"2022-04-03T21:50:02.411821+0000","last_undegraded":"2022-04-03T21:50:02.411821+0000","last_fullsized":"2022-04-03T21:50:02.411821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:42.736782+0000","last_clean_scrub_stamp":"2022-04-03T21:49:42.736782+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:38:50.071231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405095+0000","last_change":"2022-04-03T21:49:57.873204+0000","last_active":"2022-04-03T21:50:02.405095+0000","last_peered":"2022-04-03T21:50:02.405095+0000","last_clean":"2022-04-03T21:50:02.405095+0000","last_became_active":"2022-04-03T21:49:57.872943+0000","last_became_peered":"2022-04-03T21:49:57.872943+0000","last_unstale":"2022-04-03T21:50:02.405095+0000","last_undegraded":"2022-04-03T21:50:02.405095+0000","last_fullsized":"2022-04-03T21:50:02.405095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:40:34.165717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403936+0000","last_change":"2022-04-03T21:49:58.421243+0000","last_active":"2022-04-03T21:50:02.403936+0000","last_peered":"2022-04-03T21:50:02.403936+0000","last_clean":"2022-04-03T21:50:02.403936+0000","last_became_active":"2022-04-03T21:49:58.420761+0000","last_became_peered":"2022-04-03T21:49:58.420761+0000","last_unstale":"2022-04-03T21:50:02.403936+0000","last_undegraded":"2022-04-03T21:50:02.403936+0000","last_fullsized":"2022-04-03T21:50:02.403936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:06:23.093381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.429963+0000","last_change":"2022-04-03T21:50:02.424398+0000","last_active":"2022-04-03T21:50:02.429963+0000","last_peered":"2022-04-03T21:50:02.429963+0000","last_clean":"2022-04-03T21:50:02.429963+0000","last_became_active":"2022-04-03T21:50:02.423977+0000","last_became_peered":"2022-04-03T21:50:02.423977+0000","last_unstale":"2022-04-03T21:50:02.429963+0000","last_undegraded":"2022-04-03T21:50:02.429963+0000","last_fullsized":"2022-04-03T21:50:02.429963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:42:14.704158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402275+0000","last_change":"2022-04-03T21:49:51.825761+0000","last_active":"2022-04-03T21:50:02.402275+0000","last_peered":"2022-04-03T21:50:02.402275+0000","last_clean":"2022-04-03T21:50:02.402275+0000","last_became_active":"2022-04-03T21:49:51.825341+0000","last_became_peered":"2022-04-03T21:49:51.825341+0000","last_unstale":"2022-04-03T21:50:02.402275+0000","last_undegraded":"2022-04-03T21:50:02.402275+0000","last_fullsized":"2022-04-03T21:50:02.402275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:05:18.628185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410188+0000","last_change":"2022-04-03T21:49:57.873682+0000","last_active":"2022-04-03T21:50:02.410188+0000","last_peered":"2022-04-03T21:50:02.410188+0000","last_clean":"2022-04-03T21:50:02.410188+0000","last_became_active":"2022-04-03T21:49:57.873471+0000","last_became_peered":"2022-04-03T21:49:57.873471+0000","last_unstale":"2022-04-03T21:50:02.410188+0000","last_undegraded":"2022-04-03T21:50:02.410188+0000","last_fullsized":"2022-04-03T21:50:02.410188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:49:58.621137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402322+0000","last_change":"2022-04-03T21:49:58.400547+0000","last_active":"2022-04-03T21:50:02.402322+0000","last_peered":"2022-04-03T21:50:02.402322+0000","last_clean":"2022-04-03T21:50:02.402322+0000","last_became_active":"2022-04-03T21:49:58.399645+0000","last_became_peered":"2022-04-03T21:49:58.399645+0000","last_unstale":"2022-04-03T21:50:02.402322+0000","last_undegraded":"2022-04-03T21:50:02.402322+0000","last_fullsized":"2022-04-03T21:50:02.402322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T05:11:49.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.443304+0000","last_change":"2022-04-03T21:50:02.441051+0000","last_active":"2022-04-03T21:50:02.443304+0000","last_peered":"2022-04-03T21:50:02.443304+0000","last_clean":"2022-04-03T21:50:02.443304+0000","last_became_active":"2022-04-03T21:50:02.440145+0000","last_became_peered":"2022-04-03T21:50:02.440145+0000","last_unstale":"2022-04-03T21:50:02.443304+0000","last_undegraded":"2022-04-03T21:50:02.443304+0000","last_fullsized":"2022-04-03T21:50:02.443304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:27:48.125856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403762+0000","last_change":"2022-04-03T21:49:51.823192+0000","last_active":"2022-04-03T21:50:02.403762+0000","last_peered":"2022-04-03T21:50:02.403762+0000","last_clean":"2022-04-03T21:50:02.403762+0000","last_became_active":"2022-04-03T21:49:51.822812+0000","last_became_peered":"2022-04-03T21:49:51.822812+0000","last_unstale":"2022-04-03T21:50:02.403762+0000","last_undegraded":"2022-04-03T21:50:02.403762+0000","last_fullsized":"2022-04-03T21:50:02.403762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:56:34.679337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.415772+0000","last_change":"2022-04-03T21:49:57.860388+0000","last_active":"2022-04-03T21:50:02.415772+0000","last_peered":"2022-04-03T21:50:02.415772+0000","last_clean":"2022-04-03T21:50:02.415772+0000","last_became_active":"2022-04-03T21:49:57.860088+0000","last_became_peered":"2022-04-03T21:49:57.860088+0000","last_unstale":"2022-04-03T21:50:02.415772+0000","last_undegraded":"2022-04-03T21:50:02.415772+0000","last_fullsized":"2022-04-03T21:50:02.415772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:52:22.536814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.414020+0000","last_change":"2022-04-03T21:49:58.422161+0000","last_active":"2022-04-03T21:50:02.414020+0000","last_peered":"2022-04-03T21:50:02.414020+0000","last_clean":"2022-04-03T21:50:02.414020+0000","last_became_active":"2022-04-03T21:49:58.421791+0000","last_became_peered":"2022-04-03T21:49:58.421791+0000","last_unstale":"2022-04-03T21:50:02.414020+0000","last_undegraded":"2022-04-03T21:50:02.414020+0000","last_fullsized":"2022-04-03T21:50:02.414020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:07:16.740793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.430144+0000","last_change":"2022-04-03T21:50:02.421849+0000","last_active":"2022-04-03T21:50:02.430144+0000","last_peered":"2022-04-03T21:50:02.430144+0000","last_clean":"2022-04-03T21:50:02.430144+0000","last_became_active":"2022-04-03T21:50:02.421341+0000","last_became_peered":"2022-04-03T21:50:02.421341+0000","last_unstale":"2022-04-03T21:50:02.430144+0000","last_undegraded":"2022-04-03T21:50:02.430144+0000","last_fullsized":"2022-04-03T21:50:02.430144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:27:53.495587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409689+0000","last_change":"2022-04-03T21:49:57.863910+0000","last_active":"2022-04-03T21:50:02.409689+0000","last_peered":"2022-04-03T21:50:02.409689+0000","last_clean":"2022-04-03T21:50:02.409689+0000","last_became_active":"2022-04-03T21:49:57.863574+0000","last_became_peered":"2022-04-03T21:49:57.863574+0000","last_unstale":"2022-04-03T21:50:02.409689+0000","last_undegraded":"2022-04-03T21:50:02.409689+0000","last_fullsized":"2022-04-03T21:50:02.409689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:13:36.699731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410534+0000","last_change":"2022-04-03T21:49:52.057999+0000","last_active":"2022-04-03T21:50:02.410534+0000","last_peered":"2022-04-03T21:50:02.410534+0000","last_clean":"2022-04-03T21:50:02.410534+0000","last_became_active":"2022-04-03T21:49:52.057739+0000","last_became_peered":"2022-04-03T21:49:52.057739+0000","last_unstale":"2022-04-03T21:50:02.410534+0000","last_undegraded":"2022-04-03T21:50:02.410534+0000","last_fullsized":"2022-04-03T21:50:02.410534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:44:05.676474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405131+0000","last_change":"2022-04-03T21:49:58.412468+0000","last_active":"2022-04-03T21:50:02.405131+0000","last_peered":"2022-04-03T21:50:02.405131+0000","last_clean":"2022-04-03T21:50:02.405131+0000","last_became_active":"2022-04-03T21:49:58.412157+0000","last_became_peered":"2022-04-03T21:49:58.412157+0000","last_unstale":"2022-04-03T21:50:02.405131+0000","last_undegraded":"2022-04-03T21:50:02.405131+0000","last_fullsized":"2022-04-03T21:50:02.405131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T02:49:22.481343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.418110+0000","last_change":"2022-04-03T21:50:02.416690+0000","last_active":"2022-04-03T21:50:02.418110+0000","last_peered":"2022-04-03T21:50:02.418110+0000","last_clean":"2022-04-03T21:50:02.418110+0000","last_became_active":"2022-04-03T21:50:02.416202+0000","last_became_peered":"2022-04-03T21:50:02.416202+0000","last_unstale":"2022-04-03T21:50:02.418110+0000","last_undegraded":"2022-04-03T21:50:02.418110+0000","last_fullsized":"2022-04-03T21:50:02.418110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:35:47.291508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403609+0000","last_change":"2022-04-03T21:49:52.058292+0000","last_active":"2022-04-03T21:50:02.403609+0000","last_peered":"2022-04-03T21:50:02.403609+0000","last_clean":"2022-04-03T21:50:02.403609+0000","last_became_active":"2022-04-03T21:49:52.057769+0000","last_became_peered":"2022-04-03T21:49:52.057769+0000","last_unstale":"2022-04-03T21:50:02.403609+0000","last_undegraded":"2022-04-03T21:50:02.403609+0000","last_fullsized":"2022-04-03T21:50:02.403609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:50.807268+0000","last_clean_scrub_stamp":"2022-04-03T21:49:50.807268+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:10:19.197449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410357+0000","last_change":"2022-04-03T21:49:57.858802+0000","last_active":"2022-04-03T21:50:02.410357+0000","last_peered":"2022-04-03T21:50:02.410357+0000","last_clean":"2022-04-03T21:50:02.410357+0000","last_became_active":"2022-04-03T21:49:57.858491+0000","last_became_peered":"2022-04-03T21:49:57.858491+0000","last_unstale":"2022-04-03T21:50:02.410357+0000","last_undegraded":"2022-04-03T21:50:02.410357+0000","last_fullsized":"2022-04-03T21:50:02.410357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:18:02.365918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.409115+0000","last_change":"2022-04-03T21:49:58.400587+0000","last_active":"2022-04-03T21:50:02.409115+0000","last_peered":"2022-04-03T21:50:02.409115+0000","last_clean":"2022-04-03T21:50:02.409115+0000","last_became_active":"2022-04-03T21:49:58.400277+0000","last_became_peered":"2022-04-03T21:49:58.400277+0000","last_unstale":"2022-04-03T21:50:02.409115+0000","last_undegraded":"2022-04-03T21:50:02.409115+0000","last_fullsized":"2022-04-03T21:50:02.409115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:17:55.722041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.428327+0000","last_change":"2022-04-03T21:50:02.424828+0000","last_active":"2022-04-03T21:50:02.428327+0000","last_peered":"2022-04-03T21:50:02.428327+0000","last_clean":"2022-04-03T21:50:02.428327+0000","last_became_active":"2022-04-03T21:50:02.424406+0000","last_became_peered":"2022-04-03T21:50:02.424406+0000","last_unstale":"2022-04-03T21:50:02.428327+0000","last_undegraded":"2022-04-03T21:50:02.428327+0000","last_fullsized":"2022-04-03T21:50:02.428327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:17:45.759593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.405778+0000","last_change":"2022-04-03T21:49:57.870766+0000","last_active":"2022-04-03T21:50:02.405778+0000","last_peered":"2022-04-03T21:50:02.405778+0000","last_clean":"2022-04-03T21:50:02.405778+0000","last_became_active":"2022-04-03T21:49:57.870481+0000","last_became_peered":"2022-04-03T21:49:57.870481+0000","last_unstale":"2022-04-03T21:50:02.405778+0000","last_undegraded":"2022-04-03T21:50:02.405778+0000","last_fullsized":"2022-04-03T21:50:02.405778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:35:17.100943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.406335+0000","last_change":"2022-04-03T21:49:58.402346+0000","last_active":"2022-04-03T21:50:02.406335+0000","last_peered":"2022-04-03T21:50:02.406335+0000","last_clean":"2022-04-03T21:50:02.406335+0000","last_became_active":"2022-04-03T21:49:58.401964+0000","last_became_peered":"2022-04-03T21:49:58.401964+0000","last_unstale":"2022-04-03T21:50:02.406335+0000","last_undegraded":"2022-04-03T21:50:02.406335+0000","last_fullsized":"2022-04-03T21:50:02.406335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T06:15:23.150292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442587+0000","last_change":"2022-04-03T21:50:02.436307+0000","last_active":"2022-04-03T21:50:02.442587+0000","last_peered":"2022-04-03T21:50:02.442587+0000","last_clean":"2022-04-03T21:50:02.442587+0000","last_became_active":"2022-04-03T21:50:02.435842+0000","last_became_peered":"2022-04-03T21:50:02.435842+0000","last_unstale":"2022-04-03T21:50:02.442587+0000","last_undegraded":"2022-04-03T21:50:02.442587+0000","last_fullsized":"2022-04-03T21:50:02.442587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:28:23.964940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413356+0000","last_change":"2022-04-03T21:49:57.873350+0000","last_active":"2022-04-03T21:50:02.413356+0000","last_peered":"2022-04-03T21:50:02.413356+0000","last_clean":"2022-04-03T21:50:02.413356+0000","last_became_active":"2022-04-03T21:49:57.873001+0000","last_became_peered":"2022-04-03T21:49:57.873001+0000","last_unstale":"2022-04-03T21:50:02.413356+0000","last_undegraded":"2022-04-03T21:50:02.413356+0000","last_fullsized":"2022-04-03T21:50:02.413356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T04:38:09.203088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410774+0000","last_change":"2022-04-03T21:49:58.415091+0000","last_active":"2022-04-03T21:50:02.410774+0000","last_peered":"2022-04-03T21:50:02.410774+0000","last_clean":"2022-04-03T21:50:02.410774+0000","last_became_active":"2022-04-03T21:49:58.414804+0000","last_became_peered":"2022-04-03T21:49:58.414804+0000","last_unstale":"2022-04-03T21:50:02.410774+0000","last_undegraded":"2022-04-03T21:50:02.410774+0000","last_fullsized":"2022-04-03T21:50:02.410774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T22:32:09.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436838+0000","last_change":"2022-04-03T21:50:02.431066+0000","last_active":"2022-04-03T21:50:02.436838+0000","last_peered":"2022-04-03T21:50:02.436838+0000","last_clean":"2022-04-03T21:50:02.436838+0000","last_became_active":"2022-04-03T21:50:02.430674+0000","last_became_peered":"2022-04-03T21:50:02.430674+0000","last_unstale":"2022-04-03T21:50:02.436838+0000","last_undegraded":"2022-04-03T21:50:02.436838+0000","last_fullsized":"2022-04-03T21:50:02.436838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:55:33.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403806+0000","last_change":"2022-04-03T21:49:57.878346+0000","last_active":"2022-04-03T21:50:02.403806+0000","last_peered":"2022-04-03T21:50:02.403806+0000","last_clean":"2022-04-03T21:50:02.403806+0000","last_became_active":"2022-04-03T21:49:57.877994+0000","last_became_peered":"2022-04-03T21:49:57.877994+0000","last_unstale":"2022-04-03T21:50:02.403806+0000","last_undegraded":"2022-04-03T21:50:02.403806+0000","last_fullsized":"2022-04-03T21:50:02.403806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:59:05.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.413728+0000","last_change":"2022-04-03T21:49:58.402592+0000","last_active":"2022-04-03T21:50:02.413728+0000","last_peered":"2022-04-03T21:50:02.413728+0000","last_clean":"2022-04-03T21:50:02.413728+0000","last_became_active":"2022-04-03T21:49:58.402288+0000","last_became_peered":"2022-04-03T21:49:58.402288+0000","last_unstale":"2022-04-03T21:50:02.413728+0000","last_undegraded":"2022-04-03T21:50:02.413728+0000","last_fullsized":"2022-04-03T21:50:02.413728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:06:07.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.442588+0000","last_change":"2022-04-03T21:50:02.434794+0000","last_active":"2022-04-03T21:50:02.442588+0000","last_peered":"2022-04-03T21:50:02.442588+0000","last_clean":"2022-04-03T21:50:02.442588+0000","last_became_active":"2022-04-03T21:50:02.434307+0000","last_became_peered":"2022-04-03T21:50:02.434307+0000","last_unstale":"2022-04-03T21:50:02.442588+0000","last_undegraded":"2022-04-03T21:50:02.442588+0000","last_fullsized":"2022-04-03T21:50:02.442588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:05:48.587273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402186+0000","last_change":"2022-04-03T21:49:57.872939+0000","last_active":"2022-04-03T21:50:02.402186+0000","last_peered":"2022-04-03T21:50:02.402186+0000","last_clean":"2022-04-03T21:50:02.402186+0000","last_became_active":"2022-04-03T21:49:57.872688+0000","last_became_peered":"2022-04-03T21:49:57.872688+0000","last_unstale":"2022-04-03T21:50:02.402186+0000","last_undegraded":"2022-04-03T21:50:02.402186+0000","last_fullsized":"2022-04-03T21:50:02.402186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T03:19:57.738611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.401722+0000","last_change":"2022-04-03T21:49:58.405063+0000","last_active":"2022-04-03T21:50:02.401722+0000","last_peered":"2022-04-03T21:50:02.401722+0000","last_clean":"2022-04-03T21:50:02.401722+0000","last_became_active":"2022-04-03T21:49:58.404738+0000","last_became_peered":"2022-04-03T21:49:58.404738+0000","last_unstale":"2022-04-03T21:50:02.401722+0000","last_undegraded":"2022-04-03T21:50:02.401722+0000","last_fullsized":"2022-04-03T21:50:02.401722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:14:24.585390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.436350+0000","last_change":"2022-04-03T21:50:02.429562+0000","last_active":"2022-04-03T21:50:02.436350+0000","last_peered":"2022-04-03T21:50:02.436350+0000","last_clean":"2022-04-03T21:50:02.436350+0000","last_became_active":"2022-04-03T21:50:02.429153+0000","last_became_peered":"2022-04-03T21:50:02.429153+0000","last_unstale":"2022-04-03T21:50:02.436350+0000","last_undegraded":"2022-04-03T21:50:02.436350+0000","last_fullsized":"2022-04-03T21:50:02.436350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:50:01.393499+0000","last_clean_scrub_stamp":"2022-04-03T21:50:01.393499+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-04T23:23:56.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402210+0000","last_change":"2022-04-03T21:49:57.865475+0000","last_active":"2022-04-03T21:50:02.402210+0000","last_peered":"2022-04-03T21:50:02.402210+0000","last_clean":"2022-04-03T21:50:02.402210+0000","last_became_active":"2022-04-03T21:49:57.865147+0000","last_became_peered":"2022-04-03T21:49:57.865147+0000","last_unstale":"2022-04-03T21:50:02.402210+0000","last_undegraded":"2022-04-03T21:50:02.402210+0000","last_fullsized":"2022-04-03T21:50:02.402210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:56.833369+0000","last_clean_scrub_stamp":"2022-04-03T21:49:56.833369+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:47:33.277925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411366+0000","last_change":"2022-04-03T21:49:58.407938+0000","last_active":"2022-04-03T21:50:02.411366+0000","last_peered":"2022-04-03T21:50:02.411366+0000","last_clean":"2022-04-03T21:50:02.411366+0000","last_became_active":"2022-04-03T21:49:58.407645+0000","last_became_peered":"2022-04-03T21:49:58.407645+0000","last_unstale":"2022-04-03T21:50:02.411366+0000","last_undegraded":"2022-04-03T21:50:02.411366+0000","last_fullsized":"2022-04-03T21:50:02.411366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:26:23.145355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.411975+0000","last_change":"2022-04-03T21:49:58.417116+0000","last_active":"2022-04-03T21:50:02.411975+0000","last_peered":"2022-04-03T21:50:02.411975+0000","last_clean":"2022-04-03T21:50:02.411975+0000","last_became_active":"2022-04-03T21:49:58.416601+0000","last_became_peered":"2022-04-03T21:49:58.416601+0000","last_unstale":"2022-04-03T21:50:02.411975+0000","last_undegraded":"2022-04-03T21:50:02.411975+0000","last_fullsized":"2022-04-03T21:50:02.411975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T09:48:21.551919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.410282+0000","last_change":"2022-04-03T21:49:58.406506+0000","last_active":"2022-04-03T21:50:02.410282+0000","last_peered":"2022-04-03T21:50:02.410282+0000","last_clean":"2022-04-03T21:50:02.410282+0000","last_became_active":"2022-04-03T21:49:58.406217+0000","last_became_peered":"2022-04-03T21:49:58.406217+0000","last_unstale":"2022-04-03T21:50:02.410282+0000","last_undegraded":"2022-04-03T21:50:02.410282+0000","last_fullsized":"2022-04-03T21:50:02.410282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T07:24:30.050855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.421819+0000","last_change":"2022-04-03T21:49:58.424077+0000","last_active":"2022-04-03T21:50:02.421819+0000","last_peered":"2022-04-03T21:50:02.421819+0000","last_clean":"2022-04-03T21:50:02.421819+0000","last_became_active":"2022-04-03T21:49:58.423709+0000","last_became_peered":"2022-04-03T21:49:58.423709+0000","last_unstale":"2022-04-03T21:50:02.421819+0000","last_undegraded":"2022-04-03T21:50:02.421819+0000","last_fullsized":"2022-04-03T21:50:02.421819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T01:55:52.787385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.402780+0000","last_change":"2022-04-03T21:49:58.419515+0000","last_active":"2022-04-03T21:50:02.402780+0000","last_peered":"2022-04-03T21:50:02.402780+0000","last_clean":"2022-04-03T21:50:02.402780+0000","last_became_active":"2022-04-03T21:49:58.419270+0000","last_became_peered":"2022-04-03T21:49:58.419270+0000","last_unstale":"2022-04-03T21:50:02.402780+0000","last_undegraded":"2022-04-03T21:50:02.402780+0000","last_fullsized":"2022-04-03T21:50:02.402780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:06:28.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2022-04-03T21:50:02.403437+0000","last_change":"2022-04-03T21:49:58.402164+0000","last_active":"2022-04-03T21:50:02.403437+0000","last_peered":"2022-04-03T21:50:02.403437+0000","last_clean":"2022-04-03T21:50:02.403437+0000","last_became_active":"2022-04-03T21:49:58.401871+0000","last_became_peered":"2022-04-03T21:49:58.401871+0000","last_unstale":"2022-04-03T21:50:02.403437+0000","last_undegraded":"2022-04-03T21:50:02.403437+0000","last_fullsized":"2022-04-03T21:50:02.403437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T21:49:57.839206+0000","last_clean_scrub_stamp":"2022-04-03T21:49:57.839206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-04-05T00:30:03.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4530,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476748,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":125436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9148,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362692,"statfs":{"total":96636764160,"available":96627396608,"internally_reserved":0,"allocated":839680,"data_stored":651170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.984}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7270000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9459999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5949999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9140,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362700,"statfs":{"total":96636764160,"available":96627404800,"internally_reserved":0,"allocated":831488,"data_stored":651078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":121674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8040,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363800,"statfs":{"total":96636764160,"available":96628531200,"internally_reserved":0,"allocated":294912,"data_stored":121584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":121730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.641}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-03T21:50:26.900 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-04-03T21:50:26.901 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-04-03T21:50:26.901 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-04-03T21:50:26.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-04-03T21:50:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.111+0000 7f727866d700 1 Processor -- start 2022-04-03T21:50:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.112+0000 7f727866d700 1 -- start start 2022-04-03T21:50:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f727866d700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72700c1f30 0x7f72700a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f727866d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72700c2300 0x7f727014b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f727866d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72700bda50 con 0x7f72700a73e0 2022-04-03T21:50:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f727866d700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700bca90 con 0x7f72700c1f30 2022-04-03T21:50:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f727866d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700bdf60 con 0x7f72700c2300 2022-04-03T21:50:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f7276409700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f72700c1f30 0x7f72700a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f7276c0a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f72700a73e0 0x7f727014e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50510/0 (socket says 172.21.15.49:50510) 2022-04-03T21:50:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f7276c0a700 1 -- 172.21.15.49:0/1445229048 learned_addr learned my addr 172.21.15.49:0/1445229048 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.113+0000 7f7275c08700 1 --2- 172.21.15.49:0/1445229048 >> v2:172.21.15.117:3300/0 conn(0x7f72700c2300 0x7f727014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275407700 1 -- 172.21.15.49:0/1445229048 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012023443 0 0) 0x7f72700bda50 con 0x7f72700a73e0 2022-04-03T21:50:27.118 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275407700 1 -- 172.21.15.49:0/1445229048 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72580033f0 con 0x7f72700a73e0 2022-04-03T21:50:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275c08700 1 -- 172.21.15.49:0/1445229048 >> v2:172.21.15.49:3300/0 conn(0x7f72700c1f30 msgr2=0x7f72700a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275c08700 1 --2- 172.21.15.49:0/1445229048 >> v2:172.21.15.49:3300/0 conn(0x7f72700c1f30 0x7f72700a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275c08700 1 -- 172.21.15.49:0/1445229048 >> v1:172.21.15.49:6789/0 conn(0x7f72700a73e0 legacy=0x7f727014e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275c08700 1 -- 172.21.15.49:0/1445229048 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700bcd00 con 0x7f72700c2300 2022-04-03T21:50:27.119 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7276409700 1 --2- 172.21.15.49:0/1445229048 >> v2:172.21.15.49:3300/0 conn(0x7f72700c1f30 0x7f72700a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275c08700 1 --2- 172.21.15.49:0/1445229048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f727014b950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f727005e510 tx=0x7f7260009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=125869828b8c9bb1 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.114+0000 7f7275407700 1 -- 172.21.15.49:0/1445229048 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72600105b0 con 0x7f72700c2300 2022-04-03T21:50:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f7275407700 1 -- 172.21.15.49:0/1445229048 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260010710 con 0x7f72700c2300 2022-04-03T21:50:27.123 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f7275407700 1 -- 172.21.15.49:0/1445229048 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260010a90 con 0x7f72700c2300 2022-04-03T21:50:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 -- 172.21.15.49:0/1445229048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 msgr2=0x7f727014b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 --2- 172.21.15.49:0/1445229048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f727014b950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f727005e510 tx=0x7f7260009060 comp rx=0 tx=0).stop 2022-04-03T21:50:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 -- 172.21.15.49:0/1445229048 shutdown_connections 2022-04-03T21:50:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 --2- 172.21.15.49:0/1445229048 >> v2:172.21.15.49:3300/0 conn(0x7f72700c1f30 0x7f72700a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 --2- 172.21.15.49:0/1445229048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f727014b950 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 -- 172.21.15.49:0/1445229048 >> 172.21.15.49:0/1445229048 conn(0x7f727005dfd0 msgr2=0x7f72700c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 -- 172.21.15.49:0/1445229048 shutdown_connections 2022-04-03T21:50:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.115+0000 7f727866d700 1 -- 172.21.15.49:0/1445229048 wait complete. 2022-04-03T21:50:27.125 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.117+0000 7f727866d700 1 Processor -- start 2022-04-03T21:50:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.117+0000 7f727866d700 1 -- start start 2022-04-03T21:50:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f727866d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 0x7f7270146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f727866d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72700c1f30 0x7f727014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.126 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f727866d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f7270149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f727866d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270149cb0 con 0x7f72700a73e0 2022-04-03T21:50:27.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f727866d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270149820 con 0x7f72700c2300 2022-04-03T21:50:27.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f727866d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727015b9f0 con 0x7f72700c1f30 2022-04-03T21:50:27.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f7276409700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 0x7f7270146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.127 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f7275c08700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72700c1f30 0x7f727014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f7276c0a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f7270149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f7276409700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 0x7f7270146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34644/0 (socket says 172.21.15.49:34644) 2022-04-03T21:50:27.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.118+0000 7f7276409700 1 -- 172.21.15.49:0/1432249452 learned_addr learned my addr 172.21.15.49:0/1432249452 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:27.128 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f7276409700 1 -- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72700c1f30 msgr2=0x7f727014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f7276409700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72700c1f30 0x7f727014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f7276409700 1 -- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 msgr2=0x7f7270149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f7276409700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f7270149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f7276409700 1 -- 172.21.15.49:0/1432249452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0092a0 con 0x7f72700a73e0 2022-04-03T21:50:27.129 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f7276409700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 0x7f7270146e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ea20 tx=0x7f726c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00ee60 con 0x7f72700a73e0 2022-04-03T21:50:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00c850 con 0x7f72700a73e0 2022-04-03T21:50:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00cbd0 con 0x7f72700a73e0 2022-04-03T21:50:27.130 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.119+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72600092a0 con 0x7f72700a73e0 2022-04-03T21:50:27.131 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.120+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72701491d0 con 0x7f72700a73e0 2022-04-03T21:50:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.121+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7270070a20 con 0x7f72700a73e0 2022-04-03T21:50:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.122+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f726c019030 con 0x7f72700a73e0 2022-04-03T21:50:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.122+0000 7f725e7fc700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7250063ce0 0x7f7250066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.132 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.123+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f726c080c00 con 0x7f72700a73e0 2022-04-03T21:50:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.123+0000 7f7275c08700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7250063ce0 0x7f7250066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.124+0000 7f7275c08700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7250063ce0 0x7f7250066190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f72700c26d0 tx=0x7f7260016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:27.133 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.127+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f726c04f430 con 0x7f72700a73e0 2022-04-03T21:50:27.370 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.367+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7270149b00 con 0x7f72700a73e0 2022-04-03T21:50:27.370 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.368+0000 7f725e7fc700 1 -- 172.21.15.49:0/1432249452 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f726c017040 con 0x7f72700a73e0 2022-04-03T21:50:27.371 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:27.371 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-04-03T21:50:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7250063ce0 msgr2=0x7f7250066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7250063ce0 0x7f7250066190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f72700c26d0 tx=0x7f7260016000 comp rx=0 tx=0).stop 2022-04-03T21:50:27.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 msgr2=0x7f7270146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 0x7f7270146e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ea20 tx=0x7f726c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:27.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 shutdown_connections 2022-04-03T21:50:27.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7250063ce0 0x7f7250066190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72700c2300 0x7f7270149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72700a73e0 0x7f7270146e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 --2- 172.21.15.49:0/1432249452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72700c1f30 0x7f727014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 >> 172.21.15.49:0/1432249452 conn(0x7f727005dfd0 msgr2=0x7f72700bf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:27.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 shutdown_connections 2022-04-03T21:50:27.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.370+0000 7f727866d700 1 -- 172.21.15.49:0/1432249452 wait complete. 2022-04-03T21:50:27.397 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-04-03T21:50:27.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-03T21:50:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.608+0000 7f171aa9b700 1 Processor -- start 2022-04-03T21:50:27.611 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.608+0000 7f171aa9b700 1 -- start start 2022-04-03T21:50:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.609+0000 7f171aa9b700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17140c21f0 0x7f171414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.614 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.609+0000 7f171aa9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f17140bdbd0 0x7f1714155c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.609+0000 7f171aa9b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17140a47f0 con 0x7f17140c1e20 2022-04-03T21:50:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.609+0000 7f171aa9b700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1714148ee0 con 0x7f17140c21f0 2022-04-03T21:50:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.609+0000 7f171aa9b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17140bc880 con 0x7f17140bdbd0 2022-04-03T21:50:27.615 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.609+0000 7f1719298700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17140c21f0 0x7f171414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.616 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f171a29a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f17140bdbd0 0x7f1714155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.616 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719a99700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f17140c1e20 0x7f17140a4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47444/0 (socket says 172.21.15.49:47444) 2022-04-03T21:50:27.616 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719298700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f17140c21f0 0x7f171414ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34646/0 (socket says 172.21.15.49:34646) 2022-04-03T21:50:27.616 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719a99700 1 -- 172.21.15.49:0/1217380313 learned_addr learned my addr 172.21.15.49:0/1217380313 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:27.617 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719298700 1 -- 172.21.15.49:0/1217380313 >> v2:172.21.15.117:3300/0 conn(0x7f17140bdbd0 msgr2=0x7f1714155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:27.617 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719298700 1 --2- 172.21.15.49:0/1217380313 >> v2:172.21.15.117:3300/0 conn(0x7f17140bdbd0 0x7f1714155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.617 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719298700 1 -- 172.21.15.49:0/1217380313 >> v1:172.21.15.117:6789/0 conn(0x7f17140c1e20 legacy=0x7f17140a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.617 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719298700 1 -- 172.21.15.49:0/1217380313 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140a5390 con 0x7f17140c21f0 2022-04-03T21:50:27.618 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1718a97700 1 -- 172.21.15.49:0/1217380313 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292889088 0 0) 0x7f17140a47f0 con 0x7f17140c1e20 2022-04-03T21:50:27.618 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.610+0000 7f1719298700 1 --2- 172.21.15.49:0/1217380313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f171414ef80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1714069da0 tx=0x7f1704009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ef66cca0d01185 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:27.618 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f1718a97700 1 -- 172.21.15.49:0/1217380313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704011630 con 0x7f17140c21f0 2022-04-03T21:50:27.618 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f1718a97700 1 -- 172.21.15.49:0/1217380313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1704011790 con 0x7f17140c21f0 2022-04-03T21:50:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f1718a97700 1 -- 172.21.15.49:0/1217380313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704011b30 con 0x7f17140c21f0 2022-04-03T21:50:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f171aa9b700 1 -- 172.21.15.49:0/1217380313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 msgr2=0x7f171414ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f171aa9b700 1 --2- 172.21.15.49:0/1217380313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f171414ef80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1714069da0 tx=0x7f1704009060 comp rx=0 tx=0).stop 2022-04-03T21:50:27.619 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f171aa9b700 1 -- 172.21.15.49:0/1217380313 shutdown_connections 2022-04-03T21:50:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f171aa9b700 1 --2- 172.21.15.49:0/1217380313 >> v2:172.21.15.117:3300/0 conn(0x7f17140bdbd0 0x7f1714155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f171aa9b700 1 --2- 172.21.15.49:0/1217380313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f171414ef80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.611+0000 7f171aa9b700 1 -- 172.21.15.49:0/1217380313 >> 172.21.15.49:0/1217380313 conn(0x7f171405dfb0 msgr2=0x7f17140c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:27.620 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.612+0000 7f171aa9b700 1 -- 172.21.15.49:0/1217380313 shutdown_connections 2022-04-03T21:50:27.621 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.612+0000 7f171aa9b700 1 -- 172.21.15.49:0/1217380313 wait complete. 2022-04-03T21:50:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.613+0000 7f171aa9b700 1 Processor -- start 2022-04-03T21:50:27.624 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.613+0000 7f171aa9b700 1 -- start start 2022-04-03T21:50:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171aa9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140bdbd0 0x7f171415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171aa9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140c1e20 0x7f1714147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171aa9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f17141477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.625 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171aa9b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17141482f0 con 0x7f17140c21f0 2022-04-03T21:50:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171aa9b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171415f340 con 0x7f17140bdbd0 2022-04-03T21:50:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171aa9b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1714148030 con 0x7f17140c1e20 2022-04-03T21:50:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.614+0000 7f171a29a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f17141477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.626 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f1719a99700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140bdbd0 0x7f171415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f1719298700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140c1e20 0x7f1714147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f17141477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34648/0 (socket says 172.21.15.49:34648) 2022-04-03T21:50:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 -- 172.21.15.49:0/3898512208 learned_addr learned my addr 172.21.15.49:0/3898512208 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:27.627 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 -- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140c1e20 msgr2=0x7f1714147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140c1e20 0x7f1714147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 -- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140bdbd0 msgr2=0x7f171415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140bdbd0 0x7f171415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.628 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 -- 172.21.15.49:0/3898512208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040092a0 con 0x7f17140c21f0 2022-04-03T21:50:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f171a29a700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f17141477d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f170c009ef0 tx=0x7f170c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.615+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00cb70 con 0x7f17140c21f0 2022-04-03T21:50:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.616+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c00f040 con 0x7f17140c21f0 2022-04-03T21:50:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.616+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c014480 con 0x7f17140c21f0 2022-04-03T21:50:27.629 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.616+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171414bd40 con 0x7f17140c21f0 2022-04-03T21:50:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.616+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1714147d10 con 0x7f17140c21f0 2022-04-03T21:50:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.617+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1714087180 con 0x7f17140c21f0 2022-04-03T21:50:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.618+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f170c0147f0 con 0x7f17140c21f0 2022-04-03T21:50:27.630 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.618+0000 7f1701ffb700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f16f4063ce0 0x7f16f4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.619+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f170c081ad0 con 0x7f17140c21f0 2022-04-03T21:50:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.619+0000 7f1719a99700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f16f4063ce0 0x7f16f4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:27.631 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.620+0000 7f1719a99700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f16f4063ce0 0x7f16f4066190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17100047d0 tx=0x7f1710007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:27.632 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.623+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f170c050360 con 0x7f17140c21f0 2022-04-03T21:50:27.836 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.833+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1714149900 con 0x7f17140c21f0 2022-04-03T21:50:27.837 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.834+0000 7f1701ffb700 1 -- 172.21.15.49:0/3898512208 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f170c018020 con 0x7f17140c21f0 2022-04-03T21:50:27.837 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:27.838 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"e8e9dd61-1110-4fac-b12e-1468add78161","created":"2022-04-03T21:49:30.837254+0000","modified":"2022-04-03T21:50:02.940342+0000","last_up_change":"2022-04-03T21:49:43.738743+0000","last_in_change":"2022-04-03T21:49:33.372871+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-04-03T21:49:42.179170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-04-03T21:49:49.988392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-04-03T21:49:56.198385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-04-03T21:49:57.399847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2022-04-03T21:50:00.466281+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86d6bda-58f6-46b7-aa79-fb9547242948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":21712},{"type":"v1","addr":"172.21.15.49:6825","nonce":21712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":21712},{"type":"v1","addr":"172.21.15.49:6827","nonce":21712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":21712},{"type":"v1","addr":"172.21.15.49:6831","nonce":21712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":21712},{"type":"v1","addr":"172.21.15.49:6829","nonce":21712}]},"public_addr":"172.21.15.49:6825/21712","cluster_addr":"172.21.15.49:6827/21712","heartbeat_back_addr":"172.21.15.49:6831/21712","heartbeat_front_addr":"172.21.15.49:6829/21712","state":["exists","up"]},{"osd":1,"uuid":"61b0ad4d-6f29-4e48-8334-5d0ab077123e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":21710},{"type":"v1","addr":"172.21.15.49:6801","nonce":21710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":21710},{"type":"v1","addr":"172.21.15.49:6803","nonce":21710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":21710},{"type":"v1","addr":"172.21.15.49:6807","nonce":21710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":21710},{"type":"v1","addr":"172.21.15.49:6805","nonce":21710}]},"public_addr":"172.21.15.49:6801/21710","cluster_addr":"172.21.15.49:6803/21710","heartbeat_back_addr":"172.21.15.49:6807/21710","heartbeat_front_addr":"172.21.15.49:6805/21710","state":["exists","up"]},{"osd":2,"uuid":"86214e8b-dafc-4fa7-94db-f5af7687736a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":21720},{"type":"v1","addr":"172.21.15.49:6811","nonce":21720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":21720},{"type":"v1","addr":"172.21.15.49:6815","nonce":21720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":21720},{"type":"v1","addr":"172.21.15.49:6823","nonce":21720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":21720},{"type":"v1","addr":"172.21.15.49:6819","nonce":21720}]},"public_addr":"172.21.15.49:6811/21720","cluster_addr":"172.21.15.49:6815/21720","heartbeat_back_addr":"172.21.15.49:6823/21720","heartbeat_front_addr":"172.21.15.49:6819/21720","state":["exists","up"]},{"osd":3,"uuid":"e9945fc7-d7bd-485b-98d7-166981f702e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":21715},{"type":"v1","addr":"172.21.15.49:6810","nonce":21715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":21715},{"type":"v1","addr":"172.21.15.49:6814","nonce":21715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":21715},{"type":"v1","addr":"172.21.15.49:6821","nonce":21715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":21715},{"type":"v1","addr":"172.21.15.49:6818","nonce":21715}]},"public_addr":"172.21.15.49:6810/21715","cluster_addr":"172.21.15.49:6814/21715","heartbeat_back_addr":"172.21.15.49:6821/21715","heartbeat_front_addr":"172.21.15.49:6818/21715","state":["exists","up"]},{"osd":4,"uuid":"553e3f8d-bda8-477d-ac51-159398e6c430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27219},{"type":"v1","addr":"172.21.15.117:6801","nonce":27219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27219},{"type":"v1","addr":"172.21.15.117:6803","nonce":27219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":27219},{"type":"v1","addr":"172.21.15.117:6807","nonce":27219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27219},{"type":"v1","addr":"172.21.15.117:6805","nonce":27219}]},"public_addr":"172.21.15.117:6801/27219","cluster_addr":"172.21.15.117:6803/27219","heartbeat_back_addr":"172.21.15.117:6807/27219","heartbeat_front_addr":"172.21.15.117:6805/27219","state":["exists","up"]},{"osd":5,"uuid":"08f81712-b1cb-46fd-b019-93ac50a2a4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27252},{"type":"v1","addr":"172.21.15.117:6825","nonce":27252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27252},{"type":"v1","addr":"172.21.15.117:6827","nonce":27252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27252},{"type":"v1","addr":"172.21.15.117:6831","nonce":27252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27252},{"type":"v1","addr":"172.21.15.117:6829","nonce":27252}]},"public_addr":"172.21.15.117:6825/27252","cluster_addr":"172.21.15.117:6827/27252","heartbeat_back_addr":"172.21.15.117:6831/27252","heartbeat_front_addr":"172.21.15.117:6829/27252","state":["exists","up"]},{"osd":6,"uuid":"15d9cad0-7acd-4283-b7fb-2480d7bf83d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27220},{"type":"v1","addr":"172.21.15.117:6809","nonce":27220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":27220},{"type":"v1","addr":"172.21.15.117:6811","nonce":27220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27220},{"type":"v1","addr":"172.21.15.117:6815","nonce":27220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27220},{"type":"v1","addr":"172.21.15.117:6813","nonce":27220}]},"public_addr":"172.21.15.117:6809/27220","cluster_addr":"172.21.15.117:6811/27220","heartbeat_back_addr":"172.21.15.117:6815/27220","heartbeat_front_addr":"172.21.15.117:6813/27220","state":["exists","up"]},{"osd":7,"uuid":"48066a46-9f55-4ba8-8aba-f86d6ea0657f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27221},{"type":"v1","addr":"172.21.15.117:6817","nonce":27221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27221},{"type":"v1","addr":"172.21.15.117:6819","nonce":27221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27221},{"type":"v1","addr":"172.21.15.117:6823","nonce":27221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27221},{"type":"v1","addr":"172.21.15.117:6821","nonce":27221}]},"public_addr":"172.21.15.117:6817/27221","cluster_addr":"172.21.15.117:6819/27221","heartbeat_back_addr":"172.21.15.117:6823/27221","heartbeat_front_addr":"172.21.15.117:6821/27221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.089406+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.925955+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.163731+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:39.162054+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.506696+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.588505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.526629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-04-03T21:49:38.579964+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-03T21:50:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f16f4063ce0 msgr2=0x7f16f4066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f16f4063ce0 0x7f16f4066190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17100047d0 tx=0x7f1710007bb0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.841 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 msgr2=0x7f17141477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:27.841 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f17141477d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f170c009ef0 tx=0x7f170c00b040 comp rx=0 tx=0).stop 2022-04-03T21:50:27.841 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 shutdown_connections 2022-04-03T21:50:27.841 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f16f4063ce0 0x7f16f4066190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17140c21f0 0x7f17141477d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140bdbd0 0x7f171415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 --2- 172.21.15.49:0/3898512208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140c1e20 0x7f1714147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:27.842 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 >> 172.21.15.49:0/3898512208 conn(0x7f171405dfb0 msgr2=0x7f17140c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 shutdown_connections 2022-04-03T21:50:27.843 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:27.837+0000 7f171aa9b700 1 -- 172.21.15.49:0/3898512208 wait complete. 2022-04-03T21:50:27.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-04-03T21:49:42.179170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-04-03T21:49:49.988392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-04-03T21:49:56.198385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-04-03T21:49:57.399847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2022-04-03T21:50:00.466281+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-04-03T21:50:27.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-04-03T21:50:28.082 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.080+0000 7f68955c3700 1 Processor -- start 2022-04-03T21:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.080+0000 7f68955c3700 1 -- start start 2022-04-03T21:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f68955c3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68900a4d10 0x7f68900bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f68955c3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900a6ff0 con 0x7f68900a4940 2022-04-03T21:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f68955c3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900c2590 con 0x7f68900a5c10 2022-04-03T21:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f68955c3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900a66c0 con 0x7f68900a4d10 2022-04-03T21:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f688effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f68900a4940 0x7f68900c1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50512/0 (socket says 172.21.15.49:50512) 2022-04-03T21:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f688effd700 1 -- 172.21.15.49:0/599031789 learned_addr learned my addr 172.21.15.49:0/599031789 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.081+0000 7f688e7fc700 1 --2- 172.21.15.49:0/599031789 >> v2:172.21.15.117:3300/0 conn(0x7f68900a4d10 0x7f68900bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.082+0000 7f688dffb700 1 -- 172.21.15.49:0/599031789 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280704356 0 0) 0x7f68900a6ff0 con 0x7f68900a4940 2022-04-03T21:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.082+0000 7f688e7fc700 1 -- 172.21.15.49:0/599031789 >> v1:172.21.15.117:6789/0 conn(0x7f68900a5c10 legacy=0x7f6890147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.082+0000 7f688e7fc700 1 -- 172.21.15.49:0/599031789 >> v1:172.21.15.49:6789/0 conn(0x7f68900a4940 legacy=0x7f68900c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.082+0000 7f688e7fc700 1 -- 172.21.15.49:0/599031789 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900a69a0 con 0x7f68900a4d10 2022-04-03T21:50:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.082+0000 7f688e7fc700 1 --2- 172.21.15.49:0/599031789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f68900bd520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f68840096e0 tx=0x7f6884009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749bcce6eee52fa1 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f688dffb700 1 -- 172.21.15.49:0/599031789 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884004030 con 0x7f68900a4d10 2022-04-03T21:50:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f688dffb700 1 -- 172.21.15.49:0/599031789 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6884004190 con 0x7f68900a4d10 2022-04-03T21:50:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f688dffb700 1 -- 172.21.15.49:0/599031789 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884011630 con 0x7f68900a4d10 2022-04-03T21:50:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 -- 172.21.15.49:0/599031789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 msgr2=0x7f68900bd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 --2- 172.21.15.49:0/599031789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f68900bd520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f68840096e0 tx=0x7f6884009060 comp rx=0 tx=0).stop 2022-04-03T21:50:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 -- 172.21.15.49:0/599031789 shutdown_connections 2022-04-03T21:50:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 --2- 172.21.15.49:0/599031789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f68900bd520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 -- 172.21.15.49:0/599031789 >> 172.21.15.49:0/599031789 conn(0x7f689005e010 msgr2=0x7f68900c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:28.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 -- 172.21.15.49:0/599031789 shutdown_connections 2022-04-03T21:50:28.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.083+0000 7f68955c3700 1 -- 172.21.15.49:0/599031789 wait complete. 2022-04-03T21:50:28.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.085+0000 7f68955c3700 1 Processor -- start 2022-04-03T21:50:28.093 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.085+0000 7f68955c3700 1 -- start start 2022-04-03T21:50:28.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f68955c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68900a4940 0x7f689015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f68955c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f689015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f68955c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68900a5c10 0x7f689015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.094 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f68955c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689015bc60 con 0x7f68900a4940 2022-04-03T21:50:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f68955c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689015c8a0 con 0x7f68900a4d10 2022-04-03T21:50:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f68955c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68901498d0 con 0x7f68900a5c10 2022-04-03T21:50:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f688effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68900a4940 0x7f689015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f688e7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f689015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.095 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f688e7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f689015b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35484/0 (socket says 172.21.15.49:35484) 2022-04-03T21:50:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f688e7fc700 1 -- 172.21.15.49:0/2527173457 learned_addr learned my addr 172.21.15.49:0/2527173457 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.086+0000 7f688f7fe700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68900a5c10 0x7f689015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f688e7fc700 1 -- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68900a5c10 msgr2=0x7f689015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f688e7fc700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68900a5c10 0x7f689015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f688e7fc700 1 -- 172.21.15.49:0/2527173457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68900a4940 msgr2=0x7f689015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f688e7fc700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68900a4940 0x7f689015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f688e7fc700 1 -- 172.21.15.49:0/2527173457 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840092a0 con 0x7f68900a4d10 2022-04-03T21:50:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f688e7fc700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f689015b120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6890087800 tx=0x7f6884016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840036f0 con 0x7f68900a4d10 2022-04-03T21:50:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6884003850 con 0x7f68900a4d10 2022-04-03T21:50:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884003c10 con 0x7f68900a4d10 2022-04-03T21:50:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.087+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689015b980 con 0x7f68900a4d10 2022-04-03T21:50:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.088+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900b9560 con 0x7f68900a4d10 2022-04-03T21:50:28.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.088+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900c2300 con 0x7f68900a4d10 2022-04-03T21:50:28.099 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.089+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f6884017020 con 0x7f68900a4d10 2022-04-03T21:50:28.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.090+0000 7f6876ffd700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f6870063ce0 0x7f6870066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.090+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6884082420 con 0x7f68900a4d10 2022-04-03T21:50:28.100 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.091+0000 7f688effd700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f6870063ce0 0x7f6870066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.091+0000 7f688effd700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f6870063ce0 0x7f6870066190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6880004780 tx=0x7f6880007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:28.101 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.095+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f6884050cf0 con 0x7f68900a4d10 2022-04-03T21:50:28.302 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.299+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68900bbac0 con 0x7f68900a4d10 2022-04-03T21:50:28.303 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.300+0000 7f6876ffd700 1 -- 172.21.15.49:0/2527173457 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f688402a0a0 con 0x7f68900a4d10 2022-04-03T21:50:28.303 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2022-04-03T21:50:28.305 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f6870063ce0 msgr2=0x7f6870066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f6870063ce0 0x7f6870066190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6880004780 tx=0x7f6880007cd0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 msgr2=0x7f689015b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f689015b120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6890087800 tx=0x7f6884016000 comp rx=0 tx=0).stop 2022-04-03T21:50:28.306 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 shutdown_connections 2022-04-03T21:50:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f6870063ce0 0x7f6870066190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68900a5c10 0x7f689015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68900a4940 0x7f689015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.307 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 --2- 172.21.15.49:0/2527173457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68900a4d10 0x7f689015b120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.302+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 >> 172.21.15.49:0/2527173457 conn(0x7f689005e010 msgr2=0x7f68900be5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:28.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.303+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 shutdown_connections 2022-04-03T21:50:28.308 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.303+0000 7f68955c3700 1 -- 172.21.15.49:0/2527173457 wait complete. 2022-04-03T21:50:28.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-03T21:50:28.547 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.545+0000 7f53fefb6700 1 Processor -- start 2022-04-03T21:50:28.548 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.545+0000 7f53fefb6700 1 -- start start 2022-04-03T21:50:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fefb6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f8069520 0x7f53f80bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fefb6700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f53f80bbda0 0x7f53f80bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fefb6700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f80bc760 con 0x7f53f80bf340 2022-04-03T21:50:28.550 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fefb6700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f814bdc0 con 0x7f53f80bbda0 2022-04-03T21:50:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fefb6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f814b140 con 0x7f53f8069520 2022-04-03T21:50:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fcd52700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f53f80bf340 0x7f53f8068e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47448/0 (socket says 172.21.15.49:47448) 2022-04-03T21:50:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fcd52700 1 -- 172.21.15.49:0/2394824579 learned_addr learned my addr 172.21.15.49:0/2394824579 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:28.551 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53fd553700 1 --2- 172.21.15.49:0/2394824579 >> v2:172.21.15.49:3300/0 conn(0x7f53f80bbda0 0x7f53f80bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.546+0000 7f53f7fff700 1 --2- 172.21.15.49:0/2394824579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f8069520 0x7f53f80bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.547+0000 7f53f77fe700 1 -- 172.21.15.49:0/2394824579 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921734775 0 0) 0x7f53f80bc760 con 0x7f53f80bf340 2022-04-03T21:50:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.547+0000 7f53fd553700 1 -- 172.21.15.49:0/2394824579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f8069520 msgr2=0x7f53f80bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.547+0000 7f53fd553700 1 --2- 172.21.15.49:0/2394824579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f8069520 0x7f53f80bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.552 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.547+0000 7f53fd553700 1 -- 172.21.15.49:0/2394824579 >> v1:172.21.15.117:6789/0 conn(0x7f53f80bf340 legacy=0x7f53f8068e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.547+0000 7f53fd553700 1 -- 172.21.15.49:0/2394824579 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f814b420 con 0x7f53f80bbda0 2022-04-03T21:50:28.553 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.547+0000 7f53fd553700 1 --2- 172.21.15.49:0/2394824579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f80bbda0 0x7f53f80bc220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009e60 tx=0x7f53f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff63221c0d2049d7 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53f77fe700 1 -- 172.21.15.49:0/2394824579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000e070 con 0x7f53f80bbda0 2022-04-03T21:50:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53f77fe700 1 -- 172.21.15.49:0/2394824579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000bb60 con 0x7f53f80bbda0 2022-04-03T21:50:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53f77fe700 1 -- 172.21.15.49:0/2394824579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0012430 con 0x7f53f80bbda0 2022-04-03T21:50:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 -- 172.21.15.49:0/2394824579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f80bbda0 msgr2=0x7f53f80bc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 --2- 172.21.15.49:0/2394824579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f80bbda0 0x7f53f80bc220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009e60 tx=0x7f53f0009780 comp rx=0 tx=0).stop 2022-04-03T21:50:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 -- 172.21.15.49:0/2394824579 shutdown_connections 2022-04-03T21:50:28.558 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 --2- 172.21.15.49:0/2394824579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f80bbda0 0x7f53f80bc220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.559 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 --2- 172.21.15.49:0/2394824579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f8069520 0x7f53f80bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.559 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 -- 172.21.15.49:0/2394824579 >> 172.21.15.49:0/2394824579 conn(0x7f53f806e380 msgr2=0x7f53f806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:28.559 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.548+0000 7f53fefb6700 1 -- 172.21.15.49:0/2394824579 shutdown_connections 2022-04-03T21:50:28.559 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.549+0000 7f53fefb6700 1 -- 172.21.15.49:0/2394824579 wait complete. 2022-04-03T21:50:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.550+0000 7f53fefb6700 1 Processor -- start 2022-04-03T21:50:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.550+0000 7f53fefb6700 1 -- start start 2022-04-03T21:50:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fefb6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 0x7f53f815e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fefb6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f80bbda0 0x7f53f80a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.560 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fefb6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53f80bf340 0x7f53f80b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.561 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fefb6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80b8140 con 0x7f53f8069520 2022-04-03T21:50:28.561 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fefb6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f815ee40 con 0x7f53f80bf340 2022-04-03T21:50:28.561 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fefb6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f814d590 con 0x7f53f80bbda0 2022-04-03T21:50:28.561 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fcd52700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 0x7f53f815e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.562 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53f7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f80bbda0 0x7f53f80a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.562 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fd553700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53f80bf340 0x7f53f80b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.562 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fcd52700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 0x7f53f815e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34654/0 (socket says 172.21.15.49:34654) 2022-04-03T21:50:28.562 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.551+0000 7f53fcd52700 1 -- 172.21.15.49:0/605160839 learned_addr learned my addr 172.21.15.49:0/605160839 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:28.563 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53fcd52700 1 -- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f80bbda0 msgr2=0x7f53f80a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.563 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53fcd52700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f80bbda0 0x7f53f80a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.563 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53fcd52700 1 -- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53f80bf340 msgr2=0x7f53f80b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.563 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53fcd52700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53f80bf340 0x7f53f80b84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.564 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53fcd52700 1 -- 172.21.15.49:0/605160839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0009a20 con 0x7f53f8069520 2022-04-03T21:50:28.564 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53f7fff700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f80bbda0 0x7f53f80a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:28.564 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53fcd52700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 0x7f53f815e100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c4c0 tx=0x7f53ec007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:28.564 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec007150 con 0x7f53f8069520 2022-04-03T21:50:28.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.552+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec0072b0 con 0x7f53f8069520 2022-04-03T21:50:28.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.553+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f814cf60 con 0x7f53f8069520 2022-04-03T21:50:28.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.553+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0046b0 con 0x7f53f8069520 2022-04-03T21:50:28.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.553+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f814d280 con 0x7f53f8069520 2022-04-03T21:50:28.565 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.554+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f815eb20 con 0x7f53f8069520 2022-04-03T21:50:28.566 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.555+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f53ec010030 con 0x7f53f8069520 2022-04-03T21:50:28.567 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.555+0000 7f53f4ff9700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f53e0063ce0 0x7f53e0066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:28.567 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.556+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f53ec0805c0 con 0x7f53f8069520 2022-04-03T21:50:28.567 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.556+0000 7f53f7fff700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f53e0063ce0 0x7f53e0066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:28.568 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.556+0000 7f53f7fff700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f53e0063ce0 0x7f53e0066190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f53f81499e0 tx=0x7f53e4009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:28.568 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.560+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f53ec04eed0 con 0x7f53f8069520 2022-04-03T21:50:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.764+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53f8070a20 con 0x7f53f8069520 2022-04-03T21:50:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.765+0000 7f53f4ff9700 1 -- 172.21.15.49:0/605160839 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f53ec0524f0 con 0x7f53f8069520 2022-04-03T21:50:28.768 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2022-04-03T21:50:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f53e0063ce0 msgr2=0x7f53e0066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f53e0063ce0 0x7f53e0066190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f53f81499e0 tx=0x7f53e4009060 comp rx=0 tx=0).stop 2022-04-03T21:50:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 msgr2=0x7f53f815e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 0x7f53f815e100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c4c0 tx=0x7f53ec007c40 comp rx=0 tx=0).stop 2022-04-03T21:50:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 shutdown_connections 2022-04-03T21:50:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f53e0063ce0 0x7f53e0066190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53f80bf340 0x7f53f80b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53f8069520 0x7f53f815e100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 --2- 172.21.15.49:0/605160839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53f80bbda0 0x7f53f80a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.767+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 >> 172.21.15.49:0/605160839 conn(0x7f53f806e380 msgr2=0x7f53f80bb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.768+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 shutdown_connections 2022-04-03T21:50:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:28.768+0000 7f53fefb6700 1 -- 172.21.15.49:0/605160839 wait complete. 2022-04-03T21:50:28.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-04-03T21:50:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.009+0000 7f9d41ddc700 1 Processor -- start 2022-04-03T21:50:29.012 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.009+0000 7f9d41ddc700 1 -- start start 2022-04-03T21:50:29.014 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.010+0000 7f9d41ddc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c0bdac0 0x7f9d3c0a2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.015 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.010+0000 7f9d41ddc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c069480 con 0x7f9d3c06a020 2022-04-03T21:50:29.015 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.010+0000 7f9d41ddc700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c0b9170 con 0x7f9d3c0bde90 2022-04-03T21:50:29.015 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.010+0000 7f9d41ddc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c14d1d0 con 0x7f9d3c0bdac0 2022-04-03T21:50:29.015 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c0bdac0 0x7f9d3c0a2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3affd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9d3c0bde90 0x7f9d3c069910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47452/0 (socket says 172.21.15.49:47452) 2022-04-03T21:50:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3affd700 1 -- 172.21.15.49:0/1331747367 learned_addr learned my addr 172.21.15.49:0/1331747367 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3bfff700 1 --1- 172.21.15.49:0/1331747367 >> v1:172.21.15.49:6789/0 conn(0x7f9d3c06a020 0x7f9d3c1429a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50514/0 (socket says 172.21.15.49:50514) 2022-04-03T21:50:29.016 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3a7fc700 1 -- 172.21.15.49:0/1331747367 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721246452 0 0) 0x7f9d3c0b9170 con 0x7f9d3c0bde90 2022-04-03T21:50:29.017 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3a7fc700 1 -- 172.21.15.49:0/1331747367 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d280033f0 con 0x7f9d3c0bde90 2022-04-03T21:50:29.017 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3b7fe700 1 -- 172.21.15.49:0/1331747367 >> v1:172.21.15.117:6789/0 conn(0x7f9d3c0bde90 legacy=0x7f9d3c069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.017 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3b7fe700 1 -- 172.21.15.49:0/1331747367 >> v1:172.21.15.49:6789/0 conn(0x7f9d3c06a020 legacy=0x7f9d3c1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.017 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3a7fc700 1 -- 172.21.15.49:0/1331747367 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528788091 0 0) 0x7f9d3c069480 con 0x7f9d3c06a020 2022-04-03T21:50:29.017 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.011+0000 7f9d3b7fe700 1 -- 172.21.15.49:0/1331747367 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0b9410 con 0x7f9d3c0bdac0 2022-04-03T21:50:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.012+0000 7f9d3b7fe700 1 --2- 172.21.15.49:0/1331747367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c0bdac0 0x7f9d3c0a2770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009790 tx=0x7f9d2c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1f4673b61a2745 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.012+0000 7f9d3a7fc700 1 -- 172.21.15.49:0/1331747367 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c011630 con 0x7f9d3c0bdac0 2022-04-03T21:50:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.012+0000 7f9d3a7fc700 1 -- 172.21.15.49:0/1331747367 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c011790 con 0x7f9d3c0bdac0 2022-04-03T21:50:29.018 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.012+0000 7f9d3a7fc700 1 -- 172.21.15.49:0/1331747367 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c011b50 con 0x7f9d3c0bdac0 2022-04-03T21:50:29.021 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.012+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1331747367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c0bdac0 msgr2=0x7f9d3c0a2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.021 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.012+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1331747367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c0bdac0 0x7f9d3c0a2770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009790 tx=0x7f9d2c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:29.021 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.013+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1331747367 shutdown_connections 2022-04-03T21:50:29.022 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.013+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1331747367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c0bdac0 0x7f9d3c0a2770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.022 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.013+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1331747367 >> 172.21.15.49:0/1331747367 conn(0x7f9d3c0675b0 msgr2=0x7f9d3c0bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:29.022 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.013+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1331747367 shutdown_connections 2022-04-03T21:50:29.022 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.013+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1331747367 wait complete. 2022-04-03T21:50:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.014+0000 7f9d41ddc700 1 Processor -- start 2022-04-03T21:50:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.014+0000 7f9d41ddc700 1 -- start start 2022-04-03T21:50:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.015+0000 7f9d41ddc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c06a020 0x7f9d3c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.023 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.015+0000 7f9d41ddc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c0bdac0 0x7f9d3c0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.015+0000 7f9d41ddc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 0x7f9d3c0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.015+0000 7f9d41ddc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15f520 con 0x7f9d3c0bdac0 2022-04-03T21:50:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.015+0000 7f9d41ddc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0b5110 con 0x7f9d3c0bde90 2022-04-03T21:50:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.015+0000 7f9d41ddc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0b2850 con 0x7f9d3c06a020 2022-04-03T21:50:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 0x7f9d3c0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c06a020 0x7f9d3c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c0bdac0 0x7f9d3c0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 0x7f9d3c0b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35488/0 (socket says 172.21.15.49:35488) 2022-04-03T21:50:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3bfff700 1 -- 172.21.15.49:0/1408774395 learned_addr learned my addr 172.21.15.49:0/1408774395 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3b7fe700 1 -- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 msgr2=0x7f9d3c0b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3b7fe700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 0x7f9d3c0b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3b7fe700 1 -- 172.21.15.49:0/1408774395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c0bdac0 msgr2=0x7f9d3c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3b7fe700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c0bdac0 0x7f9d3c0b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3b7fe700 1 -- 172.21.15.49:0/1408774395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0092a0 con 0x7f9d3c06a020 2022-04-03T21:50:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.016+0000 7f9d3bfff700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 0x7f9d3c0b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.017+0000 7f9d3b7fe700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c06a020 0x7f9d3c15e790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c016000 tx=0x7f9d2c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.017+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c000c90 con 0x7f9d3c06a020 2022-04-03T21:50:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.017+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c011900 con 0x7f9d3c06a020 2022-04-03T21:50:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.017+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c025420 con 0x7f9d3c06a020 2022-04-03T21:50:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.017+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c0b4310 con 0x7f9d3c06a020 2022-04-03T21:50:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.017+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c15f140 con 0x7f9d3c06a020 2022-04-03T21:50:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.018+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c070a20 con 0x7f9d3c06a020 2022-04-03T21:50:29.029 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.019+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f9d2c00f050 con 0x7f9d3c06a020 2022-04-03T21:50:29.029 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.020+0000 7f9d237fe700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9d1c063ce0 0x7f9d1c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.030 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.020+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9d2c081dc0 con 0x7f9d3c06a020 2022-04-03T21:50:29.030 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.020+0000 7f9d3affd700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9d1c063ce0 0x7f9d1c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.030 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.021+0000 7f9d3affd700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9d1c063ce0 0x7f9d1c066190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0bbcc0 tx=0x7f9d30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.030 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.025+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f9d2c0506b0 con 0x7f9d3c06a020 2022-04-03T21:50:29.230 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.228+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d3c0baae0 con 0x7f9d3c06a020 2022-04-03T21:50:29.231 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.229+0000 7f9d237fe700 1 -- 172.21.15.49:0/1408774395 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d2c053cd0 con 0x7f9d3c06a020 2022-04-03T21:50:29.232 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2022-04-03T21:50:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.231+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9d1c063ce0 msgr2=0x7f9d1c066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.231+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9d1c063ce0 0x7f9d1c066190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0bbcc0 tx=0x7f9d30009040 comp rx=0 tx=0).stop 2022-04-03T21:50:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.231+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c06a020 msgr2=0x7f9d3c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.231+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c06a020 0x7f9d3c15e790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c016000 tx=0x7f9d2c017000 comp rx=0 tx=0).stop 2022-04-03T21:50:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.231+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 shutdown_connections 2022-04-03T21:50:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f9d1c063ce0 0x7f9d1c066190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d3c0bde90 0x7f9d3c0b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d3c06a020 0x7f9d3c15e790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 --2- 172.21.15.49:0/1408774395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c0bdac0 0x7f9d3c0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 >> 172.21.15.49:0/1408774395 conn(0x7f9d3c0675b0 msgr2=0x7f9d3c09f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 shutdown_connections 2022-04-03T21:50:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.232+0000 7f9d41ddc700 1 -- 172.21.15.49:0/1408774395 wait complete. 2022-04-03T21:50:29.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-04-03T21:50:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.473+0000 7fea1d754700 1 Processor -- start 2022-04-03T21:50:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.473+0000 7fea1d754700 1 -- start start 2022-04-03T21:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.474+0000 7fea1d754700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea180bde90 0x7fea18069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.474+0000 7fea1d754700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180a2e80 0x7fea18069e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.474+0000 7fea1d754700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea18069480 con 0x7fea180bdac0 2022-04-03T21:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.474+0000 7fea1d754700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180b9170 con 0x7fea180bde90 2022-04-03T21:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.474+0000 7fea1d754700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1814d1d0 con 0x7fea180a2e80 2022-04-03T21:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea177fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180a2e80 0x7fea18069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea16ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fea180bdac0 0x7fea180a2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50516/0 (socket says 172.21.15.49:50516) 2022-04-03T21:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea16ffd700 1 -- 172.21.15.49:0/770584703 learned_addr learned my addr 172.21.15.49:0/770584703 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea167fc700 1 --2- 172.21.15.49:0/770584703 >> v2:172.21.15.117:3300/0 conn(0x7fea180bde90 0x7fea18069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea177fe700 1 -- 172.21.15.49:0/770584703 >> v2:172.21.15.117:3300/0 conn(0x7fea180bde90 msgr2=0x7fea18069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea177fe700 1 --2- 172.21.15.49:0/770584703 >> v2:172.21.15.117:3300/0 conn(0x7fea180bde90 0x7fea18069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea177fe700 1 -- 172.21.15.49:0/770584703 >> v1:172.21.15.49:6789/0 conn(0x7fea180bdac0 legacy=0x7fea180a2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea177fe700 1 -- 172.21.15.49:0/770584703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180b9410 con 0x7fea180a2e80 2022-04-03T21:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.475+0000 7fea15ffb700 1 -- 172.21.15.49:0/770584703 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150836256 0 0) 0x7fea18069480 con 0x7fea180bdac0 2022-04-03T21:50:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea177fe700 1 --2- 172.21.15.49:0/770584703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180a2e80 0x7fea18069e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e60 tx=0x7fea10009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad1d54fc0cfa439b server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea15ffb700 1 -- 172.21.15.49:0/770584703 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000e070 con 0x7fea180a2e80 2022-04-03T21:50:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea15ffb700 1 -- 172.21.15.49:0/770584703 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000bb60 con 0x7fea180a2e80 2022-04-03T21:50:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea15ffb700 1 -- 172.21.15.49:0/770584703 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10012430 con 0x7fea180a2e80 2022-04-03T21:50:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea1d754700 1 -- 172.21.15.49:0/770584703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180a2e80 msgr2=0x7fea18069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.486 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea1d754700 1 --2- 172.21.15.49:0/770584703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180a2e80 0x7fea18069e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e60 tx=0x7fea10009780 comp rx=0 tx=0).stop 2022-04-03T21:50:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea1d754700 1 -- 172.21.15.49:0/770584703 shutdown_connections 2022-04-03T21:50:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea1d754700 1 --2- 172.21.15.49:0/770584703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180a2e80 0x7fea18069e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea1d754700 1 --2- 172.21.15.49:0/770584703 >> v2:172.21.15.117:3300/0 conn(0x7fea180bde90 0x7fea18069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.476+0000 7fea1d754700 1 -- 172.21.15.49:0/770584703 >> 172.21.15.49:0/770584703 conn(0x7fea180675b0 msgr2=0x7fea180bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.477+0000 7fea1d754700 1 -- 172.21.15.49:0/770584703 shutdown_connections 2022-04-03T21:50:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.477+0000 7fea1d754700 1 -- 172.21.15.49:0/770584703 wait complete. 2022-04-03T21:50:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.479+0000 7fea1d754700 1 Processor -- start 2022-04-03T21:50:29.488 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.479+0000 7fea1d754700 1 -- start start 2022-04-03T21:50:29.489 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.480+0000 7fea1d754700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea180a2e80 0x7fea18159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.489 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.480+0000 7fea1d754700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 0x7fea1815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.489 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.480+0000 7fea1d754700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180bde90 0x7fea180b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.489 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.480+0000 7fea1d754700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1815ccf0 con 0x7fea180a2e80 2022-04-03T21:50:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.480+0000 7fea1d754700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180978b0 con 0x7fea180bdac0 2022-04-03T21:50:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.480+0000 7fea1d754700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1815c780 con 0x7fea180bde90 2022-04-03T21:50:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea180a2e80 0x7fea18159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 0x7fea1815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea177fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180bde90 0x7fea180b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 0x7fea1815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35492/0 (socket says 172.21.15.49:35492) 2022-04-03T21:50:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 -- 172.21.15.49:0/2074490249 learned_addr learned my addr 172.21.15.49:0/2074490249 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 -- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180bde90 msgr2=0x7fea180b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180bde90 0x7fea180b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 -- 172.21.15.49:0/2074490249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea180a2e80 msgr2=0x7fea18159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea180a2e80 0x7fea18159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.481+0000 7fea167fc700 1 -- 172.21.15.49:0/2074490249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009a20 con 0x7fea180bdac0 2022-04-03T21:50:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.482+0000 7fea167fc700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 0x7fea1815a180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00e900 tx=0x7fea0c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.482+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c013680 con 0x7fea180bdac0 2022-04-03T21:50:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.482+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c0137e0 con 0x7fea180bdac0 2022-04-03T21:50:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.482+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1815a760 con 0x7fea180bdac0 2022-04-03T21:50:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.482+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c013b80 con 0x7fea180bdac0 2022-04-03T21:50:29.494 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.482+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18097c40 con 0x7fea180bdac0 2022-04-03T21:50:29.494 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.483+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1806a060 con 0x7fea180bdac0 2022-04-03T21:50:29.494 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.484+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fea0c019030 con 0x7fea180bdac0 2022-04-03T21:50:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.485+0000 7fe9feffd700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe9f8063ce0 0x7fe9f8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.485+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fea0c080a80 con 0x7fea180bdac0 2022-04-03T21:50:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.485+0000 7fea16ffd700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe9f8063ce0 0x7fe9f8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.486+0000 7fea16ffd700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe9f8063ce0 0x7fe9f8066190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fea080047d0 tx=0x7fea08007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.489+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fea0c04f370 con 0x7fea180bdac0 2022-04-03T21:50:29.698 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.696+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea18097e30 con 0x7fea180bdac0 2022-04-03T21:50:29.699 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.696+0000 7fe9feffd700 1 -- 172.21.15.49:0/2074490249 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea0c0170a0 con 0x7fea180bdac0 2022-04-03T21:50:29.699 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2022-04-03T21:50:29.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe9f8063ce0 msgr2=0x7fe9f8066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe9f8063ce0 0x7fe9f8066190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fea080047d0 tx=0x7fea08007d60 comp rx=0 tx=0).stop 2022-04-03T21:50:29.702 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 msgr2=0x7fea1815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 0x7fea1815a180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00e900 tx=0x7fea0c009060 comp rx=0 tx=0).stop 2022-04-03T21:50:29.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 shutdown_connections 2022-04-03T21:50:29.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fe9f8063ce0 0x7fe9f8066190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.703 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180bde90 0x7fea180b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea180a2e80 0x7fea18159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 --2- 172.21.15.49:0/2074490249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180bdac0 0x7fea1815a180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 >> 172.21.15.49:0/2074490249 conn(0x7fea180675b0 msgr2=0x7fea1814bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 shutdown_connections 2022-04-03T21:50:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.699+0000 7fea1d754700 1 -- 172.21.15.49:0/2074490249 wait complete. 2022-04-03T21:50:29.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2022-04-03T21:50:29.947 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.944+0000 7fcdb612e700 1 Processor -- start 2022-04-03T21:50:29.947 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.944+0000 7fcdb612e700 1 -- start start 2022-04-03T21:50:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.945+0000 7fcdb612e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00bdac0 0x7fcdb00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdb612e700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdb00b9360 0x7fcdb006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdb612e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb00b7c60 con 0x7fcdb00bde90 2022-04-03T21:50:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdb612e700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb014c380 con 0x7fcdb00b9360 2022-04-03T21:50:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdb612e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00b7f40 con 0x7fcdb00bdac0 2022-04-03T21:50:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdaffff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcdb00b9360 0x7fcdb006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00bdac0 0x7fcdb00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdaeffd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcdb00bde90 0x7fcdb0141c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47454/0 (socket says 172.21.15.49:47454) 2022-04-03T21:50:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.946+0000 7fcdaeffd700 1 -- 172.21.15.49:0/4286654245 learned_addr learned my addr 172.21.15.49:0/4286654245 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdae7fc700 1 -- 172.21.15.49:0/4286654245 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103831327 0 0) 0x7fcdb00b7c60 con 0x7fcdb00bde90 2022-04-03T21:50:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdaffff700 1 -- 172.21.15.49:0/4286654245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00bdac0 msgr2=0x7fcdb00b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdaffff700 1 --2- 172.21.15.49:0/4286654245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00bdac0 0x7fcdb00b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdaffff700 1 -- 172.21.15.49:0/4286654245 >> v1:172.21.15.117:6789/0 conn(0x7fcdb00bde90 legacy=0x7fcdb0141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdaffff700 1 -- 172.21.15.49:0/4286654245 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00b8220 con 0x7fcdb00b9360 2022-04-03T21:50:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdaf7fe700 1 --2- 172.21.15.49:0/4286654245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00bdac0 0x7fcdb00b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdaffff700 1 --2- 172.21.15.49:0/4286654245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00b9360 0x7fcdb006c060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009e60 tx=0x7fcda8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e76cc867902500e server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.954 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdae7fc700 1 -- 172.21.15.49:0/4286654245 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda800e070 con 0x7fcdb00b9360 2022-04-03T21:50:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdae7fc700 1 -- 172.21.15.49:0/4286654245 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda800bb60 con 0x7fcdb00b9360 2022-04-03T21:50:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.947+0000 7fcdae7fc700 1 -- 172.21.15.49:0/4286654245 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8012430 con 0x7fcdb00b9360 2022-04-03T21:50:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 -- 172.21.15.49:0/4286654245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00b9360 msgr2=0x7fcdb006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 --2- 172.21.15.49:0/4286654245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00b9360 0x7fcdb006c060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009e60 tx=0x7fcda8009780 comp rx=0 tx=0).stop 2022-04-03T21:50:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 -- 172.21.15.49:0/4286654245 shutdown_connections 2022-04-03T21:50:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 --2- 172.21.15.49:0/4286654245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00b9360 0x7fcdb006c060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 --2- 172.21.15.49:0/4286654245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00bdac0 0x7fcdb00b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 -- 172.21.15.49:0/4286654245 >> 172.21.15.49:0/4286654245 conn(0x7fcdb00675b0 msgr2=0x7fcdb00bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:29.956 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 -- 172.21.15.49:0/4286654245 shutdown_connections 2022-04-03T21:50:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.948+0000 7fcdb612e700 1 -- 172.21.15.49:0/4286654245 wait complete. 2022-04-03T21:50:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.950+0000 7fcdb612e700 1 Processor -- start 2022-04-03T21:50:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.950+0000 7fcdb612e700 1 -- start start 2022-04-03T21:50:29.960 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdb612e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 0x7fcdb00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdb612e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdb00bdac0 0x7fcdb01480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdb612e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00bde90 0x7fcdb0140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdb612e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00b5c50 con 0x7fcdb00bde90 2022-04-03T21:50:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdb612e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00b4310 con 0x7fcdb00bdac0 2022-04-03T21:50:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdb612e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0148a20 con 0x7fcdb00b9360 2022-04-03T21:50:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 0x7fcdb00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaeffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdb00bdac0 0x7fcdb01480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 0x7fcdb00b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45898/0 (socket says 172.21.15.49:45898) 2022-04-03T21:50:29.962 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 -- 172.21.15.49:0/1428325599 learned_addr learned my addr 172.21.15.49:0/1428325599 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaffff700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00bde90 0x7fcdb0140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 -- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdb00bdac0 msgr2=0x7fcdb01480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdb00bdac0 0x7fcdb01480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 -- 172.21.15.49:0/1428325599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00bde90 msgr2=0x7fcdb0140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00bde90 0x7fcdb0140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.951+0000 7fcdaf7fe700 1 -- 172.21.15.49:0/1428325599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00092a0 con 0x7fcdb00b9360 2022-04-03T21:50:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.952+0000 7fcdaf7fe700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 0x7fcdb00b3810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcda000ea50 tx=0x7fcda0009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.952+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0009600 con 0x7fcdb00b9360 2022-04-03T21:50:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.952+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000c850 con 0x7fcdb00b9360 2022-04-03T21:50:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.952+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000cbf0 con 0x7fcdb00b9360 2022-04-03T21:50:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.952+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda8009a20 con 0x7fcdb00b9360 2022-04-03T21:50:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.952+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb0147760 con 0x7fcdb00b9360 2022-04-03T21:50:29.965 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.953+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb0063f30 con 0x7fcdb00b9360 2022-04-03T21:50:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.954+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fcda0019030 con 0x7fcdb00b9360 2022-04-03T21:50:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.955+0000 7fcd977fe700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcd90063d10 0x7fcd900661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.955+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcda0080a50 con 0x7fcdb00b9360 2022-04-03T21:50:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.955+0000 7fcdaeffd700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcd90063d10 0x7fcd900661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:29.966 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.956+0000 7fcdaeffd700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcd90063d10 0x7fcd900661c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00bb650 tx=0x7fcda4000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:29.960+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7fcda004f340 con 0x7fcdb00b9360 2022-04-03T21:50:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.164+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcdb0070a20 con 0x7fcdb00b9360 2022-04-03T21:50:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.165+0000 7fcd977fe700 1 -- 172.21.15.49:0/1428325599 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcda0052960 con 0x7fcdb00b9360 2022-04-03T21:50:30.168 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2022-04-03T21:50:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.167+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcd90063d10 msgr2=0x7fcd900661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.167+0000 7fcdb612e700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcd90063d10 0x7fcd900661c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00bb650 tx=0x7fcda4000bc0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 msgr2=0x7fcdb00b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 0x7fcdb00b3810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcda000ea50 tx=0x7fcda0009060 comp rx=0 tx=0).stop 2022-04-03T21:50:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 shutdown_connections 2022-04-03T21:50:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fcd90063d10 0x7fcd900661c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdb00bde90 0x7fcdb0140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdb00b9360 0x7fcdb00b3810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 --2- 172.21.15.49:0/1428325599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdb00bdac0 0x7fcdb01480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 >> 172.21.15.49:0/1428325599 conn(0x7fcdb00675b0 msgr2=0x7fcdb00ba390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:30.175 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 shutdown_connections 2022-04-03T21:50:30.175 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.168+0000 7fcdb612e700 1 -- 172.21.15.49:0/1428325599 wait complete. 2022-04-03T21:50:30.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-03T21:50:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.407+0000 7f6650cda700 1 Processor -- start 2022-04-03T21:50:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.407+0000 7f6650cda700 1 -- start start 2022-04-03T21:50:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f6650cda700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f664c0ba230 0x7f664c0ba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f6650cda700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f664c0b3590 0x7f664c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f6650cda700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c147fa0 con 0x7f664c06a2f0 2022-04-03T21:50:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f6650cda700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c0b5be0 con 0x7f664c0b3590 2022-04-03T21:50:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f6650cda700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c068230 con 0x7f664c0ba230 2022-04-03T21:50:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f664b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f664c0ba230 0x7f664c0ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f664affd700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f664c06a2f0 0x7f664c148430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.49:47456/0 (socket says 172.21.15.49:47456) 2022-04-03T21:50:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f664affd700 1 -- 172.21.15.49:0/1323436034 learned_addr learned my addr 172.21.15.49:0/1323436034 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.408+0000 7f664b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f664c0ba230 0x7f664c0ba600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35496/0 (socket says 172.21.15.49:35496) 2022-04-03T21:50:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664bfff700 1 --2- 172.21.15.49:0/1323436034 >> v2:172.21.15.49:3300/0 conn(0x7f664c0b3590 0x7f664c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664a7fc700 1 -- 172.21.15.49:0/1323436034 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075747834 0 0) 0x7f664c147fa0 con 0x7f664c06a2f0 2022-04-03T21:50:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664a7fc700 1 -- 172.21.15.49:0/1323436034 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66380033f0 con 0x7f664c06a2f0 2022-04-03T21:50:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664b7fe700 1 -- 172.21.15.49:0/1323436034 >> v2:172.21.15.49:3300/0 conn(0x7f664c0b3590 msgr2=0x7f664c0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664b7fe700 1 --2- 172.21.15.49:0/1323436034 >> v2:172.21.15.49:3300/0 conn(0x7f664c0b3590 0x7f664c0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664b7fe700 1 -- 172.21.15.49:0/1323436034 >> v1:172.21.15.117:6789/0 conn(0x7f664c06a2f0 legacy=0x7f664c148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664b7fe700 1 -- 172.21.15.49:0/1323436034 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c0b3f00 con 0x7f664c0ba230 2022-04-03T21:50:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.409+0000 7f664bfff700 1 --2- 172.21.15.49:0/1323436034 >> v2:172.21.15.49:3300/0 conn(0x7f664c0b3590 0x7f664c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:30.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.410+0000 7f664b7fe700 1 --2- 172.21.15.49:0/1323436034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0ba230 0x7f664c0ba600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f664c068ea0 tx=0x7f663c00b300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0f6563bb558a5c server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:30.420 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.410+0000 7f664a7fc700 1 -- 172.21.15.49:0/1323436034 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00d8c0 con 0x7f664c0ba230 2022-04-03T21:50:30.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.410+0000 7f664a7fc700 1 -- 172.21.15.49:0/1323436034 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c00da20 con 0x7f664c0ba230 2022-04-03T21:50:30.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.410+0000 7f664a7fc700 1 -- 172.21.15.49:0/1323436034 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00ddc0 con 0x7f664c0ba230 2022-04-03T21:50:30.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.410+0000 7f6650cda700 1 -- 172.21.15.49:0/1323436034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0ba230 msgr2=0x7f664c0ba600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.410+0000 7f6650cda700 1 --2- 172.21.15.49:0/1323436034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0ba230 0x7f664c0ba600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f664c068ea0 tx=0x7f663c00b300 comp rx=0 tx=0).stop 2022-04-03T21:50:30.421 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.411+0000 7f6650cda700 1 -- 172.21.15.49:0/1323436034 shutdown_connections 2022-04-03T21:50:30.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.411+0000 7f6650cda700 1 --2- 172.21.15.49:0/1323436034 >> v2:172.21.15.49:3300/0 conn(0x7f664c0b3590 0x7f664c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.411+0000 7f6650cda700 1 --2- 172.21.15.49:0/1323436034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0ba230 0x7f664c0ba600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.411+0000 7f6650cda700 1 -- 172.21.15.49:0/1323436034 >> 172.21.15.49:0/1323436034 conn(0x7f664c0bdb50 msgr2=0x7f664c0b9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:30.422 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.411+0000 7f6650cda700 1 -- 172.21.15.49:0/1323436034 shutdown_connections 2022-04-03T21:50:30.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.411+0000 7f6650cda700 1 -- 172.21.15.49:0/1323436034 wait complete. 2022-04-03T21:50:30.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.412+0000 7f6650cda700 1 Processor -- start 2022-04-03T21:50:30.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.412+0000 7f6650cda700 1 -- start start 2022-04-03T21:50:30.423 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.413+0000 7f6650cda700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 0x7f664c149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.413+0000 7f6650cda700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0b3590 0x7f664c15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.413+0000 7f6650cda700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664c0ba230 0x7f664c142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.413+0000 7f6650cda700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c06cd00 con 0x7f664c0ba230 2022-04-03T21:50:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.413+0000 7f6650cda700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c15ebf0 con 0x7f664c0b3590 2022-04-03T21:50:30.424 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.413+0000 7f6650cda700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c06de30 con 0x7f664c06a2f0 2022-04-03T21:50:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664c0ba230 0x7f664c142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0b3590 0x7f664c15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 0x7f664c149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 0x7f664c149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45900/0 (socket says 172.21.15.49:45900) 2022-04-03T21:50:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 -- 172.21.15.49:0/3405586294 learned_addr learned my addr 172.21.15.49:0/3405586294 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 -- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0b3590 msgr2=0x7f664c15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0b3590 0x7f664c15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.426 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 -- 172.21.15.49:0/3405586294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664c0ba230 msgr2=0x7f664c142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664c0ba230 0x7f664c142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 -- 172.21.15.49:0/3405586294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009a20 con 0x7f664c06a2f0 2022-04-03T21:50:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664bfff700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664c0ba230 0x7f664c142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.414+0000 7f664b7fe700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 0x7f664c149ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f663c00d680 tx=0x7f663c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:30.427 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.415+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00d8c0 con 0x7f664c06a2f0 2022-04-03T21:50:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.415+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c0198a0 con 0x7f664c06a2f0 2022-04-03T21:50:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.415+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c019c40 con 0x7f664c06a2f0 2022-04-03T21:50:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.415+0000 7f6650cda700 1 -- 172.21.15.49:0/3405586294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c00b540 con 0x7f664c06a2f0 2022-04-03T21:50:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.415+0000 7f6650cda700 1 -- 172.21.15.49:0/3405586294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c06c990 con 0x7f664c06a2f0 2022-04-03T21:50:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.417+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6620005130 con 0x7f664c06a2f0 2022-04-03T21:50:30.429 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.417+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f663c0034e0 con 0x7f664c06a2f0 2022-04-03T21:50:30.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.418+0000 7f66337fe700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f662c063db0 0x7f662c066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:30.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.418+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f663c014070 con 0x7f664c06a2f0 2022-04-03T21:50:30.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.418+0000 7f664affd700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f662c063db0 0x7f662c066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:30.430 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.419+0000 7f664affd700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f662c063db0 0x7f662c066260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f664c06c7b0 tx=0x7f6640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:30.431 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.423+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f663c051060 con 0x7f664c06a2f0 2022-04-03T21:50:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.671+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6620005960 con 0x7f664c06a2f0 2022-04-03T21:50:30.675 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.672+0000 7f66337fe700 1 -- 172.21.15.49:0/3405586294 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f663c054680 con 0x7f664c06a2f0 2022-04-03T21:50:30.675 INFO:teuthology.orchestra.run.smithi049.stdout: 2022-04-03T21:50:30.675 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2007434057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2007434057},{"type":"v1","addr":"172.21.15.117:6837","nonce":2007434057}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/561054047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":561054047},{"type":"v1","addr":"172.21.15.117:6836","nonce":561054047}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3845909239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3845909239},{"type":"v1","addr":"172.21.15.49:6833","nonce":3845909239}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-03T21:49:58.381806+0000","modified":"2022-04-03T21:50:18.831161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1189888216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1189888216},{"type":"v1","addr":"172.21.15.49:6835","nonce":1189888216}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-03T21:50:30.677 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.674+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f662c063db0 msgr2=0x7f662c066260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.674+0000 7f66317fa700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f662c063db0 0x7f662c066260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f664c06c7b0 tx=0x7f6640009040 comp rx=0 tx=0).stop 2022-04-03T21:50:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.674+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 msgr2=0x7f664c149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.674+0000 7f66317fa700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 0x7f664c149ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f663c00d680 tx=0x7f663c01b000 comp rx=0 tx=0).stop 2022-04-03T21:50:30.678 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 shutdown_connections 2022-04-03T21:50:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f662c063db0 0x7f662c066260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664c0ba230 0x7f664c142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f664c06a2f0 0x7f664c149ee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 --2- 172.21.15.49:0/3405586294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f664c0b3590 0x7f664c15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:30.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 >> 172.21.15.49:0/3405586294 conn(0x7f664c0bdb50 msgr2=0x7f664c146d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:30.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 shutdown_connections 2022-04-03T21:50:30.680 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:30.675+0000 7f66317fa700 1 -- 172.21.15.49:0/3405586294 wait complete. 2022-04-03T21:50:30.681 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2022-04-03T21:50:31.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-03T21:49:58.381806+0000', 'modified': '2022-04-03T21:50:18.831161+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/1189888216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 1189888216}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 1189888216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-03T21:50:31.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-04-03T21:50:31.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-04-03T21:50:31.319 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.317+0000 7fd7baf67700 1 Processor -- start 2022-04-03T21:50:31.320 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.317+0000 7fd7baf67700 1 -- start start 2022-04-03T21:50:31.321 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7baf67700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7b40c1f00 0x7fd7b40a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7baf67700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7b40c22d0 0x7fd7b40a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7baf67700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b40bdee0 con 0x7fd7b40bc010 2022-04-03T21:50:31.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7baf67700 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40bc900 con 0x7fd7b40c22d0 2022-04-03T21:50:31.322 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7baf67700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40a5040 con 0x7fd7b40c1f00 2022-04-03T21:50:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7b3fff700 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd7b40c22d0 0x7fd7b40a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7b9504700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd7b40bc010 0x7fd7b414e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50518/0 (socket says 172.21.15.49:50518) 2022-04-03T21:50:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.318+0000 7fd7b9504700 1 -- 172.21.15.49:0/428006120 learned_addr learned my addr 172.21.15.49:0/428006120 (peer_addr_for_me v1:172.21.15.49:0/0) 2022-04-03T21:50:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/428006120 >> v2:172.21.15.117:3300/0 conn(0x7fd7b40c1f00 0x7fd7b40a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b3fff700 1 -- 172.21.15.49:0/428006120 >> v2:172.21.15.117:3300/0 conn(0x7fd7b40c1f00 msgr2=0x7fd7b40a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/428006120 >> v2:172.21.15.117:3300/0 conn(0x7fd7b40c1f00 0x7fd7b40a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b3fff700 1 -- 172.21.15.49:0/428006120 >> v1:172.21.15.49:6789/0 conn(0x7fd7b40bc010 legacy=0x7fd7b414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b37fe700 1 -- 172.21.15.49:0/428006120 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887481394 0 0) 0x7fd7b40bdee0 con 0x7fd7b40bc010 2022-04-03T21:50:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b3fff700 1 -- 172.21.15.49:0/428006120 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b40bd640 con 0x7fd7b40c22d0 2022-04-03T21:50:31.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.319+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/428006120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40c22d0 0x7fd7b40a6de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40bcc20 tx=0x7fd7a0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd83c4d47608af3 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7b37fe700 1 -- 172.21.15.49:0/428006120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0011630 con 0x7fd7b40c22d0 2022-04-03T21:50:31.328 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7b37fe700 1 -- 172.21.15.49:0/428006120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0011790 con 0x7fd7b40c22d0 2022-04-03T21:50:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7b37fe700 1 -- 172.21.15.49:0/428006120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0011b30 con 0x7fd7b40c22d0 2022-04-03T21:50:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 -- 172.21.15.49:0/428006120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40c22d0 msgr2=0x7fd7b40a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 --2- 172.21.15.49:0/428006120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40c22d0 0x7fd7b40a6de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40bcc20 tx=0x7fd7a0009060 comp rx=0 tx=0).stop 2022-04-03T21:50:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 -- 172.21.15.49:0/428006120 shutdown_connections 2022-04-03T21:50:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 --2- 172.21.15.49:0/428006120 >> v2:172.21.15.117:3300/0 conn(0x7fd7b40c1f00 0x7fd7b40a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 --2- 172.21.15.49:0/428006120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40c22d0 0x7fd7b40a6de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 -- 172.21.15.49:0/428006120 >> 172.21.15.49:0/428006120 conn(0x7fd7b405e010 msgr2=0x7fd7b40c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.320+0000 7fd7baf67700 1 -- 172.21.15.49:0/428006120 shutdown_connections 2022-04-03T21:50:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.321+0000 7fd7baf67700 1 -- 172.21.15.49:0/428006120 wait complete. 2022-04-03T21:50:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.322+0000 7fd7baf67700 1 Processor -- start 2022-04-03T21:50:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.322+0000 7fd7baf67700 1 -- start start 2022-04-03T21:50:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7baf67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40bc010 0x7fd7b415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7baf67700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 0x7fd7b40b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7baf67700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b40c22d0 0x7fd7b4149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7baf67700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40b5b60 con 0x7fd7b40bc010 2022-04-03T21:50:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7baf67700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40b6260 con 0x7fd7b40c22d0 2022-04-03T21:50:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7baf67700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b415e750 con 0x7fd7b40c1f00 2022-04-03T21:50:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40bc010 0x7fd7b415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.332 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 0x7fd7b40b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 0x7fd7b40b96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45902/0 (socket says 172.21.15.49:45902) 2022-04-03T21:50:31.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.323+0000 7fd7b9504700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b40c22d0 0x7fd7b4149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 -- 172.21.15.49:0/2966054740 learned_addr learned my addr 172.21.15.49:0/2966054740 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.333 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 -- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b40c22d0 msgr2=0x7fd7b4149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b40c22d0 0x7fd7b4149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 -- 172.21.15.49:0/2966054740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40bc010 msgr2=0x7fd7b415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40bc010 0x7fd7b415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 -- 172.21.15.49:0/2966054740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00092a0 con 0x7fd7b40c1f00 2022-04-03T21:50:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.324+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 0x7fd7b40b96a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009dd0 tx=0x7fd7a0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.325+0000 7fd7b0ff9700 1 -- 172.21.15.49:0/2966054740 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00036f0 con 0x7fd7b40c1f00 2022-04-03T21:50:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.325+0000 7fd7b0ff9700 1 -- 172.21.15.49:0/2966054740 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a0003850 con 0x7fd7b40c1f00 2022-04-03T21:50:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.325+0000 7fd7b0ff9700 1 -- 172.21.15.49:0/2966054740 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0003c10 con 0x7fd7b40c1f00 2022-04-03T21:50:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.325+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b415f120 con 0x7fd7b40c1f00 2022-04-03T21:50:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.325+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b40b5880 con 0x7fd7b40c1f00 2022-04-03T21:50:31.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.327+0000 7fd7b0ff9700 1 -- 172.21.15.49:0/2966054740 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7fd7a002b030 con 0x7fd7b40c1f00 2022-04-03T21:50:31.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.328+0000 7fd7b0ff9700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd79c063d10 0x7fd79c0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.342 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.328+0000 7fd7b0ff9700 1 -- 172.21.15.49:0/2966054740 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd7a0082150 con 0x7fd7b40c1f00 2022-04-03T21:50:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.328+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd79c063d10 0x7fd79c0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.329+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd79c063d10 0x7fd79c0661c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009c30 tx=0x7fd7a8009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.330+0000 7fd7c48a2b80 1 Processor -- start 2022-04-03T21:50:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.330+0000 7fd7c48a2b80 1 -- start start 2022-04-03T21:50:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbf8b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfc2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc3980 0x5643bbfc3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbf0be50 con 0x5643bbfc2430 2022-04-03T21:50:31.344 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbe77890 con 0x5643bbfc3980 2022-04-03T21:50:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643bbee0950 con 0x5643bbf86f60 2022-04-03T21:50:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbf8b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfc2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfc2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45904/0 (socket says 172.21.15.49:45904) 2022-04-03T21:50:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.331+0000 7fd7b3fff700 1 -- 172.21.15.49:0/1817045957 learned_addr learned my addr 172.21.15.49:0/1817045957 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b9504700 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc3980 0x5643bbfc3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b3fff700 1 -- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc3980 msgr2=0x5643bbfc3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc3980 0x5643bbfc3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.346 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b3fff700 1 -- 172.21.15.49:0/1817045957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 msgr2=0x5643bbf8b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbf8b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b3fff700 1 -- 172.21.15.49:0/1817045957 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643bbcdb540 con 0x5643bbf86f60 2022-04-03T21:50:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfc2800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0011f80 tx=0x7fd7a0082040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eadfbdaf62c1664a server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd795ffb700 1 -- 172.21.15.49:0/1817045957 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0065ea0 con 0x5643bbf86f60 2022-04-03T21:50:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd795ffb700 1 -- 172.21.15.49:0/1817045957 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a005abe0 con 0x5643bbf86f60 2022-04-03T21:50:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.332+0000 7fd795ffb700 1 -- 172.21.15.49:0/1817045957 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0057190 con 0x5643bbf86f60 2022-04-03T21:50:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 msgr2=0x5643bbfc2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfc2800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0011f80 tx=0x7fd7a0082040 comp rx=0 tx=0).stop 2022-04-03T21:50:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1817045957 shutdown_connections 2022-04-03T21:50:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc3980 0x5643bbfc3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbf8b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1817045957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfc2800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1817045957 >> 172.21.15.49:0/1817045957 conn(0x5643bbf89170 msgr2=0x5643bbf8a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.349 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1817045957 shutdown_connections 2022-04-03T21:50:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.333+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1817045957 wait complete. 2022-04-03T21:50:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.334+0000 7fd7c48a2b80 1 -- start start 2022-04-03T21:50:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.334+0000 7fd7c48a2b80 1 Processor -- start 2022-04-03T21:50:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.335+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 0x5643bbfc0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.350 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.335+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbfbf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.335+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.335+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbedaa30 con 0x5643bbfc2430 2022-04-03T21:50:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.335+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbdd6710 con 0x5643bbf86f60 2022-04-03T21:50:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.335+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643bbfbee30 con 0x5643bbfc3980 2022-04-03T21:50:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7c48a2b80 10 client.0 _ll_register_callbacks cb 0x5643bbe8aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-04-03T21:50:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 0x5643bbfc0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbfbf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.352 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 0x5643bbfc0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35506/0 (socket says 172.21.15.49:35506) 2022-04-03T21:50:31.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45906/0 (socket says 172.21.15.49:45906) 2022-04-03T21:50:31.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b8d03700 1 -- 172.21.15.49:0/3157893920 learned_addr learned my addr 172.21.15.49:0/3157893920 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 -- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 msgr2=0x5643bbfc0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.353 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 0x5643bbfc0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 -- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 msgr2=0x5643bbfbf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbfbf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b9504700 1 -- 172.21.15.49:0/3157893920 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b40b5880 con 0x5643bbfc3980 2022-04-03T21:50:31.354 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.336+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 0x5643bbfc0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd7b9504700 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa7a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001560 tx=0x7fd7ac007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154592ed404c58a0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd78effd700 10 client.0 ms_handle_connect on v2:172.21.15.117:3301/0 2022-04-03T21:50:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd78effd700 1 -- 172.21.15.49:0/3157893920 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac01a030 con 0x5643bbfc3980 2022-04-03T21:50:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643bbf7fdd0 con 0x5643bbfc3980 2022-04-03T21:50:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd78effd700 1 -- 172.21.15.49:0/3157893920 <== mon.2 v2:172.21.15.117:3301/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd7ac01b070 con 0x5643bbfc3980 2022-04-03T21:50:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd78effd700 1 -- 172.21.15.49:0/3157893920 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ac0020d0 con 0x5643bbfc3980 2022-04-03T21:50:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd7c48a2b80 10 client.4565 fetch_fsmap learned FSMap version 9 2022-04-03T21:50:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.337+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5643bbd15b10 con 0x5643bbfc3980 2022-04-03T21:50:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd78effd700 1 -- 172.21.15.49:0/3157893920 <== mon.2 v2:172.21.15.117:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac025020 con 0x5643bbfc3980 2022-04-03T21:50:31.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd78effd700 1 -- 172.21.15.49:0/3157893920 <== mon.2 v2:172.21.15.117:3301/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd7ac012050 con 0x5643bbfc3980 2022-04-03T21:50:31.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7c48a2b80 10 client.4565 fetch_fsmap finished waiting for FSMap version 9 2022-04-03T21:50:31.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7c48a2b80 10 client.4565 resolve_mds: resolved name 'c' to daemon mds.c 2022-04-03T21:50:31.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7c48a2b80 20 client.4565 populate_metadata read hostname 'smithi049' 2022-04-03T21:50:31.357 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bbfbbbc0 0x5643bbfbbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7c48a2b80 4 client.4565 mds_command: new command op to 4309 tid=0[{"prefix": "get_command_descriptions"}] 2022-04-03T21:50:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 --> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643bbe8d830 con 0x5643bbfbbbc0 2022-04-03T21:50:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.338+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bbfbbbc0 0x5643bbfbbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.339+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bbfbbbc0 0x5643bbfbbf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dab9ed6e5e44f3c server_cookie=a48f7314f95d35d in_seq=0 out_seq=0 2022-04-03T21:50:31.358 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.339+0000 7fd78effd700 10 client.4565 ms_handle_connect on v2:172.21.15.49:6834/1189888216 2022-04-03T21:50:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd78effd700 1 -- 172.21.15.49:0/3157893920 <== mds.0 v2:172.21.15.49:6834/1189888216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x5643bbe8d830 con 0x5643bbfbbbc0 2022-04-03T21:50:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd78effd700 10 client.4565 handle_command_reply: tid=0 2022-04-03T21:50:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 client.4565 shutdown 2022-04-03T21:50:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 msgr2=0x5643bbfa7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa7a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001560 tx=0x7fd7ac007eb0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 shutdown_connections 2022-04-03T21:50:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bbfbbbc0 0x5643bbfbbf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa7a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbf86f60 0x5643bbfc0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/3157893920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc2430 0x5643bbfbf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd78effd700 0 client.4565 ms_handle_reset on v2:172.21.15.49:6834/1189888216 2022-04-03T21:50:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.340+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 >> 172.21.15.49:0/3157893920 conn(0x5643bbf89170 msgr2=0x5643bbf8a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.341+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 shutdown_connections 2022-04-03T21:50:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.341+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/3157893920 wait complete. 2022-04-03T21:50:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.341+0000 7fd7c48a2b80 20 client.4565 trim_cache size 0 max 16384 2022-04-03T21:50:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.358+0000 7fd7c48a2b80 1 Processor -- start 2022-04-03T21:50:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.358+0000 7fd7c48a2b80 1 -- start start 2022-04-03T21:50:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 0x5643bbf8a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfa75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbf88540 con 0x5643bbf86f60 2022-04-03T21:50:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbf8dfe0 con 0x5643bbfc2430 2022-04-03T21:50:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643bbf6a010 con 0x5643bbfc3980 2022-04-03T21:50:31.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.359+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 0x5643bbf8a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 0x5643bbf8a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34678/0 (socket says 172.21.15.49:34678) 2022-04-03T21:50:31.373 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 -- 172.21.15.49:0/1840211376 learned_addr learned my addr 172.21.15.49:0/1840211376 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b9504700 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfa75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 -- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 msgr2=0x5643bbfa8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 -- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 msgr2=0x5643bbfa75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfa75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 -- 172.21.15.49:0/1840211376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643bbd13fe0 con 0x5643bbf86f60 2022-04-03T21:50:31.375 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.360+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 0x5643bbf8a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5643bbf89750 tx=0x7fd7a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c713606878533d server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7967fc700 1 -- 172.21.15.49:0/1840211376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8026040 con 0x5643bbf86f60 2022-04-03T21:50:31.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7967fc700 1 -- 172.21.15.49:0/1840211376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a8003c70 con 0x5643bbf86f60 2022-04-03T21:50:31.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7967fc700 1 -- 172.21.15.49:0/1840211376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a802c5b0 con 0x5643bbf86f60 2022-04-03T21:50:31.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1840211376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 msgr2=0x5643bbf8a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.376 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 0x5643bbf8a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5643bbf89750 tx=0x7fd7a8016000 comp rx=0 tx=0).stop 2022-04-03T21:50:31.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1840211376 shutdown_connections 2022-04-03T21:50:31.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbfc3980 0x5643bbfa8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbf86f60 0x5643bbf8a890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.377 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/1840211376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfa75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.361+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1840211376 >> 172.21.15.49:0/1840211376 conn(0x5643bbf89170 msgr2=0x5643bbf88930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.362+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1840211376 shutdown_connections 2022-04-03T21:50:31.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.362+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/1840211376 wait complete. 2022-04-03T21:50:31.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.362+0000 7fd7c48a2b80 1 -- start start 2022-04-03T21:50:31.378 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.362+0000 7fd7c48a2b80 1 Processor -- start 2022-04-03T21:50:31.379 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.363+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfa79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.379 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.363+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfe5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.379 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.363+0000 7fd7c48a2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc3980 0x5643bbf85ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.379 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bbfe00d0 con 0x5643bbfc3980 2022-04-03T21:50:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643bc022b30 con 0x5643bbfc2430 2022-04-03T21:50:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7c48a2b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643bc028860 con 0x5643bbf86f60 2022-04-03T21:50:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7c48a2b80 10 client.0 _ll_register_callbacks cb 0x7fd7ac007490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-04-03T21:50:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b9504700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc3980 0x5643bbf85ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.380 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfa79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfe5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfa79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45910/0 (socket says 172.21.15.49:45910) 2022-04-03T21:50:31.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 -- 172.21.15.49:0/768341511 learned_addr learned my addr 172.21.15.49:0/768341511 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.381 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 -- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 msgr2=0x5643bbfe5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfe5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 -- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc3980 msgr2=0x5643bbf85ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc3980 0x5643bbf85ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b8d03700 1 -- 172.21.15.49:0/768341511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8011e20 con 0x5643bbf86f60 2022-04-03T21:50:31.382 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.364+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfe5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:31.383 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd7b8d03700 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfa79b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009ae0 tx=0x7fd7a8031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64552d7896e57d7e server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.383 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd78effd700 10 client.0 ms_handle_connect on v2:172.21.15.117:3301/0 2022-04-03T21:50:31.383 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd78effd700 1 -- 172.21.15.49:0/768341511 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8026050 con 0x5643bbf86f60 2022-04-03T21:50:31.383 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd78effd700 1 -- 172.21.15.49:0/768341511 <== mon.2 v2:172.21.15.117:3301/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd7a801a040 con 0x5643bbf86f60 2022-04-03T21:50:31.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643bbfcc820 con 0x5643bbf86f60 2022-04-03T21:50:31.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd78effd700 1 -- 172.21.15.49:0/768341511 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7a8039070 con 0x5643bbf86f60 2022-04-03T21:50:31.384 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd7c48a2b80 10 client.4571 fetch_fsmap learned FSMap version 9 2022-04-03T21:50:31.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.365+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5643bbd3c160 con 0x5643bbf86f60 2022-04-03T21:50:31.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd78effd700 1 -- 172.21.15.49:0/768341511 <== mon.2 v2:172.21.15.117:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643bbfcc820 con 0x5643bbf86f60 2022-04-03T21:50:31.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd78effd700 1 -- 172.21.15.49:0/768341511 <== mon.2 v2:172.21.15.117:3301/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd7a8032020 con 0x5643bbf86f60 2022-04-03T21:50:31.385 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7c48a2b80 10 client.4571 fetch_fsmap finished waiting for FSMap version 9 2022-04-03T21:50:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7c48a2b80 10 client.4571 resolve_mds: resolved name 'c' to daemon mds.c 2022-04-03T21:50:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7c48a2b80 20 client.4571 populate_metadata read hostname 'smithi049' 2022-04-03T21:50:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bc02c570 0x5643bbf86020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7c48a2b80 4 client.4571 mds_command: new command op to 4309 tid=0[{"prefix": "status"}] 2022-04-03T21:50:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 --> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd7a005abe0 con 0x5643bc02c570 2022-04-03T21:50:31.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.366+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bc02c570 0x5643bbf86020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7b3fff700 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bc02c570 0x5643bbf86020 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b46bbe5a49901beb server_cookie=9db62b9dcefce2fd in_seq=0 out_seq=0 2022-04-03T21:50:31.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd78effd700 10 client.4571 ms_handle_connect on v2:172.21.15.49:6834/1189888216 2022-04-03T21:50:31.387 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd78effd700 1 -- 172.21.15.49:0/768341511 <== mds.0 v2:172.21.15.49:6834/1189888216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7fd7a005abe0 con 0x5643bc02c570 2022-04-03T21:50:31.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd78effd700 10 client.4571 handle_command_reply: tid=0 2022-04-03T21:50:31.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 client.4571 shutdown 2022-04-03T21:50:31.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 msgr2=0x5643bbfa79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfa79b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009ae0 tx=0x7fd7a8031000 comp rx=0 tx=0).stop 2022-04-03T21:50:31.388 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 shutdown_connections 2022-04-03T21:50:31.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:6834/1189888216,v1:172.21.15.49:6835/1189888216] conn(0x5643bc02c570 0x5643bbf86020 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643bbfc3980 0x5643bbf85ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5643bbf86f60 0x5643bbfa79b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.389 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 --2- 172.21.15.49:0/768341511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5643bbfc2430 0x5643bbfe5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 >> 172.21.15.49:0/768341511 conn(0x5643bbf89170 msgr2=0x5643bbf88930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd78effd700 0 client.4571 ms_handle_reset on v2:172.21.15.49:6834/1189888216 2022-04-03T21:50:31.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.367+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 shutdown_connections 2022-04-03T21:50:31.390 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7c48a2b80 1 -- 172.21.15.49:0/768341511 wait complete. 2022-04-03T21:50:31.391 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7c48a2b80 20 client.4571 trim_cache size 0 max 16384 2022-04-03T21:50:31.391 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2022-04-03T21:50:31.391 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "e8e9dd61-1110-4fac-b12e-1468add78161", 2022-04-03T21:50:31.392 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2022-04-03T21:50:31.392 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4309, 2022-04-03T21:50:31.392 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2022-04-03T21:50:31.392 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2022-04-03T21:50:31.393 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2022-04-03T21:50:31.393 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 32.983393104999998, 2022-04-03T21:50:31.393 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 9, 2022-04-03T21:50:31.394 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 28, 2022-04-03T21:50:31.394 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 28, 2022-04-03T21:50:31.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 39.326227517 2022-04-03T21:50:31.394 INFO:teuthology.orchestra.run.smithi049.stdout:} 2022-04-03T21:50:31.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd79c063d10 msgr2=0x7fd79c0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.396 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd79c063d10 0x7fd79c0661c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009c30 tx=0x7fd7a8009060 comp rx=0 tx=0).stop 2022-04-03T21:50:31.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 msgr2=0x7fd7b40b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 0x7fd7b40b96a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009dd0 tx=0x7fd7a0017000 comp rx=0 tx=0).stop 2022-04-03T21:50:31.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 shutdown_connections 2022-04-03T21:50:31.397 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7fd79c063d10 0x7fd79c0661c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b40c22d0 0x7fd7b4149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b40bc010 0x7fd7b415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 --2- 172.21.15.49:0/2966054740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7b40c1f00 0x7fd7b40b96a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.398 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.368+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 >> 172.21.15.49:0/2966054740 conn(0x7fd7b405e010 msgr2=0x7fd7b414cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.369+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 shutdown_connections 2022-04-03T21:50:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.369+0000 7fd7baf67700 1 -- 172.21.15.49:0/2966054740 wait complete. 2022-04-03T21:50:31.399 INFO:teuthology.run_tasks:Running task kclient... 2022-04-03T21:50:31.412 INFO:tasks.kclient:Mounting kernel clients... 2022-04-03T21:50:31.413 INFO:tasks.kclient:config is {'client.0': {}} 2022-04-03T21:50:31.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:31.414 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2022-04-03T21:50:31.467 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2022-04-03T21:50:31.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:31.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2022-04-03T21:50:31.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:31.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2022-04-03T21:50:31.684 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2022-04-03T21:50:31.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-04-03T21:50:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.899+0000 7f7c1e471700 1 Processor -- start 2022-04-03T21:50:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.899+0000 7f7c1e471700 1 -- start start 2022-04-03T21:50:31.913 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1e471700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c1814b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1e471700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c180bff50 0x7f7c180bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1e471700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1806c210 con 0x7f7c1806dca0 2022-04-03T21:50:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1e471700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1814efd0 con 0x7f7c180bff50 2022-04-03T21:50:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1e471700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1814f460 con 0x7f7c180bfb80 2022-04-03T21:50:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1d46f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c1814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.900+0000 7f7c1cc6e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c180bff50 0x7f7c180bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1d46f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c1814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.49:45912/0 (socket says 172.21.15.49:45912) 2022-04-03T21:50:31.917 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1d46f700 1 -- 172.21.15.49:0/76188222 learned_addr learned my addr 172.21.15.49:0/76188222 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1cc6e700 1 -- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 msgr2=0x7f7c1814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-03T21:50:31.918 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1cc6e700 1 --2- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c1814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1cc6e700 1 -- 172.21.15.49:0/76188222 >> v1:172.21.15.49:6789/0 conn(0x7f7c1806dca0 legacy=0x7f7c180a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1cc6e700 1 -- 172.21.15.49:0/76188222 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1806c460 con 0x7f7c180bff50 2022-04-03T21:50:31.919 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1d46f700 1 --2- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c1814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-04-03T21:50:31.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.901+0000 7f7c1cc6e700 1 --2- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180bff50 0x7f7c180bb2b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009790 tx=0x7f7c08009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a125b438e25391 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.920 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c07fff700 1 -- 172.21.15.49:0/76188222 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011630 con 0x7f7c180bff50 2022-04-03T21:50:31.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c07fff700 1 -- 172.21.15.49:0/76188222 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08011790 con 0x7f7c180bff50 2022-04-03T21:50:31.921 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c07fff700 1 -- 172.21.15.49:0/76188222 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011b50 con 0x7f7c180bff50 2022-04-03T21:50:31.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 -- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180bff50 msgr2=0x7f7c180bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.922 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 --2- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180bff50 0x7f7c180bb2b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009790 tx=0x7f7c08009060 comp rx=0 tx=0).stop 2022-04-03T21:50:31.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 -- 172.21.15.49:0/76188222 shutdown_connections 2022-04-03T21:50:31.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 --2- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c1814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.923 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 --2- 172.21.15.49:0/76188222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c180bff50 0x7f7c180bb2b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 -- 172.21.15.49:0/76188222 >> 172.21.15.49:0/76188222 conn(0x7f7c1805e010 msgr2=0x7f7c180bf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:31.924 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 -- 172.21.15.49:0/76188222 shutdown_connections 2022-04-03T21:50:31.925 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.902+0000 7f7c1e471700 1 -- 172.21.15.49:0/76188222 wait complete. 2022-04-03T21:50:31.925 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.904+0000 7f7c1e471700 1 Processor -- start 2022-04-03T21:50:31.926 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.904+0000 7f7c1e471700 1 -- start start 2022-04-03T21:50:31.926 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.905+0000 7f7c1e471700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1806dca0 0x7f7c180a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.927 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.905+0000 7f7c1e471700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c180b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.927 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.905+0000 7f7c1e471700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c180bff50 0x7f7c1814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.928 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.905+0000 7f7c1e471700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1814af00 con 0x7f7c180bff50 2022-04-03T21:50:31.928 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.905+0000 7f7c1e471700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a2740 con 0x7f7c1806dca0 2022-04-03T21:50:31.929 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.905+0000 7f7c1e471700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180bea00 con 0x7f7c180bfb80 2022-04-03T21:50:31.929 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1d46f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1806dca0 0x7f7c180a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.929 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c180b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.930 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1d46f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1806dca0 0x7f7c180a34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.49:35514/0 (socket says 172.21.15.49:35514) 2022-04-03T21:50:31.930 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1d46f700 1 -- 172.21.15.49:0/54799108 learned_addr learned my addr 172.21.15.49:0/54799108 (peer_addr_for_me v2:172.21.15.49:0/0) 2022-04-03T21:50:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1dc70700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c180bff50 0x7f7c1814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.931 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 -- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1806dca0 msgr2=0x7f7c180a34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.932 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1806dca0 0x7f7c180a34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.932 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 -- 172.21.15.49:0/54799108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c180bff50 msgr2=0x7f7c1814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:31.932 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c180bff50 0x7f7c1814f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:31.933 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 -- 172.21.15.49:0/54799108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14009370 con 0x7f7c180bfb80 2022-04-03T21:50:31.933 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.906+0000 7f7c1cc6e700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c180b6f60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c08016000 tx=0x7f7c08017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.934 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.907+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08009130 con 0x7f7c180bfb80 2022-04-03T21:50:31.934 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.907+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08011900 con 0x7f7c180bfb80 2022-04-03T21:50:31.935 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.907+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c080092a0 con 0x7f7c180bfb80 2022-04-03T21:50:31.935 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.907+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801a430 con 0x7f7c180bfb80 2022-04-03T21:50:31.936 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.907+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1814b150 con 0x7f7c180bfb80 2022-04-03T21:50:31.936 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.908+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1804b890 con 0x7f7c180bfb80 2022-04-03T21:50:31.937 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.909+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 81922+0+0 (secure 0 0 0) 0x7f7c0800f050 con 0x7f7c180bfb80 2022-04-03T21:50:31.937 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.910+0000 7f7c057fa700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7bf8063d10 0x7f7bf80661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-04-03T21:50:31.937 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.910+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7c08082260 con 0x7f7c180bfb80 2022-04-03T21:50:31.938 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.910+0000 7f7c1d46f700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7bf8063d10 0x7f7bf80661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-04-03T21:50:31.938 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.911+0000 7f7c1d46f700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7bf8063d10 0x7f7bf80661c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c14006d00 tx=0x7f7c140090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-03T21:50:31.939 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:31.914+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162503 (secure 0 0 0) 0x7f7c08050b50 con 0x7f7c180bfb80 2022-04-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.162+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c1814e6a0 con 0x7f7c180bfb80 2022-04-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.163+0000 7f7c057fa700 1 -- 172.21.15.49:0/54799108 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7c08015070 con 0x7f7c180bfb80 2022-04-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2022-04-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.165+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7bf8063d10 msgr2=0x7f7bf80661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.165+0000 7f7c1e471700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7bf8063d10 0x7f7bf80661c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c14006d00 tx=0x7f7c140090f0 comp rx=0 tx=0).stop 2022-04-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.165+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 msgr2=0x7f7c180b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.165+0000 7f7c1e471700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c180b6f60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c08016000 tx=0x7f7c08017000 comp rx=0 tx=0).stop 2022-04-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.165+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 shutdown_connections 2022-04-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:6832/26568,v1:172.21.15.117:6833/26568] conn(0x7f7bf8063d10 0x7f7bf80661c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c180bff50 0x7f7c1814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1806dca0 0x7f7c180a34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 --2- 172.21.15.49:0/54799108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c180bfb80 0x7f7c180b6f60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-04-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 >> 172.21.15.49:0/54799108 conn(0x7f7c1805e010 msgr2=0x7f7c181507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 shutdown_connections 2022-04-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi049.stderr:2022-04-03T21:50:32.166+0000 7f7c1e471700 1 -- 172.21.15.49:0/54799108 wait complete. 2022-04-03T21:50:32.194 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-04-03T21:50:32.195 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-04-03T21:50:32.195 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2022-04-03T21:50:32.196 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-04-03T21:50:32.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:32.197 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-04-03T21:50:32.197 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-04-03T21:50:32.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-04-03T21:50:32.198 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-04-03T21:50:32.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.200 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2022-04-03T21:50:32.255 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-04-03T21:50:32.255 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-04-03T21:50:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2022-04-03T21:50:32.256 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2022-04-03T21:50:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2022-04-03T21:50:32.257 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2022-04-03T21:50:32.258 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-03T21:50:32.258 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:32.259 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2022-04-03T21:50:32.259 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-03T21:50:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:32.260 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2022-04-03T21:50:32.261 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2022-04-03T21:50:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:32.261 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2022-04-03T21:50:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2022-04-03T21:50:32.262 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42764sec preferred_lft 42764sec 2022-04-03T21:50:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2022-04-03T21:50:32.263 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2022-04-03T21:50:32.264 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-03T21:50:32.264 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2022-04-03T21:50:32.265 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2022-04-03T21:50:32.267 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-04-03T21:50:32.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.268 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:32.269 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:32.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2022-04-03T21:50:32.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2022-04-03T21:50:32.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2022-04-03T21:50:32.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-04-03T21:50:32.272 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:32.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.505 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-04-03T21:50:32.586 INFO:teuthology.orchestra.run.smithi049.stdout:1 2022-04-03T21:50:32.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.591 DEBUG:teuthology.orchestra.run.smithi049:> route 2022-04-03T21:50:32.648 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2022-04-03T21:50:32.648 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-04-03T21:50:32.648 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2022-04-03T21:50:32.649 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2022-04-03T21:50:32.649 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-04-03T21:50:32.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.651 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:32.651 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:32.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2022-04-03T21:50:32.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2022-04-03T21:50:32.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2022-04-03T21:50:32.652 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:32.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.852 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2022-04-03T21:50:32.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.907 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2022-04-03T21:50:32.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:32.963 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:32.963 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:32.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-04-03T21:50:32.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-04-03T21:50:32.964 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:33.134 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-04-03T21:50:33.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:33.135 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:33.135 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:33.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-04-03T21:50:33.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-04-03T21:50:33.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-04-03T21:50:33.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-04-03T21:50:33.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-04-03T21:50:33.137 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:33.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:33.422 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2022-04-03T21:50:33.422 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2022-04-03T21:50:33.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2022-04-03T21:50:33.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2022-04-03T21:50:33.423 DEBUG:teuthology.orchestra.run.smithi049:> ') 2022-04-03T21:50:33.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-04-03T21:50:33.623 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:33.677 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-04-03T21:50:33.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-04-03T21:50:33.679 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:33.731 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2022-04-03T21:50:33.732 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-04-03T21:50:33.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2022-04-03T21:50:33.847 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2022-04-03T21:50:33.847 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2022-04-03T21:50:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2022-04-03T21:50:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2022-04-03T21:50:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@e8e9dd61-1110-4fac-b12e-1468add78161.cephfs=/ 2022-04-03T21:50:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.49:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2022-04-03T21:50:34.337 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-04-03T21:50:34.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-03T21:50:34.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:34.420 INFO:teuthology.run_tasks:Running task workunit... 2022-04-03T21:50:34.433 INFO:tasks.workunit:Pulling workunits from ref cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:50:34.435 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-04-03T21:50:34.435 INFO:tasks.workunit:timeout=3h 2022-04-03T21:50:34.435 INFO:tasks.workunit:cleanup=True 2022-04-03T21:50:34.436 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:34.491 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:34.491 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-04-03T21:50:34.491 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 29h/41d Inode: 1 Links: 2 2022-04-03T21:50:34.492 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-03T21:50:34.492 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:cephfs_t:s0 2022-04-03T21:50:34.492 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-04-03T21:50:34.492 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2022-04-03 21:49:58.386802330 +0000 2022-04-03T21:50:34.492 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2022-04-03 21:50:09.388020855 +0000 2022-04-03T21:50:34.493 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2022-04-03 21:49:58.386802330 +0000 2022-04-03T21:50:34.493 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-04-03T21:50:34.494 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-04-03T21:50:34.581 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cfb8f943163b374162da0d7b0240f267dd46e4e1 2022-04-03T21:50:34.638 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-04-03T21:50:52.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:50:52.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:51:19.577 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 61% (6033/9786) Updating files: 62% (6068/9786) Updating files: 63% (6166/9786) Updating files: 64% (6264/9786) Updating files: 65% (6361/9786) Updating files: 66% (6459/9786) Updating files: 67% (6557/9786) Updating files: 68% (6655/9786) Updating files: 69% (6753/9786) Updating files: 70% (6851/9786) Updating files: 71% (6949/9786) Updating files: 72% (7046/9786) Updating files: 73% (7144/9786) Updating files: 74% (7242/9786) Updating files: 75% (7340/9786) Updating files: 76% (7438/9786) Updating files: 77% (7536/9786) Updating files: 78% (7634/9786) Updating files: 79% (7731/9786) Updating files: 80% (7829/9786) Updating files: 81% (7927/9786) Updating files: 82% (8025/9786) Updating files: 83% (8123/9786) Updating files: 84% (8221/9786) Updating files: 85% (8319/9786) Updating files: 86% (8416/9786) Updating files: 87% (8514/9786) Updating files: 88% (8612/9786) Updating files: 89% (8710/9786) Updating files: 90% (8808/9786) Updating files: 91% (8906/9786) Updating files: 92% (9004/9786) Updating files: 92% (9055/9786) Updating files: 93% (9101/9786) Updating files: 94% (9199/9786) Updating files: 95% (9297/9786) Updating files: 96% (9395/9786) Updating files: 97% (9493/9786) Updating files: 98% (9591/9786) Updating files: 99% (9689/9786) Updating files: 100% (9786/9786) Updating files: 100% (9786/9786), done. 2022-04-03T21:51:21.518 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to 'cfb8f943163b374162da0d7b0240f267dd46e4e1'. 2022-04-03T21:51:21.518 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.519 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-04-03T21:51:21.519 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2022-04-03T21:51:21.519 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2022-04-03T21:51:21.519 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.520 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2022-04-03T21:51:21.520 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2022-04-03T21:51:21.520 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.520 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2022-04-03T21:51:21.521 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.521 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2022-04-03T21:51:21.521 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.521 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2022-04-03T21:51:21.522 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.522 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-04-03T21:51:21.522 INFO:tasks.workunit.client.0.smithi049.stderr: 2022-04-03T21:51:21.522 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at cfb8f943163 mount.ceph: remove `ms_mode' mount option when switching to old-syntax 2022-04-03T21:51:21.564 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-04-03T21:51:21.627 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-04-03T21:51:21.633 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-04-03T21:51:21.633 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-04-03T21:51:21.820 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-04-03T21:51:21.917 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-04-03T21:51:21.997 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-04-03T21:51:22.001 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-04-03T21:51:22.002 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-04-03T21:51:22.080 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-04-03T21:51:22.091 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2022-04-03T21:51:22.091 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-04-03T21:51:22.147 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2022-04-03T21:51:22.148 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2022-04-03T21:51:22.149 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2022-04-03T21:51:22.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2022-04-03T21:51:23.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:51:23.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:51:24.680 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir foo 2022-04-03T21:51:24.688 INFO:tasks.workunit.client.0.smithi049.stderr:+ cp linux-2.6.33.tar.bz2 foo 2022-04-03T21:51:24.821 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir foo/.snap/barsnap 2022-04-03T21:51:24.833 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm foo/linux-2.6.33.tar.bz2 2022-04-03T21:51:24.843 INFO:tasks.workunit.client.0.smithi049.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2022-04-03T21:51:25.300 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'passed: files are identical' 2022-04-03T21:51:25.300 INFO:tasks.workunit.client.0.smithi049.stdout:passed: files are identical 2022-04-03T21:51:25.301 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir foo/.snap/barsnap 2022-04-03T21:51:25.328 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:51:25.329 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:51:25.330 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:51:25.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:51:25.423 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2022-04-03T21:51:25.424 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2022-04-03T21:51:25.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 1 2022-04-03T21:51:25.514 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 2 2022-04-03T21:51:25.514 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 3 2022-04-03T21:51:25.515 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -e file4 ']' 2022-04-03T21:51:25.515 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir .snap/snap1 2022-04-03T21:51:25.527 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 4 2022-04-03T21:51:25.529 INFO:tasks.workunit.client.0.smithi049.stderr:++ ls 2022-04-03T21:51:25.535 INFO:tasks.workunit.client.0.smithi049.stderr:+ now='file1 2022-04-03T21:51:25.536 INFO:tasks.workunit.client.0.smithi049.stderr:file2 2022-04-03T21:51:25.536 INFO:tasks.workunit.client.0.smithi049.stderr:file3 2022-04-03T21:51:25.536 INFO:tasks.workunit.client.0.smithi049.stderr:file4' 2022-04-03T21:51:25.537 INFO:tasks.workunit.client.0.smithi049.stderr:++ ls .snap/snap1 2022-04-03T21:51:25.541 INFO:tasks.workunit.client.0.smithi049.stderr:+ then='file1 2022-04-03T21:51:25.541 INFO:tasks.workunit.client.0.smithi049.stderr:file2 2022-04-03T21:51:25.542 INFO:tasks.workunit.client.0.smithi049.stderr:file3' 2022-04-03T21:51:25.542 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir .snap/snap1 2022-04-03T21:51:25.549 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 'file1 2022-04-03T21:51:25.549 INFO:tasks.workunit.client.0.smithi049.stderr:file2 2022-04-03T21:51:25.549 INFO:tasks.workunit.client.0.smithi049.stderr:file3 2022-04-03T21:51:25.550 INFO:tasks.workunit.client.0.smithi049.stderr:file4' = 'file1 2022-04-03T21:51:25.550 INFO:tasks.workunit.client.0.smithi049.stderr:file2 2022-04-03T21:51:25.551 INFO:tasks.workunit.client.0.smithi049.stderr:file3' ']' 2022-04-03T21:51:25.551 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 1 2022-04-03T21:51:25.557 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 2 2022-04-03T21:51:25.565 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 3 2022-04-03T21:51:25.573 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir .snap/snap1 2022-04-03T21:51:25.583 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 4 2022-04-03T21:51:25.590 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir .snap/snap1 2022-04-03T21:51:25.600 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm file1 file2 file3 file4 2022-04-03T21:51:25.604 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:51:25.605 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:51:25.607 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:51:25.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:51:25.699 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2022-04-03T21:51:25.700 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2022-04-03T21:51:25.771 INFO:tasks.workunit.client.0.smithi049.stdout:Create dir 100 to 199 ... 2022-04-03T21:51:25.885 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 100 2022-04-03T21:51:25.894 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 101 2022-04-03T21:51:25.909 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 102 2022-04-03T21:51:25.924 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 103 2022-04-03T21:51:25.938 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 104 2022-04-03T21:51:25.950 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 105 2022-04-03T21:51:25.961 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 106 2022-04-03T21:51:25.973 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 107 2022-04-03T21:51:25.984 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 108 2022-04-03T21:51:25.995 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 109 2022-04-03T21:51:26.007 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 110 2022-04-03T21:51:26.018 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 111 2022-04-03T21:51:26.030 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 112 2022-04-03T21:51:26.041 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 113 2022-04-03T21:51:26.053 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 114 2022-04-03T21:51:26.065 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 115 2022-04-03T21:51:26.077 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 116 2022-04-03T21:51:26.090 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 117 2022-04-03T21:51:26.101 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 118 2022-04-03T21:51:26.113 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 119 2022-04-03T21:51:26.129 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 120 2022-04-03T21:51:26.144 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 121 2022-04-03T21:51:26.160 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 122 2022-04-03T21:51:26.173 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 123 2022-04-03T21:51:26.182 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 124 2022-04-03T21:51:26.194 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 125 2022-04-03T21:51:26.205 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 126 2022-04-03T21:51:26.216 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 127 2022-04-03T21:51:26.228 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 128 2022-04-03T21:51:26.240 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 129 2022-04-03T21:51:26.252 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 130 2022-04-03T21:51:26.264 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 131 2022-04-03T21:51:26.276 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 132 2022-04-03T21:51:26.288 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 133 2022-04-03T21:51:26.300 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 134 2022-04-03T21:51:26.314 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 135 2022-04-03T21:51:26.325 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 136 2022-04-03T21:51:26.337 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 137 2022-04-03T21:51:26.348 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 138 2022-04-03T21:51:26.360 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 139 2022-04-03T21:51:26.371 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 140 2022-04-03T21:51:26.382 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 141 2022-04-03T21:51:26.394 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 142 2022-04-03T21:51:26.406 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 143 2022-04-03T21:51:26.419 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 144 2022-04-03T21:51:26.532 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 145 2022-04-03T21:51:26.532 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 146 2022-04-03T21:51:26.532 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 147 2022-04-03T21:51:26.533 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 148 2022-04-03T21:51:26.533 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 149 2022-04-03T21:51:26.533 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 150 2022-04-03T21:51:26.533 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 151 2022-04-03T21:51:26.542 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 152 2022-04-03T21:51:26.554 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 153 2022-04-03T21:51:26.565 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 154 2022-04-03T21:51:26.577 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 155 2022-04-03T21:51:26.589 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 156 2022-04-03T21:51:26.601 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 157 2022-04-03T21:51:26.613 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 158 2022-04-03T21:51:26.625 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 159 2022-04-03T21:51:26.637 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 160 2022-04-03T21:51:26.649 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 161 2022-04-03T21:51:26.661 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 162 2022-04-03T21:51:26.674 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 163 2022-04-03T21:51:26.686 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 164 2022-04-03T21:51:26.698 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 165 2022-04-03T21:51:26.710 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 166 2022-04-03T21:51:26.722 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 167 2022-04-03T21:51:26.735 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 168 2022-04-03T21:51:26.747 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 169 2022-04-03T21:51:26.759 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 170 2022-04-03T21:51:26.772 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 171 2022-04-03T21:51:26.783 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 172 2022-04-03T21:51:26.795 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 173 2022-04-03T21:51:26.807 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 174 2022-04-03T21:51:26.820 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 175 2022-04-03T21:51:26.832 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 176 2022-04-03T21:51:26.844 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 177 2022-04-03T21:51:26.856 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 178 2022-04-03T21:51:26.868 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 179 2022-04-03T21:51:26.881 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 180 2022-04-03T21:51:26.893 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 181 2022-04-03T21:51:26.905 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 182 2022-04-03T21:51:26.917 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 183 2022-04-03T21:51:26.929 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 184 2022-04-03T21:51:26.941 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 185 2022-04-03T21:51:26.953 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 186 2022-04-03T21:51:26.965 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 187 2022-04-03T21:51:26.977 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 188 2022-04-03T21:51:26.990 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 189 2022-04-03T21:51:27.002 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 190 2022-04-03T21:51:27.014 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 191 2022-04-03T21:51:27.026 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 192 2022-04-03T21:51:27.038 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 193 2022-04-03T21:51:27.050 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 194 2022-04-03T21:51:27.079 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 195 2022-04-03T21:51:27.096 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 196 2022-04-03T21:51:27.114 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 197 2022-04-03T21:51:27.130 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 198 2022-04-03T21:51:27.146 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 199 2022-04-03T21:51:27.163 INFO:tasks.workunit.client.0.smithi049.stdout:Take first snapshot .snap/test1 2022-04-03T21:51:27.482 INFO:tasks.workunit.client.0.smithi049.stdout:Create dir 200 to 299 ... 2022-04-03T21:51:27.485 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 200 2022-04-03T21:51:27.494 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 201 2022-04-03T21:51:27.506 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 202 2022-04-03T21:51:27.518 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 203 2022-04-03T21:51:27.529 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 204 2022-04-03T21:51:27.541 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 205 2022-04-03T21:51:27.552 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 206 2022-04-03T21:51:27.563 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 207 2022-04-03T21:51:27.574 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 208 2022-04-03T21:51:27.585 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 209 2022-04-03T21:51:27.596 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 210 2022-04-03T21:51:27.606 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 211 2022-04-03T21:51:27.617 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 212 2022-04-03T21:51:27.628 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 213 2022-04-03T21:51:27.640 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 214 2022-04-03T21:51:27.652 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 215 2022-04-03T21:51:27.663 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 216 2022-04-03T21:51:27.675 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 217 2022-04-03T21:51:27.687 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 218 2022-04-03T21:51:27.698 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 219 2022-04-03T21:51:27.710 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 220 2022-04-03T21:51:27.722 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 221 2022-04-03T21:51:27.733 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 222 2022-04-03T21:51:27.745 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 223 2022-04-03T21:51:27.756 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 224 2022-04-03T21:51:27.768 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 225 2022-04-03T21:51:27.780 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 226 2022-04-03T21:51:27.791 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 227 2022-04-03T21:51:27.802 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 228 2022-04-03T21:51:27.814 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 229 2022-04-03T21:51:27.826 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 230 2022-04-03T21:51:27.836 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 231 2022-04-03T21:51:27.848 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 232 2022-04-03T21:51:27.859 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 233 2022-04-03T21:51:27.872 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 234 2022-04-03T21:51:27.890 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 235 2022-04-03T21:51:27.904 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 236 2022-04-03T21:51:27.915 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 237 2022-04-03T21:51:27.947 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 238 2022-04-03T21:51:27.975 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 239 2022-04-03T21:51:27.993 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 240 2022-04-03T21:51:28.004 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 241 2022-04-03T21:51:28.015 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 242 2022-04-03T21:51:28.026 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 243 2022-04-03T21:51:28.037 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 244 2022-04-03T21:51:28.048 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 245 2022-04-03T21:51:28.058 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 246 2022-04-03T21:51:28.069 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 247 2022-04-03T21:51:28.080 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 248 2022-04-03T21:51:28.091 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 249 2022-04-03T21:51:28.101 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 250 2022-04-03T21:51:28.112 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 251 2022-04-03T21:51:28.123 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 252 2022-04-03T21:51:28.134 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 253 2022-04-03T21:51:28.144 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 254 2022-04-03T21:51:28.155 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 255 2022-04-03T21:51:28.167 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 256 2022-04-03T21:51:28.342 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 257 2022-04-03T21:51:28.353 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 258 2022-04-03T21:51:28.364 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 259 2022-04-03T21:51:28.375 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 260 2022-04-03T21:51:28.386 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 261 2022-04-03T21:51:28.397 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 262 2022-04-03T21:51:28.409 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 263 2022-04-03T21:51:28.424 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 264 2022-04-03T21:51:28.438 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 265 2022-04-03T21:51:28.448 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 266 2022-04-03T21:51:28.460 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 267 2022-04-03T21:51:28.476 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 268 2022-04-03T21:51:28.491 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 269 2022-04-03T21:51:28.505 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 270 2022-04-03T21:51:28.519 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 271 2022-04-03T21:51:28.529 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 272 2022-04-03T21:51:28.540 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 273 2022-04-03T21:51:28.551 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 274 2022-04-03T21:51:28.562 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 275 2022-04-03T21:51:28.573 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 276 2022-04-03T21:51:28.584 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 277 2022-04-03T21:51:28.595 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 278 2022-04-03T21:51:28.606 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 279 2022-04-03T21:51:28.617 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 280 2022-04-03T21:51:28.629 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 281 2022-04-03T21:51:28.640 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 282 2022-04-03T21:51:28.651 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 283 2022-04-03T21:51:28.662 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 284 2022-04-03T21:51:28.673 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 285 2022-04-03T21:51:28.684 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 286 2022-04-03T21:51:28.696 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 287 2022-04-03T21:51:28.707 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 288 2022-04-03T21:51:28.718 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 289 2022-04-03T21:51:28.729 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 290 2022-04-03T21:51:28.741 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 291 2022-04-03T21:51:28.752 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 292 2022-04-03T21:51:28.763 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 293 2022-04-03T21:51:28.775 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 294 2022-04-03T21:51:28.787 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 295 2022-04-03T21:51:28.799 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 296 2022-04-03T21:51:28.811 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 297 2022-04-03T21:51:28.822 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 298 2022-04-03T21:51:28.834 INFO:tasks.workunit.client.0.smithi049.stdout: create dir 299 2022-04-03T21:51:28.846 INFO:tasks.workunit.client.0.smithi049.stdout:Create a snapshot in every first level dir ... 2022-04-03T21:51:28.951 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/.snap/snap-subdir-test 2022-04-03T21:51:28.973 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/30 file after the snapshot 2022-04-03T21:51:28.975 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/31 file after the snapshot 2022-04-03T21:51:28.976 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/32 file after the snapshot 2022-04-03T21:51:28.976 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/33 file after the snapshot 2022-04-03T21:51:28.976 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/34 file after the snapshot 2022-04-03T21:51:28.976 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/35 file after the snapshot 2022-04-03T21:51:28.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/36 file after the snapshot 2022-04-03T21:51:28.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/37 file after the snapshot 2022-04-03T21:51:28.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/38 file after the snapshot 2022-04-03T21:51:28.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 100/39 file after the snapshot 2022-04-03T21:51:28.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/.snap/snap-subdir-test 2022-04-03T21:51:29.012 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/30 file after the snapshot 2022-04-03T21:51:29.014 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/31 file after the snapshot 2022-04-03T21:51:29.014 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/32 file after the snapshot 2022-04-03T21:51:29.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/33 file after the snapshot 2022-04-03T21:51:29.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/34 file after the snapshot 2022-04-03T21:51:29.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/35 file after the snapshot 2022-04-03T21:51:29.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/36 file after the snapshot 2022-04-03T21:51:29.016 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/37 file after the snapshot 2022-04-03T21:51:29.016 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/38 file after the snapshot 2022-04-03T21:51:29.016 INFO:tasks.workunit.client.0.smithi049.stdout: create 101/39 file after the snapshot 2022-04-03T21:51:29.016 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/.snap/snap-subdir-test 2022-04-03T21:51:29.049 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/30 file after the snapshot 2022-04-03T21:51:29.051 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/31 file after the snapshot 2022-04-03T21:51:29.051 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/32 file after the snapshot 2022-04-03T21:51:29.051 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/33 file after the snapshot 2022-04-03T21:51:29.052 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/34 file after the snapshot 2022-04-03T21:51:29.052 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/35 file after the snapshot 2022-04-03T21:51:29.052 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/36 file after the snapshot 2022-04-03T21:51:29.052 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/37 file after the snapshot 2022-04-03T21:51:29.052 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/38 file after the snapshot 2022-04-03T21:51:29.053 INFO:tasks.workunit.client.0.smithi049.stdout: create 102/39 file after the snapshot 2022-04-03T21:51:29.053 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/.snap/snap-subdir-test 2022-04-03T21:51:29.079 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/30 file after the snapshot 2022-04-03T21:51:29.081 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/31 file after the snapshot 2022-04-03T21:51:29.081 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/32 file after the snapshot 2022-04-03T21:51:29.081 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/33 file after the snapshot 2022-04-03T21:51:29.081 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/34 file after the snapshot 2022-04-03T21:51:29.082 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/35 file after the snapshot 2022-04-03T21:51:29.082 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/36 file after the snapshot 2022-04-03T21:51:29.082 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/37 file after the snapshot 2022-04-03T21:51:29.082 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/38 file after the snapshot 2022-04-03T21:51:29.082 INFO:tasks.workunit.client.0.smithi049.stdout: create 103/39 file after the snapshot 2022-04-03T21:51:29.083 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/.snap/snap-subdir-test 2022-04-03T21:51:29.112 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/30 file after the snapshot 2022-04-03T21:51:29.114 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/31 file after the snapshot 2022-04-03T21:51:29.114 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/32 file after the snapshot 2022-04-03T21:51:29.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/33 file after the snapshot 2022-04-03T21:51:29.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/34 file after the snapshot 2022-04-03T21:51:29.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/35 file after the snapshot 2022-04-03T21:51:29.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/36 file after the snapshot 2022-04-03T21:51:29.116 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/37 file after the snapshot 2022-04-03T21:51:29.116 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/38 file after the snapshot 2022-04-03T21:51:29.116 INFO:tasks.workunit.client.0.smithi049.stdout: create 104/39 file after the snapshot 2022-04-03T21:51:29.116 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/.snap/snap-subdir-test 2022-04-03T21:51:29.142 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/30 file after the snapshot 2022-04-03T21:51:29.144 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/31 file after the snapshot 2022-04-03T21:51:29.144 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/32 file after the snapshot 2022-04-03T21:51:29.144 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/33 file after the snapshot 2022-04-03T21:51:29.145 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/34 file after the snapshot 2022-04-03T21:51:29.146 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/35 file after the snapshot 2022-04-03T21:51:29.146 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/36 file after the snapshot 2022-04-03T21:51:29.146 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/37 file after the snapshot 2022-04-03T21:51:29.147 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/38 file after the snapshot 2022-04-03T21:51:29.147 INFO:tasks.workunit.client.0.smithi049.stdout: create 105/39 file after the snapshot 2022-04-03T21:51:29.147 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/.snap/snap-subdir-test 2022-04-03T21:51:29.185 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/30 file after the snapshot 2022-04-03T21:51:29.187 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/31 file after the snapshot 2022-04-03T21:51:29.187 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/32 file after the snapshot 2022-04-03T21:51:29.187 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/33 file after the snapshot 2022-04-03T21:51:29.187 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/34 file after the snapshot 2022-04-03T21:51:29.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/35 file after the snapshot 2022-04-03T21:51:29.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/36 file after the snapshot 2022-04-03T21:51:29.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/37 file after the snapshot 2022-04-03T21:51:29.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/38 file after the snapshot 2022-04-03T21:51:29.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 106/39 file after the snapshot 2022-04-03T21:51:29.190 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/.snap/snap-subdir-test 2022-04-03T21:51:29.217 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/30 file after the snapshot 2022-04-03T21:51:29.219 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/31 file after the snapshot 2022-04-03T21:51:29.219 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/32 file after the snapshot 2022-04-03T21:51:29.219 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/33 file after the snapshot 2022-04-03T21:51:29.220 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/34 file after the snapshot 2022-04-03T21:51:29.220 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/35 file after the snapshot 2022-04-03T21:51:29.220 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/36 file after the snapshot 2022-04-03T21:51:29.220 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/37 file after the snapshot 2022-04-03T21:51:29.220 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/38 file after the snapshot 2022-04-03T21:51:29.221 INFO:tasks.workunit.client.0.smithi049.stdout: create 107/39 file after the snapshot 2022-04-03T21:51:29.221 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/.snap/snap-subdir-test 2022-04-03T21:51:29.247 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/30 file after the snapshot 2022-04-03T21:51:29.249 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/31 file after the snapshot 2022-04-03T21:51:29.249 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/32 file after the snapshot 2022-04-03T21:51:29.249 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/33 file after the snapshot 2022-04-03T21:51:29.249 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/34 file after the snapshot 2022-04-03T21:51:29.250 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/35 file after the snapshot 2022-04-03T21:51:29.250 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/36 file after the snapshot 2022-04-03T21:51:29.250 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/37 file after the snapshot 2022-04-03T21:51:29.250 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/38 file after the snapshot 2022-04-03T21:51:29.251 INFO:tasks.workunit.client.0.smithi049.stdout: create 108/39 file after the snapshot 2022-04-03T21:51:29.251 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/.snap/snap-subdir-test 2022-04-03T21:51:29.276 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/30 file after the snapshot 2022-04-03T21:51:29.277 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/31 file after the snapshot 2022-04-03T21:51:29.277 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/32 file after the snapshot 2022-04-03T21:51:29.278 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/33 file after the snapshot 2022-04-03T21:51:29.278 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/34 file after the snapshot 2022-04-03T21:51:29.279 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/35 file after the snapshot 2022-04-03T21:51:29.279 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/36 file after the snapshot 2022-04-03T21:51:29.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/37 file after the snapshot 2022-04-03T21:51:29.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/38 file after the snapshot 2022-04-03T21:51:29.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 109/39 file after the snapshot 2022-04-03T21:51:29.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/.snap/snap-subdir-test 2022-04-03T21:51:29.306 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/30 file after the snapshot 2022-04-03T21:51:29.307 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/31 file after the snapshot 2022-04-03T21:51:29.308 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/32 file after the snapshot 2022-04-03T21:51:29.308 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/33 file after the snapshot 2022-04-03T21:51:29.308 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/34 file after the snapshot 2022-04-03T21:51:29.310 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/35 file after the snapshot 2022-04-03T21:51:29.310 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/36 file after the snapshot 2022-04-03T21:51:29.310 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/37 file after the snapshot 2022-04-03T21:51:29.310 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/38 file after the snapshot 2022-04-03T21:51:29.311 INFO:tasks.workunit.client.0.smithi049.stdout: create 110/39 file after the snapshot 2022-04-03T21:51:29.311 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/.snap/snap-subdir-test 2022-04-03T21:51:29.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/30 file after the snapshot 2022-04-03T21:51:29.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/31 file after the snapshot 2022-04-03T21:51:29.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/32 file after the snapshot 2022-04-03T21:51:29.340 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/33 file after the snapshot 2022-04-03T21:51:29.340 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/34 file after the snapshot 2022-04-03T21:51:29.340 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/35 file after the snapshot 2022-04-03T21:51:29.340 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/36 file after the snapshot 2022-04-03T21:51:29.341 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/37 file after the snapshot 2022-04-03T21:51:29.341 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/38 file after the snapshot 2022-04-03T21:51:29.341 INFO:tasks.workunit.client.0.smithi049.stdout: create 111/39 file after the snapshot 2022-04-03T21:51:29.341 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/.snap/snap-subdir-test 2022-04-03T21:51:29.366 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/30 file after the snapshot 2022-04-03T21:51:29.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/31 file after the snapshot 2022-04-03T21:51:29.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/32 file after the snapshot 2022-04-03T21:51:29.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/33 file after the snapshot 2022-04-03T21:51:29.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/34 file after the snapshot 2022-04-03T21:51:29.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/35 file after the snapshot 2022-04-03T21:51:29.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/36 file after the snapshot 2022-04-03T21:51:29.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/37 file after the snapshot 2022-04-03T21:51:29.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/38 file after the snapshot 2022-04-03T21:51:29.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 112/39 file after the snapshot 2022-04-03T21:51:29.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/.snap/snap-subdir-test 2022-04-03T21:51:29.396 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/30 file after the snapshot 2022-04-03T21:51:29.397 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/31 file after the snapshot 2022-04-03T21:51:29.398 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/32 file after the snapshot 2022-04-03T21:51:29.398 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/33 file after the snapshot 2022-04-03T21:51:29.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/34 file after the snapshot 2022-04-03T21:51:29.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/35 file after the snapshot 2022-04-03T21:51:29.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/36 file after the snapshot 2022-04-03T21:51:29.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/37 file after the snapshot 2022-04-03T21:51:29.400 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/38 file after the snapshot 2022-04-03T21:51:29.400 INFO:tasks.workunit.client.0.smithi049.stdout: create 113/39 file after the snapshot 2022-04-03T21:51:29.400 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/.snap/snap-subdir-test 2022-04-03T21:51:29.426 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/30 file after the snapshot 2022-04-03T21:51:29.428 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/31 file after the snapshot 2022-04-03T21:51:29.429 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/32 file after the snapshot 2022-04-03T21:51:29.429 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/33 file after the snapshot 2022-04-03T21:51:29.429 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/34 file after the snapshot 2022-04-03T21:51:29.429 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/35 file after the snapshot 2022-04-03T21:51:29.430 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/36 file after the snapshot 2022-04-03T21:51:29.430 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/37 file after the snapshot 2022-04-03T21:51:29.430 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/38 file after the snapshot 2022-04-03T21:51:29.430 INFO:tasks.workunit.client.0.smithi049.stdout: create 114/39 file after the snapshot 2022-04-03T21:51:29.431 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/.snap/snap-subdir-test 2022-04-03T21:51:29.457 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/30 file after the snapshot 2022-04-03T21:51:29.459 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/31 file after the snapshot 2022-04-03T21:51:29.460 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/32 file after the snapshot 2022-04-03T21:51:29.460 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/33 file after the snapshot 2022-04-03T21:51:29.460 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/34 file after the snapshot 2022-04-03T21:51:29.460 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/35 file after the snapshot 2022-04-03T21:51:29.461 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/36 file after the snapshot 2022-04-03T21:51:29.461 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/37 file after the snapshot 2022-04-03T21:51:29.461 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/38 file after the snapshot 2022-04-03T21:51:29.461 INFO:tasks.workunit.client.0.smithi049.stdout: create 115/39 file after the snapshot 2022-04-03T21:51:29.462 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/.snap/snap-subdir-test 2022-04-03T21:51:29.488 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/30 file after the snapshot 2022-04-03T21:51:29.490 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/31 file after the snapshot 2022-04-03T21:51:29.491 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/32 file after the snapshot 2022-04-03T21:51:29.491 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/33 file after the snapshot 2022-04-03T21:51:29.491 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/34 file after the snapshot 2022-04-03T21:51:29.491 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/35 file after the snapshot 2022-04-03T21:51:29.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/36 file after the snapshot 2022-04-03T21:51:29.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/37 file after the snapshot 2022-04-03T21:51:29.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/38 file after the snapshot 2022-04-03T21:51:29.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 116/39 file after the snapshot 2022-04-03T21:51:29.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/.snap/snap-subdir-test 2022-04-03T21:51:29.517 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/30 file after the snapshot 2022-04-03T21:51:29.519 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/31 file after the snapshot 2022-04-03T21:51:29.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/32 file after the snapshot 2022-04-03T21:51:29.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/33 file after the snapshot 2022-04-03T21:51:29.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/34 file after the snapshot 2022-04-03T21:51:29.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/35 file after the snapshot 2022-04-03T21:51:29.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/36 file after the snapshot 2022-04-03T21:51:29.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/37 file after the snapshot 2022-04-03T21:51:29.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/38 file after the snapshot 2022-04-03T21:51:29.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 117/39 file after the snapshot 2022-04-03T21:51:29.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/.snap/snap-subdir-test 2022-04-03T21:51:29.547 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/30 file after the snapshot 2022-04-03T21:51:29.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/31 file after the snapshot 2022-04-03T21:51:29.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/32 file after the snapshot 2022-04-03T21:51:29.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/33 file after the snapshot 2022-04-03T21:51:29.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/34 file after the snapshot 2022-04-03T21:51:29.550 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/35 file after the snapshot 2022-04-03T21:51:29.550 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/36 file after the snapshot 2022-04-03T21:51:29.551 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/37 file after the snapshot 2022-04-03T21:51:29.551 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/38 file after the snapshot 2022-04-03T21:51:29.551 INFO:tasks.workunit.client.0.smithi049.stdout: create 118/39 file after the snapshot 2022-04-03T21:51:29.551 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/.snap/snap-subdir-test 2022-04-03T21:51:29.578 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/30 file after the snapshot 2022-04-03T21:51:29.579 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/31 file after the snapshot 2022-04-03T21:51:29.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/32 file after the snapshot 2022-04-03T21:51:29.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/33 file after the snapshot 2022-04-03T21:51:29.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/34 file after the snapshot 2022-04-03T21:51:29.581 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/35 file after the snapshot 2022-04-03T21:51:29.581 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/36 file after the snapshot 2022-04-03T21:51:29.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/37 file after the snapshot 2022-04-03T21:51:29.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/38 file after the snapshot 2022-04-03T21:51:29.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 119/39 file after the snapshot 2022-04-03T21:51:29.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/.snap/snap-subdir-test 2022-04-03T21:51:29.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/30 file after the snapshot 2022-04-03T21:51:29.613 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/31 file after the snapshot 2022-04-03T21:51:29.614 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/32 file after the snapshot 2022-04-03T21:51:29.614 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/33 file after the snapshot 2022-04-03T21:51:29.614 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/34 file after the snapshot 2022-04-03T21:51:29.615 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/35 file after the snapshot 2022-04-03T21:51:29.616 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/36 file after the snapshot 2022-04-03T21:51:29.616 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/37 file after the snapshot 2022-04-03T21:51:29.616 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/38 file after the snapshot 2022-04-03T21:51:29.616 INFO:tasks.workunit.client.0.smithi049.stdout: create 120/39 file after the snapshot 2022-04-03T21:51:29.616 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/.snap/snap-subdir-test 2022-04-03T21:51:29.642 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/30 file after the snapshot 2022-04-03T21:51:29.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/31 file after the snapshot 2022-04-03T21:51:29.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/32 file after the snapshot 2022-04-03T21:51:29.645 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/33 file after the snapshot 2022-04-03T21:51:29.645 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/34 file after the snapshot 2022-04-03T21:51:29.645 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/35 file after the snapshot 2022-04-03T21:51:29.645 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/36 file after the snapshot 2022-04-03T21:51:29.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/37 file after the snapshot 2022-04-03T21:51:29.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/38 file after the snapshot 2022-04-03T21:51:29.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 121/39 file after the snapshot 2022-04-03T21:51:29.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/.snap/snap-subdir-test 2022-04-03T21:51:29.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/30 file after the snapshot 2022-04-03T21:51:29.677 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/31 file after the snapshot 2022-04-03T21:51:29.677 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/32 file after the snapshot 2022-04-03T21:51:29.677 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/33 file after the snapshot 2022-04-03T21:51:29.677 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/34 file after the snapshot 2022-04-03T21:51:29.678 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/35 file after the snapshot 2022-04-03T21:51:29.678 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/36 file after the snapshot 2022-04-03T21:51:29.678 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/37 file after the snapshot 2022-04-03T21:51:29.678 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/38 file after the snapshot 2022-04-03T21:51:29.679 INFO:tasks.workunit.client.0.smithi049.stdout: create 122/39 file after the snapshot 2022-04-03T21:51:29.679 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/.snap/snap-subdir-test 2022-04-03T21:51:29.704 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/30 file after the snapshot 2022-04-03T21:51:29.706 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/31 file after the snapshot 2022-04-03T21:51:29.706 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/32 file after the snapshot 2022-04-03T21:51:29.706 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/33 file after the snapshot 2022-04-03T21:51:29.707 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/34 file after the snapshot 2022-04-03T21:51:29.707 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/35 file after the snapshot 2022-04-03T21:51:29.707 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/36 file after the snapshot 2022-04-03T21:51:29.707 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/37 file after the snapshot 2022-04-03T21:51:29.708 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/38 file after the snapshot 2022-04-03T21:51:29.708 INFO:tasks.workunit.client.0.smithi049.stdout: create 123/39 file after the snapshot 2022-04-03T21:51:29.708 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/.snap/snap-subdir-test 2022-04-03T21:51:29.735 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/30 file after the snapshot 2022-04-03T21:51:29.737 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/31 file after the snapshot 2022-04-03T21:51:29.738 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/32 file after the snapshot 2022-04-03T21:51:29.738 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/33 file after the snapshot 2022-04-03T21:51:29.738 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/34 file after the snapshot 2022-04-03T21:51:29.738 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/35 file after the snapshot 2022-04-03T21:51:29.739 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/36 file after the snapshot 2022-04-03T21:51:29.739 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/37 file after the snapshot 2022-04-03T21:51:29.739 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/38 file after the snapshot 2022-04-03T21:51:29.739 INFO:tasks.workunit.client.0.smithi049.stdout: create 124/39 file after the snapshot 2022-04-03T21:51:29.739 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/.snap/snap-subdir-test 2022-04-03T21:51:29.767 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/30 file after the snapshot 2022-04-03T21:51:29.770 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/31 file after the snapshot 2022-04-03T21:51:29.771 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/32 file after the snapshot 2022-04-03T21:51:29.771 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/33 file after the snapshot 2022-04-03T21:51:29.771 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/34 file after the snapshot 2022-04-03T21:51:29.771 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/35 file after the snapshot 2022-04-03T21:51:29.772 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/36 file after the snapshot 2022-04-03T21:51:29.772 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/37 file after the snapshot 2022-04-03T21:51:29.772 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/38 file after the snapshot 2022-04-03T21:51:29.772 INFO:tasks.workunit.client.0.smithi049.stdout: create 125/39 file after the snapshot 2022-04-03T21:51:29.772 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/.snap/snap-subdir-test 2022-04-03T21:51:29.801 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/30 file after the snapshot 2022-04-03T21:51:29.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/31 file after the snapshot 2022-04-03T21:51:29.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/32 file after the snapshot 2022-04-03T21:51:29.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/33 file after the snapshot 2022-04-03T21:51:29.804 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/34 file after the snapshot 2022-04-03T21:51:29.804 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/35 file after the snapshot 2022-04-03T21:51:29.804 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/36 file after the snapshot 2022-04-03T21:51:29.804 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/37 file after the snapshot 2022-04-03T21:51:29.804 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/38 file after the snapshot 2022-04-03T21:51:29.805 INFO:tasks.workunit.client.0.smithi049.stdout: create 126/39 file after the snapshot 2022-04-03T21:51:29.805 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/.snap/snap-subdir-test 2022-04-03T21:51:29.829 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/30 file after the snapshot 2022-04-03T21:51:29.831 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/31 file after the snapshot 2022-04-03T21:51:29.831 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/32 file after the snapshot 2022-04-03T21:51:29.832 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/33 file after the snapshot 2022-04-03T21:51:29.832 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/34 file after the snapshot 2022-04-03T21:51:29.832 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/35 file after the snapshot 2022-04-03T21:51:29.833 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/36 file after the snapshot 2022-04-03T21:51:29.833 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/37 file after the snapshot 2022-04-03T21:51:29.834 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/38 file after the snapshot 2022-04-03T21:51:29.834 INFO:tasks.workunit.client.0.smithi049.stdout: create 127/39 file after the snapshot 2022-04-03T21:51:29.834 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/.snap/snap-subdir-test 2022-04-03T21:51:29.858 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/30 file after the snapshot 2022-04-03T21:51:29.860 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/31 file after the snapshot 2022-04-03T21:51:29.860 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/32 file after the snapshot 2022-04-03T21:51:29.860 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/33 file after the snapshot 2022-04-03T21:51:29.861 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/34 file after the snapshot 2022-04-03T21:51:29.862 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/35 file after the snapshot 2022-04-03T21:51:29.862 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/36 file after the snapshot 2022-04-03T21:51:29.862 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/37 file after the snapshot 2022-04-03T21:51:29.862 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/38 file after the snapshot 2022-04-03T21:51:29.863 INFO:tasks.workunit.client.0.smithi049.stdout: create 128/39 file after the snapshot 2022-04-03T21:51:29.863 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/.snap/snap-subdir-test 2022-04-03T21:51:29.889 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/30 file after the snapshot 2022-04-03T21:51:29.890 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/31 file after the snapshot 2022-04-03T21:51:29.890 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/32 file after the snapshot 2022-04-03T21:51:29.891 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/33 file after the snapshot 2022-04-03T21:51:29.891 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/34 file after the snapshot 2022-04-03T21:51:29.892 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/35 file after the snapshot 2022-04-03T21:51:29.892 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/36 file after the snapshot 2022-04-03T21:51:29.892 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/37 file after the snapshot 2022-04-03T21:51:29.893 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/38 file after the snapshot 2022-04-03T21:51:29.893 INFO:tasks.workunit.client.0.smithi049.stdout: create 129/39 file after the snapshot 2022-04-03T21:51:29.893 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/.snap/snap-subdir-test 2022-04-03T21:51:29.917 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/30 file after the snapshot 2022-04-03T21:51:29.919 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/31 file after the snapshot 2022-04-03T21:51:29.919 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/32 file after the snapshot 2022-04-03T21:51:29.919 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/33 file after the snapshot 2022-04-03T21:51:29.920 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/34 file after the snapshot 2022-04-03T21:51:29.921 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/35 file after the snapshot 2022-04-03T21:51:29.921 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/36 file after the snapshot 2022-04-03T21:51:29.921 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/37 file after the snapshot 2022-04-03T21:51:29.921 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/38 file after the snapshot 2022-04-03T21:51:29.922 INFO:tasks.workunit.client.0.smithi049.stdout: create 130/39 file after the snapshot 2022-04-03T21:51:29.922 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/.snap/snap-subdir-test 2022-04-03T21:51:29.947 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/30 file after the snapshot 2022-04-03T21:51:29.949 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/31 file after the snapshot 2022-04-03T21:51:29.949 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/32 file after the snapshot 2022-04-03T21:51:29.949 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/33 file after the snapshot 2022-04-03T21:51:29.949 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/34 file after the snapshot 2022-04-03T21:51:29.950 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/35 file after the snapshot 2022-04-03T21:51:29.950 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/36 file after the snapshot 2022-04-03T21:51:29.950 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/37 file after the snapshot 2022-04-03T21:51:29.950 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/38 file after the snapshot 2022-04-03T21:51:29.950 INFO:tasks.workunit.client.0.smithi049.stdout: create 131/39 file after the snapshot 2022-04-03T21:51:29.951 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/.snap/snap-subdir-test 2022-04-03T21:51:29.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/30 file after the snapshot 2022-04-03T21:51:29.979 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/31 file after the snapshot 2022-04-03T21:51:29.979 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/32 file after the snapshot 2022-04-03T21:51:29.979 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/33 file after the snapshot 2022-04-03T21:51:29.979 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/34 file after the snapshot 2022-04-03T21:51:29.980 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/35 file after the snapshot 2022-04-03T21:51:29.980 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/36 file after the snapshot 2022-04-03T21:51:29.980 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/37 file after the snapshot 2022-04-03T21:51:29.980 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/38 file after the snapshot 2022-04-03T21:51:29.980 INFO:tasks.workunit.client.0.smithi049.stdout: create 132/39 file after the snapshot 2022-04-03T21:51:29.981 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/.snap/snap-subdir-test 2022-04-03T21:51:30.006 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/30 file after the snapshot 2022-04-03T21:51:30.008 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/31 file after the snapshot 2022-04-03T21:51:30.008 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/32 file after the snapshot 2022-04-03T21:51:30.008 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/33 file after the snapshot 2022-04-03T21:51:30.008 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/34 file after the snapshot 2022-04-03T21:51:30.009 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/35 file after the snapshot 2022-04-03T21:51:30.009 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/36 file after the snapshot 2022-04-03T21:51:30.009 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/37 file after the snapshot 2022-04-03T21:51:30.009 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/38 file after the snapshot 2022-04-03T21:51:30.010 INFO:tasks.workunit.client.0.smithi049.stdout: create 133/39 file after the snapshot 2022-04-03T21:51:30.010 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/.snap/snap-subdir-test 2022-04-03T21:51:30.036 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/30 file after the snapshot 2022-04-03T21:51:30.038 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/31 file after the snapshot 2022-04-03T21:51:30.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/32 file after the snapshot 2022-04-03T21:51:30.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/33 file after the snapshot 2022-04-03T21:51:30.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/34 file after the snapshot 2022-04-03T21:51:30.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/35 file after the snapshot 2022-04-03T21:51:30.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/36 file after the snapshot 2022-04-03T21:51:30.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/37 file after the snapshot 2022-04-03T21:51:30.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/38 file after the snapshot 2022-04-03T21:51:30.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 134/39 file after the snapshot 2022-04-03T21:51:30.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/.snap/snap-subdir-test 2022-04-03T21:51:30.064 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/30 file after the snapshot 2022-04-03T21:51:30.066 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/31 file after the snapshot 2022-04-03T21:51:30.066 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/32 file after the snapshot 2022-04-03T21:51:30.066 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/33 file after the snapshot 2022-04-03T21:51:30.067 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/34 file after the snapshot 2022-04-03T21:51:30.068 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/35 file after the snapshot 2022-04-03T21:51:30.068 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/36 file after the snapshot 2022-04-03T21:51:30.068 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/37 file after the snapshot 2022-04-03T21:51:30.069 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/38 file after the snapshot 2022-04-03T21:51:30.069 INFO:tasks.workunit.client.0.smithi049.stdout: create 135/39 file after the snapshot 2022-04-03T21:51:30.069 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/.snap/snap-subdir-test 2022-04-03T21:51:30.095 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/30 file after the snapshot 2022-04-03T21:51:30.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/31 file after the snapshot 2022-04-03T21:51:30.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/32 file after the snapshot 2022-04-03T21:51:30.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/33 file after the snapshot 2022-04-03T21:51:30.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/34 file after the snapshot 2022-04-03T21:51:30.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/35 file after the snapshot 2022-04-03T21:51:30.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/36 file after the snapshot 2022-04-03T21:51:30.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/37 file after the snapshot 2022-04-03T21:51:30.099 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/38 file after the snapshot 2022-04-03T21:51:30.099 INFO:tasks.workunit.client.0.smithi049.stdout: create 136/39 file after the snapshot 2022-04-03T21:51:30.099 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/.snap/snap-subdir-test 2022-04-03T21:51:30.123 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/30 file after the snapshot 2022-04-03T21:51:30.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/31 file after the snapshot 2022-04-03T21:51:30.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/32 file after the snapshot 2022-04-03T21:51:30.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/33 file after the snapshot 2022-04-03T21:51:30.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/34 file after the snapshot 2022-04-03T21:51:30.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/35 file after the snapshot 2022-04-03T21:51:30.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/36 file after the snapshot 2022-04-03T21:51:30.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/37 file after the snapshot 2022-04-03T21:51:30.127 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/38 file after the snapshot 2022-04-03T21:51:30.127 INFO:tasks.workunit.client.0.smithi049.stdout: create 137/39 file after the snapshot 2022-04-03T21:51:30.127 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/.snap/snap-subdir-test 2022-04-03T21:51:30.151 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/30 file after the snapshot 2022-04-03T21:51:30.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/31 file after the snapshot 2022-04-03T21:51:30.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/32 file after the snapshot 2022-04-03T21:51:30.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/33 file after the snapshot 2022-04-03T21:51:30.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/34 file after the snapshot 2022-04-03T21:51:30.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/35 file after the snapshot 2022-04-03T21:51:30.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/36 file after the snapshot 2022-04-03T21:51:30.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/37 file after the snapshot 2022-04-03T21:51:30.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/38 file after the snapshot 2022-04-03T21:51:30.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 138/39 file after the snapshot 2022-04-03T21:51:30.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/.snap/snap-subdir-test 2022-04-03T21:51:30.179 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/30 file after the snapshot 2022-04-03T21:51:30.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/31 file after the snapshot 2022-04-03T21:51:30.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/32 file after the snapshot 2022-04-03T21:51:30.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/33 file after the snapshot 2022-04-03T21:51:30.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/34 file after the snapshot 2022-04-03T21:51:30.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/35 file after the snapshot 2022-04-03T21:51:30.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/36 file after the snapshot 2022-04-03T21:51:30.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/37 file after the snapshot 2022-04-03T21:51:30.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/38 file after the snapshot 2022-04-03T21:51:30.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 139/39 file after the snapshot 2022-04-03T21:51:30.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/.snap/snap-subdir-test 2022-04-03T21:51:30.207 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/30 file after the snapshot 2022-04-03T21:51:30.209 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/31 file after the snapshot 2022-04-03T21:51:30.209 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/32 file after the snapshot 2022-04-03T21:51:30.209 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/33 file after the snapshot 2022-04-03T21:51:30.209 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/34 file after the snapshot 2022-04-03T21:51:30.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/35 file after the snapshot 2022-04-03T21:51:30.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/36 file after the snapshot 2022-04-03T21:51:30.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/37 file after the snapshot 2022-04-03T21:51:30.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/38 file after the snapshot 2022-04-03T21:51:30.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 140/39 file after the snapshot 2022-04-03T21:51:30.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/.snap/snap-subdir-test 2022-04-03T21:51:30.234 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/30 file after the snapshot 2022-04-03T21:51:30.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/31 file after the snapshot 2022-04-03T21:51:30.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/32 file after the snapshot 2022-04-03T21:51:30.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/33 file after the snapshot 2022-04-03T21:51:30.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/34 file after the snapshot 2022-04-03T21:51:30.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/35 file after the snapshot 2022-04-03T21:51:30.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/36 file after the snapshot 2022-04-03T21:51:30.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/37 file after the snapshot 2022-04-03T21:51:30.239 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/38 file after the snapshot 2022-04-03T21:51:30.239 INFO:tasks.workunit.client.0.smithi049.stdout: create 141/39 file after the snapshot 2022-04-03T21:51:30.239 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/.snap/snap-subdir-test 2022-04-03T21:51:30.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/30 file after the snapshot 2022-04-03T21:51:30.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/31 file after the snapshot 2022-04-03T21:51:30.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/32 file after the snapshot 2022-04-03T21:51:30.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/33 file after the snapshot 2022-04-03T21:51:30.267 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/34 file after the snapshot 2022-04-03T21:51:30.267 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/35 file after the snapshot 2022-04-03T21:51:30.267 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/36 file after the snapshot 2022-04-03T21:51:30.267 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/37 file after the snapshot 2022-04-03T21:51:30.267 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/38 file after the snapshot 2022-04-03T21:51:30.268 INFO:tasks.workunit.client.0.smithi049.stdout: create 142/39 file after the snapshot 2022-04-03T21:51:30.268 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/.snap/snap-subdir-test 2022-04-03T21:51:30.298 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/30 file after the snapshot 2022-04-03T21:51:30.300 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/31 file after the snapshot 2022-04-03T21:51:30.301 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/32 file after the snapshot 2022-04-03T21:51:30.301 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/33 file after the snapshot 2022-04-03T21:51:30.301 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/34 file after the snapshot 2022-04-03T21:51:30.302 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/35 file after the snapshot 2022-04-03T21:51:30.302 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/36 file after the snapshot 2022-04-03T21:51:30.303 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/37 file after the snapshot 2022-04-03T21:51:30.303 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/38 file after the snapshot 2022-04-03T21:51:30.303 INFO:tasks.workunit.client.0.smithi049.stdout: create 143/39 file after the snapshot 2022-04-03T21:51:30.303 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/.snap/snap-subdir-test 2022-04-03T21:51:30.332 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/30 file after the snapshot 2022-04-03T21:51:30.334 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/31 file after the snapshot 2022-04-03T21:51:30.335 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/32 file after the snapshot 2022-04-03T21:51:30.335 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/33 file after the snapshot 2022-04-03T21:51:30.335 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/34 file after the snapshot 2022-04-03T21:51:30.336 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/35 file after the snapshot 2022-04-03T21:51:30.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/36 file after the snapshot 2022-04-03T21:51:30.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/37 file after the snapshot 2022-04-03T21:51:30.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/38 file after the snapshot 2022-04-03T21:51:30.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 144/39 file after the snapshot 2022-04-03T21:51:30.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/.snap/snap-subdir-test 2022-04-03T21:51:30.367 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/30 file after the snapshot 2022-04-03T21:51:30.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/31 file after the snapshot 2022-04-03T21:51:30.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/32 file after the snapshot 2022-04-03T21:51:30.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/33 file after the snapshot 2022-04-03T21:51:30.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/34 file after the snapshot 2022-04-03T21:51:30.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/35 file after the snapshot 2022-04-03T21:51:30.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/36 file after the snapshot 2022-04-03T21:51:30.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/37 file after the snapshot 2022-04-03T21:51:30.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/38 file after the snapshot 2022-04-03T21:51:30.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 145/39 file after the snapshot 2022-04-03T21:51:30.372 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/.snap/snap-subdir-test 2022-04-03T21:51:30.401 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/30 file after the snapshot 2022-04-03T21:51:30.404 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/31 file after the snapshot 2022-04-03T21:51:30.404 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/32 file after the snapshot 2022-04-03T21:51:30.404 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/33 file after the snapshot 2022-04-03T21:51:30.404 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/34 file after the snapshot 2022-04-03T21:51:30.405 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/35 file after the snapshot 2022-04-03T21:51:30.405 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/36 file after the snapshot 2022-04-03T21:51:30.405 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/37 file after the snapshot 2022-04-03T21:51:30.405 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/38 file after the snapshot 2022-04-03T21:51:30.406 INFO:tasks.workunit.client.0.smithi049.stdout: create 146/39 file after the snapshot 2022-04-03T21:51:30.406 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/.snap/snap-subdir-test 2022-04-03T21:51:30.437 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/30 file after the snapshot 2022-04-03T21:51:30.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/31 file after the snapshot 2022-04-03T21:51:30.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/32 file after the snapshot 2022-04-03T21:51:30.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/33 file after the snapshot 2022-04-03T21:51:30.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/34 file after the snapshot 2022-04-03T21:51:30.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/35 file after the snapshot 2022-04-03T21:51:30.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/36 file after the snapshot 2022-04-03T21:51:30.441 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/37 file after the snapshot 2022-04-03T21:51:30.442 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/38 file after the snapshot 2022-04-03T21:51:30.442 INFO:tasks.workunit.client.0.smithi049.stdout: create 147/39 file after the snapshot 2022-04-03T21:51:30.442 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/.snap/snap-subdir-test 2022-04-03T21:51:30.466 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/30 file after the snapshot 2022-04-03T21:51:30.468 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/31 file after the snapshot 2022-04-03T21:51:30.468 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/32 file after the snapshot 2022-04-03T21:51:30.469 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/33 file after the snapshot 2022-04-03T21:51:30.469 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/34 file after the snapshot 2022-04-03T21:51:30.469 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/35 file after the snapshot 2022-04-03T21:51:30.470 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/36 file after the snapshot 2022-04-03T21:51:30.470 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/37 file after the snapshot 2022-04-03T21:51:30.471 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/38 file after the snapshot 2022-04-03T21:51:30.471 INFO:tasks.workunit.client.0.smithi049.stdout: create 148/39 file after the snapshot 2022-04-03T21:51:30.471 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/.snap/snap-subdir-test 2022-04-03T21:51:30.496 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/30 file after the snapshot 2022-04-03T21:51:30.497 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/31 file after the snapshot 2022-04-03T21:51:30.497 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/32 file after the snapshot 2022-04-03T21:51:30.497 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/33 file after the snapshot 2022-04-03T21:51:30.498 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/34 file after the snapshot 2022-04-03T21:51:30.499 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/35 file after the snapshot 2022-04-03T21:51:30.499 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/36 file after the snapshot 2022-04-03T21:51:30.499 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/37 file after the snapshot 2022-04-03T21:51:30.499 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/38 file after the snapshot 2022-04-03T21:51:30.499 INFO:tasks.workunit.client.0.smithi049.stdout: create 149/39 file after the snapshot 2022-04-03T21:51:30.500 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/.snap/snap-subdir-test 2022-04-03T21:51:30.525 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/30 file after the snapshot 2022-04-03T21:51:30.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/31 file after the snapshot 2022-04-03T21:51:30.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/32 file after the snapshot 2022-04-03T21:51:30.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/33 file after the snapshot 2022-04-03T21:51:30.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/34 file after the snapshot 2022-04-03T21:51:30.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/35 file after the snapshot 2022-04-03T21:51:30.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/36 file after the snapshot 2022-04-03T21:51:30.530 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/37 file after the snapshot 2022-04-03T21:51:30.530 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/38 file after the snapshot 2022-04-03T21:51:30.530 INFO:tasks.workunit.client.0.smithi049.stdout: create 150/39 file after the snapshot 2022-04-03T21:51:30.530 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/.snap/snap-subdir-test 2022-04-03T21:51:30.555 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/30 file after the snapshot 2022-04-03T21:51:30.556 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/31 file after the snapshot 2022-04-03T21:51:30.556 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/32 file after the snapshot 2022-04-03T21:51:30.557 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/33 file after the snapshot 2022-04-03T21:51:30.558 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/34 file after the snapshot 2022-04-03T21:51:30.558 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/35 file after the snapshot 2022-04-03T21:51:30.558 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/36 file after the snapshot 2022-04-03T21:51:30.559 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/37 file after the snapshot 2022-04-03T21:51:30.559 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/38 file after the snapshot 2022-04-03T21:51:30.559 INFO:tasks.workunit.client.0.smithi049.stdout: create 151/39 file after the snapshot 2022-04-03T21:51:30.559 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/.snap/snap-subdir-test 2022-04-03T21:51:30.584 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/30 file after the snapshot 2022-04-03T21:51:30.585 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/31 file after the snapshot 2022-04-03T21:51:30.586 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/32 file after the snapshot 2022-04-03T21:51:30.586 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/33 file after the snapshot 2022-04-03T21:51:30.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/34 file after the snapshot 2022-04-03T21:51:30.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/35 file after the snapshot 2022-04-03T21:51:30.588 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/36 file after the snapshot 2022-04-03T21:51:30.588 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/37 file after the snapshot 2022-04-03T21:51:30.588 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/38 file after the snapshot 2022-04-03T21:51:30.588 INFO:tasks.workunit.client.0.smithi049.stdout: create 152/39 file after the snapshot 2022-04-03T21:51:30.589 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/.snap/snap-subdir-test 2022-04-03T21:51:30.614 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/30 file after the snapshot 2022-04-03T21:51:30.616 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/31 file after the snapshot 2022-04-03T21:51:30.617 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/32 file after the snapshot 2022-04-03T21:51:30.617 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/33 file after the snapshot 2022-04-03T21:51:30.617 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/34 file after the snapshot 2022-04-03T21:51:30.617 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/35 file after the snapshot 2022-04-03T21:51:30.617 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/36 file after the snapshot 2022-04-03T21:51:30.618 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/37 file after the snapshot 2022-04-03T21:51:30.618 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/38 file after the snapshot 2022-04-03T21:51:30.619 INFO:tasks.workunit.client.0.smithi049.stdout: create 153/39 file after the snapshot 2022-04-03T21:51:30.619 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/.snap/snap-subdir-test 2022-04-03T21:51:30.643 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/30 file after the snapshot 2022-04-03T21:51:30.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/31 file after the snapshot 2022-04-03T21:51:30.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/32 file after the snapshot 2022-04-03T21:51:30.645 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/33 file after the snapshot 2022-04-03T21:51:30.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/34 file after the snapshot 2022-04-03T21:51:30.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/35 file after the snapshot 2022-04-03T21:51:30.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/36 file after the snapshot 2022-04-03T21:51:30.646 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/37 file after the snapshot 2022-04-03T21:51:30.647 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/38 file after the snapshot 2022-04-03T21:51:30.647 INFO:tasks.workunit.client.0.smithi049.stdout: create 154/39 file after the snapshot 2022-04-03T21:51:30.647 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/.snap/snap-subdir-test 2022-04-03T21:51:30.671 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/30 file after the snapshot 2022-04-03T21:51:30.672 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/31 file after the snapshot 2022-04-03T21:51:30.673 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/32 file after the snapshot 2022-04-03T21:51:30.673 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/33 file after the snapshot 2022-04-03T21:51:30.674 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/34 file after the snapshot 2022-04-03T21:51:30.674 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/35 file after the snapshot 2022-04-03T21:51:30.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/36 file after the snapshot 2022-04-03T21:51:30.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/37 file after the snapshot 2022-04-03T21:51:30.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/38 file after the snapshot 2022-04-03T21:51:30.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 155/39 file after the snapshot 2022-04-03T21:51:30.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/.snap/snap-subdir-test 2022-04-03T21:51:30.699 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/30 file after the snapshot 2022-04-03T21:51:30.700 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/31 file after the snapshot 2022-04-03T21:51:30.701 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/32 file after the snapshot 2022-04-03T21:51:30.701 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/33 file after the snapshot 2022-04-03T21:51:30.701 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/34 file after the snapshot 2022-04-03T21:51:30.702 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/35 file after the snapshot 2022-04-03T21:51:30.702 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/36 file after the snapshot 2022-04-03T21:51:30.703 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/37 file after the snapshot 2022-04-03T21:51:30.703 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/38 file after the snapshot 2022-04-03T21:51:30.703 INFO:tasks.workunit.client.0.smithi049.stdout: create 156/39 file after the snapshot 2022-04-03T21:51:30.703 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/.snap/snap-subdir-test 2022-04-03T21:51:30.727 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/30 file after the snapshot 2022-04-03T21:51:30.729 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/31 file after the snapshot 2022-04-03T21:51:30.729 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/32 file after the snapshot 2022-04-03T21:51:30.729 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/33 file after the snapshot 2022-04-03T21:51:30.729 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/34 file after the snapshot 2022-04-03T21:51:30.730 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/35 file after the snapshot 2022-04-03T21:51:30.730 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/36 file after the snapshot 2022-04-03T21:51:30.731 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/37 file after the snapshot 2022-04-03T21:51:30.731 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/38 file after the snapshot 2022-04-03T21:51:30.731 INFO:tasks.workunit.client.0.smithi049.stdout: create 157/39 file after the snapshot 2022-04-03T21:51:30.731 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/.snap/snap-subdir-test 2022-04-03T21:51:30.756 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/30 file after the snapshot 2022-04-03T21:51:30.758 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/31 file after the snapshot 2022-04-03T21:51:30.758 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/32 file after the snapshot 2022-04-03T21:51:30.758 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/33 file after the snapshot 2022-04-03T21:51:30.759 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/34 file after the snapshot 2022-04-03T21:51:30.760 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/35 file after the snapshot 2022-04-03T21:51:30.760 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/36 file after the snapshot 2022-04-03T21:51:30.760 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/37 file after the snapshot 2022-04-03T21:51:30.760 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/38 file after the snapshot 2022-04-03T21:51:30.761 INFO:tasks.workunit.client.0.smithi049.stdout: create 158/39 file after the snapshot 2022-04-03T21:51:30.761 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/.snap/snap-subdir-test 2022-04-03T21:51:30.785 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/30 file after the snapshot 2022-04-03T21:51:30.786 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/31 file after the snapshot 2022-04-03T21:51:30.787 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/32 file after the snapshot 2022-04-03T21:51:30.787 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/33 file after the snapshot 2022-04-03T21:51:30.787 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/34 file after the snapshot 2022-04-03T21:51:30.788 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/35 file after the snapshot 2022-04-03T21:51:30.788 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/36 file after the snapshot 2022-04-03T21:51:30.789 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/37 file after the snapshot 2022-04-03T21:51:30.789 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/38 file after the snapshot 2022-04-03T21:51:30.789 INFO:tasks.workunit.client.0.smithi049.stdout: create 159/39 file after the snapshot 2022-04-03T21:51:30.789 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/.snap/snap-subdir-test 2022-04-03T21:51:30.816 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/30 file after the snapshot 2022-04-03T21:51:30.817 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/31 file after the snapshot 2022-04-03T21:51:30.817 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/32 file after the snapshot 2022-04-03T21:51:30.818 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/33 file after the snapshot 2022-04-03T21:51:30.819 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/34 file after the snapshot 2022-04-03T21:51:30.819 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/35 file after the snapshot 2022-04-03T21:51:30.819 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/36 file after the snapshot 2022-04-03T21:51:30.820 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/37 file after the snapshot 2022-04-03T21:51:30.820 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/38 file after the snapshot 2022-04-03T21:51:30.820 INFO:tasks.workunit.client.0.smithi049.stdout: create 160/39 file after the snapshot 2022-04-03T21:51:30.820 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/.snap/snap-subdir-test 2022-04-03T21:51:30.846 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/30 file after the snapshot 2022-04-03T21:51:30.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/31 file after the snapshot 2022-04-03T21:51:30.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/32 file after the snapshot 2022-04-03T21:51:30.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/33 file after the snapshot 2022-04-03T21:51:30.849 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/34 file after the snapshot 2022-04-03T21:51:30.849 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/35 file after the snapshot 2022-04-03T21:51:30.849 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/36 file after the snapshot 2022-04-03T21:51:30.849 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/37 file after the snapshot 2022-04-03T21:51:30.849 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/38 file after the snapshot 2022-04-03T21:51:30.850 INFO:tasks.workunit.client.0.smithi049.stdout: create 161/39 file after the snapshot 2022-04-03T21:51:30.850 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/.snap/snap-subdir-test 2022-04-03T21:51:30.875 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/30 file after the snapshot 2022-04-03T21:51:30.877 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/31 file after the snapshot 2022-04-03T21:51:30.877 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/32 file after the snapshot 2022-04-03T21:51:30.878 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/33 file after the snapshot 2022-04-03T21:51:30.878 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/34 file after the snapshot 2022-04-03T21:51:30.878 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/35 file after the snapshot 2022-04-03T21:51:30.878 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/36 file after the snapshot 2022-04-03T21:51:30.879 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/37 file after the snapshot 2022-04-03T21:51:30.879 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/38 file after the snapshot 2022-04-03T21:51:30.879 INFO:tasks.workunit.client.0.smithi049.stdout: create 162/39 file after the snapshot 2022-04-03T21:51:30.879 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/.snap/snap-subdir-test 2022-04-03T21:51:30.903 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/30 file after the snapshot 2022-04-03T21:51:30.905 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/31 file after the snapshot 2022-04-03T21:51:30.905 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/32 file after the snapshot 2022-04-03T21:51:30.905 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/33 file after the snapshot 2022-04-03T21:51:30.906 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/34 file after the snapshot 2022-04-03T21:51:30.906 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/35 file after the snapshot 2022-04-03T21:51:30.906 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/36 file after the snapshot 2022-04-03T21:51:30.906 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/37 file after the snapshot 2022-04-03T21:51:30.907 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/38 file after the snapshot 2022-04-03T21:51:30.907 INFO:tasks.workunit.client.0.smithi049.stdout: create 163/39 file after the snapshot 2022-04-03T21:51:30.907 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/.snap/snap-subdir-test 2022-04-03T21:51:30.930 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/30 file after the snapshot 2022-04-03T21:51:30.932 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/31 file after the snapshot 2022-04-03T21:51:30.932 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/32 file after the snapshot 2022-04-03T21:51:30.932 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/33 file after the snapshot 2022-04-03T21:51:30.932 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/34 file after the snapshot 2022-04-03T21:51:30.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/35 file after the snapshot 2022-04-03T21:51:30.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/36 file after the snapshot 2022-04-03T21:51:30.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/37 file after the snapshot 2022-04-03T21:51:30.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/38 file after the snapshot 2022-04-03T21:51:30.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 164/39 file after the snapshot 2022-04-03T21:51:30.934 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/.snap/snap-subdir-test 2022-04-03T21:51:30.957 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/30 file after the snapshot 2022-04-03T21:51:30.958 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/31 file after the snapshot 2022-04-03T21:51:30.959 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/32 file after the snapshot 2022-04-03T21:51:30.959 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/33 file after the snapshot 2022-04-03T21:51:30.959 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/34 file after the snapshot 2022-04-03T21:51:30.959 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/35 file after the snapshot 2022-04-03T21:51:30.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/36 file after the snapshot 2022-04-03T21:51:30.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/37 file after the snapshot 2022-04-03T21:51:30.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/38 file after the snapshot 2022-04-03T21:51:30.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 165/39 file after the snapshot 2022-04-03T21:51:30.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/.snap/snap-subdir-test 2022-04-03T21:51:30.983 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/30 file after the snapshot 2022-04-03T21:51:30.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/31 file after the snapshot 2022-04-03T21:51:30.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/32 file after the snapshot 2022-04-03T21:51:30.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/33 file after the snapshot 2022-04-03T21:51:30.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/34 file after the snapshot 2022-04-03T21:51:30.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/35 file after the snapshot 2022-04-03T21:51:30.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/36 file after the snapshot 2022-04-03T21:51:30.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/37 file after the snapshot 2022-04-03T21:51:30.987 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/38 file after the snapshot 2022-04-03T21:51:30.987 INFO:tasks.workunit.client.0.smithi049.stdout: create 166/39 file after the snapshot 2022-04-03T21:51:30.987 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/.snap/snap-subdir-test 2022-04-03T21:51:31.011 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/30 file after the snapshot 2022-04-03T21:51:31.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/31 file after the snapshot 2022-04-03T21:51:31.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/32 file after the snapshot 2022-04-03T21:51:31.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/33 file after the snapshot 2022-04-03T21:51:31.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/34 file after the snapshot 2022-04-03T21:51:31.014 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/35 file after the snapshot 2022-04-03T21:51:31.014 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/36 file after the snapshot 2022-04-03T21:51:31.014 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/37 file after the snapshot 2022-04-03T21:51:31.014 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/38 file after the snapshot 2022-04-03T21:51:31.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 167/39 file after the snapshot 2022-04-03T21:51:31.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/.snap/snap-subdir-test 2022-04-03T21:51:31.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/30 file after the snapshot 2022-04-03T21:51:31.041 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/31 file after the snapshot 2022-04-03T21:51:31.042 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/32 file after the snapshot 2022-04-03T21:51:31.042 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/33 file after the snapshot 2022-04-03T21:51:31.042 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/34 file after the snapshot 2022-04-03T21:51:31.042 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/35 file after the snapshot 2022-04-03T21:51:31.043 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/36 file after the snapshot 2022-04-03T21:51:31.043 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/37 file after the snapshot 2022-04-03T21:51:31.043 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/38 file after the snapshot 2022-04-03T21:51:31.043 INFO:tasks.workunit.client.0.smithi049.stdout: create 168/39 file after the snapshot 2022-04-03T21:51:31.043 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/.snap/snap-subdir-test 2022-04-03T21:51:31.068 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/30 file after the snapshot 2022-04-03T21:51:31.069 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/31 file after the snapshot 2022-04-03T21:51:31.069 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/32 file after the snapshot 2022-04-03T21:51:31.070 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/33 file after the snapshot 2022-04-03T21:51:31.070 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/34 file after the snapshot 2022-04-03T21:51:31.070 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/35 file after the snapshot 2022-04-03T21:51:31.070 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/36 file after the snapshot 2022-04-03T21:51:31.071 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/37 file after the snapshot 2022-04-03T21:51:31.071 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/38 file after the snapshot 2022-04-03T21:51:31.071 INFO:tasks.workunit.client.0.smithi049.stdout: create 169/39 file after the snapshot 2022-04-03T21:51:31.071 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/.snap/snap-subdir-test 2022-04-03T21:51:31.094 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/30 file after the snapshot 2022-04-03T21:51:31.096 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/31 file after the snapshot 2022-04-03T21:51:31.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/32 file after the snapshot 2022-04-03T21:51:31.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/33 file after the snapshot 2022-04-03T21:51:31.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/34 file after the snapshot 2022-04-03T21:51:31.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/35 file after the snapshot 2022-04-03T21:51:31.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/36 file after the snapshot 2022-04-03T21:51:31.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/37 file after the snapshot 2022-04-03T21:51:31.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/38 file after the snapshot 2022-04-03T21:51:31.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 170/39 file after the snapshot 2022-04-03T21:51:31.098 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/.snap/snap-subdir-test 2022-04-03T21:51:31.122 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/30 file after the snapshot 2022-04-03T21:51:31.124 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/31 file after the snapshot 2022-04-03T21:51:31.124 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/32 file after the snapshot 2022-04-03T21:51:31.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/33 file after the snapshot 2022-04-03T21:51:31.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/34 file after the snapshot 2022-04-03T21:51:31.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/35 file after the snapshot 2022-04-03T21:51:31.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/36 file after the snapshot 2022-04-03T21:51:31.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/37 file after the snapshot 2022-04-03T21:51:31.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/38 file after the snapshot 2022-04-03T21:51:31.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 171/39 file after the snapshot 2022-04-03T21:51:31.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/.snap/snap-subdir-test 2022-04-03T21:51:31.151 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/30 file after the snapshot 2022-04-03T21:51:31.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/31 file after the snapshot 2022-04-03T21:51:31.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/32 file after the snapshot 2022-04-03T21:51:31.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/33 file after the snapshot 2022-04-03T21:51:31.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/34 file after the snapshot 2022-04-03T21:51:31.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/35 file after the snapshot 2022-04-03T21:51:31.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/36 file after the snapshot 2022-04-03T21:51:31.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/37 file after the snapshot 2022-04-03T21:51:31.154 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/38 file after the snapshot 2022-04-03T21:51:31.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 172/39 file after the snapshot 2022-04-03T21:51:31.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/.snap/snap-subdir-test 2022-04-03T21:51:31.177 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/30 file after the snapshot 2022-04-03T21:51:31.179 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/31 file after the snapshot 2022-04-03T21:51:31.180 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/32 file after the snapshot 2022-04-03T21:51:31.180 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/33 file after the snapshot 2022-04-03T21:51:31.180 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/34 file after the snapshot 2022-04-03T21:51:31.180 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/35 file after the snapshot 2022-04-03T21:51:31.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/36 file after the snapshot 2022-04-03T21:51:31.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/37 file after the snapshot 2022-04-03T21:51:31.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/38 file after the snapshot 2022-04-03T21:51:31.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 173/39 file after the snapshot 2022-04-03T21:51:31.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/.snap/snap-subdir-test 2022-04-03T21:51:31.203 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/30 file after the snapshot 2022-04-03T21:51:31.205 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/31 file after the snapshot 2022-04-03T21:51:31.206 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/32 file after the snapshot 2022-04-03T21:51:31.206 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/33 file after the snapshot 2022-04-03T21:51:31.206 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/34 file after the snapshot 2022-04-03T21:51:31.206 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/35 file after the snapshot 2022-04-03T21:51:31.207 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/36 file after the snapshot 2022-04-03T21:51:31.207 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/37 file after the snapshot 2022-04-03T21:51:31.207 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/38 file after the snapshot 2022-04-03T21:51:31.207 INFO:tasks.workunit.client.0.smithi049.stdout: create 174/39 file after the snapshot 2022-04-03T21:51:31.207 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/.snap/snap-subdir-test 2022-04-03T21:51:31.232 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/30 file after the snapshot 2022-04-03T21:51:31.235 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/31 file after the snapshot 2022-04-03T21:51:31.235 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/32 file after the snapshot 2022-04-03T21:51:31.235 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/33 file after the snapshot 2022-04-03T21:51:31.235 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/34 file after the snapshot 2022-04-03T21:51:31.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/35 file after the snapshot 2022-04-03T21:51:31.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/36 file after the snapshot 2022-04-03T21:51:31.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/37 file after the snapshot 2022-04-03T21:51:31.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/38 file after the snapshot 2022-04-03T21:51:31.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 175/39 file after the snapshot 2022-04-03T21:51:31.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/.snap/snap-subdir-test 2022-04-03T21:51:31.260 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/30 file after the snapshot 2022-04-03T21:51:31.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/31 file after the snapshot 2022-04-03T21:51:31.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/32 file after the snapshot 2022-04-03T21:51:31.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/33 file after the snapshot 2022-04-03T21:51:31.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/34 file after the snapshot 2022-04-03T21:51:31.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/35 file after the snapshot 2022-04-03T21:51:31.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/36 file after the snapshot 2022-04-03T21:51:31.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/37 file after the snapshot 2022-04-03T21:51:31.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/38 file after the snapshot 2022-04-03T21:51:31.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 176/39 file after the snapshot 2022-04-03T21:51:31.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/.snap/snap-subdir-test 2022-04-03T21:51:31.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/30 file after the snapshot 2022-04-03T21:51:31.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/31 file after the snapshot 2022-04-03T21:51:31.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/32 file after the snapshot 2022-04-03T21:51:31.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/33 file after the snapshot 2022-04-03T21:51:31.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/34 file after the snapshot 2022-04-03T21:51:31.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/35 file after the snapshot 2022-04-03T21:51:31.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/36 file after the snapshot 2022-04-03T21:51:31.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/37 file after the snapshot 2022-04-03T21:51:31.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/38 file after the snapshot 2022-04-03T21:51:31.291 INFO:tasks.workunit.client.0.smithi049.stdout: create 177/39 file after the snapshot 2022-04-03T21:51:31.291 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/.snap/snap-subdir-test 2022-04-03T21:51:31.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/30 file after the snapshot 2022-04-03T21:51:31.315 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/31 file after the snapshot 2022-04-03T21:51:31.316 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/32 file after the snapshot 2022-04-03T21:51:31.316 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/33 file after the snapshot 2022-04-03T21:51:31.316 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/34 file after the snapshot 2022-04-03T21:51:31.316 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/35 file after the snapshot 2022-04-03T21:51:31.316 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/36 file after the snapshot 2022-04-03T21:51:31.317 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/37 file after the snapshot 2022-04-03T21:51:31.317 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/38 file after the snapshot 2022-04-03T21:51:31.317 INFO:tasks.workunit.client.0.smithi049.stdout: create 178/39 file after the snapshot 2022-04-03T21:51:31.317 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/.snap/snap-subdir-test 2022-04-03T21:51:31.340 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/30 file after the snapshot 2022-04-03T21:51:31.342 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/31 file after the snapshot 2022-04-03T21:51:31.342 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/32 file after the snapshot 2022-04-03T21:51:31.343 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/33 file after the snapshot 2022-04-03T21:51:31.343 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/34 file after the snapshot 2022-04-03T21:51:31.343 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/35 file after the snapshot 2022-04-03T21:51:31.343 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/36 file after the snapshot 2022-04-03T21:51:31.343 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/37 file after the snapshot 2022-04-03T21:51:31.344 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/38 file after the snapshot 2022-04-03T21:51:31.344 INFO:tasks.workunit.client.0.smithi049.stdout: create 179/39 file after the snapshot 2022-04-03T21:51:31.344 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/.snap/snap-subdir-test 2022-04-03T21:51:31.366 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/30 file after the snapshot 2022-04-03T21:51:31.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/31 file after the snapshot 2022-04-03T21:51:31.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/32 file after the snapshot 2022-04-03T21:51:31.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/33 file after the snapshot 2022-04-03T21:51:31.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/34 file after the snapshot 2022-04-03T21:51:31.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/35 file after the snapshot 2022-04-03T21:51:31.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/36 file after the snapshot 2022-04-03T21:51:31.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/37 file after the snapshot 2022-04-03T21:51:31.370 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/38 file after the snapshot 2022-04-03T21:51:31.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 180/39 file after the snapshot 2022-04-03T21:51:31.371 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/.snap/snap-subdir-test 2022-04-03T21:51:31.395 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/30 file after the snapshot 2022-04-03T21:51:31.397 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/31 file after the snapshot 2022-04-03T21:51:31.398 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/32 file after the snapshot 2022-04-03T21:51:31.398 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/33 file after the snapshot 2022-04-03T21:51:31.398 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/34 file after the snapshot 2022-04-03T21:51:31.398 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/35 file after the snapshot 2022-04-03T21:51:31.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/36 file after the snapshot 2022-04-03T21:51:31.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/37 file after the snapshot 2022-04-03T21:51:31.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/38 file after the snapshot 2022-04-03T21:51:31.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 181/39 file after the snapshot 2022-04-03T21:51:31.399 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/.snap/snap-subdir-test 2022-04-03T21:51:31.421 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/30 file after the snapshot 2022-04-03T21:51:31.423 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/31 file after the snapshot 2022-04-03T21:51:31.423 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/32 file after the snapshot 2022-04-03T21:51:31.424 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/33 file after the snapshot 2022-04-03T21:51:31.424 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/34 file after the snapshot 2022-04-03T21:51:31.424 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/35 file after the snapshot 2022-04-03T21:51:31.424 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/36 file after the snapshot 2022-04-03T21:51:31.424 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/37 file after the snapshot 2022-04-03T21:51:31.425 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/38 file after the snapshot 2022-04-03T21:51:31.425 INFO:tasks.workunit.client.0.smithi049.stdout: create 182/39 file after the snapshot 2022-04-03T21:51:31.425 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/.snap/snap-subdir-test 2022-04-03T21:51:31.447 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/30 file after the snapshot 2022-04-03T21:51:31.449 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/31 file after the snapshot 2022-04-03T21:51:31.450 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/32 file after the snapshot 2022-04-03T21:51:31.450 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/33 file after the snapshot 2022-04-03T21:51:31.450 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/34 file after the snapshot 2022-04-03T21:51:31.450 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/35 file after the snapshot 2022-04-03T21:51:31.451 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/36 file after the snapshot 2022-04-03T21:51:31.451 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/37 file after the snapshot 2022-04-03T21:51:31.451 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/38 file after the snapshot 2022-04-03T21:51:31.451 INFO:tasks.workunit.client.0.smithi049.stdout: create 183/39 file after the snapshot 2022-04-03T21:51:31.451 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/.snap/snap-subdir-test 2022-04-03T21:51:31.473 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/30 file after the snapshot 2022-04-03T21:51:31.475 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/31 file after the snapshot 2022-04-03T21:51:31.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/32 file after the snapshot 2022-04-03T21:51:31.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/33 file after the snapshot 2022-04-03T21:51:31.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/34 file after the snapshot 2022-04-03T21:51:31.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/35 file after the snapshot 2022-04-03T21:51:31.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/36 file after the snapshot 2022-04-03T21:51:31.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/37 file after the snapshot 2022-04-03T21:51:31.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/38 file after the snapshot 2022-04-03T21:51:31.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 184/39 file after the snapshot 2022-04-03T21:51:31.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/.snap/snap-subdir-test 2022-04-03T21:51:31.500 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/30 file after the snapshot 2022-04-03T21:51:31.501 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/31 file after the snapshot 2022-04-03T21:51:31.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/32 file after the snapshot 2022-04-03T21:51:31.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/33 file after the snapshot 2022-04-03T21:51:31.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/34 file after the snapshot 2022-04-03T21:51:31.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/35 file after the snapshot 2022-04-03T21:51:31.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/36 file after the snapshot 2022-04-03T21:51:31.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/37 file after the snapshot 2022-04-03T21:51:31.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/38 file after the snapshot 2022-04-03T21:51:31.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 185/39 file after the snapshot 2022-04-03T21:51:31.504 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/.snap/snap-subdir-test 2022-04-03T21:51:31.526 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/30 file after the snapshot 2022-04-03T21:51:31.528 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/31 file after the snapshot 2022-04-03T21:51:31.528 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/32 file after the snapshot 2022-04-03T21:51:31.528 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/33 file after the snapshot 2022-04-03T21:51:31.528 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/34 file after the snapshot 2022-04-03T21:51:31.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/35 file after the snapshot 2022-04-03T21:51:31.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/36 file after the snapshot 2022-04-03T21:51:31.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/37 file after the snapshot 2022-04-03T21:51:31.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/38 file after the snapshot 2022-04-03T21:51:31.529 INFO:tasks.workunit.client.0.smithi049.stdout: create 186/39 file after the snapshot 2022-04-03T21:51:31.530 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/.snap/snap-subdir-test 2022-04-03T21:51:31.552 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/30 file after the snapshot 2022-04-03T21:51:31.554 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/31 file after the snapshot 2022-04-03T21:51:31.554 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/32 file after the snapshot 2022-04-03T21:51:31.554 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/33 file after the snapshot 2022-04-03T21:51:31.554 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/34 file after the snapshot 2022-04-03T21:51:31.555 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/35 file after the snapshot 2022-04-03T21:51:31.555 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/36 file after the snapshot 2022-04-03T21:51:31.555 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/37 file after the snapshot 2022-04-03T21:51:31.555 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/38 file after the snapshot 2022-04-03T21:51:31.556 INFO:tasks.workunit.client.0.smithi049.stdout: create 187/39 file after the snapshot 2022-04-03T21:51:31.556 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/.snap/snap-subdir-test 2022-04-03T21:51:31.579 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/30 file after the snapshot 2022-04-03T21:51:31.581 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/31 file after the snapshot 2022-04-03T21:51:31.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/32 file after the snapshot 2022-04-03T21:51:31.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/33 file after the snapshot 2022-04-03T21:51:31.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/34 file after the snapshot 2022-04-03T21:51:31.582 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/35 file after the snapshot 2022-04-03T21:51:31.583 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/36 file after the snapshot 2022-04-03T21:51:31.583 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/37 file after the snapshot 2022-04-03T21:51:31.583 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/38 file after the snapshot 2022-04-03T21:51:31.583 INFO:tasks.workunit.client.0.smithi049.stdout: create 188/39 file after the snapshot 2022-04-03T21:51:31.584 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/.snap/snap-subdir-test 2022-04-03T21:51:31.608 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/30 file after the snapshot 2022-04-03T21:51:31.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/31 file after the snapshot 2022-04-03T21:51:31.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/32 file after the snapshot 2022-04-03T21:51:31.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/33 file after the snapshot 2022-04-03T21:51:31.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/34 file after the snapshot 2022-04-03T21:51:31.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/35 file after the snapshot 2022-04-03T21:51:31.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/36 file after the snapshot 2022-04-03T21:51:31.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/37 file after the snapshot 2022-04-03T21:51:31.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/38 file after the snapshot 2022-04-03T21:51:31.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 189/39 file after the snapshot 2022-04-03T21:51:31.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/.snap/snap-subdir-test 2022-04-03T21:51:31.633 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/30 file after the snapshot 2022-04-03T21:51:31.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/31 file after the snapshot 2022-04-03T21:51:31.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/32 file after the snapshot 2022-04-03T21:51:31.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/33 file after the snapshot 2022-04-03T21:51:31.636 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/34 file after the snapshot 2022-04-03T21:51:31.636 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/35 file after the snapshot 2022-04-03T21:51:31.636 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/36 file after the snapshot 2022-04-03T21:51:31.636 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/37 file after the snapshot 2022-04-03T21:51:31.636 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/38 file after the snapshot 2022-04-03T21:51:31.637 INFO:tasks.workunit.client.0.smithi049.stdout: create 190/39 file after the snapshot 2022-04-03T21:51:31.637 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/.snap/snap-subdir-test 2022-04-03T21:51:31.658 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/30 file after the snapshot 2022-04-03T21:51:31.660 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/31 file after the snapshot 2022-04-03T21:51:31.660 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/32 file after the snapshot 2022-04-03T21:51:31.660 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/33 file after the snapshot 2022-04-03T21:51:31.660 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/34 file after the snapshot 2022-04-03T21:51:31.661 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/35 file after the snapshot 2022-04-03T21:51:31.661 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/36 file after the snapshot 2022-04-03T21:51:31.661 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/37 file after the snapshot 2022-04-03T21:51:31.661 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/38 file after the snapshot 2022-04-03T21:51:31.661 INFO:tasks.workunit.client.0.smithi049.stdout: create 191/39 file after the snapshot 2022-04-03T21:51:31.662 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/.snap/snap-subdir-test 2022-04-03T21:51:31.686 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/30 file after the snapshot 2022-04-03T21:51:31.688 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/31 file after the snapshot 2022-04-03T21:51:31.689 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/32 file after the snapshot 2022-04-03T21:51:31.689 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/33 file after the snapshot 2022-04-03T21:51:31.689 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/34 file after the snapshot 2022-04-03T21:51:31.689 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/35 file after the snapshot 2022-04-03T21:51:31.690 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/36 file after the snapshot 2022-04-03T21:51:31.690 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/37 file after the snapshot 2022-04-03T21:51:31.690 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/38 file after the snapshot 2022-04-03T21:51:31.690 INFO:tasks.workunit.client.0.smithi049.stdout: create 192/39 file after the snapshot 2022-04-03T21:51:31.690 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/.snap/snap-subdir-test 2022-04-03T21:51:31.712 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/30 file after the snapshot 2022-04-03T21:51:31.714 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/31 file after the snapshot 2022-04-03T21:51:31.714 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/32 file after the snapshot 2022-04-03T21:51:31.715 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/33 file after the snapshot 2022-04-03T21:51:31.715 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/34 file after the snapshot 2022-04-03T21:51:31.715 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/35 file after the snapshot 2022-04-03T21:51:31.715 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/36 file after the snapshot 2022-04-03T21:51:31.715 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/37 file after the snapshot 2022-04-03T21:51:31.716 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/38 file after the snapshot 2022-04-03T21:51:31.716 INFO:tasks.workunit.client.0.smithi049.stdout: create 193/39 file after the snapshot 2022-04-03T21:51:31.716 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/.snap/snap-subdir-test 2022-04-03T21:51:31.741 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/30 file after the snapshot 2022-04-03T21:51:31.743 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/31 file after the snapshot 2022-04-03T21:51:31.743 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/32 file after the snapshot 2022-04-03T21:51:31.743 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/33 file after the snapshot 2022-04-03T21:51:31.743 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/34 file after the snapshot 2022-04-03T21:51:31.744 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/35 file after the snapshot 2022-04-03T21:51:31.744 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/36 file after the snapshot 2022-04-03T21:51:31.744 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/37 file after the snapshot 2022-04-03T21:51:31.744 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/38 file after the snapshot 2022-04-03T21:51:31.745 INFO:tasks.workunit.client.0.smithi049.stdout: create 194/39 file after the snapshot 2022-04-03T21:51:31.745 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/.snap/snap-subdir-test 2022-04-03T21:51:31.767 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/30 file after the snapshot 2022-04-03T21:51:31.769 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/31 file after the snapshot 2022-04-03T21:51:31.769 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/32 file after the snapshot 2022-04-03T21:51:31.769 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/33 file after the snapshot 2022-04-03T21:51:31.769 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/34 file after the snapshot 2022-04-03T21:51:31.770 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/35 file after the snapshot 2022-04-03T21:51:31.770 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/36 file after the snapshot 2022-04-03T21:51:31.770 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/37 file after the snapshot 2022-04-03T21:51:31.770 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/38 file after the snapshot 2022-04-03T21:51:31.770 INFO:tasks.workunit.client.0.smithi049.stdout: create 195/39 file after the snapshot 2022-04-03T21:51:31.771 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/.snap/snap-subdir-test 2022-04-03T21:51:31.794 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/30 file after the snapshot 2022-04-03T21:51:31.796 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/31 file after the snapshot 2022-04-03T21:51:31.796 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/32 file after the snapshot 2022-04-03T21:51:31.796 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/33 file after the snapshot 2022-04-03T21:51:31.796 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/34 file after the snapshot 2022-04-03T21:51:31.796 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/35 file after the snapshot 2022-04-03T21:51:31.797 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/36 file after the snapshot 2022-04-03T21:51:31.797 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/37 file after the snapshot 2022-04-03T21:51:31.797 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/38 file after the snapshot 2022-04-03T21:51:31.797 INFO:tasks.workunit.client.0.smithi049.stdout: create 196/39 file after the snapshot 2022-04-03T21:51:31.797 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/.snap/snap-subdir-test 2022-04-03T21:51:31.819 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/30 file after the snapshot 2022-04-03T21:51:31.821 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/31 file after the snapshot 2022-04-03T21:51:31.821 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/32 file after the snapshot 2022-04-03T21:51:31.821 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/33 file after the snapshot 2022-04-03T21:51:31.821 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/34 file after the snapshot 2022-04-03T21:51:31.822 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/35 file after the snapshot 2022-04-03T21:51:31.822 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/36 file after the snapshot 2022-04-03T21:51:31.822 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/37 file after the snapshot 2022-04-03T21:51:31.822 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/38 file after the snapshot 2022-04-03T21:51:31.823 INFO:tasks.workunit.client.0.smithi049.stdout: create 197/39 file after the snapshot 2022-04-03T21:51:31.823 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/.snap/snap-subdir-test 2022-04-03T21:51:31.844 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/30 file after the snapshot 2022-04-03T21:51:31.846 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/31 file after the snapshot 2022-04-03T21:51:31.847 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/32 file after the snapshot 2022-04-03T21:51:31.847 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/33 file after the snapshot 2022-04-03T21:51:31.847 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/34 file after the snapshot 2022-04-03T21:51:31.847 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/35 file after the snapshot 2022-04-03T21:51:31.847 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/36 file after the snapshot 2022-04-03T21:51:31.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/37 file after the snapshot 2022-04-03T21:51:31.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/38 file after the snapshot 2022-04-03T21:51:31.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 198/39 file after the snapshot 2022-04-03T21:51:31.848 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/.snap/snap-subdir-test 2022-04-03T21:51:31.869 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/30 file after the snapshot 2022-04-03T21:51:31.871 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/31 file after the snapshot 2022-04-03T21:51:31.871 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/32 file after the snapshot 2022-04-03T21:51:31.871 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/33 file after the snapshot 2022-04-03T21:51:31.872 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/34 file after the snapshot 2022-04-03T21:51:31.872 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/35 file after the snapshot 2022-04-03T21:51:31.872 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/36 file after the snapshot 2022-04-03T21:51:31.872 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/37 file after the snapshot 2022-04-03T21:51:31.873 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/38 file after the snapshot 2022-04-03T21:51:31.873 INFO:tasks.workunit.client.0.smithi049.stdout: create 199/39 file after the snapshot 2022-04-03T21:51:31.873 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/.snap/snap-subdir-test 2022-04-03T21:51:31.897 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/30 file after the snapshot 2022-04-03T21:51:31.899 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/31 file after the snapshot 2022-04-03T21:51:31.900 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/32 file after the snapshot 2022-04-03T21:51:31.900 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/33 file after the snapshot 2022-04-03T21:51:31.900 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/34 file after the snapshot 2022-04-03T21:51:31.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/35 file after the snapshot 2022-04-03T21:51:31.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/36 file after the snapshot 2022-04-03T21:51:31.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/37 file after the snapshot 2022-04-03T21:51:31.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/38 file after the snapshot 2022-04-03T21:51:31.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 200/39 file after the snapshot 2022-04-03T21:51:31.902 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/.snap/snap-subdir-test 2022-04-03T21:51:31.924 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/30 file after the snapshot 2022-04-03T21:51:31.926 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/31 file after the snapshot 2022-04-03T21:51:31.926 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/32 file after the snapshot 2022-04-03T21:51:31.926 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/33 file after the snapshot 2022-04-03T21:51:31.926 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/34 file after the snapshot 2022-04-03T21:51:31.927 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/35 file after the snapshot 2022-04-03T21:51:31.927 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/36 file after the snapshot 2022-04-03T21:51:31.927 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/37 file after the snapshot 2022-04-03T21:51:31.927 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/38 file after the snapshot 2022-04-03T21:51:31.927 INFO:tasks.workunit.client.0.smithi049.stdout: create 201/39 file after the snapshot 2022-04-03T21:51:31.928 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/.snap/snap-subdir-test 2022-04-03T21:51:31.948 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/30 file after the snapshot 2022-04-03T21:51:31.950 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/31 file after the snapshot 2022-04-03T21:51:31.951 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/32 file after the snapshot 2022-04-03T21:51:31.951 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/33 file after the snapshot 2022-04-03T21:51:31.951 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/34 file after the snapshot 2022-04-03T21:51:31.951 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/35 file after the snapshot 2022-04-03T21:51:31.952 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/36 file after the snapshot 2022-04-03T21:51:31.952 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/37 file after the snapshot 2022-04-03T21:51:31.952 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/38 file after the snapshot 2022-04-03T21:51:31.952 INFO:tasks.workunit.client.0.smithi049.stdout: create 202/39 file after the snapshot 2022-04-03T21:51:31.953 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/.snap/snap-subdir-test 2022-04-03T21:51:31.974 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/30 file after the snapshot 2022-04-03T21:51:31.976 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/31 file after the snapshot 2022-04-03T21:51:31.976 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/32 file after the snapshot 2022-04-03T21:51:31.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/33 file after the snapshot 2022-04-03T21:51:31.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/34 file after the snapshot 2022-04-03T21:51:31.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/35 file after the snapshot 2022-04-03T21:51:31.977 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/36 file after the snapshot 2022-04-03T21:51:31.978 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/37 file after the snapshot 2022-04-03T21:51:31.978 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/38 file after the snapshot 2022-04-03T21:51:31.978 INFO:tasks.workunit.client.0.smithi049.stdout: create 203/39 file after the snapshot 2022-04-03T21:51:31.978 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/.snap/snap-subdir-test 2022-04-03T21:51:32.001 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/30 file after the snapshot 2022-04-03T21:51:32.003 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/31 file after the snapshot 2022-04-03T21:51:32.004 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/32 file after the snapshot 2022-04-03T21:51:32.004 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/33 file after the snapshot 2022-04-03T21:51:32.004 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/34 file after the snapshot 2022-04-03T21:51:32.004 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/35 file after the snapshot 2022-04-03T21:51:32.004 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/36 file after the snapshot 2022-04-03T21:51:32.005 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/37 file after the snapshot 2022-04-03T21:51:32.005 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/38 file after the snapshot 2022-04-03T21:51:32.005 INFO:tasks.workunit.client.0.smithi049.stdout: create 204/39 file after the snapshot 2022-04-03T21:51:32.005 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/.snap/snap-subdir-test 2022-04-03T21:51:32.027 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/30 file after the snapshot 2022-04-03T21:51:32.030 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/31 file after the snapshot 2022-04-03T21:51:32.030 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/32 file after the snapshot 2022-04-03T21:51:32.030 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/33 file after the snapshot 2022-04-03T21:51:32.030 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/34 file after the snapshot 2022-04-03T21:51:32.031 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/35 file after the snapshot 2022-04-03T21:51:32.031 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/36 file after the snapshot 2022-04-03T21:51:32.031 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/37 file after the snapshot 2022-04-03T21:51:32.031 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/38 file after the snapshot 2022-04-03T21:51:32.031 INFO:tasks.workunit.client.0.smithi049.stdout: create 205/39 file after the snapshot 2022-04-03T21:51:32.032 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/.snap/snap-subdir-test 2022-04-03T21:51:32.055 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/30 file after the snapshot 2022-04-03T21:51:32.073 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/31 file after the snapshot 2022-04-03T21:51:32.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/32 file after the snapshot 2022-04-03T21:51:32.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/33 file after the snapshot 2022-04-03T21:51:32.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/34 file after the snapshot 2022-04-03T21:51:32.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/35 file after the snapshot 2022-04-03T21:51:32.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/36 file after the snapshot 2022-04-03T21:51:32.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/37 file after the snapshot 2022-04-03T21:51:32.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/38 file after the snapshot 2022-04-03T21:51:32.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 206/39 file after the snapshot 2022-04-03T21:51:32.076 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/.snap/snap-subdir-test 2022-04-03T21:51:32.104 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/30 file after the snapshot 2022-04-03T21:51:32.106 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/31 file after the snapshot 2022-04-03T21:51:32.106 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/32 file after the snapshot 2022-04-03T21:51:32.106 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/33 file after the snapshot 2022-04-03T21:51:32.106 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/34 file after the snapshot 2022-04-03T21:51:32.107 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/35 file after the snapshot 2022-04-03T21:51:32.107 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/36 file after the snapshot 2022-04-03T21:51:32.107 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/37 file after the snapshot 2022-04-03T21:51:32.107 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/38 file after the snapshot 2022-04-03T21:51:32.107 INFO:tasks.workunit.client.0.smithi049.stdout: create 207/39 file after the snapshot 2022-04-03T21:51:32.108 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/.snap/snap-subdir-test 2022-04-03T21:51:32.135 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/30 file after the snapshot 2022-04-03T21:51:32.136 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/31 file after the snapshot 2022-04-03T21:51:32.137 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/32 file after the snapshot 2022-04-03T21:51:32.137 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/33 file after the snapshot 2022-04-03T21:51:32.137 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/34 file after the snapshot 2022-04-03T21:51:32.137 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/35 file after the snapshot 2022-04-03T21:51:32.137 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/36 file after the snapshot 2022-04-03T21:51:32.138 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/37 file after the snapshot 2022-04-03T21:51:32.138 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/38 file after the snapshot 2022-04-03T21:51:32.138 INFO:tasks.workunit.client.0.smithi049.stdout: create 208/39 file after the snapshot 2022-04-03T21:51:32.138 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/.snap/snap-subdir-test 2022-04-03T21:51:32.166 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/30 file after the snapshot 2022-04-03T21:51:32.167 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/31 file after the snapshot 2022-04-03T21:51:32.168 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/32 file after the snapshot 2022-04-03T21:51:32.168 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/33 file after the snapshot 2022-04-03T21:51:32.168 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/34 file after the snapshot 2022-04-03T21:51:32.169 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/35 file after the snapshot 2022-04-03T21:51:32.169 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/36 file after the snapshot 2022-04-03T21:51:32.169 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/37 file after the snapshot 2022-04-03T21:51:32.169 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/38 file after the snapshot 2022-04-03T21:51:32.169 INFO:tasks.workunit.client.0.smithi049.stdout: create 209/39 file after the snapshot 2022-04-03T21:51:32.170 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/.snap/snap-subdir-test 2022-04-03T21:51:32.194 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/30 file after the snapshot 2022-04-03T21:51:32.196 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/31 file after the snapshot 2022-04-03T21:51:32.196 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/32 file after the snapshot 2022-04-03T21:51:32.197 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/33 file after the snapshot 2022-04-03T21:51:32.197 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/34 file after the snapshot 2022-04-03T21:51:32.197 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/35 file after the snapshot 2022-04-03T21:51:32.197 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/36 file after the snapshot 2022-04-03T21:51:32.197 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/37 file after the snapshot 2022-04-03T21:51:32.198 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/38 file after the snapshot 2022-04-03T21:51:32.198 INFO:tasks.workunit.client.0.smithi049.stdout: create 210/39 file after the snapshot 2022-04-03T21:51:32.198 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/.snap/snap-subdir-test 2022-04-03T21:51:32.224 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/30 file after the snapshot 2022-04-03T21:51:32.226 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/31 file after the snapshot 2022-04-03T21:51:32.226 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/32 file after the snapshot 2022-04-03T21:51:32.227 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/33 file after the snapshot 2022-04-03T21:51:32.227 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/34 file after the snapshot 2022-04-03T21:51:32.227 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/35 file after the snapshot 2022-04-03T21:51:32.227 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/36 file after the snapshot 2022-04-03T21:51:32.227 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/37 file after the snapshot 2022-04-03T21:51:32.228 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/38 file after the snapshot 2022-04-03T21:51:32.228 INFO:tasks.workunit.client.0.smithi049.stdout: create 211/39 file after the snapshot 2022-04-03T21:51:32.228 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/.snap/snap-subdir-test 2022-04-03T21:51:32.251 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/30 file after the snapshot 2022-04-03T21:51:32.253 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/31 file after the snapshot 2022-04-03T21:51:32.254 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/32 file after the snapshot 2022-04-03T21:51:32.254 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/33 file after the snapshot 2022-04-03T21:51:32.254 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/34 file after the snapshot 2022-04-03T21:51:32.255 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/35 file after the snapshot 2022-04-03T21:51:32.255 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/36 file after the snapshot 2022-04-03T21:51:32.255 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/37 file after the snapshot 2022-04-03T21:51:32.255 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/38 file after the snapshot 2022-04-03T21:51:32.256 INFO:tasks.workunit.client.0.smithi049.stdout: create 212/39 file after the snapshot 2022-04-03T21:51:32.256 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/.snap/snap-subdir-test 2022-04-03T21:51:32.277 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/30 file after the snapshot 2022-04-03T21:51:32.279 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/31 file after the snapshot 2022-04-03T21:51:32.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/32 file after the snapshot 2022-04-03T21:51:32.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/33 file after the snapshot 2022-04-03T21:51:32.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/34 file after the snapshot 2022-04-03T21:51:32.280 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/35 file after the snapshot 2022-04-03T21:51:32.281 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/36 file after the snapshot 2022-04-03T21:51:32.281 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/37 file after the snapshot 2022-04-03T21:51:32.281 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/38 file after the snapshot 2022-04-03T21:51:32.281 INFO:tasks.workunit.client.0.smithi049.stdout: create 213/39 file after the snapshot 2022-04-03T21:51:32.282 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/.snap/snap-subdir-test 2022-04-03T21:51:32.303 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/30 file after the snapshot 2022-04-03T21:51:32.305 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/31 file after the snapshot 2022-04-03T21:51:32.305 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/32 file after the snapshot 2022-04-03T21:51:32.306 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/33 file after the snapshot 2022-04-03T21:51:32.306 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/34 file after the snapshot 2022-04-03T21:51:32.306 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/35 file after the snapshot 2022-04-03T21:51:32.306 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/36 file after the snapshot 2022-04-03T21:51:32.307 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/37 file after the snapshot 2022-04-03T21:51:32.307 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/38 file after the snapshot 2022-04-03T21:51:32.307 INFO:tasks.workunit.client.0.smithi049.stdout: create 214/39 file after the snapshot 2022-04-03T21:51:32.307 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/.snap/snap-subdir-test 2022-04-03T21:51:32.329 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/30 file after the snapshot 2022-04-03T21:51:32.331 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/31 file after the snapshot 2022-04-03T21:51:32.331 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/32 file after the snapshot 2022-04-03T21:51:32.332 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/33 file after the snapshot 2022-04-03T21:51:32.332 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/34 file after the snapshot 2022-04-03T21:51:32.332 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/35 file after the snapshot 2022-04-03T21:51:32.332 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/36 file after the snapshot 2022-04-03T21:51:32.333 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/37 file after the snapshot 2022-04-03T21:51:32.333 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/38 file after the snapshot 2022-04-03T21:51:32.333 INFO:tasks.workunit.client.0.smithi049.stdout: create 215/39 file after the snapshot 2022-04-03T21:51:32.333 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/.snap/snap-subdir-test 2022-04-03T21:51:32.356 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/30 file after the snapshot 2022-04-03T21:51:32.358 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/31 file after the snapshot 2022-04-03T21:51:32.358 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/32 file after the snapshot 2022-04-03T21:51:32.358 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/33 file after the snapshot 2022-04-03T21:51:32.359 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/34 file after the snapshot 2022-04-03T21:51:32.359 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/35 file after the snapshot 2022-04-03T21:51:32.359 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/36 file after the snapshot 2022-04-03T21:51:32.359 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/37 file after the snapshot 2022-04-03T21:51:32.360 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/38 file after the snapshot 2022-04-03T21:51:32.360 INFO:tasks.workunit.client.0.smithi049.stdout: create 216/39 file after the snapshot 2022-04-03T21:51:32.360 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/.snap/snap-subdir-test 2022-04-03T21:51:32.383 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/30 file after the snapshot 2022-04-03T21:51:32.384 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/31 file after the snapshot 2022-04-03T21:51:32.385 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/32 file after the snapshot 2022-04-03T21:51:32.385 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/33 file after the snapshot 2022-04-03T21:51:32.385 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/34 file after the snapshot 2022-04-03T21:51:32.385 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/35 file after the snapshot 2022-04-03T21:51:32.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/36 file after the snapshot 2022-04-03T21:51:32.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/37 file after the snapshot 2022-04-03T21:51:32.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/38 file after the snapshot 2022-04-03T21:51:32.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 217/39 file after the snapshot 2022-04-03T21:51:32.387 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/.snap/snap-subdir-test 2022-04-03T21:51:32.410 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/30 file after the snapshot 2022-04-03T21:51:32.411 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/31 file after the snapshot 2022-04-03T21:51:32.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/32 file after the snapshot 2022-04-03T21:51:32.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/33 file after the snapshot 2022-04-03T21:51:32.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/34 file after the snapshot 2022-04-03T21:51:32.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/35 file after the snapshot 2022-04-03T21:51:32.413 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/36 file after the snapshot 2022-04-03T21:51:32.413 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/37 file after the snapshot 2022-04-03T21:51:32.413 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/38 file after the snapshot 2022-04-03T21:51:32.413 INFO:tasks.workunit.client.0.smithi049.stdout: create 218/39 file after the snapshot 2022-04-03T21:51:32.414 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/.snap/snap-subdir-test 2022-04-03T21:51:32.436 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/30 file after the snapshot 2022-04-03T21:51:32.438 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/31 file after the snapshot 2022-04-03T21:51:32.438 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/32 file after the snapshot 2022-04-03T21:51:32.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/33 file after the snapshot 2022-04-03T21:51:32.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/34 file after the snapshot 2022-04-03T21:51:32.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/35 file after the snapshot 2022-04-03T21:51:32.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/36 file after the snapshot 2022-04-03T21:51:32.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/37 file after the snapshot 2022-04-03T21:51:32.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/38 file after the snapshot 2022-04-03T21:51:32.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 219/39 file after the snapshot 2022-04-03T21:51:32.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/.snap/snap-subdir-test 2022-04-03T21:51:32.463 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/30 file after the snapshot 2022-04-03T21:51:32.465 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/31 file after the snapshot 2022-04-03T21:51:32.465 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/32 file after the snapshot 2022-04-03T21:51:32.465 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/33 file after the snapshot 2022-04-03T21:51:32.466 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/34 file after the snapshot 2022-04-03T21:51:32.466 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/35 file after the snapshot 2022-04-03T21:51:32.466 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/36 file after the snapshot 2022-04-03T21:51:32.466 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/37 file after the snapshot 2022-04-03T21:51:32.467 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/38 file after the snapshot 2022-04-03T21:51:32.467 INFO:tasks.workunit.client.0.smithi049.stdout: create 220/39 file after the snapshot 2022-04-03T21:51:32.467 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/.snap/snap-subdir-test 2022-04-03T21:51:32.490 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/30 file after the snapshot 2022-04-03T21:51:32.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/31 file after the snapshot 2022-04-03T21:51:32.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/32 file after the snapshot 2022-04-03T21:51:32.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/33 file after the snapshot 2022-04-03T21:51:32.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/34 file after the snapshot 2022-04-03T21:51:32.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/35 file after the snapshot 2022-04-03T21:51:32.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/36 file after the snapshot 2022-04-03T21:51:32.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/37 file after the snapshot 2022-04-03T21:51:32.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/38 file after the snapshot 2022-04-03T21:51:32.494 INFO:tasks.workunit.client.0.smithi049.stdout: create 221/39 file after the snapshot 2022-04-03T21:51:32.494 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/.snap/snap-subdir-test 2022-04-03T21:51:32.517 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/30 file after the snapshot 2022-04-03T21:51:32.519 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/31 file after the snapshot 2022-04-03T21:51:32.519 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/32 file after the snapshot 2022-04-03T21:51:32.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/33 file after the snapshot 2022-04-03T21:51:32.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/34 file after the snapshot 2022-04-03T21:51:32.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/35 file after the snapshot 2022-04-03T21:51:32.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/36 file after the snapshot 2022-04-03T21:51:32.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/37 file after the snapshot 2022-04-03T21:51:32.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/38 file after the snapshot 2022-04-03T21:51:32.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 222/39 file after the snapshot 2022-04-03T21:51:32.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/.snap/snap-subdir-test 2022-04-03T21:51:32.545 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/30 file after the snapshot 2022-04-03T21:51:32.547 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/31 file after the snapshot 2022-04-03T21:51:32.547 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/32 file after the snapshot 2022-04-03T21:51:32.547 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/33 file after the snapshot 2022-04-03T21:51:32.547 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/34 file after the snapshot 2022-04-03T21:51:32.547 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/35 file after the snapshot 2022-04-03T21:51:32.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/36 file after the snapshot 2022-04-03T21:51:32.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/37 file after the snapshot 2022-04-03T21:51:32.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/38 file after the snapshot 2022-04-03T21:51:32.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 223/39 file after the snapshot 2022-04-03T21:51:32.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/.snap/snap-subdir-test 2022-04-03T21:51:32.576 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/30 file after the snapshot 2022-04-03T21:51:32.579 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/31 file after the snapshot 2022-04-03T21:51:32.579 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/32 file after the snapshot 2022-04-03T21:51:32.579 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/33 file after the snapshot 2022-04-03T21:51:32.579 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/34 file after the snapshot 2022-04-03T21:51:32.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/35 file after the snapshot 2022-04-03T21:51:32.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/36 file after the snapshot 2022-04-03T21:51:32.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/37 file after the snapshot 2022-04-03T21:51:32.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/38 file after the snapshot 2022-04-03T21:51:32.580 INFO:tasks.workunit.client.0.smithi049.stdout: create 224/39 file after the snapshot 2022-04-03T21:51:32.581 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/.snap/snap-subdir-test 2022-04-03T21:51:32.607 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/30 file after the snapshot 2022-04-03T21:51:32.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/31 file after the snapshot 2022-04-03T21:51:32.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/32 file after the snapshot 2022-04-03T21:51:32.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/33 file after the snapshot 2022-04-03T21:51:32.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/34 file after the snapshot 2022-04-03T21:51:32.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/35 file after the snapshot 2022-04-03T21:51:32.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/36 file after the snapshot 2022-04-03T21:51:32.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/37 file after the snapshot 2022-04-03T21:51:32.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/38 file after the snapshot 2022-04-03T21:51:32.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 225/39 file after the snapshot 2022-04-03T21:51:32.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/.snap/snap-subdir-test 2022-04-03T21:51:32.640 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/30 file after the snapshot 2022-04-03T21:51:32.643 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/31 file after the snapshot 2022-04-03T21:51:32.643 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/32 file after the snapshot 2022-04-03T21:51:32.643 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/33 file after the snapshot 2022-04-03T21:51:32.643 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/34 file after the snapshot 2022-04-03T21:51:32.643 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/35 file after the snapshot 2022-04-03T21:51:32.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/36 file after the snapshot 2022-04-03T21:51:32.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/37 file after the snapshot 2022-04-03T21:51:32.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/38 file after the snapshot 2022-04-03T21:51:32.644 INFO:tasks.workunit.client.0.smithi049.stdout: create 226/39 file after the snapshot 2022-04-03T21:51:32.645 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/.snap/snap-subdir-test 2022-04-03T21:51:32.671 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/30 file after the snapshot 2022-04-03T21:51:32.673 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/31 file after the snapshot 2022-04-03T21:51:32.674 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/32 file after the snapshot 2022-04-03T21:51:32.674 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/33 file after the snapshot 2022-04-03T21:51:32.674 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/34 file after the snapshot 2022-04-03T21:51:32.674 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/35 file after the snapshot 2022-04-03T21:51:32.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/36 file after the snapshot 2022-04-03T21:51:32.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/37 file after the snapshot 2022-04-03T21:51:32.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/38 file after the snapshot 2022-04-03T21:51:32.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 227/39 file after the snapshot 2022-04-03T21:51:32.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/.snap/snap-subdir-test 2022-04-03T21:51:32.697 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/30 file after the snapshot 2022-04-03T21:51:32.699 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/31 file after the snapshot 2022-04-03T21:51:32.699 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/32 file after the snapshot 2022-04-03T21:51:32.699 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/33 file after the snapshot 2022-04-03T21:51:32.699 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/34 file after the snapshot 2022-04-03T21:51:32.700 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/35 file after the snapshot 2022-04-03T21:51:32.700 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/36 file after the snapshot 2022-04-03T21:51:32.700 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/37 file after the snapshot 2022-04-03T21:51:32.700 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/38 file after the snapshot 2022-04-03T21:51:32.701 INFO:tasks.workunit.client.0.smithi049.stdout: create 228/39 file after the snapshot 2022-04-03T21:51:32.701 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/.snap/snap-subdir-test 2022-04-03T21:51:32.723 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/30 file after the snapshot 2022-04-03T21:51:32.725 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/31 file after the snapshot 2022-04-03T21:51:32.725 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/32 file after the snapshot 2022-04-03T21:51:32.725 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/33 file after the snapshot 2022-04-03T21:51:32.725 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/34 file after the snapshot 2022-04-03T21:51:32.726 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/35 file after the snapshot 2022-04-03T21:51:32.726 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/36 file after the snapshot 2022-04-03T21:51:32.726 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/37 file after the snapshot 2022-04-03T21:51:32.726 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/38 file after the snapshot 2022-04-03T21:51:32.727 INFO:tasks.workunit.client.0.smithi049.stdout: create 229/39 file after the snapshot 2022-04-03T21:51:32.727 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/.snap/snap-subdir-test 2022-04-03T21:51:32.748 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/30 file after the snapshot 2022-04-03T21:51:32.750 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/31 file after the snapshot 2022-04-03T21:51:32.750 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/32 file after the snapshot 2022-04-03T21:51:32.750 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/33 file after the snapshot 2022-04-03T21:51:32.751 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/34 file after the snapshot 2022-04-03T21:51:32.751 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/35 file after the snapshot 2022-04-03T21:51:32.751 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/36 file after the snapshot 2022-04-03T21:51:32.751 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/37 file after the snapshot 2022-04-03T21:51:32.751 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/38 file after the snapshot 2022-04-03T21:51:32.752 INFO:tasks.workunit.client.0.smithi049.stdout: create 230/39 file after the snapshot 2022-04-03T21:51:32.752 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/.snap/snap-subdir-test 2022-04-03T21:51:32.774 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/30 file after the snapshot 2022-04-03T21:51:32.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/31 file after the snapshot 2022-04-03T21:51:32.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/32 file after the snapshot 2022-04-03T21:51:32.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/33 file after the snapshot 2022-04-03T21:51:32.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/34 file after the snapshot 2022-04-03T21:51:32.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/35 file after the snapshot 2022-04-03T21:51:32.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/36 file after the snapshot 2022-04-03T21:51:32.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/37 file after the snapshot 2022-04-03T21:51:32.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/38 file after the snapshot 2022-04-03T21:51:32.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 231/39 file after the snapshot 2022-04-03T21:51:32.778 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/.snap/snap-subdir-test 2022-04-03T21:51:32.799 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/30 file after the snapshot 2022-04-03T21:51:32.801 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/31 file after the snapshot 2022-04-03T21:51:32.801 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/32 file after the snapshot 2022-04-03T21:51:32.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/33 file after the snapshot 2022-04-03T21:51:32.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/34 file after the snapshot 2022-04-03T21:51:32.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/35 file after the snapshot 2022-04-03T21:51:32.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/36 file after the snapshot 2022-04-03T21:51:32.802 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/37 file after the snapshot 2022-04-03T21:51:32.803 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/38 file after the snapshot 2022-04-03T21:51:32.803 INFO:tasks.workunit.client.0.smithi049.stdout: create 232/39 file after the snapshot 2022-04-03T21:51:32.803 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/.snap/snap-subdir-test 2022-04-03T21:51:32.824 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/30 file after the snapshot 2022-04-03T21:51:32.826 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/31 file after the snapshot 2022-04-03T21:51:32.827 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/32 file after the snapshot 2022-04-03T21:51:32.827 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/33 file after the snapshot 2022-04-03T21:51:32.827 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/34 file after the snapshot 2022-04-03T21:51:32.828 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/35 file after the snapshot 2022-04-03T21:51:32.828 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/36 file after the snapshot 2022-04-03T21:51:32.828 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/37 file after the snapshot 2022-04-03T21:51:32.828 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/38 file after the snapshot 2022-04-03T21:51:32.828 INFO:tasks.workunit.client.0.smithi049.stdout: create 233/39 file after the snapshot 2022-04-03T21:51:32.829 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/.snap/snap-subdir-test 2022-04-03T21:51:32.850 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/30 file after the snapshot 2022-04-03T21:51:32.853 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/31 file after the snapshot 2022-04-03T21:51:32.853 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/32 file after the snapshot 2022-04-03T21:51:32.853 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/33 file after the snapshot 2022-04-03T21:51:32.853 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/34 file after the snapshot 2022-04-03T21:51:32.854 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/35 file after the snapshot 2022-04-03T21:51:32.854 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/36 file after the snapshot 2022-04-03T21:51:32.854 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/37 file after the snapshot 2022-04-03T21:51:32.854 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/38 file after the snapshot 2022-04-03T21:51:32.854 INFO:tasks.workunit.client.0.smithi049.stdout: create 234/39 file after the snapshot 2022-04-03T21:51:32.855 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/.snap/snap-subdir-test 2022-04-03T21:51:32.881 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/30 file after the snapshot 2022-04-03T21:51:32.883 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/31 file after the snapshot 2022-04-03T21:51:32.884 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/32 file after the snapshot 2022-04-03T21:51:32.884 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/33 file after the snapshot 2022-04-03T21:51:32.884 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/34 file after the snapshot 2022-04-03T21:51:32.884 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/35 file after the snapshot 2022-04-03T21:51:32.885 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/36 file after the snapshot 2022-04-03T21:51:32.885 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/37 file after the snapshot 2022-04-03T21:51:32.885 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/38 file after the snapshot 2022-04-03T21:51:32.885 INFO:tasks.workunit.client.0.smithi049.stdout: create 235/39 file after the snapshot 2022-04-03T21:51:32.886 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/.snap/snap-subdir-test 2022-04-03T21:51:32.909 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/30 file after the snapshot 2022-04-03T21:51:32.911 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/31 file after the snapshot 2022-04-03T21:51:32.911 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/32 file after the snapshot 2022-04-03T21:51:32.911 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/33 file after the snapshot 2022-04-03T21:51:32.911 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/34 file after the snapshot 2022-04-03T21:51:32.912 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/35 file after the snapshot 2022-04-03T21:51:32.912 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/36 file after the snapshot 2022-04-03T21:51:32.912 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/37 file after the snapshot 2022-04-03T21:51:32.912 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/38 file after the snapshot 2022-04-03T21:51:32.912 INFO:tasks.workunit.client.0.smithi049.stdout: create 236/39 file after the snapshot 2022-04-03T21:51:32.913 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/.snap/snap-subdir-test 2022-04-03T21:51:32.936 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/30 file after the snapshot 2022-04-03T21:51:32.938 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/31 file after the snapshot 2022-04-03T21:51:32.938 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/32 file after the snapshot 2022-04-03T21:51:32.939 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/33 file after the snapshot 2022-04-03T21:51:32.939 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/34 file after the snapshot 2022-04-03T21:51:32.939 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/35 file after the snapshot 2022-04-03T21:51:32.939 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/36 file after the snapshot 2022-04-03T21:51:32.940 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/37 file after the snapshot 2022-04-03T21:51:32.940 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/38 file after the snapshot 2022-04-03T21:51:32.940 INFO:tasks.workunit.client.0.smithi049.stdout: create 237/39 file after the snapshot 2022-04-03T21:51:32.940 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/.snap/snap-subdir-test 2022-04-03T21:51:32.964 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/30 file after the snapshot 2022-04-03T21:51:32.966 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/31 file after the snapshot 2022-04-03T21:51:32.966 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/32 file after the snapshot 2022-04-03T21:51:32.966 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/33 file after the snapshot 2022-04-03T21:51:32.966 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/34 file after the snapshot 2022-04-03T21:51:32.967 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/35 file after the snapshot 2022-04-03T21:51:32.967 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/36 file after the snapshot 2022-04-03T21:51:32.967 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/37 file after the snapshot 2022-04-03T21:51:32.967 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/38 file after the snapshot 2022-04-03T21:51:32.967 INFO:tasks.workunit.client.0.smithi049.stdout: create 238/39 file after the snapshot 2022-04-03T21:51:32.968 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/.snap/snap-subdir-test 2022-04-03T21:51:32.989 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/30 file after the snapshot 2022-04-03T21:51:32.991 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/31 file after the snapshot 2022-04-03T21:51:32.991 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/32 file after the snapshot 2022-04-03T21:51:32.992 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/33 file after the snapshot 2022-04-03T21:51:32.992 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/34 file after the snapshot 2022-04-03T21:51:32.992 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/35 file after the snapshot 2022-04-03T21:51:32.992 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/36 file after the snapshot 2022-04-03T21:51:32.992 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/37 file after the snapshot 2022-04-03T21:51:32.993 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/38 file after the snapshot 2022-04-03T21:51:32.993 INFO:tasks.workunit.client.0.smithi049.stdout: create 239/39 file after the snapshot 2022-04-03T21:51:32.993 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/.snap/snap-subdir-test 2022-04-03T21:51:33.015 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/30 file after the snapshot 2022-04-03T21:51:33.017 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/31 file after the snapshot 2022-04-03T21:51:33.018 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/32 file after the snapshot 2022-04-03T21:51:33.018 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/33 file after the snapshot 2022-04-03T21:51:33.018 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/34 file after the snapshot 2022-04-03T21:51:33.018 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/35 file after the snapshot 2022-04-03T21:51:33.019 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/36 file after the snapshot 2022-04-03T21:51:33.019 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/37 file after the snapshot 2022-04-03T21:51:33.019 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/38 file after the snapshot 2022-04-03T21:51:33.019 INFO:tasks.workunit.client.0.smithi049.stdout: create 240/39 file after the snapshot 2022-04-03T21:51:33.019 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/.snap/snap-subdir-test 2022-04-03T21:51:33.044 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/30 file after the snapshot 2022-04-03T21:51:33.046 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/31 file after the snapshot 2022-04-03T21:51:33.047 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/32 file after the snapshot 2022-04-03T21:51:33.047 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/33 file after the snapshot 2022-04-03T21:51:33.047 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/34 file after the snapshot 2022-04-03T21:51:33.047 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/35 file after the snapshot 2022-04-03T21:51:33.048 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/36 file after the snapshot 2022-04-03T21:51:33.048 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/37 file after the snapshot 2022-04-03T21:51:33.048 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/38 file after the snapshot 2022-04-03T21:51:33.048 INFO:tasks.workunit.client.0.smithi049.stdout: create 241/39 file after the snapshot 2022-04-03T21:51:33.048 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/.snap/snap-subdir-test 2022-04-03T21:51:33.071 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/30 file after the snapshot 2022-04-03T21:51:33.073 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/31 file after the snapshot 2022-04-03T21:51:33.073 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/32 file after the snapshot 2022-04-03T21:51:33.073 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/33 file after the snapshot 2022-04-03T21:51:33.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/34 file after the snapshot 2022-04-03T21:51:33.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/35 file after the snapshot 2022-04-03T21:51:33.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/36 file after the snapshot 2022-04-03T21:51:33.074 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/37 file after the snapshot 2022-04-03T21:51:33.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/38 file after the snapshot 2022-04-03T21:51:33.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 242/39 file after the snapshot 2022-04-03T21:51:33.075 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/.snap/snap-subdir-test 2022-04-03T21:51:33.097 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/30 file after the snapshot 2022-04-03T21:51:33.099 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/31 file after the snapshot 2022-04-03T21:51:33.100 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/32 file after the snapshot 2022-04-03T21:51:33.100 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/33 file after the snapshot 2022-04-03T21:51:33.100 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/34 file after the snapshot 2022-04-03T21:51:33.100 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/35 file after the snapshot 2022-04-03T21:51:33.101 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/36 file after the snapshot 2022-04-03T21:51:33.101 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/37 file after the snapshot 2022-04-03T21:51:33.101 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/38 file after the snapshot 2022-04-03T21:51:33.101 INFO:tasks.workunit.client.0.smithi049.stdout: create 243/39 file after the snapshot 2022-04-03T21:51:33.102 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/.snap/snap-subdir-test 2022-04-03T21:51:33.122 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/30 file after the snapshot 2022-04-03T21:51:33.124 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/31 file after the snapshot 2022-04-03T21:51:33.124 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/32 file after the snapshot 2022-04-03T21:51:33.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/33 file after the snapshot 2022-04-03T21:51:33.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/34 file after the snapshot 2022-04-03T21:51:33.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/35 file after the snapshot 2022-04-03T21:51:33.125 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/36 file after the snapshot 2022-04-03T21:51:33.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/37 file after the snapshot 2022-04-03T21:51:33.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/38 file after the snapshot 2022-04-03T21:51:33.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 244/39 file after the snapshot 2022-04-03T21:51:33.126 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/.snap/snap-subdir-test 2022-04-03T21:51:33.153 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/30 file after the snapshot 2022-04-03T21:51:33.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/31 file after the snapshot 2022-04-03T21:51:33.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/32 file after the snapshot 2022-04-03T21:51:33.155 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/33 file after the snapshot 2022-04-03T21:51:33.156 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/34 file after the snapshot 2022-04-03T21:51:33.156 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/35 file after the snapshot 2022-04-03T21:51:33.156 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/36 file after the snapshot 2022-04-03T21:51:33.156 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/37 file after the snapshot 2022-04-03T21:51:33.157 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/38 file after the snapshot 2022-04-03T21:51:33.157 INFO:tasks.workunit.client.0.smithi049.stdout: create 245/39 file after the snapshot 2022-04-03T21:51:33.157 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/.snap/snap-subdir-test 2022-04-03T21:51:33.179 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/30 file after the snapshot 2022-04-03T21:51:33.181 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/31 file after the snapshot 2022-04-03T21:51:33.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/32 file after the snapshot 2022-04-03T21:51:33.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/33 file after the snapshot 2022-04-03T21:51:33.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/34 file after the snapshot 2022-04-03T21:51:33.182 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/35 file after the snapshot 2022-04-03T21:51:33.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/36 file after the snapshot 2022-04-03T21:51:33.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/37 file after the snapshot 2022-04-03T21:51:33.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/38 file after the snapshot 2022-04-03T21:51:33.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 246/39 file after the snapshot 2022-04-03T21:51:33.183 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/.snap/snap-subdir-test 2022-04-03T21:51:33.208 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/30 file after the snapshot 2022-04-03T21:51:33.209 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/31 file after the snapshot 2022-04-03T21:51:33.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/32 file after the snapshot 2022-04-03T21:51:33.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/33 file after the snapshot 2022-04-03T21:51:33.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/34 file after the snapshot 2022-04-03T21:51:33.210 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/35 file after the snapshot 2022-04-03T21:51:33.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/36 file after the snapshot 2022-04-03T21:51:33.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/37 file after the snapshot 2022-04-03T21:51:33.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/38 file after the snapshot 2022-04-03T21:51:33.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 247/39 file after the snapshot 2022-04-03T21:51:33.211 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/.snap/snap-subdir-test 2022-04-03T21:51:33.233 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/30 file after the snapshot 2022-04-03T21:51:33.235 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/31 file after the snapshot 2022-04-03T21:51:33.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/32 file after the snapshot 2022-04-03T21:51:33.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/33 file after the snapshot 2022-04-03T21:51:33.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/34 file after the snapshot 2022-04-03T21:51:33.236 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/35 file after the snapshot 2022-04-03T21:51:33.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/36 file after the snapshot 2022-04-03T21:51:33.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/37 file after the snapshot 2022-04-03T21:51:33.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/38 file after the snapshot 2022-04-03T21:51:33.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 248/39 file after the snapshot 2022-04-03T21:51:33.237 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/.snap/snap-subdir-test 2022-04-03T21:51:33.258 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/30 file after the snapshot 2022-04-03T21:51:33.260 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/31 file after the snapshot 2022-04-03T21:51:33.261 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/32 file after the snapshot 2022-04-03T21:51:33.261 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/33 file after the snapshot 2022-04-03T21:51:33.261 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/34 file after the snapshot 2022-04-03T21:51:33.261 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/35 file after the snapshot 2022-04-03T21:51:33.261 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/36 file after the snapshot 2022-04-03T21:51:33.262 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/37 file after the snapshot 2022-04-03T21:51:33.262 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/38 file after the snapshot 2022-04-03T21:51:33.262 INFO:tasks.workunit.client.0.smithi049.stdout: create 249/39 file after the snapshot 2022-04-03T21:51:33.262 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/.snap/snap-subdir-test 2022-04-03T21:51:33.284 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/30 file after the snapshot 2022-04-03T21:51:33.286 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/31 file after the snapshot 2022-04-03T21:51:33.286 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/32 file after the snapshot 2022-04-03T21:51:33.286 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/33 file after the snapshot 2022-04-03T21:51:33.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/34 file after the snapshot 2022-04-03T21:51:33.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/35 file after the snapshot 2022-04-03T21:51:33.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/36 file after the snapshot 2022-04-03T21:51:33.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/37 file after the snapshot 2022-04-03T21:51:33.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/38 file after the snapshot 2022-04-03T21:51:33.288 INFO:tasks.workunit.client.0.smithi049.stdout: create 250/39 file after the snapshot 2022-04-03T21:51:33.288 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/.snap/snap-subdir-test 2022-04-03T21:51:33.309 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/30 file after the snapshot 2022-04-03T21:51:33.312 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/31 file after the snapshot 2022-04-03T21:51:33.312 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/32 file after the snapshot 2022-04-03T21:51:33.312 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/33 file after the snapshot 2022-04-03T21:51:33.312 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/34 file after the snapshot 2022-04-03T21:51:33.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/35 file after the snapshot 2022-04-03T21:51:33.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/36 file after the snapshot 2022-04-03T21:51:33.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/37 file after the snapshot 2022-04-03T21:51:33.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/38 file after the snapshot 2022-04-03T21:51:33.314 INFO:tasks.workunit.client.0.smithi049.stdout: create 251/39 file after the snapshot 2022-04-03T21:51:33.314 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/.snap/snap-subdir-test 2022-04-03T21:51:33.335 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/30 file after the snapshot 2022-04-03T21:51:33.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/31 file after the snapshot 2022-04-03T21:51:33.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/32 file after the snapshot 2022-04-03T21:51:33.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/33 file after the snapshot 2022-04-03T21:51:33.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/34 file after the snapshot 2022-04-03T21:51:33.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/35 file after the snapshot 2022-04-03T21:51:33.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/36 file after the snapshot 2022-04-03T21:51:33.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/37 file after the snapshot 2022-04-03T21:51:33.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/38 file after the snapshot 2022-04-03T21:51:33.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 252/39 file after the snapshot 2022-04-03T21:51:33.340 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/.snap/snap-subdir-test 2022-04-03T21:51:33.365 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/30 file after the snapshot 2022-04-03T21:51:33.367 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/31 file after the snapshot 2022-04-03T21:51:33.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/32 file after the snapshot 2022-04-03T21:51:33.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/33 file after the snapshot 2022-04-03T21:51:33.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/34 file after the snapshot 2022-04-03T21:51:33.368 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/35 file after the snapshot 2022-04-03T21:51:33.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/36 file after the snapshot 2022-04-03T21:51:33.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/37 file after the snapshot 2022-04-03T21:51:33.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/38 file after the snapshot 2022-04-03T21:51:33.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 253/39 file after the snapshot 2022-04-03T21:51:33.369 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/.snap/snap-subdir-test 2022-04-03T21:51:33.390 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/30 file after the snapshot 2022-04-03T21:51:33.392 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/31 file after the snapshot 2022-04-03T21:51:33.393 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/32 file after the snapshot 2022-04-03T21:51:33.393 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/33 file after the snapshot 2022-04-03T21:51:33.393 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/34 file after the snapshot 2022-04-03T21:51:33.393 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/35 file after the snapshot 2022-04-03T21:51:33.394 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/36 file after the snapshot 2022-04-03T21:51:33.394 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/37 file after the snapshot 2022-04-03T21:51:33.394 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/38 file after the snapshot 2022-04-03T21:51:33.394 INFO:tasks.workunit.client.0.smithi049.stdout: create 254/39 file after the snapshot 2022-04-03T21:51:33.395 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/.snap/snap-subdir-test 2022-04-03T21:51:33.415 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/30 file after the snapshot 2022-04-03T21:51:33.417 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/31 file after the snapshot 2022-04-03T21:51:33.418 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/32 file after the snapshot 2022-04-03T21:51:33.418 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/33 file after the snapshot 2022-04-03T21:51:33.418 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/34 file after the snapshot 2022-04-03T21:51:33.418 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/35 file after the snapshot 2022-04-03T21:51:33.419 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/36 file after the snapshot 2022-04-03T21:51:33.419 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/37 file after the snapshot 2022-04-03T21:51:33.419 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/38 file after the snapshot 2022-04-03T21:51:33.419 INFO:tasks.workunit.client.0.smithi049.stdout: create 255/39 file after the snapshot 2022-04-03T21:51:33.420 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/.snap/snap-subdir-test 2022-04-03T21:51:33.442 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/30 file after the snapshot 2022-04-03T21:51:33.444 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/31 file after the snapshot 2022-04-03T21:51:33.444 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/32 file after the snapshot 2022-04-03T21:51:33.444 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/33 file after the snapshot 2022-04-03T21:51:33.444 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/34 file after the snapshot 2022-04-03T21:51:33.445 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/35 file after the snapshot 2022-04-03T21:51:33.445 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/36 file after the snapshot 2022-04-03T21:51:33.445 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/37 file after the snapshot 2022-04-03T21:51:33.446 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/38 file after the snapshot 2022-04-03T21:51:33.446 INFO:tasks.workunit.client.0.smithi049.stdout: create 256/39 file after the snapshot 2022-04-03T21:51:33.446 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/.snap/snap-subdir-test 2022-04-03T21:51:33.472 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/30 file after the snapshot 2022-04-03T21:51:33.475 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/31 file after the snapshot 2022-04-03T21:51:33.475 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/32 file after the snapshot 2022-04-03T21:51:33.475 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/33 file after the snapshot 2022-04-03T21:51:33.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/34 file after the snapshot 2022-04-03T21:51:33.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/35 file after the snapshot 2022-04-03T21:51:33.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/36 file after the snapshot 2022-04-03T21:51:33.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/37 file after the snapshot 2022-04-03T21:51:33.476 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/38 file after the snapshot 2022-04-03T21:51:33.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 257/39 file after the snapshot 2022-04-03T21:51:33.477 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/.snap/snap-subdir-test 2022-04-03T21:51:33.499 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/30 file after the snapshot 2022-04-03T21:51:33.501 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/31 file after the snapshot 2022-04-03T21:51:33.501 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/32 file after the snapshot 2022-04-03T21:51:33.501 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/33 file after the snapshot 2022-04-03T21:51:33.501 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/34 file after the snapshot 2022-04-03T21:51:33.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/35 file after the snapshot 2022-04-03T21:51:33.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/36 file after the snapshot 2022-04-03T21:51:33.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/37 file after the snapshot 2022-04-03T21:51:33.502 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/38 file after the snapshot 2022-04-03T21:51:33.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 258/39 file after the snapshot 2022-04-03T21:51:33.503 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/.snap/snap-subdir-test 2022-04-03T21:51:33.523 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/30 file after the snapshot 2022-04-03T21:51:33.526 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/31 file after the snapshot 2022-04-03T21:51:33.526 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/32 file after the snapshot 2022-04-03T21:51:33.526 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/33 file after the snapshot 2022-04-03T21:51:33.526 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/34 file after the snapshot 2022-04-03T21:51:33.526 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/35 file after the snapshot 2022-04-03T21:51:33.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/36 file after the snapshot 2022-04-03T21:51:33.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/37 file after the snapshot 2022-04-03T21:51:33.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/38 file after the snapshot 2022-04-03T21:51:33.527 INFO:tasks.workunit.client.0.smithi049.stdout: create 259/39 file after the snapshot 2022-04-03T21:51:33.528 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/.snap/snap-subdir-test 2022-04-03T21:51:33.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/30 file after the snapshot 2022-04-03T21:51:33.550 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/31 file after the snapshot 2022-04-03T21:51:33.551 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/32 file after the snapshot 2022-04-03T21:51:33.551 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/33 file after the snapshot 2022-04-03T21:51:33.552 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/34 file after the snapshot 2022-04-03T21:51:33.552 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/35 file after the snapshot 2022-04-03T21:51:33.552 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/36 file after the snapshot 2022-04-03T21:51:33.553 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/37 file after the snapshot 2022-04-03T21:51:33.553 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/38 file after the snapshot 2022-04-03T21:51:33.553 INFO:tasks.workunit.client.0.smithi049.stdout: create 260/39 file after the snapshot 2022-04-03T21:51:33.553 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/.snap/snap-subdir-test 2022-04-03T21:51:33.583 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/30 file after the snapshot 2022-04-03T21:51:33.584 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/31 file after the snapshot 2022-04-03T21:51:33.585 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/32 file after the snapshot 2022-04-03T21:51:33.585 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/33 file after the snapshot 2022-04-03T21:51:33.586 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/34 file after the snapshot 2022-04-03T21:51:33.586 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/35 file after the snapshot 2022-04-03T21:51:33.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/36 file after the snapshot 2022-04-03T21:51:33.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/37 file after the snapshot 2022-04-03T21:51:33.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/38 file after the snapshot 2022-04-03T21:51:33.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 261/39 file after the snapshot 2022-04-03T21:51:33.587 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/.snap/snap-subdir-test 2022-04-03T21:51:33.608 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/30 file after the snapshot 2022-04-03T21:51:33.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/31 file after the snapshot 2022-04-03T21:51:33.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/32 file after the snapshot 2022-04-03T21:51:33.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/33 file after the snapshot 2022-04-03T21:51:33.610 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/34 file after the snapshot 2022-04-03T21:51:33.611 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/35 file after the snapshot 2022-04-03T21:51:33.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/36 file after the snapshot 2022-04-03T21:51:33.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/37 file after the snapshot 2022-04-03T21:51:33.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/38 file after the snapshot 2022-04-03T21:51:33.612 INFO:tasks.workunit.client.0.smithi049.stdout: create 262/39 file after the snapshot 2022-04-03T21:51:33.613 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/.snap/snap-subdir-test 2022-04-03T21:51:33.633 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/30 file after the snapshot 2022-04-03T21:51:33.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/31 file after the snapshot 2022-04-03T21:51:33.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/32 file after the snapshot 2022-04-03T21:51:33.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/33 file after the snapshot 2022-04-03T21:51:33.635 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/34 file after the snapshot 2022-04-03T21:51:33.636 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/35 file after the snapshot 2022-04-03T21:51:33.637 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/36 file after the snapshot 2022-04-03T21:51:33.637 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/37 file after the snapshot 2022-04-03T21:51:33.637 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/38 file after the snapshot 2022-04-03T21:51:33.637 INFO:tasks.workunit.client.0.smithi049.stdout: create 263/39 file after the snapshot 2022-04-03T21:51:33.638 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/.snap/snap-subdir-test 2022-04-03T21:51:33.662 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/30 file after the snapshot 2022-04-03T21:51:33.662 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/31 file after the snapshot 2022-04-03T21:51:33.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/32 file after the snapshot 2022-04-03T21:51:33.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/33 file after the snapshot 2022-04-03T21:51:33.675 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/34 file after the snapshot 2022-04-03T21:51:33.676 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/35 file after the snapshot 2022-04-03T21:51:33.676 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/36 file after the snapshot 2022-04-03T21:51:33.676 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/37 file after the snapshot 2022-04-03T21:51:33.676 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/38 file after the snapshot 2022-04-03T21:51:33.676 INFO:tasks.workunit.client.0.smithi049.stdout: create 264/39 file after the snapshot 2022-04-03T21:51:33.677 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/.snap/snap-subdir-test 2022-04-03T21:51:33.690 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/30 file after the snapshot 2022-04-03T21:51:33.691 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/31 file after the snapshot 2022-04-03T21:51:33.691 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/32 file after the snapshot 2022-04-03T21:51:33.692 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/33 file after the snapshot 2022-04-03T21:51:33.693 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/34 file after the snapshot 2022-04-03T21:51:33.693 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/35 file after the snapshot 2022-04-03T21:51:33.693 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/36 file after the snapshot 2022-04-03T21:51:33.693 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/37 file after the snapshot 2022-04-03T21:51:33.694 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/38 file after the snapshot 2022-04-03T21:51:33.694 INFO:tasks.workunit.client.0.smithi049.stdout: create 265/39 file after the snapshot 2022-04-03T21:51:33.694 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/.snap/snap-subdir-test 2022-04-03T21:51:33.718 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/30 file after the snapshot 2022-04-03T21:51:33.719 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/31 file after the snapshot 2022-04-03T21:51:33.720 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/32 file after the snapshot 2022-04-03T21:51:33.720 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/33 file after the snapshot 2022-04-03T21:51:33.721 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/34 file after the snapshot 2022-04-03T21:51:33.721 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/35 file after the snapshot 2022-04-03T21:51:33.721 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/36 file after the snapshot 2022-04-03T21:51:33.722 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/37 file after the snapshot 2022-04-03T21:51:33.722 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/38 file after the snapshot 2022-04-03T21:51:33.722 INFO:tasks.workunit.client.0.smithi049.stdout: create 266/39 file after the snapshot 2022-04-03T21:51:33.722 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/.snap/snap-subdir-test 2022-04-03T21:51:33.744 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/30 file after the snapshot 2022-04-03T21:51:33.746 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/31 file after the snapshot 2022-04-03T21:51:33.746 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/32 file after the snapshot 2022-04-03T21:51:33.746 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/33 file after the snapshot 2022-04-03T21:51:33.747 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/34 file after the snapshot 2022-04-03T21:51:33.748 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/35 file after the snapshot 2022-04-03T21:51:33.748 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/36 file after the snapshot 2022-04-03T21:51:33.748 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/37 file after the snapshot 2022-04-03T21:51:33.748 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/38 file after the snapshot 2022-04-03T21:51:33.749 INFO:tasks.workunit.client.0.smithi049.stdout: create 267/39 file after the snapshot 2022-04-03T21:51:33.749 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/.snap/snap-subdir-test 2022-04-03T21:51:33.772 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/30 file after the snapshot 2022-04-03T21:51:33.775 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/31 file after the snapshot 2022-04-03T21:51:33.775 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/32 file after the snapshot 2022-04-03T21:51:33.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/33 file after the snapshot 2022-04-03T21:51:33.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/34 file after the snapshot 2022-04-03T21:51:33.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/35 file after the snapshot 2022-04-03T21:51:33.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/36 file after the snapshot 2022-04-03T21:51:33.776 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/37 file after the snapshot 2022-04-03T21:51:33.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/38 file after the snapshot 2022-04-03T21:51:33.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 268/39 file after the snapshot 2022-04-03T21:51:33.777 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/.snap/snap-subdir-test 2022-04-03T21:51:33.805 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/30 file after the snapshot 2022-04-03T21:51:33.808 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/31 file after the snapshot 2022-04-03T21:51:33.808 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/32 file after the snapshot 2022-04-03T21:51:33.808 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/33 file after the snapshot 2022-04-03T21:51:33.808 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/34 file after the snapshot 2022-04-03T21:51:33.809 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/35 file after the snapshot 2022-04-03T21:51:33.809 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/36 file after the snapshot 2022-04-03T21:51:33.809 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/37 file after the snapshot 2022-04-03T21:51:33.809 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/38 file after the snapshot 2022-04-03T21:51:33.810 INFO:tasks.workunit.client.0.smithi049.stdout: create 269/39 file after the snapshot 2022-04-03T21:51:33.810 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/.snap/snap-subdir-test 2022-04-03T21:51:33.838 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/30 file after the snapshot 2022-04-03T21:51:33.839 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/31 file after the snapshot 2022-04-03T21:51:33.840 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/32 file after the snapshot 2022-04-03T21:51:33.840 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/33 file after the snapshot 2022-04-03T21:51:33.841 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/34 file after the snapshot 2022-04-03T21:51:33.841 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/35 file after the snapshot 2022-04-03T21:51:33.841 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/36 file after the snapshot 2022-04-03T21:51:33.842 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/37 file after the snapshot 2022-04-03T21:51:33.842 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/38 file after the snapshot 2022-04-03T21:51:33.842 INFO:tasks.workunit.client.0.smithi049.stdout: create 270/39 file after the snapshot 2022-04-03T21:51:33.842 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/.snap/snap-subdir-test 2022-04-03T21:51:33.867 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/30 file after the snapshot 2022-04-03T21:51:33.869 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/31 file after the snapshot 2022-04-03T21:51:33.869 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/32 file after the snapshot 2022-04-03T21:51:33.869 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/33 file after the snapshot 2022-04-03T21:51:33.870 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/34 file after the snapshot 2022-04-03T21:51:33.870 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/35 file after the snapshot 2022-04-03T21:51:33.870 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/36 file after the snapshot 2022-04-03T21:51:33.871 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/37 file after the snapshot 2022-04-03T21:51:33.871 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/38 file after the snapshot 2022-04-03T21:51:33.871 INFO:tasks.workunit.client.0.smithi049.stdout: create 271/39 file after the snapshot 2022-04-03T21:51:33.872 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/.snap/snap-subdir-test 2022-04-03T21:51:33.899 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/30 file after the snapshot 2022-04-03T21:51:33.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/31 file after the snapshot 2022-04-03T21:51:33.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/32 file after the snapshot 2022-04-03T21:51:33.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/33 file after the snapshot 2022-04-03T21:51:33.901 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/34 file after the snapshot 2022-04-03T21:51:33.902 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/35 file after the snapshot 2022-04-03T21:51:33.902 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/36 file after the snapshot 2022-04-03T21:51:33.902 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/37 file after the snapshot 2022-04-03T21:51:33.902 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/38 file after the snapshot 2022-04-03T21:51:33.903 INFO:tasks.workunit.client.0.smithi049.stdout: create 272/39 file after the snapshot 2022-04-03T21:51:33.903 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/.snap/snap-subdir-test 2022-04-03T21:51:33.930 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/30 file after the snapshot 2022-04-03T21:51:33.932 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/31 file after the snapshot 2022-04-03T21:51:33.932 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/32 file after the snapshot 2022-04-03T21:51:33.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/33 file after the snapshot 2022-04-03T21:51:33.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/34 file after the snapshot 2022-04-03T21:51:33.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/35 file after the snapshot 2022-04-03T21:51:33.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/36 file after the snapshot 2022-04-03T21:51:33.933 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/37 file after the snapshot 2022-04-03T21:51:33.934 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/38 file after the snapshot 2022-04-03T21:51:33.934 INFO:tasks.workunit.client.0.smithi049.stdout: create 273/39 file after the snapshot 2022-04-03T21:51:33.934 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/.snap/snap-subdir-test 2022-04-03T21:51:33.958 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/30 file after the snapshot 2022-04-03T21:51:33.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/31 file after the snapshot 2022-04-03T21:51:33.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/32 file after the snapshot 2022-04-03T21:51:33.960 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/33 file after the snapshot 2022-04-03T21:51:33.961 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/34 file after the snapshot 2022-04-03T21:51:33.961 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/35 file after the snapshot 2022-04-03T21:51:33.961 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/36 file after the snapshot 2022-04-03T21:51:33.961 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/37 file after the snapshot 2022-04-03T21:51:33.961 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/38 file after the snapshot 2022-04-03T21:51:33.962 INFO:tasks.workunit.client.0.smithi049.stdout: create 274/39 file after the snapshot 2022-04-03T21:51:33.962 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/.snap/snap-subdir-test 2022-04-03T21:51:33.982 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/30 file after the snapshot 2022-04-03T21:51:33.984 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/31 file after the snapshot 2022-04-03T21:51:33.984 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/32 file after the snapshot 2022-04-03T21:51:33.984 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/33 file after the snapshot 2022-04-03T21:51:33.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/34 file after the snapshot 2022-04-03T21:51:33.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/35 file after the snapshot 2022-04-03T21:51:33.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/36 file after the snapshot 2022-04-03T21:51:33.985 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/37 file after the snapshot 2022-04-03T21:51:33.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/38 file after the snapshot 2022-04-03T21:51:33.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 275/39 file after the snapshot 2022-04-03T21:51:33.986 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/.snap/snap-subdir-test 2022-04-03T21:51:34.009 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/30 file after the snapshot 2022-04-03T21:51:34.011 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/31 file after the snapshot 2022-04-03T21:51:34.011 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/32 file after the snapshot 2022-04-03T21:51:34.012 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/33 file after the snapshot 2022-04-03T21:51:34.012 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/34 file after the snapshot 2022-04-03T21:51:34.012 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/35 file after the snapshot 2022-04-03T21:51:34.012 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/36 file after the snapshot 2022-04-03T21:51:34.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/37 file after the snapshot 2022-04-03T21:51:34.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/38 file after the snapshot 2022-04-03T21:51:34.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 276/39 file after the snapshot 2022-04-03T21:51:34.013 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/.snap/snap-subdir-test 2022-04-03T21:51:34.035 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/30 file after the snapshot 2022-04-03T21:51:34.037 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/31 file after the snapshot 2022-04-03T21:51:34.038 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/32 file after the snapshot 2022-04-03T21:51:34.038 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/33 file after the snapshot 2022-04-03T21:51:34.038 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/34 file after the snapshot 2022-04-03T21:51:34.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/35 file after the snapshot 2022-04-03T21:51:34.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/36 file after the snapshot 2022-04-03T21:51:34.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/37 file after the snapshot 2022-04-03T21:51:34.039 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/38 file after the snapshot 2022-04-03T21:51:34.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 277/39 file after the snapshot 2022-04-03T21:51:34.040 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/.snap/snap-subdir-test 2022-04-03T21:51:34.059 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/30 file after the snapshot 2022-04-03T21:51:34.061 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/31 file after the snapshot 2022-04-03T21:51:34.062 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/32 file after the snapshot 2022-04-03T21:51:34.062 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/33 file after the snapshot 2022-04-03T21:51:34.062 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/34 file after the snapshot 2022-04-03T21:51:34.062 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/35 file after the snapshot 2022-04-03T21:51:34.063 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/36 file after the snapshot 2022-04-03T21:51:34.063 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/37 file after the snapshot 2022-04-03T21:51:34.063 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/38 file after the snapshot 2022-04-03T21:51:34.063 INFO:tasks.workunit.client.0.smithi049.stdout: create 278/39 file after the snapshot 2022-04-03T21:51:34.063 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/.snap/snap-subdir-test 2022-04-03T21:51:34.086 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/30 file after the snapshot 2022-04-03T21:51:34.088 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/31 file after the snapshot 2022-04-03T21:51:34.088 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/32 file after the snapshot 2022-04-03T21:51:34.088 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/33 file after the snapshot 2022-04-03T21:51:34.088 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/34 file after the snapshot 2022-04-03T21:51:34.089 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/35 file after the snapshot 2022-04-03T21:51:34.089 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/36 file after the snapshot 2022-04-03T21:51:34.089 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/37 file after the snapshot 2022-04-03T21:51:34.089 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/38 file after the snapshot 2022-04-03T21:51:34.089 INFO:tasks.workunit.client.0.smithi049.stdout: create 279/39 file after the snapshot 2022-04-03T21:51:34.090 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/.snap/snap-subdir-test 2022-04-03T21:51:34.111 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/30 file after the snapshot 2022-04-03T21:51:34.113 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/31 file after the snapshot 2022-04-03T21:51:34.113 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/32 file after the snapshot 2022-04-03T21:51:34.114 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/33 file after the snapshot 2022-04-03T21:51:34.114 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/34 file after the snapshot 2022-04-03T21:51:34.114 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/35 file after the snapshot 2022-04-03T21:51:34.114 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/36 file after the snapshot 2022-04-03T21:51:34.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/37 file after the snapshot 2022-04-03T21:51:34.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/38 file after the snapshot 2022-04-03T21:51:34.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 280/39 file after the snapshot 2022-04-03T21:51:34.115 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/.snap/snap-subdir-test 2022-04-03T21:51:34.138 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/30 file after the snapshot 2022-04-03T21:51:34.140 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/31 file after the snapshot 2022-04-03T21:51:34.140 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/32 file after the snapshot 2022-04-03T21:51:34.141 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/33 file after the snapshot 2022-04-03T21:51:34.141 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/34 file after the snapshot 2022-04-03T21:51:34.141 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/35 file after the snapshot 2022-04-03T21:51:34.141 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/36 file after the snapshot 2022-04-03T21:51:34.141 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/37 file after the snapshot 2022-04-03T21:51:34.142 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/38 file after the snapshot 2022-04-03T21:51:34.142 INFO:tasks.workunit.client.0.smithi049.stdout: create 281/39 file after the snapshot 2022-04-03T21:51:34.142 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/.snap/snap-subdir-test 2022-04-03T21:51:34.163 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/30 file after the snapshot 2022-04-03T21:51:34.165 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/31 file after the snapshot 2022-04-03T21:51:34.166 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/32 file after the snapshot 2022-04-03T21:51:34.166 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/33 file after the snapshot 2022-04-03T21:51:34.166 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/34 file after the snapshot 2022-04-03T21:51:34.166 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/35 file after the snapshot 2022-04-03T21:51:34.166 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/36 file after the snapshot 2022-04-03T21:51:34.167 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/37 file after the snapshot 2022-04-03T21:51:34.167 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/38 file after the snapshot 2022-04-03T21:51:34.167 INFO:tasks.workunit.client.0.smithi049.stdout: create 282/39 file after the snapshot 2022-04-03T21:51:34.167 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/.snap/snap-subdir-test 2022-04-03T21:51:34.186 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/30 file after the snapshot 2022-04-03T21:51:34.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/31 file after the snapshot 2022-04-03T21:51:34.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/32 file after the snapshot 2022-04-03T21:51:34.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/33 file after the snapshot 2022-04-03T21:51:34.189 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/34 file after the snapshot 2022-04-03T21:51:34.190 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/35 file after the snapshot 2022-04-03T21:51:34.190 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/36 file after the snapshot 2022-04-03T21:51:34.190 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/37 file after the snapshot 2022-04-03T21:51:34.190 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/38 file after the snapshot 2022-04-03T21:51:34.190 INFO:tasks.workunit.client.0.smithi049.stdout: create 283/39 file after the snapshot 2022-04-03T21:51:34.191 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/.snap/snap-subdir-test 2022-04-03T21:51:34.212 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/30 file after the snapshot 2022-04-03T21:51:34.214 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/31 file after the snapshot 2022-04-03T21:51:34.214 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/32 file after the snapshot 2022-04-03T21:51:34.214 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/33 file after the snapshot 2022-04-03T21:51:34.214 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/34 file after the snapshot 2022-04-03T21:51:34.215 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/35 file after the snapshot 2022-04-03T21:51:34.215 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/36 file after the snapshot 2022-04-03T21:51:34.215 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/37 file after the snapshot 2022-04-03T21:51:34.215 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/38 file after the snapshot 2022-04-03T21:51:34.216 INFO:tasks.workunit.client.0.smithi049.stdout: create 284/39 file after the snapshot 2022-04-03T21:51:34.216 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/.snap/snap-subdir-test 2022-04-03T21:51:34.235 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/30 file after the snapshot 2022-04-03T21:51:34.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/31 file after the snapshot 2022-04-03T21:51:34.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/32 file after the snapshot 2022-04-03T21:51:34.238 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/33 file after the snapshot 2022-04-03T21:51:34.239 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/34 file after the snapshot 2022-04-03T21:51:34.239 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/35 file after the snapshot 2022-04-03T21:51:34.239 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/36 file after the snapshot 2022-04-03T21:51:34.240 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/37 file after the snapshot 2022-04-03T21:51:34.240 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/38 file after the snapshot 2022-04-03T21:51:34.240 INFO:tasks.workunit.client.0.smithi049.stdout: create 285/39 file after the snapshot 2022-04-03T21:51:34.240 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/.snap/snap-subdir-test 2022-04-03T21:51:34.261 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/30 file after the snapshot 2022-04-03T21:51:34.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/31 file after the snapshot 2022-04-03T21:51:34.263 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/32 file after the snapshot 2022-04-03T21:51:34.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/33 file after the snapshot 2022-04-03T21:51:34.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/34 file after the snapshot 2022-04-03T21:51:34.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/35 file after the snapshot 2022-04-03T21:51:34.264 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/36 file after the snapshot 2022-04-03T21:51:34.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/37 file after the snapshot 2022-04-03T21:51:34.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/38 file after the snapshot 2022-04-03T21:51:34.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 286/39 file after the snapshot 2022-04-03T21:51:34.265 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/.snap/snap-subdir-test 2022-04-03T21:51:34.287 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/30 file after the snapshot 2022-04-03T21:51:34.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/31 file after the snapshot 2022-04-03T21:51:34.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/32 file after the snapshot 2022-04-03T21:51:34.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/33 file after the snapshot 2022-04-03T21:51:34.289 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/34 file after the snapshot 2022-04-03T21:51:34.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/35 file after the snapshot 2022-04-03T21:51:34.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/36 file after the snapshot 2022-04-03T21:51:34.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/37 file after the snapshot 2022-04-03T21:51:34.290 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/38 file after the snapshot 2022-04-03T21:51:34.291 INFO:tasks.workunit.client.0.smithi049.stdout: create 287/39 file after the snapshot 2022-04-03T21:51:34.291 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/.snap/snap-subdir-test 2022-04-03T21:51:34.311 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/30 file after the snapshot 2022-04-03T21:51:34.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/31 file after the snapshot 2022-04-03T21:51:34.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/32 file after the snapshot 2022-04-03T21:51:34.313 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/33 file after the snapshot 2022-04-03T21:51:34.314 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/34 file after the snapshot 2022-04-03T21:51:34.314 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/35 file after the snapshot 2022-04-03T21:51:34.314 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/36 file after the snapshot 2022-04-03T21:51:34.314 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/37 file after the snapshot 2022-04-03T21:51:34.315 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/38 file after the snapshot 2022-04-03T21:51:34.315 INFO:tasks.workunit.client.0.smithi049.stdout: create 288/39 file after the snapshot 2022-04-03T21:51:34.315 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/.snap/snap-subdir-test 2022-04-03T21:51:34.335 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/30 file after the snapshot 2022-04-03T21:51:34.337 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/31 file after the snapshot 2022-04-03T21:51:34.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/32 file after the snapshot 2022-04-03T21:51:34.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/33 file after the snapshot 2022-04-03T21:51:34.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/34 file after the snapshot 2022-04-03T21:51:34.338 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/35 file after the snapshot 2022-04-03T21:51:34.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/36 file after the snapshot 2022-04-03T21:51:34.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/37 file after the snapshot 2022-04-03T21:51:34.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/38 file after the snapshot 2022-04-03T21:51:34.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 289/39 file after the snapshot 2022-04-03T21:51:34.339 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/.snap/snap-subdir-test 2022-04-03T21:51:34.360 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/30 file after the snapshot 2022-04-03T21:51:34.362 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/31 file after the snapshot 2022-04-03T21:51:34.362 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/32 file after the snapshot 2022-04-03T21:51:34.363 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/33 file after the snapshot 2022-04-03T21:51:34.363 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/34 file after the snapshot 2022-04-03T21:51:34.363 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/35 file after the snapshot 2022-04-03T21:51:34.363 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/36 file after the snapshot 2022-04-03T21:51:34.364 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/37 file after the snapshot 2022-04-03T21:51:34.364 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/38 file after the snapshot 2022-04-03T21:51:34.364 INFO:tasks.workunit.client.0.smithi049.stdout: create 290/39 file after the snapshot 2022-04-03T21:51:34.364 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/.snap/snap-subdir-test 2022-04-03T21:51:34.384 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/30 file after the snapshot 2022-04-03T21:51:34.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/31 file after the snapshot 2022-04-03T21:51:34.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/32 file after the snapshot 2022-04-03T21:51:34.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/33 file after the snapshot 2022-04-03T21:51:34.386 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/34 file after the snapshot 2022-04-03T21:51:34.387 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/35 file after the snapshot 2022-04-03T21:51:34.387 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/36 file after the snapshot 2022-04-03T21:51:34.387 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/37 file after the snapshot 2022-04-03T21:51:34.387 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/38 file after the snapshot 2022-04-03T21:51:34.388 INFO:tasks.workunit.client.0.smithi049.stdout: create 291/39 file after the snapshot 2022-04-03T21:51:34.388 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/.snap/snap-subdir-test 2022-04-03T21:51:34.410 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/30 file after the snapshot 2022-04-03T21:51:34.411 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/31 file after the snapshot 2022-04-03T21:51:34.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/32 file after the snapshot 2022-04-03T21:51:34.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/33 file after the snapshot 2022-04-03T21:51:34.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/34 file after the snapshot 2022-04-03T21:51:34.412 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/35 file after the snapshot 2022-04-03T21:51:34.413 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/36 file after the snapshot 2022-04-03T21:51:34.414 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/37 file after the snapshot 2022-04-03T21:51:34.414 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/38 file after the snapshot 2022-04-03T21:51:34.414 INFO:tasks.workunit.client.0.smithi049.stdout: create 292/39 file after the snapshot 2022-04-03T21:51:34.414 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/.snap/snap-subdir-test 2022-04-03T21:51:34.436 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/30 file after the snapshot 2022-04-03T21:51:34.437 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/31 file after the snapshot 2022-04-03T21:51:34.437 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/32 file after the snapshot 2022-04-03T21:51:34.437 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/33 file after the snapshot 2022-04-03T21:51:34.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/34 file after the snapshot 2022-04-03T21:51:34.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/35 file after the snapshot 2022-04-03T21:51:34.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/36 file after the snapshot 2022-04-03T21:51:34.439 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/37 file after the snapshot 2022-04-03T21:51:34.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/38 file after the snapshot 2022-04-03T21:51:34.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 293/39 file after the snapshot 2022-04-03T21:51:34.440 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/.snap/snap-subdir-test 2022-04-03T21:51:34.459 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/30 file after the snapshot 2022-04-03T21:51:34.461 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/31 file after the snapshot 2022-04-03T21:51:34.462 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/32 file after the snapshot 2022-04-03T21:51:34.462 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/33 file after the snapshot 2022-04-03T21:51:34.462 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/34 file after the snapshot 2022-04-03T21:51:34.462 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/35 file after the snapshot 2022-04-03T21:51:34.463 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/36 file after the snapshot 2022-04-03T21:51:34.463 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/37 file after the snapshot 2022-04-03T21:51:34.463 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/38 file after the snapshot 2022-04-03T21:51:34.463 INFO:tasks.workunit.client.0.smithi049.stdout: create 294/39 file after the snapshot 2022-04-03T21:51:34.463 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/.snap/snap-subdir-test 2022-04-03T21:51:34.490 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/30 file after the snapshot 2022-04-03T21:51:34.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/31 file after the snapshot 2022-04-03T21:51:34.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/32 file after the snapshot 2022-04-03T21:51:34.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/33 file after the snapshot 2022-04-03T21:51:34.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/34 file after the snapshot 2022-04-03T21:51:34.492 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/35 file after the snapshot 2022-04-03T21:51:34.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/36 file after the snapshot 2022-04-03T21:51:34.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/37 file after the snapshot 2022-04-03T21:51:34.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/38 file after the snapshot 2022-04-03T21:51:34.493 INFO:tasks.workunit.client.0.smithi049.stdout: create 295/39 file after the snapshot 2022-04-03T21:51:34.494 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/.snap/snap-subdir-test 2022-04-03T21:51:34.518 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/30 file after the snapshot 2022-04-03T21:51:34.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/31 file after the snapshot 2022-04-03T21:51:34.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/32 file after the snapshot 2022-04-03T21:51:34.520 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/33 file after the snapshot 2022-04-03T21:51:34.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/34 file after the snapshot 2022-04-03T21:51:34.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/35 file after the snapshot 2022-04-03T21:51:34.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/36 file after the snapshot 2022-04-03T21:51:34.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/37 file after the snapshot 2022-04-03T21:51:34.521 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/38 file after the snapshot 2022-04-03T21:51:34.522 INFO:tasks.workunit.client.0.smithi049.stdout: create 296/39 file after the snapshot 2022-04-03T21:51:34.522 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/.snap/snap-subdir-test 2022-04-03T21:51:34.546 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/30 file after the snapshot 2022-04-03T21:51:34.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/31 file after the snapshot 2022-04-03T21:51:34.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/32 file after the snapshot 2022-04-03T21:51:34.548 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/33 file after the snapshot 2022-04-03T21:51:34.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/34 file after the snapshot 2022-04-03T21:51:34.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/35 file after the snapshot 2022-04-03T21:51:34.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/36 file after the snapshot 2022-04-03T21:51:34.549 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/37 file after the snapshot 2022-04-03T21:51:34.550 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/38 file after the snapshot 2022-04-03T21:51:34.550 INFO:tasks.workunit.client.0.smithi049.stdout: create 297/39 file after the snapshot 2022-04-03T21:51:34.550 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/.snap/snap-subdir-test 2022-04-03T21:51:34.570 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/30 file after the snapshot 2022-04-03T21:51:34.572 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/31 file after the snapshot 2022-04-03T21:51:34.572 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/32 file after the snapshot 2022-04-03T21:51:34.572 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/33 file after the snapshot 2022-04-03T21:51:34.572 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/34 file after the snapshot 2022-04-03T21:51:34.573 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/35 file after the snapshot 2022-04-03T21:51:34.573 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/36 file after the snapshot 2022-04-03T21:51:34.573 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/37 file after the snapshot 2022-04-03T21:51:34.573 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/38 file after the snapshot 2022-04-03T21:51:34.574 INFO:tasks.workunit.client.0.smithi049.stdout: create 298/39 file after the snapshot 2022-04-03T21:51:34.574 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/.snap/snap-subdir-test 2022-04-03T21:51:34.592 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/30 file after the snapshot 2022-04-03T21:51:34.594 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/31 file after the snapshot 2022-04-03T21:51:34.595 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/32 file after the snapshot 2022-04-03T21:51:34.595 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/33 file after the snapshot 2022-04-03T21:51:34.595 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/34 file after the snapshot 2022-04-03T21:51:34.595 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/35 file after the snapshot 2022-04-03T21:51:34.596 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/36 file after the snapshot 2022-04-03T21:51:34.596 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/37 file after the snapshot 2022-04-03T21:51:34.596 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/38 file after the snapshot 2022-04-03T21:51:34.596 INFO:tasks.workunit.client.0.smithi049.stdout: create 299/39 file after the snapshot 2022-04-03T21:51:34.596 INFO:tasks.workunit.client.0.smithi049.stdout:Take second snapshot .snap/test2 2022-04-03T21:51:34.666 INFO:tasks.workunit.client.0.smithi049.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2022-04-03T21:51:53.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:51:53.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:51:54.821 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2022-04-03T21:51:54.822 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2022-04-03T21:51:54.822 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2022-04-03T21:51:54.822 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2022-04-03T21:51:54.822 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2022-04-03T21:51:54.823 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2022-04-03T21:51:54.823 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2022-04-03T21:51:54.823 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2022-04-03T21:51:54.823 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2022-04-03T21:51:54.823 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2022-04-03T21:51:54.824 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2022-04-03T21:51:54.824 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2022-04-03T21:51:54.824 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2022-04-03T21:51:54.824 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2022-04-03T21:51:54.824 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2022-04-03T21:51:54.825 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2022-04-03T21:51:54.825 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2022-04-03T21:51:54.825 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2022-04-03T21:51:54.825 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2022-04-03T21:51:54.826 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2022-04-03T21:51:54.826 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2022-04-03T21:51:54.826 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2022-04-03T21:51:54.826 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2022-04-03T21:51:54.827 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2022-04-03T21:51:54.827 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2022-04-03T21:51:54.827 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2022-04-03T21:51:54.827 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2022-04-03T21:51:54.827 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2022-04-03T21:51:54.828 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2022-04-03T21:51:54.828 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2022-04-03T21:51:54.828 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2022-04-03T21:51:54.828 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2022-04-03T21:51:54.828 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2022-04-03T21:51:54.829 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2022-04-03T21:51:54.829 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2022-04-03T21:51:54.829 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2022-04-03T21:51:54.829 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2022-04-03T21:51:54.830 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2022-04-03T21:51:54.830 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2022-04-03T21:51:54.830 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2022-04-03T21:51:54.830 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2022-04-03T21:51:54.830 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2022-04-03T21:51:54.831 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2022-04-03T21:51:54.831 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2022-04-03T21:51:54.831 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2022-04-03T21:51:54.831 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2022-04-03T21:51:54.832 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2022-04-03T21:51:54.832 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2022-04-03T21:51:54.832 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2022-04-03T21:51:54.832 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2022-04-03T21:51:54.832 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2022-04-03T21:51:54.833 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2022-04-03T21:51:54.833 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2022-04-03T21:51:54.833 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2022-04-03T21:51:54.833 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2022-04-03T21:51:54.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2022-04-03T21:51:54.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2022-04-03T21:51:54.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2022-04-03T21:51:54.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2022-04-03T21:51:54.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2022-04-03T21:51:54.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2022-04-03T21:51:54.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2022-04-03T21:51:54.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2022-04-03T21:51:54.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2022-04-03T21:51:54.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2022-04-03T21:51:54.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2022-04-03T21:51:54.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2022-04-03T21:51:54.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2022-04-03T21:51:54.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2022-04-03T21:51:54.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2022-04-03T21:51:54.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2022-04-03T21:51:54.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2022-04-03T21:51:54.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2022-04-03T21:51:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2022-04-03T21:51:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2022-04-03T21:51:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2022-04-03T21:51:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2022-04-03T21:51:54.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2022-04-03T21:51:54.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2022-04-03T21:51:54.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2022-04-03T21:51:54.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2022-04-03T21:51:55.323 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2022-04-03T21:51:55.323 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2022-04-03T21:51:55.323 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2022-04-03T21:51:55.323 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2022-04-03T21:51:55.324 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2022-04-03T21:51:55.324 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2022-04-03T21:51:55.324 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2022-04-03T21:51:55.324 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2022-04-03T21:51:55.324 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2022-04-03T21:51:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2022-04-03T21:51:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2022-04-03T21:51:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2022-04-03T21:51:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2022-04-03T21:51:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2022-04-03T21:51:55.326 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2022-04-03T21:51:55.326 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2022-04-03T21:51:55.326 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2022-04-03T21:51:55.326 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2022-04-03T21:51:55.326 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2022-04-03T21:51:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2022-04-03T21:51:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2022-04-03T21:51:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2022-04-03T21:51:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2022-04-03T21:51:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2022-04-03T21:51:55.328 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2022-04-03T21:51:55.328 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2022-04-03T21:51:55.328 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2022-04-03T21:51:55.328 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2022-04-03T21:51:55.328 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2022-04-03T21:51:55.329 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2022-04-03T21:51:55.329 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2022-04-03T21:51:55.329 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2022-04-03T21:51:55.329 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2022-04-03T21:51:55.329 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2022-04-03T21:51:55.330 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2022-04-03T21:51:55.330 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2022-04-03T21:51:55.330 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2022-04-03T21:51:55.330 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2022-04-03T21:51:55.331 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2022-04-03T21:51:55.331 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2022-04-03T21:51:55.331 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2022-04-03T21:51:55.331 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2022-04-03T21:51:55.331 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2022-04-03T21:51:55.332 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2022-04-03T21:51:55.332 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2022-04-03T21:51:55.332 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2022-04-03T21:51:55.332 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2022-04-03T21:51:55.333 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2022-04-03T21:51:55.333 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2022-04-03T21:51:55.333 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2022-04-03T21:51:55.333 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2022-04-03T21:51:55.333 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2022-04-03T21:51:55.334 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2022-04-03T21:51:55.334 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2022-04-03T21:51:55.334 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2022-04-03T21:51:55.334 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2022-04-03T21:51:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2022-04-03T21:51:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2022-04-03T21:51:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2022-04-03T21:51:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2022-04-03T21:51:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2022-04-03T21:51:55.336 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2022-04-03T21:51:55.336 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2022-04-03T21:51:55.336 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2022-04-03T21:51:55.336 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2022-04-03T21:51:55.336 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2022-04-03T21:51:55.337 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2022-04-03T21:51:55.337 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2022-04-03T21:51:55.337 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2022-04-03T21:51:55.337 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2022-04-03T21:51:55.337 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2022-04-03T21:51:55.338 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2022-04-03T21:51:55.338 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2022-04-03T21:51:55.338 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2022-04-03T21:51:55.338 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2022-04-03T21:51:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2022-04-03T21:51:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2022-04-03T21:51:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2022-04-03T21:51:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2022-04-03T21:51:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2022-04-03T21:51:55.340 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2022-04-03T21:51:55.833 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2022-04-03T21:51:55.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2022-04-03T21:51:55.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2022-04-03T21:51:55.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2022-04-03T21:51:55.834 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2022-04-03T21:51:55.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2022-04-03T21:51:55.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2022-04-03T21:51:55.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2022-04-03T21:51:55.835 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2022-04-03T21:51:55.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2022-04-03T21:51:55.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2022-04-03T21:51:55.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2022-04-03T21:51:55.836 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2022-04-03T21:51:55.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2022-04-03T21:51:55.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2022-04-03T21:51:55.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2022-04-03T21:51:55.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2022-04-03T21:51:55.837 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2022-04-03T21:51:55.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2022-04-03T21:51:55.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2022-04-03T21:51:55.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2022-04-03T21:51:55.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2022-04-03T21:51:55.838 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2022-04-03T21:51:55.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2022-04-03T21:51:55.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2022-04-03T21:51:55.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2022-04-03T21:51:55.839 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2022-04-03T21:51:55.840 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2022-04-03T21:51:55.840 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2022-04-03T21:51:55.840 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2022-04-03T21:51:55.840 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2022-04-03T21:51:55.840 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2022-04-03T21:51:55.841 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2022-04-03T21:51:55.841 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2022-04-03T21:51:55.841 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2022-04-03T21:51:55.841 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2022-04-03T21:51:55.842 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2022-04-03T21:51:55.842 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2022-04-03T21:51:55.842 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2022-04-03T21:51:55.842 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2022-04-03T21:51:55.843 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2022-04-03T21:51:55.843 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2022-04-03T21:51:55.843 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2022-04-03T21:51:55.843 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2022-04-03T21:51:55.844 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2022-04-03T21:51:55.844 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2022-04-03T21:51:55.844 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2022-04-03T21:51:55.844 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2022-04-03T21:51:55.844 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2022-04-03T21:51:55.845 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2022-04-03T21:51:55.845 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2022-04-03T21:51:55.845 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2022-04-03T21:51:55.845 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2022-04-03T21:51:55.845 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2022-04-03T21:51:55.846 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2022-04-03T21:51:55.846 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2022-04-03T21:51:55.846 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2022-04-03T21:51:55.846 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2022-04-03T21:51:55.847 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2022-04-03T21:51:55.847 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2022-04-03T21:51:55.847 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2022-04-03T21:51:55.847 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2022-04-03T21:51:55.848 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2022-04-03T21:51:55.848 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2022-04-03T21:51:55.848 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2022-04-03T21:51:55.848 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2022-04-03T21:51:55.848 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2022-04-03T21:51:55.849 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2022-04-03T21:51:55.849 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2022-04-03T21:51:55.849 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2022-04-03T21:51:55.849 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2022-04-03T21:51:55.849 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2022-04-03T21:51:55.850 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2022-04-03T21:51:55.850 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2022-04-03T21:51:55.850 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2022-04-03T21:51:55.850 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2022-04-03T21:51:55.851 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2022-04-03T21:51:55.851 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2022-04-03T21:51:55.851 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2022-04-03T21:51:55.852 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2022-04-03T21:51:55.852 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2022-04-03T21:51:56.352 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2022-04-03T21:51:56.353 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2022-04-03T21:51:56.354 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2022-04-03T21:51:56.357 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2022-04-03T21:51:56.357 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2022-04-03T21:51:56.358 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2022-04-03T21:51:56.358 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2022-04-03T21:51:56.358 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2022-04-03T21:51:56.358 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2022-04-03T21:51:56.359 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2022-04-03T21:51:56.359 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2022-04-03T21:51:56.359 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2022-04-03T21:51:56.359 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2022-04-03T21:51:56.360 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2022-04-03T21:51:56.360 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2022-04-03T21:51:56.361 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2022-04-03T21:51:56.361 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2022-04-03T21:51:56.361 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2022-04-03T21:51:56.361 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2022-04-03T21:51:56.362 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2022-04-03T21:51:56.362 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2022-04-03T21:51:56.363 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2022-04-03T21:51:56.363 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2022-04-03T21:51:56.364 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2022-04-03T21:51:56.364 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2022-04-03T21:51:56.364 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2022-04-03T21:51:56.365 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2022-04-03T21:51:56.365 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2022-04-03T21:51:56.366 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2022-04-03T21:51:56.366 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2022-04-03T21:51:56.367 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2022-04-03T21:51:56.367 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2022-04-03T21:51:56.367 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2022-04-03T21:51:56.368 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2022-04-03T21:51:56.368 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2022-04-03T21:51:56.369 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2022-04-03T21:51:56.369 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2022-04-03T21:51:56.370 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2022-04-03T21:51:56.370 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2022-04-03T21:51:56.371 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2022-04-03T21:51:56.371 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2022-04-03T21:51:56.371 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2022-04-03T21:51:56.372 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2022-04-03T21:51:56.372 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2022-04-03T21:51:56.373 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2022-04-03T21:51:56.373 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2022-04-03T21:51:56.374 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2022-04-03T21:51:56.374 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2022-04-03T21:51:56.375 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2022-04-03T21:51:56.375 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2022-04-03T21:51:56.375 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2022-04-03T21:51:56.376 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2022-04-03T21:51:56.376 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2022-04-03T21:51:56.377 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2022-04-03T21:51:56.377 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2022-04-03T21:51:56.378 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2022-04-03T21:51:56.378 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2022-04-03T21:51:56.379 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2022-04-03T21:51:56.379 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2022-04-03T21:51:56.379 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2022-04-03T21:51:56.380 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2022-04-03T21:51:56.380 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2022-04-03T21:51:56.381 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2022-04-03T21:51:56.381 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2022-04-03T21:51:56.382 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2022-04-03T21:51:56.382 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2022-04-03T21:51:56.383 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2022-04-03T21:51:56.383 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2022-04-03T21:51:56.383 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2022-04-03T21:51:56.384 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2022-04-03T21:51:56.384 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2022-04-03T21:51:56.384 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2022-04-03T21:51:56.385 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2022-04-03T21:51:56.385 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2022-04-03T21:51:56.385 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2022-04-03T21:51:56.386 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2022-04-03T21:51:56.386 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2022-04-03T21:51:56.387 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2022-04-03T21:51:56.387 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2022-04-03T21:51:56.388 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2022-04-03T21:51:56.388 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2022-04-03T21:51:56.864 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2022-04-03T21:51:56.864 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2022-04-03T21:51:56.864 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2022-04-03T21:51:56.865 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2022-04-03T21:51:56.865 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2022-04-03T21:51:56.865 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2022-04-03T21:51:56.865 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2022-04-03T21:51:56.865 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2022-04-03T21:51:56.866 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2022-04-03T21:51:56.866 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2022-04-03T21:51:56.866 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2022-04-03T21:51:56.866 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2022-04-03T21:51:56.867 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2022-04-03T21:51:56.867 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2022-04-03T21:51:56.867 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2022-04-03T21:51:56.867 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2022-04-03T21:51:56.868 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2022-04-03T21:51:56.868 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2022-04-03T21:51:56.868 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2022-04-03T21:51:56.868 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2022-04-03T21:51:56.868 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2022-04-03T21:51:56.869 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2022-04-03T21:51:56.869 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2022-04-03T21:51:56.870 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2022-04-03T21:51:56.870 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2022-04-03T21:51:56.870 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2022-04-03T21:51:56.871 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2022-04-03T21:51:56.871 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2022-04-03T21:51:56.871 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2022-04-03T21:51:56.872 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2022-04-03T21:51:56.872 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2022-04-03T21:51:56.872 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2022-04-03T21:51:56.872 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2022-04-03T21:51:56.872 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2022-04-03T21:51:56.873 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2022-04-03T21:51:56.873 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2022-04-03T21:51:56.873 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2022-04-03T21:51:56.873 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2022-04-03T21:51:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2022-04-03T21:51:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2022-04-03T21:51:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2022-04-03T21:51:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2022-04-03T21:51:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2022-04-03T21:51:56.875 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2022-04-03T21:51:56.875 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2022-04-03T21:51:56.875 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2022-04-03T21:51:56.875 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2022-04-03T21:51:56.875 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2022-04-03T21:51:56.876 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2022-04-03T21:51:56.876 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2022-04-03T21:51:56.876 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2022-04-03T21:51:56.876 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2022-04-03T21:51:56.876 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2022-04-03T21:51:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2022-04-03T21:51:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2022-04-03T21:51:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2022-04-03T21:51:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2022-04-03T21:51:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2022-04-03T21:51:56.878 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2022-04-03T21:51:56.878 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2022-04-03T21:51:56.878 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2022-04-03T21:51:56.878 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2022-04-03T21:51:56.879 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2022-04-03T21:51:56.879 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2022-04-03T21:51:56.879 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2022-04-03T21:51:56.879 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2022-04-03T21:51:56.880 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2022-04-03T21:51:56.880 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2022-04-03T21:51:56.880 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2022-04-03T21:51:56.880 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2022-04-03T21:51:56.880 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2022-04-03T21:51:56.881 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2022-04-03T21:51:56.881 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2022-04-03T21:51:56.881 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2022-04-03T21:51:56.881 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2022-04-03T21:51:56.882 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2022-04-03T21:51:56.882 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2022-04-03T21:51:56.882 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2022-04-03T21:51:56.882 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2022-04-03T21:51:56.882 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2022-04-03T21:51:56.883 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2022-04-03T21:52:05.888 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2022-04-03T21:52:05.888 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2022-04-03T21:52:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2022-04-03T21:52:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2022-04-03T21:52:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2022-04-03T21:52:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2022-04-03T21:52:05.890 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2022-04-03T21:52:05.890 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2022-04-03T21:52:05.890 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2022-04-03T21:52:05.890 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2022-04-03T21:52:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2022-04-03T21:52:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2022-04-03T21:52:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2022-04-03T21:52:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2022-04-03T21:52:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2022-04-03T21:52:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2022-04-03T21:52:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2022-04-03T21:52:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2022-04-03T21:52:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2022-04-03T21:52:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2022-04-03T21:52:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2022-04-03T21:52:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2022-04-03T21:52:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2022-04-03T21:52:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2022-04-03T21:52:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2022-04-03T21:52:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2022-04-03T21:52:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2022-04-03T21:52:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2022-04-03T21:52:05.895 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2022-04-03T21:52:05.895 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2022-04-03T21:52:05.895 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2022-04-03T21:52:05.895 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2022-04-03T21:52:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2022-04-03T21:52:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2022-04-03T21:52:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2022-04-03T21:52:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2022-04-03T21:52:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2022-04-03T21:52:05.897 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2022-04-03T21:52:05.897 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2022-04-03T21:52:05.897 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2022-04-03T21:52:05.897 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2022-04-03T21:52:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2022-04-03T21:52:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2022-04-03T21:52:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2022-04-03T21:52:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2022-04-03T21:52:05.899 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2022-04-03T21:52:05.899 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2022-04-03T21:52:05.899 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2022-04-03T21:52:05.899 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2022-04-03T21:52:05.899 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2022-04-03T21:52:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2022-04-03T21:52:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2022-04-03T21:52:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2022-04-03T21:52:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2022-04-03T21:52:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2022-04-03T21:52:05.901 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2022-04-03T21:52:05.901 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2022-04-03T21:52:05.901 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2022-04-03T21:52:05.901 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2022-04-03T21:52:05.902 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2022-04-03T21:52:05.902 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2022-04-03T21:52:05.902 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2022-04-03T21:52:05.902 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2022-04-03T21:52:05.902 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2022-04-03T21:52:05.903 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2022-04-03T21:52:05.903 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2022-04-03T21:52:05.903 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2022-04-03T21:52:05.903 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2022-04-03T21:52:05.903 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2022-04-03T21:52:05.904 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2022-04-03T21:52:05.904 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2022-04-03T21:52:05.904 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2022-04-03T21:52:05.904 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2022-04-03T21:52:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2022-04-03T21:52:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2022-04-03T21:52:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2022-04-03T21:52:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2022-04-03T21:52:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2022-04-03T21:52:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2022-04-03T21:52:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2022-04-03T21:52:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2022-04-03T21:52:06.427 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2022-04-03T21:52:06.427 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2022-04-03T21:52:06.428 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2022-04-03T21:52:06.428 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2022-04-03T21:52:06.428 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2022-04-03T21:52:06.428 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2022-04-03T21:52:06.428 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2022-04-03T21:52:06.429 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2022-04-03T21:52:06.429 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2022-04-03T21:52:06.429 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2022-04-03T21:52:06.429 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2022-04-03T21:52:06.430 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2022-04-03T21:52:06.430 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2022-04-03T21:52:06.430 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2022-04-03T21:52:06.430 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2022-04-03T21:52:06.430 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2022-04-03T21:52:06.431 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2022-04-03T21:52:06.431 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2022-04-03T21:52:06.431 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2022-04-03T21:52:06.431 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2022-04-03T21:52:06.431 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2022-04-03T21:52:06.432 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2022-04-03T21:52:06.432 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2022-04-03T21:52:06.432 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2022-04-03T21:52:06.432 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2022-04-03T21:52:06.432 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2022-04-03T21:52:06.433 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2022-04-03T21:52:06.433 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2022-04-03T21:52:06.433 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2022-04-03T21:52:06.433 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2022-04-03T21:52:06.434 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2022-04-03T21:52:06.434 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2022-04-03T21:52:06.434 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2022-04-03T21:52:06.434 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2022-04-03T21:52:06.434 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2022-04-03T21:52:06.435 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2022-04-03T21:52:06.435 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2022-04-03T21:52:06.435 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2022-04-03T21:52:06.435 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2022-04-03T21:52:06.436 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2022-04-03T21:52:06.436 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2022-04-03T21:52:06.436 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2022-04-03T21:52:06.436 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2022-04-03T21:52:06.437 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2022-04-03T21:52:06.437 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2022-04-03T21:52:06.437 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2022-04-03T21:52:06.437 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2022-04-03T21:52:06.437 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2022-04-03T21:52:06.438 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2022-04-03T21:52:06.438 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2022-04-03T21:52:06.438 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2022-04-03T21:52:06.438 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2022-04-03T21:52:06.439 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2022-04-03T21:52:06.439 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2022-04-03T21:52:06.439 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2022-04-03T21:52:06.439 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2022-04-03T21:52:06.440 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2022-04-03T21:52:06.440 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2022-04-03T21:52:06.441 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2022-04-03T21:52:06.441 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2022-04-03T21:52:06.441 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2022-04-03T21:52:06.441 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2022-04-03T21:52:06.441 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2022-04-03T21:52:06.442 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2022-04-03T21:52:06.442 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2022-04-03T21:52:06.442 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2022-04-03T21:52:06.442 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2022-04-03T21:52:06.442 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2022-04-03T21:52:06.443 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2022-04-03T21:52:06.443 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2022-04-03T21:52:06.443 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2022-04-03T21:52:06.443 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2022-04-03T21:52:06.444 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2022-04-03T21:52:06.444 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2022-04-03T21:52:06.444 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2022-04-03T21:52:06.444 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2022-04-03T21:52:06.444 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2022-04-03T21:52:06.445 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2022-04-03T21:52:06.445 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2022-04-03T21:52:06.445 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2022-04-03T21:52:06.445 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2022-04-03T21:52:06.445 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2022-04-03T21:52:06.944 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2022-04-03T21:52:06.944 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2022-04-03T21:52:06.945 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2022-04-03T21:52:06.945 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2022-04-03T21:52:06.945 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2022-04-03T21:52:06.946 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2022-04-03T21:52:06.947 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2022-04-03T21:52:06.947 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2022-04-03T21:52:06.948 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2022-04-03T21:52:06.948 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2022-04-03T21:52:06.948 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2022-04-03T21:52:06.949 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2022-04-03T21:52:06.949 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2022-04-03T21:52:06.950 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2022-04-03T21:52:06.950 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2022-04-03T21:52:06.951 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2022-04-03T21:52:06.951 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2022-04-03T21:52:06.951 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2022-04-03T21:52:06.952 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2022-04-03T21:52:06.952 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2022-04-03T21:52:06.952 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2022-04-03T21:52:06.952 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2022-04-03T21:52:06.952 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2022-04-03T21:52:06.953 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2022-04-03T21:52:06.953 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2022-04-03T21:52:06.953 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2022-04-03T21:52:06.953 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2022-04-03T21:52:06.953 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2022-04-03T21:52:06.954 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2022-04-03T21:52:06.954 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2022-04-03T21:52:06.954 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2022-04-03T21:52:06.955 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2022-04-03T21:52:06.955 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2022-04-03T21:52:06.955 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2022-04-03T21:52:06.956 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2022-04-03T21:52:06.956 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2022-04-03T21:52:06.957 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2022-04-03T21:52:06.957 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2022-04-03T21:52:06.957 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2022-04-03T21:52:06.958 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2022-04-03T21:52:06.958 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2022-04-03T21:52:06.959 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2022-04-03T21:52:06.959 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2022-04-03T21:52:06.960 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2022-04-03T21:52:06.960 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2022-04-03T21:52:06.960 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2022-04-03T21:52:06.961 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2022-04-03T21:52:06.961 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2022-04-03T21:52:06.962 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2022-04-03T21:52:06.962 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2022-04-03T21:52:06.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2022-04-03T21:52:06.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2022-04-03T21:52:06.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2022-04-03T21:52:06.964 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2022-04-03T21:52:06.964 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2022-04-03T21:52:06.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2022-04-03T21:52:06.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2022-04-03T21:52:06.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2022-04-03T21:52:06.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2022-04-03T21:52:06.966 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2022-04-03T21:52:06.966 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2022-04-03T21:52:06.967 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2022-04-03T21:52:06.967 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2022-04-03T21:52:06.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2022-04-03T21:52:06.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2022-04-03T21:52:06.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2022-04-03T21:52:06.969 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2022-04-03T21:52:06.969 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2022-04-03T21:52:06.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2022-04-03T21:52:06.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2022-04-03T21:52:06.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2022-04-03T21:52:06.971 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2022-04-03T21:52:06.971 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2022-04-03T21:52:06.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2022-04-03T21:52:06.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2022-04-03T21:52:06.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2022-04-03T21:52:06.973 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2022-04-03T21:52:06.973 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2022-04-03T21:52:06.974 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2022-04-03T21:52:06.974 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2022-04-03T21:52:06.975 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2022-04-03T21:52:07.446 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2022-04-03T21:52:07.447 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2022-04-03T21:52:07.447 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2022-04-03T21:52:07.447 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2022-04-03T21:52:07.447 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2022-04-03T21:52:07.448 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2022-04-03T21:52:07.448 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2022-04-03T21:52:07.448 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2022-04-03T21:52:07.448 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2022-04-03T21:52:07.448 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2022-04-03T21:52:07.449 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2022-04-03T21:52:07.449 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2022-04-03T21:52:07.449 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2022-04-03T21:52:07.449 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2022-04-03T21:52:07.449 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2022-04-03T21:52:07.450 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2022-04-03T21:52:07.450 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2022-04-03T21:52:07.450 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2022-04-03T21:52:07.450 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2022-04-03T21:52:07.451 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2022-04-03T21:52:07.451 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2022-04-03T21:52:07.451 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2022-04-03T21:52:07.451 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2022-04-03T21:52:07.451 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2022-04-03T21:52:07.452 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2022-04-03T21:52:07.452 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2022-04-03T21:52:07.452 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2022-04-03T21:52:07.452 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2022-04-03T21:52:07.452 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2022-04-03T21:52:07.453 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2022-04-03T21:52:07.453 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2022-04-03T21:52:07.453 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2022-04-03T21:52:07.453 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2022-04-03T21:52:07.453 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2022-04-03T21:52:07.454 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2022-04-03T21:52:07.454 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2022-04-03T21:52:07.454 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2022-04-03T21:52:07.454 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2022-04-03T21:52:07.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2022-04-03T21:52:07.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2022-04-03T21:52:07.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2022-04-03T21:52:07.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2022-04-03T21:52:07.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2022-04-03T21:52:07.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2022-04-03T21:52:07.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2022-04-03T21:52:07.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2022-04-03T21:52:07.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2022-04-03T21:52:07.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2022-04-03T21:52:07.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2022-04-03T21:52:07.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2022-04-03T21:52:07.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2022-04-03T21:52:07.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2022-04-03T21:52:07.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2022-04-03T21:52:07.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2022-04-03T21:52:07.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2022-04-03T21:52:07.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2022-04-03T21:52:07.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2022-04-03T21:52:07.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2022-04-03T21:52:07.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2022-04-03T21:52:07.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2022-04-03T21:52:07.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2022-04-03T21:52:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2022-04-03T21:52:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2022-04-03T21:52:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2022-04-03T21:52:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2022-04-03T21:52:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2022-04-03T21:52:07.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2022-04-03T21:52:07.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2022-04-03T21:52:07.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2022-04-03T21:52:07.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2022-04-03T21:52:07.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2022-04-03T21:52:07.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2022-04-03T21:52:07.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2022-04-03T21:52:07.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2022-04-03T21:52:07.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2022-04-03T21:52:07.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2022-04-03T21:52:07.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2022-04-03T21:52:07.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2022-04-03T21:52:07.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2022-04-03T21:52:07.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2022-04-03T21:52:07.464 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2022-04-03T21:52:07.962 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2022-04-03T21:52:07.962 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2022-04-03T21:52:07.962 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2022-04-03T21:52:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2022-04-03T21:52:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2022-04-03T21:52:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2022-04-03T21:52:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2022-04-03T21:52:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2022-04-03T21:52:07.964 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2022-04-03T21:52:07.964 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2022-04-03T21:52:07.964 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2022-04-03T21:52:07.964 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2022-04-03T21:52:07.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2022-04-03T21:52:07.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2022-04-03T21:52:07.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2022-04-03T21:52:07.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2022-04-03T21:52:07.965 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2022-04-03T21:52:07.966 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2022-04-03T21:52:07.966 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2022-04-03T21:52:07.966 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2022-04-03T21:52:07.967 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2022-04-03T21:52:07.967 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2022-04-03T21:52:07.967 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2022-04-03T21:52:07.967 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2022-04-03T21:52:07.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2022-04-03T21:52:07.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2022-04-03T21:52:07.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2022-04-03T21:52:07.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2022-04-03T21:52:07.968 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2022-04-03T21:52:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2022-04-03T21:52:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2022-04-03T21:52:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2022-04-03T21:52:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2022-04-03T21:52:07.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2022-04-03T21:52:07.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2022-04-03T21:52:07.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2022-04-03T21:52:07.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2022-04-03T21:52:07.970 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2022-04-03T21:52:07.971 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2022-04-03T21:52:07.971 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2022-04-03T21:52:07.971 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2022-04-03T21:52:07.971 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2022-04-03T21:52:07.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2022-04-03T21:52:07.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2022-04-03T21:52:07.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2022-04-03T21:52:07.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2022-04-03T21:52:07.972 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2022-04-03T21:52:07.973 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2022-04-03T21:52:07.973 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2022-04-03T21:52:07.973 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2022-04-03T21:52:07.973 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2022-04-03T21:52:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2022-04-03T21:52:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2022-04-03T21:52:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2022-04-03T21:52:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2022-04-03T21:52:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2022-04-03T21:52:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2022-04-03T21:52:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2022-04-03T21:52:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2022-04-03T21:52:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2022-04-03T21:52:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2022-04-03T21:52:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2022-04-03T21:52:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2022-04-03T21:52:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2022-04-03T21:52:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2022-04-03T21:52:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2022-04-03T21:52:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2022-04-03T21:52:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2022-04-03T21:52:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2022-04-03T21:52:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2022-04-03T21:52:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2022-04-03T21:52:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2022-04-03T21:52:07.979 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2022-04-03T21:52:07.979 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2022-04-03T21:52:07.979 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2022-04-03T21:52:07.979 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2022-04-03T21:52:07.979 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2022-04-03T21:52:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2022-04-03T21:52:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2022-04-03T21:52:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2022-04-03T21:52:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2022-04-03T21:52:08.481 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2022-04-03T21:52:08.482 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2022-04-03T21:52:08.482 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2022-04-03T21:52:08.482 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2022-04-03T21:52:08.482 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2022-04-03T21:52:08.483 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2022-04-03T21:52:08.483 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2022-04-03T21:52:08.483 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2022-04-03T21:52:08.483 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2022-04-03T21:52:08.484 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2022-04-03T21:52:08.484 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2022-04-03T21:52:08.484 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2022-04-03T21:52:08.484 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2022-04-03T21:52:08.484 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2022-04-03T21:52:08.485 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2022-04-03T21:52:08.485 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2022-04-03T21:52:08.485 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2022-04-03T21:52:08.485 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2022-04-03T21:52:08.485 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2022-04-03T21:52:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2022-04-03T21:52:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2022-04-03T21:52:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2022-04-03T21:52:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2022-04-03T21:52:08.487 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2022-04-03T21:52:08.487 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2022-04-03T21:52:08.487 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2022-04-03T21:52:08.487 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2022-04-03T21:52:08.487 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2022-04-03T21:52:08.488 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2022-04-03T21:52:08.488 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2022-04-03T21:52:08.488 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2022-04-03T21:52:08.488 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2022-04-03T21:52:08.488 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2022-04-03T21:52:08.489 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2022-04-03T21:52:08.489 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2022-04-03T21:52:08.489 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2022-04-03T21:52:08.489 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2022-04-03T21:52:08.490 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2022-04-03T21:52:08.490 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2022-04-03T21:52:08.490 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2022-04-03T21:52:08.490 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2022-04-03T21:52:08.490 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2022-04-03T21:52:08.491 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2022-04-03T21:52:08.491 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2022-04-03T21:52:08.491 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2022-04-03T21:52:08.491 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2022-04-03T21:52:08.491 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2022-04-03T21:52:08.492 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2022-04-03T21:52:08.492 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2022-04-03T21:52:08.492 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2022-04-03T21:52:08.492 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2022-04-03T21:52:08.492 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2022-04-03T21:52:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2022-04-03T21:52:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2022-04-03T21:52:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2022-04-03T21:52:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2022-04-03T21:52:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2022-04-03T21:52:08.494 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2022-04-03T21:52:08.494 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2022-04-03T21:52:08.494 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2022-04-03T21:52:08.494 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2022-04-03T21:52:08.495 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2022-04-03T21:52:08.495 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2022-04-03T21:52:08.495 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2022-04-03T21:52:08.495 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2022-04-03T21:52:08.495 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2022-04-03T21:52:08.496 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2022-04-03T21:52:08.496 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2022-04-03T21:52:08.496 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2022-04-03T21:52:08.496 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2022-04-03T21:52:08.496 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2022-04-03T21:52:08.497 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2022-04-03T21:52:08.497 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2022-04-03T21:52:08.497 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2022-04-03T21:52:08.497 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2022-04-03T21:52:08.497 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2022-04-03T21:52:08.498 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2022-04-03T21:52:08.498 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2022-04-03T21:52:08.498 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2022-04-03T21:52:08.498 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2022-04-03T21:52:08.498 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2022-04-03T21:52:09.007 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2022-04-03T21:52:09.007 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2022-04-03T21:52:09.008 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2022-04-03T21:52:09.008 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2022-04-03T21:52:09.008 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2022-04-03T21:52:09.008 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2022-04-03T21:52:09.009 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2022-04-03T21:52:09.009 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2022-04-03T21:52:09.009 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2022-04-03T21:52:09.009 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2022-04-03T21:52:09.010 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2022-04-03T21:52:09.010 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2022-04-03T21:52:09.010 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2022-04-03T21:52:09.010 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2022-04-03T21:52:09.010 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2022-04-03T21:52:09.011 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2022-04-03T21:52:09.011 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2022-04-03T21:52:09.011 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2022-04-03T21:52:09.011 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2022-04-03T21:52:09.012 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2022-04-03T21:52:09.012 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2022-04-03T21:52:09.012 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2022-04-03T21:52:09.012 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2022-04-03T21:52:09.012 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2022-04-03T21:52:09.013 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2022-04-03T21:52:09.013 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2022-04-03T21:52:09.013 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2022-04-03T21:52:09.013 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2022-04-03T21:52:09.013 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2022-04-03T21:52:09.014 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2022-04-03T21:52:09.014 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2022-04-03T21:52:09.014 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2022-04-03T21:52:09.014 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2022-04-03T21:52:09.015 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2022-04-03T21:52:09.015 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2022-04-03T21:52:09.015 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2022-04-03T21:52:09.015 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2022-04-03T21:52:09.016 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2022-04-03T21:52:09.016 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2022-04-03T21:52:09.016 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2022-04-03T21:52:09.016 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2022-04-03T21:52:09.016 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2022-04-03T21:52:09.017 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2022-04-03T21:52:09.017 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2022-04-03T21:52:09.017 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2022-04-03T21:52:09.017 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2022-04-03T21:52:09.018 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2022-04-03T21:52:09.018 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2022-04-03T21:52:09.018 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2022-04-03T21:52:09.018 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2022-04-03T21:52:09.018 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2022-04-03T21:52:09.019 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2022-04-03T21:52:09.019 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2022-04-03T21:52:09.019 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2022-04-03T21:52:09.019 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2022-04-03T21:52:09.020 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2022-04-03T21:52:09.020 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2022-04-03T21:52:09.020 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2022-04-03T21:52:09.020 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2022-04-03T21:52:09.020 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2022-04-03T21:52:09.021 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2022-04-03T21:52:09.021 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2022-04-03T21:52:09.021 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2022-04-03T21:52:09.021 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2022-04-03T21:52:09.021 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2022-04-03T21:52:09.022 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2022-04-03T21:52:09.022 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2022-04-03T21:52:09.022 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2022-04-03T21:52:09.022 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2022-04-03T21:52:09.023 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2022-04-03T21:52:09.023 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2022-04-03T21:52:09.023 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2022-04-03T21:52:09.023 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2022-04-03T21:52:09.023 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2022-04-03T21:52:09.024 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2022-04-03T21:52:09.024 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2022-04-03T21:52:09.024 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2022-04-03T21:52:09.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2022-04-03T21:52:09.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2022-04-03T21:52:09.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2022-04-03T21:52:09.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2022-04-03T21:52:09.509 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2022-04-03T21:52:09.509 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2022-04-03T21:52:09.510 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2022-04-03T21:52:09.510 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2022-04-03T21:52:09.510 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2022-04-03T21:52:09.510 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2022-04-03T21:52:09.511 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2022-04-03T21:52:09.511 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2022-04-03T21:52:09.511 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2022-04-03T21:52:09.511 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2022-04-03T21:52:09.511 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2022-04-03T21:52:09.512 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2022-04-03T21:52:09.512 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2022-04-03T21:52:09.512 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2022-04-03T21:52:09.512 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2022-04-03T21:52:09.513 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2022-04-03T21:52:09.513 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2022-04-03T21:52:09.513 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2022-04-03T21:52:09.513 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2022-04-03T21:52:09.513 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2022-04-03T21:52:09.514 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2022-04-03T21:52:09.514 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2022-04-03T21:52:09.514 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2022-04-03T21:52:09.514 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2022-04-03T21:52:09.514 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2022-04-03T21:52:09.515 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2022-04-03T21:52:09.515 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2022-04-03T21:52:09.515 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2022-04-03T21:52:09.515 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2022-04-03T21:52:09.515 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2022-04-03T21:52:09.516 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2022-04-03T21:52:09.516 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2022-04-03T21:52:09.516 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2022-04-03T21:52:09.516 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2022-04-03T21:52:09.516 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2022-04-03T21:52:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2022-04-03T21:52:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2022-04-03T21:52:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2022-04-03T21:52:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2022-04-03T21:52:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2022-04-03T21:52:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2022-04-03T21:52:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2022-04-03T21:52:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2022-04-03T21:52:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2022-04-03T21:52:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2022-04-03T21:52:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2022-04-03T21:52:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2022-04-03T21:52:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2022-04-03T21:52:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2022-04-03T21:52:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2022-04-03T21:52:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2022-04-03T21:52:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2022-04-03T21:52:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2022-04-03T21:52:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2022-04-03T21:52:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2022-04-03T21:52:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2022-04-03T21:52:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2022-04-03T21:52:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2022-04-03T21:52:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2022-04-03T21:52:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2022-04-03T21:52:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2022-04-03T21:52:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2022-04-03T21:52:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2022-04-03T21:52:09.523 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2022-04-03T21:52:09.523 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2022-04-03T21:52:09.523 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2022-04-03T21:52:09.523 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2022-04-03T21:52:09.523 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2022-04-03T21:52:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2022-04-03T21:52:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2022-04-03T21:52:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2022-04-03T21:52:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2022-04-03T21:52:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2022-04-03T21:52:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2022-04-03T21:52:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2022-04-03T21:52:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2022-04-03T21:52:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2022-04-03T21:52:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2022-04-03T21:52:09.526 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2022-04-03T21:52:09.526 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2022-04-03T21:52:09.526 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2022-04-03T21:52:10.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2022-04-03T21:52:10.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2022-04-03T21:52:10.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2022-04-03T21:52:10.025 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2022-04-03T21:52:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2022-04-03T21:52:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2022-04-03T21:52:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2022-04-03T21:52:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2022-04-03T21:52:10.027 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2022-04-03T21:52:10.027 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2022-04-03T21:52:10.027 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2022-04-03T21:52:10.027 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2022-04-03T21:52:10.027 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2022-04-03T21:52:10.028 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2022-04-03T21:52:10.028 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2022-04-03T21:52:10.028 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2022-04-03T21:52:10.028 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2022-04-03T21:52:10.029 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2022-04-03T21:52:10.029 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2022-04-03T21:52:10.029 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2022-04-03T21:52:10.029 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2022-04-03T21:52:10.029 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2022-04-03T21:52:10.030 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2022-04-03T21:52:10.030 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2022-04-03T21:52:10.030 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2022-04-03T21:52:10.030 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2022-04-03T21:52:10.031 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2022-04-03T21:52:10.031 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2022-04-03T21:52:10.031 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2022-04-03T21:52:10.031 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2022-04-03T21:52:10.031 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2022-04-03T21:52:10.032 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2022-04-03T21:52:10.032 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2022-04-03T21:52:10.032 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2022-04-03T21:52:10.032 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2022-04-03T21:52:10.033 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2022-04-03T21:52:10.033 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2022-04-03T21:52:10.033 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2022-04-03T21:52:10.034 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2022-04-03T21:52:10.034 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2022-04-03T21:52:10.034 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2022-04-03T21:52:10.035 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2022-04-03T21:52:10.035 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2022-04-03T21:52:10.035 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2022-04-03T21:52:10.035 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2022-04-03T21:52:10.036 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2022-04-03T21:52:10.036 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2022-04-03T21:52:10.036 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2022-04-03T21:52:10.036 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2022-04-03T21:52:10.037 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2022-04-03T21:52:10.037 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2022-04-03T21:52:10.037 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2022-04-03T21:52:10.037 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2022-04-03T21:52:10.037 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2022-04-03T21:52:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2022-04-03T21:52:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2022-04-03T21:52:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2022-04-03T21:52:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2022-04-03T21:52:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2022-04-03T21:52:10.039 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2022-04-03T21:52:10.039 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2022-04-03T21:52:10.039 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2022-04-03T21:52:10.039 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2022-04-03T21:52:10.040 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2022-04-03T21:52:10.040 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2022-04-03T21:52:10.040 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2022-04-03T21:52:10.040 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2022-04-03T21:52:10.040 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2022-04-03T21:52:10.041 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2022-04-03T21:52:10.041 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2022-04-03T21:52:10.041 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2022-04-03T21:52:10.041 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2022-04-03T21:52:10.041 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2022-04-03T21:52:10.042 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2022-04-03T21:52:10.042 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2022-04-03T21:52:10.042 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2022-04-03T21:52:10.042 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2022-04-03T21:52:10.042 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2022-04-03T21:52:10.043 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2022-04-03T21:52:10.043 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2022-04-03T21:52:10.043 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2022-04-03T21:52:10.454 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2022-04-03T21:52:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2022-04-03T21:52:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2022-04-03T21:52:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2022-04-03T21:52:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2022-04-03T21:52:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2022-04-03T21:52:10.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2022-04-03T21:52:10.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2022-04-03T21:52:10.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2022-04-03T21:52:10.456 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2022-04-03T21:52:10.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2022-04-03T21:52:10.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2022-04-03T21:52:10.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2022-04-03T21:52:10.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2022-04-03T21:52:10.457 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2022-04-03T21:52:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2022-04-03T21:52:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2022-04-03T21:52:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2022-04-03T21:52:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2022-04-03T21:52:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2022-04-03T21:52:10.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2022-04-03T21:52:10.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2022-04-03T21:52:10.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2022-04-03T21:52:10.459 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2022-04-03T21:52:10.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2022-04-03T21:52:10.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2022-04-03T21:52:10.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2022-04-03T21:52:10.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2022-04-03T21:52:10.460 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2022-04-03T21:52:10.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2022-04-03T21:52:10.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2022-04-03T21:52:10.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2022-04-03T21:52:10.461 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2022-04-03T21:52:10.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2022-04-03T21:52:10.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2022-04-03T21:52:10.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2022-04-03T21:52:10.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2022-04-03T21:52:10.462 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2022-04-03T21:52:10.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2022-04-03T21:52:10.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2022-04-03T21:52:10.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2022-04-03T21:52:10.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2022-04-03T21:52:10.463 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2022-04-03T21:52:10.464 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2022-04-03T21:52:10.464 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2022-04-03T21:52:10.464 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2022-04-03T21:52:10.464 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2022-04-03T21:52:10.464 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2022-04-03T21:52:10.465 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2022-04-03T21:52:10.465 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2022-04-03T21:52:10.465 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2022-04-03T21:52:10.465 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2022-04-03T21:52:10.466 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2022-04-03T21:52:10.466 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2022-04-03T21:52:10.466 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2022-04-03T21:52:10.466 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2022-04-03T21:52:10.466 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2022-04-03T21:52:10.467 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2022-04-03T21:52:10.467 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2022-04-03T21:52:10.467 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2022-04-03T21:52:10.467 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2022-04-03T21:52:10.467 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2022-04-03T21:52:10.468 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2022-04-03T21:52:10.468 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2022-04-03T21:52:10.468 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2022-04-03T21:52:10.469 INFO:tasks.workunit.client.0.smithi049.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2022-04-03T21:52:10.469 INFO:tasks.workunit.client.0.smithi049.stdout:Take third snapshot .snap/test3 2022-04-03T21:52:10.476 INFO:tasks.workunit.client.0.smithi049.stdout:Delete the snapshots... 2022-04-03T21:52:10.784 INFO:tasks.workunit.client.0.smithi049.stdout:.//.snap/test1 2022-04-03T21:52:10.785 INFO:tasks.workunit.client.0.smithi049.stdout:.//.snap/test2 2022-04-03T21:52:10.785 INFO:tasks.workunit.client.0.smithi049.stdout:.//.snap/test3 2022-04-03T21:52:10.793 INFO:tasks.workunit.client.0.smithi049.stdout:./274/.snap/snap-subdir-test 2022-04-03T21:52:10.801 INFO:tasks.workunit.client.0.smithi049.stdout:./166/.snap/snap-subdir-test 2022-04-03T21:52:10.810 INFO:tasks.workunit.client.0.smithi049.stdout:./256/.snap/snap-subdir-test 2022-04-03T21:52:10.818 INFO:tasks.workunit.client.0.smithi049.stdout:./247/.snap/snap-subdir-test 2022-04-03T21:52:10.827 INFO:tasks.workunit.client.0.smithi049.stdout:./248/.snap/snap-subdir-test 2022-04-03T21:52:10.835 INFO:tasks.workunit.client.0.smithi049.stdout:./147/.snap/snap-subdir-test 2022-04-03T21:52:10.843 INFO:tasks.workunit.client.0.smithi049.stdout:./151/.snap/snap-subdir-test 2022-04-03T21:52:10.852 INFO:tasks.workunit.client.0.smithi049.stdout:./170/.snap/snap-subdir-test 2022-04-03T21:52:10.862 INFO:tasks.workunit.client.0.smithi049.stdout:./167/.snap/snap-subdir-test 2022-04-03T21:52:10.873 INFO:tasks.workunit.client.0.smithi049.stdout:./140/.snap/snap-subdir-test 2022-04-03T21:52:10.881 INFO:tasks.workunit.client.0.smithi049.stdout:./142/.snap/snap-subdir-test 2022-04-03T21:52:10.890 INFO:tasks.workunit.client.0.smithi049.stdout:./150/.snap/snap-subdir-test 2022-04-03T21:52:10.898 INFO:tasks.workunit.client.0.smithi049.stdout:./273/.snap/snap-subdir-test 2022-04-03T21:52:10.907 INFO:tasks.workunit.client.0.smithi049.stdout:./269/.snap/snap-subdir-test 2022-04-03T21:52:10.914 INFO:tasks.workunit.client.0.smithi049.stdout:./105/.snap/snap-subdir-test 2022-04-03T21:52:10.922 INFO:tasks.workunit.client.0.smithi049.stdout:./210/.snap/snap-subdir-test 2022-04-03T21:52:10.930 INFO:tasks.workunit.client.0.smithi049.stdout:./265/.snap/snap-subdir-test 2022-04-03T21:52:10.938 INFO:tasks.workunit.client.0.smithi049.stdout:./218/.snap/snap-subdir-test 2022-04-03T21:52:10.946 INFO:tasks.workunit.client.0.smithi049.stdout:./290/.snap/snap-subdir-test 2022-04-03T21:52:10.955 INFO:tasks.workunit.client.0.smithi049.stdout:./149/.snap/snap-subdir-test 2022-04-03T21:52:10.963 INFO:tasks.workunit.client.0.smithi049.stdout:./109/.snap/snap-subdir-test 2022-04-03T21:52:10.971 INFO:tasks.workunit.client.0.smithi049.stdout:./292/.snap/snap-subdir-test 2022-04-03T21:52:10.979 INFO:tasks.workunit.client.0.smithi049.stdout:./242/.snap/snap-subdir-test 2022-04-03T21:52:10.986 INFO:tasks.workunit.client.0.smithi049.stdout:./158/.snap/snap-subdir-test 2022-04-03T21:52:10.994 INFO:tasks.workunit.client.0.smithi049.stdout:./243/.snap/snap-subdir-test 2022-04-03T21:52:11.002 INFO:tasks.workunit.client.0.smithi049.stdout:./106/.snap/snap-subdir-test 2022-04-03T21:52:11.010 INFO:tasks.workunit.client.0.smithi049.stdout:./250/.snap/snap-subdir-test 2022-04-03T21:52:11.017 INFO:tasks.workunit.client.0.smithi049.stdout:./221/.snap/snap-subdir-test 2022-04-03T21:52:11.025 INFO:tasks.workunit.client.0.smithi049.stdout:./244/.snap/snap-subdir-test 2022-04-03T21:52:11.033 INFO:tasks.workunit.client.0.smithi049.stdout:./258/.snap/snap-subdir-test 2022-04-03T21:52:11.040 INFO:tasks.workunit.client.0.smithi049.stdout:./268/.snap/snap-subdir-test 2022-04-03T21:52:11.048 INFO:tasks.workunit.client.0.smithi049.stdout:./189/.snap/snap-subdir-test 2022-04-03T21:52:11.056 INFO:tasks.workunit.client.0.smithi049.stdout:./285/.snap/snap-subdir-test 2022-04-03T21:52:11.063 INFO:tasks.workunit.client.0.smithi049.stdout:./208/.snap/snap-subdir-test 2022-04-03T21:52:11.071 INFO:tasks.workunit.client.0.smithi049.stdout:./288/.snap/snap-subdir-test 2022-04-03T21:52:11.079 INFO:tasks.workunit.client.0.smithi049.stdout:./209/.snap/snap-subdir-test 2022-04-03T21:52:11.087 INFO:tasks.workunit.client.0.smithi049.stdout:./253/.snap/snap-subdir-test 2022-04-03T21:52:11.095 INFO:tasks.workunit.client.0.smithi049.stdout:./249/.snap/snap-subdir-test 2022-04-03T21:52:11.103 INFO:tasks.workunit.client.0.smithi049.stdout:./133/.snap/snap-subdir-test 2022-04-03T21:52:11.111 INFO:tasks.workunit.client.0.smithi049.stdout:./291/.snap/snap-subdir-test 2022-04-03T21:52:11.119 INFO:tasks.workunit.client.0.smithi049.stdout:./226/.snap/snap-subdir-test 2022-04-03T21:52:11.126 INFO:tasks.workunit.client.0.smithi049.stdout:./173/.snap/snap-subdir-test 2022-04-03T21:52:11.134 INFO:tasks.workunit.client.0.smithi049.stdout:./174/.snap/snap-subdir-test 2022-04-03T21:52:11.141 INFO:tasks.workunit.client.0.smithi049.stdout:./299/.snap/snap-subdir-test 2022-04-03T21:52:11.149 INFO:tasks.workunit.client.0.smithi049.stdout:./262/.snap/snap-subdir-test 2022-04-03T21:52:11.157 INFO:tasks.workunit.client.0.smithi049.stdout:./231/.snap/snap-subdir-test 2022-04-03T21:52:11.164 INFO:tasks.workunit.client.0.smithi049.stdout:./214/.snap/snap-subdir-test 2022-04-03T21:52:11.172 INFO:tasks.workunit.client.0.smithi049.stdout:./281/.snap/snap-subdir-test 2022-04-03T21:52:11.180 INFO:tasks.workunit.client.0.smithi049.stdout:./289/.snap/snap-subdir-test 2022-04-03T21:52:11.188 INFO:tasks.workunit.client.0.smithi049.stdout:./283/.snap/snap-subdir-test 2022-04-03T21:52:11.196 INFO:tasks.workunit.client.0.smithi049.stdout:./232/.snap/snap-subdir-test 2022-04-03T21:52:11.205 INFO:tasks.workunit.client.0.smithi049.stdout:./298/.snap/snap-subdir-test 2022-04-03T21:52:11.212 INFO:tasks.workunit.client.0.smithi049.stdout:./233/.snap/snap-subdir-test 2022-04-03T21:52:11.220 INFO:tasks.workunit.client.0.smithi049.stdout:./155/.snap/snap-subdir-test 2022-04-03T21:52:11.228 INFO:tasks.workunit.client.0.smithi049.stdout:./114/.snap/snap-subdir-test 2022-04-03T21:52:11.236 INFO:tasks.workunit.client.0.smithi049.stdout:./159/.snap/snap-subdir-test 2022-04-03T21:52:11.245 INFO:tasks.workunit.client.0.smithi049.stdout:./187/.snap/snap-subdir-test 2022-04-03T21:52:11.253 INFO:tasks.workunit.client.0.smithi049.stdout:./185/.snap/snap-subdir-test 2022-04-03T21:52:11.261 INFO:tasks.workunit.client.0.smithi049.stdout:./293/.snap/snap-subdir-test 2022-04-03T21:52:11.269 INFO:tasks.workunit.client.0.smithi049.stdout:./228/.snap/snap-subdir-test 2022-04-03T21:52:11.277 INFO:tasks.workunit.client.0.smithi049.stdout:./120/.snap/snap-subdir-test 2022-04-03T21:52:11.284 INFO:tasks.workunit.client.0.smithi049.stdout:./110/.snap/snap-subdir-test 2022-04-03T21:52:11.292 INFO:tasks.workunit.client.0.smithi049.stdout:./267/.snap/snap-subdir-test 2022-04-03T21:52:11.300 INFO:tasks.workunit.client.0.smithi049.stdout:./202/.snap/snap-subdir-test 2022-04-03T21:52:11.307 INFO:tasks.workunit.client.0.smithi049.stdout:./137/.snap/snap-subdir-test 2022-04-03T21:52:11.315 INFO:tasks.workunit.client.0.smithi049.stdout:./246/.snap/snap-subdir-test 2022-04-03T21:52:11.323 INFO:tasks.workunit.client.0.smithi049.stdout:./219/.snap/snap-subdir-test 2022-04-03T21:52:11.331 INFO:tasks.workunit.client.0.smithi049.stdout:./198/.snap/snap-subdir-test 2022-04-03T21:52:11.338 INFO:tasks.workunit.client.0.smithi049.stdout:./136/.snap/snap-subdir-test 2022-04-03T21:52:11.346 INFO:tasks.workunit.client.0.smithi049.stdout:./270/.snap/snap-subdir-test 2022-04-03T21:52:11.354 INFO:tasks.workunit.client.0.smithi049.stdout:./125/.snap/snap-subdir-test 2022-04-03T21:52:11.362 INFO:tasks.workunit.client.0.smithi049.stdout:./194/.snap/snap-subdir-test 2022-04-03T21:52:11.370 INFO:tasks.workunit.client.0.smithi049.stdout:./119/.snap/snap-subdir-test 2022-04-03T21:52:11.379 INFO:tasks.workunit.client.0.smithi049.stdout:./297/.snap/snap-subdir-test 2022-04-03T21:52:11.387 INFO:tasks.workunit.client.0.smithi049.stdout:./230/.snap/snap-subdir-test 2022-04-03T21:52:11.395 INFO:tasks.workunit.client.0.smithi049.stdout:./260/.snap/snap-subdir-test 2022-04-03T21:52:11.403 INFO:tasks.workunit.client.0.smithi049.stdout:./157/.snap/snap-subdir-test 2022-04-03T21:52:11.412 INFO:tasks.workunit.client.0.smithi049.stdout:./172/.snap/snap-subdir-test 2022-04-03T21:52:11.420 INFO:tasks.workunit.client.0.smithi049.stdout:./277/.snap/snap-subdir-test 2022-04-03T21:52:11.428 INFO:tasks.workunit.client.0.smithi049.stdout:./186/.snap/snap-subdir-test 2022-04-03T21:52:11.436 INFO:tasks.workunit.client.0.smithi049.stdout:./237/.snap/snap-subdir-test 2022-04-03T21:52:11.444 INFO:tasks.workunit.client.0.smithi049.stdout:./190/.snap/snap-subdir-test 2022-04-03T21:52:11.452 INFO:tasks.workunit.client.0.smithi049.stdout:./213/.snap/snap-subdir-test 2022-04-03T21:52:11.461 INFO:tasks.workunit.client.0.smithi049.stdout:./104/.snap/snap-subdir-test 2022-04-03T21:52:11.468 INFO:tasks.workunit.client.0.smithi049.stdout:./164/.snap/snap-subdir-test 2022-04-03T21:52:11.476 INFO:tasks.workunit.client.0.smithi049.stdout:./112/.snap/snap-subdir-test 2022-04-03T21:52:11.484 INFO:tasks.workunit.client.0.smithi049.stdout:./295/.snap/snap-subdir-test 2022-04-03T21:52:11.492 INFO:tasks.workunit.client.0.smithi049.stdout:./272/.snap/snap-subdir-test 2022-04-03T21:52:11.500 INFO:tasks.workunit.client.0.smithi049.stdout:./100/.snap/snap-subdir-test 2022-04-03T21:52:11.509 INFO:tasks.workunit.client.0.smithi049.stdout:./134/.snap/snap-subdir-test 2022-04-03T21:52:11.517 INFO:tasks.workunit.client.0.smithi049.stdout:./200/.snap/snap-subdir-test 2022-04-03T21:52:11.525 INFO:tasks.workunit.client.0.smithi049.stdout:./115/.snap/snap-subdir-test 2022-04-03T21:52:11.533 INFO:tasks.workunit.client.0.smithi049.stdout:./284/.snap/snap-subdir-test 2022-04-03T21:52:11.541 INFO:tasks.workunit.client.0.smithi049.stdout:./280/.snap/snap-subdir-test 2022-04-03T21:52:11.549 INFO:tasks.workunit.client.0.smithi049.stdout:./116/.snap/snap-subdir-test 2022-04-03T21:52:11.558 INFO:tasks.workunit.client.0.smithi049.stdout:./245/.snap/snap-subdir-test 2022-04-03T21:52:11.566 INFO:tasks.workunit.client.0.smithi049.stdout:./195/.snap/snap-subdir-test 2022-04-03T21:52:11.573 INFO:tasks.workunit.client.0.smithi049.stdout:./138/.snap/snap-subdir-test 2022-04-03T21:52:11.582 INFO:tasks.workunit.client.0.smithi049.stdout:./135/.snap/snap-subdir-test 2022-04-03T21:52:11.589 INFO:tasks.workunit.client.0.smithi049.stdout:./117/.snap/snap-subdir-test 2022-04-03T21:52:11.603 INFO:tasks.workunit.client.0.smithi049.stdout:./241/.snap/snap-subdir-test 2022-04-03T21:52:11.606 INFO:tasks.workunit.client.0.smithi049.stdout:./143/.snap/snap-subdir-test 2022-04-03T21:52:11.614 INFO:tasks.workunit.client.0.smithi049.stdout:./180/.snap/snap-subdir-test 2022-04-03T21:52:11.622 INFO:tasks.workunit.client.0.smithi049.stdout:./126/.snap/snap-subdir-test 2022-04-03T21:52:11.630 INFO:tasks.workunit.client.0.smithi049.stdout:./161/.snap/snap-subdir-test 2022-04-03T21:52:11.637 INFO:tasks.workunit.client.0.smithi049.stdout:./204/.snap/snap-subdir-test 2022-04-03T21:52:11.645 INFO:tasks.workunit.client.0.smithi049.stdout:./176/.snap/snap-subdir-test 2022-04-03T21:52:11.653 INFO:tasks.workunit.client.0.smithi049.stdout:./255/.snap/snap-subdir-test 2022-04-03T21:52:11.661 INFO:tasks.workunit.client.0.smithi049.stdout:./215/.snap/snap-subdir-test 2022-04-03T21:52:11.668 INFO:tasks.workunit.client.0.smithi049.stdout:./111/.snap/snap-subdir-test 2022-04-03T21:52:11.676 INFO:tasks.workunit.client.0.smithi049.stdout:./238/.snap/snap-subdir-test 2022-04-03T21:52:11.684 INFO:tasks.workunit.client.0.smithi049.stdout:./191/.snap/snap-subdir-test 2022-04-03T21:52:11.692 INFO:tasks.workunit.client.0.smithi049.stdout:./184/.snap/snap-subdir-test 2022-04-03T21:52:11.700 INFO:tasks.workunit.client.0.smithi049.stdout:./192/.snap/snap-subdir-test 2022-04-03T21:52:11.708 INFO:tasks.workunit.client.0.smithi049.stdout:./103/.snap/snap-subdir-test 2022-04-03T21:52:11.716 INFO:tasks.workunit.client.0.smithi049.stdout:./128/.snap/snap-subdir-test 2022-04-03T21:52:11.724 INFO:tasks.workunit.client.0.smithi049.stdout:./229/.snap/snap-subdir-test 2022-04-03T21:52:11.732 INFO:tasks.workunit.client.0.smithi049.stdout:./144/.snap/snap-subdir-test 2022-04-03T21:52:11.740 INFO:tasks.workunit.client.0.smithi049.stdout:./146/.snap/snap-subdir-test 2022-04-03T21:52:11.748 INFO:tasks.workunit.client.0.smithi049.stdout:./227/.snap/snap-subdir-test 2022-04-03T21:52:11.755 INFO:tasks.workunit.client.0.smithi049.stdout:./278/.snap/snap-subdir-test 2022-04-03T21:52:11.763 INFO:tasks.workunit.client.0.smithi049.stdout:./141/.snap/snap-subdir-test 2022-04-03T21:52:11.771 INFO:tasks.workunit.client.0.smithi049.stdout:./234/.snap/snap-subdir-test 2022-04-03T21:52:11.779 INFO:tasks.workunit.client.0.smithi049.stdout:./225/.snap/snap-subdir-test 2022-04-03T21:52:11.786 INFO:tasks.workunit.client.0.smithi049.stdout:./182/.snap/snap-subdir-test 2022-04-03T21:52:11.793 INFO:tasks.workunit.client.0.smithi049.stdout:./107/.snap/snap-subdir-test 2022-04-03T21:52:11.802 INFO:tasks.workunit.client.0.smithi049.stdout:./178/.snap/snap-subdir-test 2022-04-03T21:52:11.809 INFO:tasks.workunit.client.0.smithi049.stdout:./266/.snap/snap-subdir-test 2022-04-03T21:52:11.817 INFO:tasks.workunit.client.0.smithi049.stdout:./240/.snap/snap-subdir-test 2022-04-03T21:52:11.826 INFO:tasks.workunit.client.0.smithi049.stdout:./156/.snap/snap-subdir-test 2022-04-03T21:52:11.833 INFO:tasks.workunit.client.0.smithi049.stdout:./131/.snap/snap-subdir-test 2022-04-03T21:52:11.841 INFO:tasks.workunit.client.0.smithi049.stdout:./123/.snap/snap-subdir-test 2022-04-03T21:52:11.849 INFO:tasks.workunit.client.0.smithi049.stdout:./160/.snap/snap-subdir-test 2022-04-03T21:52:11.857 INFO:tasks.workunit.client.0.smithi049.stdout:./165/.snap/snap-subdir-test 2022-04-03T21:52:11.865 INFO:tasks.workunit.client.0.smithi049.stdout:./101/.snap/snap-subdir-test 2022-04-03T21:52:11.878 INFO:tasks.workunit.client.0.smithi049.stdout:./148/.snap/snap-subdir-test 2022-04-03T21:52:11.886 INFO:tasks.workunit.client.0.smithi049.stdout:./168/.snap/snap-subdir-test 2022-04-03T21:52:11.894 INFO:tasks.workunit.client.0.smithi049.stdout:./179/.snap/snap-subdir-test 2022-04-03T21:52:11.902 INFO:tasks.workunit.client.0.smithi049.stdout:./257/.snap/snap-subdir-test 2022-04-03T21:52:11.910 INFO:tasks.workunit.client.0.smithi049.stdout:./252/.snap/snap-subdir-test 2022-04-03T21:52:11.917 INFO:tasks.workunit.client.0.smithi049.stdout:./132/.snap/snap-subdir-test 2022-04-03T21:52:11.926 INFO:tasks.workunit.client.0.smithi049.stdout:./236/.snap/snap-subdir-test 2022-04-03T21:52:11.933 INFO:tasks.workunit.client.0.smithi049.stdout:./211/.snap/snap-subdir-test 2022-04-03T21:52:11.941 INFO:tasks.workunit.client.0.smithi049.stdout:./199/.snap/snap-subdir-test 2022-04-03T21:52:11.949 INFO:tasks.workunit.client.0.smithi049.stdout:./205/.snap/snap-subdir-test 2022-04-03T21:52:11.956 INFO:tasks.workunit.client.0.smithi049.stdout:./163/.snap/snap-subdir-test 2022-04-03T21:52:11.964 INFO:tasks.workunit.client.0.smithi049.stdout:./261/.snap/snap-subdir-test 2022-04-03T21:52:11.972 INFO:tasks.workunit.client.0.smithi049.stdout:./201/.snap/snap-subdir-test 2022-04-03T21:52:11.980 INFO:tasks.workunit.client.0.smithi049.stdout:./282/.snap/snap-subdir-test 2022-04-03T21:52:11.987 INFO:tasks.workunit.client.0.smithi049.stdout:./296/.snap/snap-subdir-test 2022-04-03T21:52:11.995 INFO:tasks.workunit.client.0.smithi049.stdout:./217/.snap/snap-subdir-test 2022-04-03T21:52:12.004 INFO:tasks.workunit.client.0.smithi049.stdout:./153/.snap/snap-subdir-test 2022-04-03T21:52:12.011 INFO:tasks.workunit.client.0.smithi049.stdout:./206/.snap/snap-subdir-test 2022-04-03T21:52:12.019 INFO:tasks.workunit.client.0.smithi049.stdout:./122/.snap/snap-subdir-test 2022-04-03T21:52:12.027 INFO:tasks.workunit.client.0.smithi049.stdout:./162/.snap/snap-subdir-test 2022-04-03T21:52:12.035 INFO:tasks.workunit.client.0.smithi049.stdout:./197/.snap/snap-subdir-test 2022-04-03T21:52:12.043 INFO:tasks.workunit.client.0.smithi049.stdout:./216/.snap/snap-subdir-test 2022-04-03T21:52:12.704 INFO:tasks.workunit.client.0.smithi049.stdout:./254/.snap/snap-subdir-test 2022-04-03T21:52:12.712 INFO:tasks.workunit.client.0.smithi049.stdout:./113/.snap/snap-subdir-test 2022-04-03T21:52:12.721 INFO:tasks.workunit.client.0.smithi049.stdout:./152/.snap/snap-subdir-test 2022-04-03T21:52:12.729 INFO:tasks.workunit.client.0.smithi049.stdout:./121/.snap/snap-subdir-test 2022-04-03T21:52:12.737 INFO:tasks.workunit.client.0.smithi049.stdout:./118/.snap/snap-subdir-test 2022-04-03T21:52:12.745 INFO:tasks.workunit.client.0.smithi049.stdout:./196/.snap/snap-subdir-test 2022-04-03T21:52:12.753 INFO:tasks.workunit.client.0.smithi049.stdout:./124/.snap/snap-subdir-test 2022-04-03T21:52:12.761 INFO:tasks.workunit.client.0.smithi049.stdout:./239/.snap/snap-subdir-test 2022-04-03T21:52:12.769 INFO:tasks.workunit.client.0.smithi049.stdout:./188/.snap/snap-subdir-test 2022-04-03T21:52:12.777 INFO:tasks.workunit.client.0.smithi049.stdout:./287/.snap/snap-subdir-test 2022-04-03T21:52:12.785 INFO:tasks.workunit.client.0.smithi049.stdout:./275/.snap/snap-subdir-test 2022-04-03T21:52:12.793 INFO:tasks.workunit.client.0.smithi049.stdout:./259/.snap/snap-subdir-test 2022-04-03T21:52:12.801 INFO:tasks.workunit.client.0.smithi049.stdout:./224/.snap/snap-subdir-test 2022-04-03T21:52:12.808 INFO:tasks.workunit.client.0.smithi049.stdout:./264/.snap/snap-subdir-test 2022-04-03T21:52:12.816 INFO:tasks.workunit.client.0.smithi049.stdout:./145/.snap/snap-subdir-test 2022-04-03T21:52:12.824 INFO:tasks.workunit.client.0.smithi049.stdout:./279/.snap/snap-subdir-test 2022-04-03T21:52:12.831 INFO:tasks.workunit.client.0.smithi049.stdout:./263/.snap/snap-subdir-test 2022-04-03T21:52:12.839 INFO:tasks.workunit.client.0.smithi049.stdout:./130/.snap/snap-subdir-test 2022-04-03T21:52:12.847 INFO:tasks.workunit.client.0.smithi049.stdout:./193/.snap/snap-subdir-test 2022-04-03T21:52:12.855 INFO:tasks.workunit.client.0.smithi049.stdout:./223/.snap/snap-subdir-test 2022-04-03T21:52:12.862 INFO:tasks.workunit.client.0.smithi049.stdout:./207/.snap/snap-subdir-test 2022-04-03T21:52:12.870 INFO:tasks.workunit.client.0.smithi049.stdout:./276/.snap/snap-subdir-test 2022-04-03T21:52:12.879 INFO:tasks.workunit.client.0.smithi049.stdout:./271/.snap/snap-subdir-test 2022-04-03T21:52:12.887 INFO:tasks.workunit.client.0.smithi049.stdout:./251/.snap/snap-subdir-test 2022-04-03T21:52:12.896 INFO:tasks.workunit.client.0.smithi049.stdout:./175/.snap/snap-subdir-test 2022-04-03T21:52:12.904 INFO:tasks.workunit.client.0.smithi049.stdout:./222/.snap/snap-subdir-test 2022-04-03T21:52:12.912 INFO:tasks.workunit.client.0.smithi049.stdout:./220/.snap/snap-subdir-test 2022-04-03T21:52:12.920 INFO:tasks.workunit.client.0.smithi049.stdout:./203/.snap/snap-subdir-test 2022-04-03T21:52:12.928 INFO:tasks.workunit.client.0.smithi049.stdout:./181/.snap/snap-subdir-test 2022-04-03T21:52:12.936 INFO:tasks.workunit.client.0.smithi049.stdout:./286/.snap/snap-subdir-test 2022-04-03T21:52:12.944 INFO:tasks.workunit.client.0.smithi049.stdout:./127/.snap/snap-subdir-test 2022-04-03T21:52:12.953 INFO:tasks.workunit.client.0.smithi049.stdout:./108/.snap/snap-subdir-test 2022-04-03T21:52:12.961 INFO:tasks.workunit.client.0.smithi049.stdout:./183/.snap/snap-subdir-test 2022-04-03T21:52:12.969 INFO:tasks.workunit.client.0.smithi049.stdout:./294/.snap/snap-subdir-test 2022-04-03T21:52:12.977 INFO:tasks.workunit.client.0.smithi049.stdout:./235/.snap/snap-subdir-test 2022-04-03T21:52:12.985 INFO:tasks.workunit.client.0.smithi049.stdout:./177/.snap/snap-subdir-test 2022-04-03T21:52:12.993 INFO:tasks.workunit.client.0.smithi049.stdout:./169/.snap/snap-subdir-test 2022-04-03T21:52:13.001 INFO:tasks.workunit.client.0.smithi049.stdout:./212/.snap/snap-subdir-test 2022-04-03T21:52:13.009 INFO:tasks.workunit.client.0.smithi049.stdout:./154/.snap/snap-subdir-test 2022-04-03T21:52:13.017 INFO:tasks.workunit.client.0.smithi049.stdout:./171/.snap/snap-subdir-test 2022-04-03T21:52:13.026 INFO:tasks.workunit.client.0.smithi049.stdout:./139/.snap/snap-subdir-test 2022-04-03T21:52:13.034 INFO:tasks.workunit.client.0.smithi049.stdout:./102/.snap/snap-subdir-test 2022-04-03T21:52:13.042 INFO:tasks.workunit.client.0.smithi049.stdout:./129/.snap/snap-subdir-test 2022-04-03T21:52:14.982 INFO:tasks.workunit.client.0.smithi049.stdout:Delete all the files and directories ... 2022-04-03T21:52:15.491 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/19' 2022-04-03T21:52:15.491 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/15' 2022-04-03T21:52:15.491 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/31' 2022-04-03T21:52:15.492 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/36' 2022-04-03T21:52:15.492 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/20' 2022-04-03T21:52:15.492 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/12' 2022-04-03T21:52:15.492 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/39' 2022-04-03T21:52:15.492 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/10' 2022-04-03T21:52:15.493 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/34' 2022-04-03T21:52:15.493 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/38' 2022-04-03T21:52:15.493 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/11' 2022-04-03T21:52:15.493 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/16' 2022-04-03T21:52:15.494 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/32' 2022-04-03T21:52:15.494 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/30' 2022-04-03T21:52:15.494 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/14' 2022-04-03T21:52:15.495 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/18' 2022-04-03T21:52:15.495 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/13' 2022-04-03T21:52:15.495 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/33' 2022-04-03T21:52:15.495 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/17' 2022-04-03T21:52:15.495 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/35' 2022-04-03T21:52:15.496 INFO:tasks.workunit.client.0.smithi049.stdout:removed './100/37' 2022-04-03T21:52:15.496 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './100' 2022-04-03T21:52:15.496 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/19' 2022-04-03T21:52:15.496 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/15' 2022-04-03T21:52:15.497 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/31' 2022-04-03T21:52:15.497 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/36' 2022-04-03T21:52:15.497 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/20' 2022-04-03T21:52:15.497 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/12' 2022-04-03T21:52:15.497 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/39' 2022-04-03T21:52:15.498 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/10' 2022-04-03T21:52:15.498 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/34' 2022-04-03T21:52:15.498 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/38' 2022-04-03T21:52:15.498 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/11' 2022-04-03T21:52:15.498 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/16' 2022-04-03T21:52:15.499 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/32' 2022-04-03T21:52:15.499 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/30' 2022-04-03T21:52:15.499 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/14' 2022-04-03T21:52:15.499 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/18' 2022-04-03T21:52:15.500 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/13' 2022-04-03T21:52:15.500 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/33' 2022-04-03T21:52:15.500 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/17' 2022-04-03T21:52:15.500 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/35' 2022-04-03T21:52:15.500 INFO:tasks.workunit.client.0.smithi049.stdout:removed './101/37' 2022-04-03T21:52:15.501 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './101' 2022-04-03T21:52:15.501 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/19' 2022-04-03T21:52:15.501 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/15' 2022-04-03T21:52:15.501 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/31' 2022-04-03T21:52:15.502 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/36' 2022-04-03T21:52:15.502 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/20' 2022-04-03T21:52:15.502 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/12' 2022-04-03T21:52:15.502 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/39' 2022-04-03T21:52:15.502 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/10' 2022-04-03T21:52:15.503 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/34' 2022-04-03T21:52:15.503 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/38' 2022-04-03T21:52:15.503 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/11' 2022-04-03T21:52:15.503 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/16' 2022-04-03T21:52:15.503 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/32' 2022-04-03T21:52:15.504 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/30' 2022-04-03T21:52:15.504 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/14' 2022-04-03T21:52:15.504 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/18' 2022-04-03T21:52:15.504 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/13' 2022-04-03T21:52:15.505 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/33' 2022-04-03T21:52:15.505 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/17' 2022-04-03T21:52:15.505 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/35' 2022-04-03T21:52:15.505 INFO:tasks.workunit.client.0.smithi049.stdout:removed './102/37' 2022-04-03T21:52:15.505 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './102' 2022-04-03T21:52:15.506 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/19' 2022-04-03T21:52:15.506 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/15' 2022-04-03T21:52:15.506 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/31' 2022-04-03T21:52:15.506 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/36' 2022-04-03T21:52:15.506 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/20' 2022-04-03T21:52:15.507 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/12' 2022-04-03T21:52:15.507 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/39' 2022-04-03T21:52:15.507 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/10' 2022-04-03T21:52:15.507 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/34' 2022-04-03T21:52:15.508 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/38' 2022-04-03T21:52:15.508 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/11' 2022-04-03T21:52:15.508 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/16' 2022-04-03T21:52:15.508 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/32' 2022-04-03T21:52:15.508 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/30' 2022-04-03T21:52:15.509 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/14' 2022-04-03T21:52:15.509 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/18' 2022-04-03T21:52:15.509 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/13' 2022-04-03T21:52:15.509 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/33' 2022-04-03T21:52:15.509 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/17' 2022-04-03T21:52:15.510 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/35' 2022-04-03T21:52:15.510 INFO:tasks.workunit.client.0.smithi049.stdout:removed './103/37' 2022-04-03T21:52:15.510 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './103' 2022-04-03T21:52:15.510 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/19' 2022-04-03T21:52:15.511 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/15' 2022-04-03T21:52:15.511 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/31' 2022-04-03T21:52:15.511 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/36' 2022-04-03T21:52:15.511 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/20' 2022-04-03T21:52:15.512 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/12' 2022-04-03T21:52:15.512 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/39' 2022-04-03T21:52:15.512 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/10' 2022-04-03T21:52:15.512 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/34' 2022-04-03T21:52:15.513 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/38' 2022-04-03T21:52:15.513 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/11' 2022-04-03T21:52:15.513 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/16' 2022-04-03T21:52:15.513 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/32' 2022-04-03T21:52:15.513 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/30' 2022-04-03T21:52:15.514 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/14' 2022-04-03T21:52:15.514 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/18' 2022-04-03T21:52:15.514 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/13' 2022-04-03T21:52:15.514 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/33' 2022-04-03T21:52:15.515 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/17' 2022-04-03T21:52:15.515 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/35' 2022-04-03T21:52:15.515 INFO:tasks.workunit.client.0.smithi049.stdout:removed './104/37' 2022-04-03T21:52:15.515 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './104' 2022-04-03T21:52:15.515 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/19' 2022-04-03T21:52:15.516 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/15' 2022-04-03T21:52:15.516 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/31' 2022-04-03T21:52:15.516 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/36' 2022-04-03T21:52:15.516 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/20' 2022-04-03T21:52:15.517 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/12' 2022-04-03T21:52:15.517 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/39' 2022-04-03T21:52:15.517 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/10' 2022-04-03T21:52:15.517 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/34' 2022-04-03T21:52:15.517 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/38' 2022-04-03T21:52:15.518 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/11' 2022-04-03T21:52:15.518 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/16' 2022-04-03T21:52:15.518 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/32' 2022-04-03T21:52:15.518 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/30' 2022-04-03T21:52:15.519 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/14' 2022-04-03T21:52:15.519 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/18' 2022-04-03T21:52:15.519 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/13' 2022-04-03T21:52:15.519 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/33' 2022-04-03T21:52:15.519 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/17' 2022-04-03T21:52:15.520 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/35' 2022-04-03T21:52:15.520 INFO:tasks.workunit.client.0.smithi049.stdout:removed './105/37' 2022-04-03T21:52:15.520 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './105' 2022-04-03T21:52:15.520 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/19' 2022-04-03T21:52:15.520 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/15' 2022-04-03T21:52:15.521 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/31' 2022-04-03T21:52:15.521 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/36' 2022-04-03T21:52:15.521 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/20' 2022-04-03T21:52:15.521 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/12' 2022-04-03T21:52:15.521 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/39' 2022-04-03T21:52:15.522 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/10' 2022-04-03T21:52:15.522 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/34' 2022-04-03T21:52:15.522 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/38' 2022-04-03T21:52:15.522 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/11' 2022-04-03T21:52:15.523 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/16' 2022-04-03T21:52:15.523 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/32' 2022-04-03T21:52:15.523 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/30' 2022-04-03T21:52:15.523 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/14' 2022-04-03T21:52:15.523 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/18' 2022-04-03T21:52:15.524 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/13' 2022-04-03T21:52:15.524 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/33' 2022-04-03T21:52:15.524 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/17' 2022-04-03T21:52:15.524 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/35' 2022-04-03T21:52:15.525 INFO:tasks.workunit.client.0.smithi049.stdout:removed './106/37' 2022-04-03T21:52:15.525 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './106' 2022-04-03T21:52:15.525 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/19' 2022-04-03T21:52:15.525 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/15' 2022-04-03T21:52:15.525 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/31' 2022-04-03T21:52:15.526 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/36' 2022-04-03T21:52:15.526 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/20' 2022-04-03T21:52:15.526 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/12' 2022-04-03T21:52:15.526 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/39' 2022-04-03T21:52:15.526 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/10' 2022-04-03T21:52:15.527 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/34' 2022-04-03T21:52:15.527 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/38' 2022-04-03T21:52:15.527 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/11' 2022-04-03T21:52:15.527 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/16' 2022-04-03T21:52:15.528 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/32' 2022-04-03T21:52:15.528 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/30' 2022-04-03T21:52:15.528 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/14' 2022-04-03T21:52:15.528 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/18' 2022-04-03T21:52:15.528 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/13' 2022-04-03T21:52:15.529 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/33' 2022-04-03T21:52:15.529 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/17' 2022-04-03T21:52:15.529 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/35' 2022-04-03T21:52:15.529 INFO:tasks.workunit.client.0.smithi049.stdout:removed './107/37' 2022-04-03T21:52:15.529 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './107' 2022-04-03T21:52:15.530 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/19' 2022-04-03T21:52:15.530 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/15' 2022-04-03T21:52:15.530 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/31' 2022-04-03T21:52:15.530 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/36' 2022-04-03T21:52:15.531 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/20' 2022-04-03T21:52:15.531 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/12' 2022-04-03T21:52:15.531 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/39' 2022-04-03T21:52:15.531 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/10' 2022-04-03T21:52:15.531 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/34' 2022-04-03T21:52:15.532 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/38' 2022-04-03T21:52:15.532 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/11' 2022-04-03T21:52:15.532 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/16' 2022-04-03T21:52:15.532 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/32' 2022-04-03T21:52:15.532 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/30' 2022-04-03T21:52:15.533 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/14' 2022-04-03T21:52:15.533 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/18' 2022-04-03T21:52:15.533 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/13' 2022-04-03T21:52:15.533 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/33' 2022-04-03T21:52:15.534 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/17' 2022-04-03T21:52:15.534 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/35' 2022-04-03T21:52:15.534 INFO:tasks.workunit.client.0.smithi049.stdout:removed './108/37' 2022-04-03T21:52:15.534 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './108' 2022-04-03T21:52:15.535 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/19' 2022-04-03T21:52:15.535 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/15' 2022-04-03T21:52:15.535 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/31' 2022-04-03T21:52:15.535 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/36' 2022-04-03T21:52:15.535 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/20' 2022-04-03T21:52:15.536 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/12' 2022-04-03T21:52:15.536 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/39' 2022-04-03T21:52:15.536 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/10' 2022-04-03T21:52:15.536 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/34' 2022-04-03T21:52:15.536 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/38' 2022-04-03T21:52:15.537 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/11' 2022-04-03T21:52:15.537 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/16' 2022-04-03T21:52:15.537 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/32' 2022-04-03T21:52:15.537 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/30' 2022-04-03T21:52:16.159 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/14' 2022-04-03T21:52:16.160 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/18' 2022-04-03T21:52:16.160 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/13' 2022-04-03T21:52:16.160 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/33' 2022-04-03T21:52:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/17' 2022-04-03T21:52:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/35' 2022-04-03T21:52:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:removed './109/37' 2022-04-03T21:52:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './109' 2022-04-03T21:52:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/19' 2022-04-03T21:52:16.162 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/15' 2022-04-03T21:52:16.162 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/31' 2022-04-03T21:52:16.162 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/36' 2022-04-03T21:52:16.162 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/20' 2022-04-03T21:52:16.162 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/12' 2022-04-03T21:52:16.163 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/39' 2022-04-03T21:52:16.163 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/10' 2022-04-03T21:52:16.163 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/34' 2022-04-03T21:52:16.163 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/38' 2022-04-03T21:52:16.164 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/11' 2022-04-03T21:52:16.164 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/16' 2022-04-03T21:52:16.164 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/32' 2022-04-03T21:52:16.164 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/30' 2022-04-03T21:52:16.164 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/14' 2022-04-03T21:52:16.165 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/18' 2022-04-03T21:52:16.165 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/13' 2022-04-03T21:52:16.165 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/33' 2022-04-03T21:52:16.165 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/17' 2022-04-03T21:52:16.165 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/35' 2022-04-03T21:52:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:removed './110/37' 2022-04-03T21:52:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './110' 2022-04-03T21:52:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/19' 2022-04-03T21:52:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/15' 2022-04-03T21:52:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/31' 2022-04-03T21:52:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/36' 2022-04-03T21:52:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/20' 2022-04-03T21:52:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/12' 2022-04-03T21:52:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/39' 2022-04-03T21:52:16.168 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/10' 2022-04-03T21:52:16.168 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/34' 2022-04-03T21:52:16.168 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/38' 2022-04-03T21:52:16.168 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/11' 2022-04-03T21:52:16.168 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/16' 2022-04-03T21:52:16.169 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/32' 2022-04-03T21:52:16.169 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/30' 2022-04-03T21:52:16.169 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/14' 2022-04-03T21:52:16.169 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/18' 2022-04-03T21:52:16.169 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/13' 2022-04-03T21:52:16.170 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/33' 2022-04-03T21:52:16.170 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/17' 2022-04-03T21:52:16.170 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/35' 2022-04-03T21:52:16.170 INFO:tasks.workunit.client.0.smithi049.stdout:removed './111/37' 2022-04-03T21:52:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './111' 2022-04-03T21:52:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/19' 2022-04-03T21:52:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/15' 2022-04-03T21:52:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/31' 2022-04-03T21:52:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/36' 2022-04-03T21:52:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/20' 2022-04-03T21:52:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/12' 2022-04-03T21:52:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/39' 2022-04-03T21:52:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/10' 2022-04-03T21:52:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/34' 2022-04-03T21:52:16.173 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/38' 2022-04-03T21:52:16.173 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/11' 2022-04-03T21:52:16.173 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/16' 2022-04-03T21:52:16.174 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/32' 2022-04-03T21:52:16.174 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/30' 2022-04-03T21:52:16.174 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/14' 2022-04-03T21:52:16.174 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/18' 2022-04-03T21:52:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/13' 2022-04-03T21:52:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/33' 2022-04-03T21:52:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/17' 2022-04-03T21:52:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/35' 2022-04-03T21:52:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:removed './112/37' 2022-04-03T21:52:16.176 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './112' 2022-04-03T21:52:16.176 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/19' 2022-04-03T21:52:16.176 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/15' 2022-04-03T21:52:16.176 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/31' 2022-04-03T21:52:16.176 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/36' 2022-04-03T21:52:16.177 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/20' 2022-04-03T21:52:16.177 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/12' 2022-04-03T21:52:16.177 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/39' 2022-04-03T21:52:16.177 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/10' 2022-04-03T21:52:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/34' 2022-04-03T21:52:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/38' 2022-04-03T21:52:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/11' 2022-04-03T21:52:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/16' 2022-04-03T21:52:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/32' 2022-04-03T21:52:16.179 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/30' 2022-04-03T21:52:16.179 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/14' 2022-04-03T21:52:16.179 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/18' 2022-04-03T21:52:16.179 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/13' 2022-04-03T21:52:16.179 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/33' 2022-04-03T21:52:16.180 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/17' 2022-04-03T21:52:16.180 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/35' 2022-04-03T21:52:16.180 INFO:tasks.workunit.client.0.smithi049.stdout:removed './113/37' 2022-04-03T21:52:16.180 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './113' 2022-04-03T21:52:16.181 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/19' 2022-04-03T21:52:16.181 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/15' 2022-04-03T21:52:16.181 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/31' 2022-04-03T21:52:16.181 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/36' 2022-04-03T21:52:16.181 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/20' 2022-04-03T21:52:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/12' 2022-04-03T21:52:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/39' 2022-04-03T21:52:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/10' 2022-04-03T21:52:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/34' 2022-04-03T21:52:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/38' 2022-04-03T21:52:16.183 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/11' 2022-04-03T21:52:16.183 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/16' 2022-04-03T21:52:16.183 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/32' 2022-04-03T21:52:16.183 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/30' 2022-04-03T21:52:16.183 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/14' 2022-04-03T21:52:16.184 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/18' 2022-04-03T21:52:16.184 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/13' 2022-04-03T21:52:16.184 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/33' 2022-04-03T21:52:16.184 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/17' 2022-04-03T21:52:16.184 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/35' 2022-04-03T21:52:16.185 INFO:tasks.workunit.client.0.smithi049.stdout:removed './114/37' 2022-04-03T21:52:16.185 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './114' 2022-04-03T21:52:16.185 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/19' 2022-04-03T21:52:16.185 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/15' 2022-04-03T21:52:16.185 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/31' 2022-04-03T21:52:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/36' 2022-04-03T21:52:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/20' 2022-04-03T21:52:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/12' 2022-04-03T21:52:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/39' 2022-04-03T21:52:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/10' 2022-04-03T21:52:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/34' 2022-04-03T21:52:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/38' 2022-04-03T21:52:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/11' 2022-04-03T21:52:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/16' 2022-04-03T21:52:16.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/32' 2022-04-03T21:52:16.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/30' 2022-04-03T21:52:16.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/14' 2022-04-03T21:52:16.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/18' 2022-04-03T21:52:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/13' 2022-04-03T21:52:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/33' 2022-04-03T21:52:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/17' 2022-04-03T21:52:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/35' 2022-04-03T21:52:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './115/37' 2022-04-03T21:52:16.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './115' 2022-04-03T21:52:16.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/19' 2022-04-03T21:52:16.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/15' 2022-04-03T21:52:16.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/31' 2022-04-03T21:52:16.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/36' 2022-04-03T21:52:16.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/20' 2022-04-03T21:52:16.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/12' 2022-04-03T21:52:16.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/39' 2022-04-03T21:52:16.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/10' 2022-04-03T21:52:16.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/34' 2022-04-03T21:52:16.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/38' 2022-04-03T21:52:16.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/11' 2022-04-03T21:52:16.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/16' 2022-04-03T21:52:16.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/32' 2022-04-03T21:52:16.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/30' 2022-04-03T21:52:16.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/14' 2022-04-03T21:52:16.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/18' 2022-04-03T21:52:16.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/13' 2022-04-03T21:52:16.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/33' 2022-04-03T21:52:16.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/17' 2022-04-03T21:52:16.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/35' 2022-04-03T21:52:16.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './116/37' 2022-04-03T21:52:16.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './116' 2022-04-03T21:52:16.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/19' 2022-04-03T21:52:16.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/15' 2022-04-03T21:52:16.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/31' 2022-04-03T21:52:16.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/36' 2022-04-03T21:52:16.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/20' 2022-04-03T21:52:16.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/12' 2022-04-03T21:52:16.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/39' 2022-04-03T21:52:16.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/10' 2022-04-03T21:52:16.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/34' 2022-04-03T21:52:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/38' 2022-04-03T21:52:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/11' 2022-04-03T21:52:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/16' 2022-04-03T21:52:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/32' 2022-04-03T21:52:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/30' 2022-04-03T21:52:16.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/14' 2022-04-03T21:52:16.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/18' 2022-04-03T21:52:16.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/13' 2022-04-03T21:52:16.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/33' 2022-04-03T21:52:16.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/17' 2022-04-03T21:52:16.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/35' 2022-04-03T21:52:16.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './117/37' 2022-04-03T21:52:16.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './117' 2022-04-03T21:52:16.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/19' 2022-04-03T21:52:16.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/15' 2022-04-03T21:52:16.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/31' 2022-04-03T21:52:16.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/36' 2022-04-03T21:52:16.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/20' 2022-04-03T21:52:16.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/12' 2022-04-03T21:52:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/39' 2022-04-03T21:52:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/10' 2022-04-03T21:52:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/34' 2022-04-03T21:52:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/38' 2022-04-03T21:52:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/11' 2022-04-03T21:52:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/16' 2022-04-03T21:52:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/32' 2022-04-03T21:52:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/30' 2022-04-03T21:52:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/14' 2022-04-03T21:52:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/18' 2022-04-03T21:52:16.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/13' 2022-04-03T21:52:16.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/33' 2022-04-03T21:52:16.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/17' 2022-04-03T21:52:16.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/35' 2022-04-03T21:52:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './118/37' 2022-04-03T21:52:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './118' 2022-04-03T21:52:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/19' 2022-04-03T21:52:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/15' 2022-04-03T21:52:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/31' 2022-04-03T21:52:16.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/36' 2022-04-03T21:52:16.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/20' 2022-04-03T21:52:16.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/12' 2022-04-03T21:52:16.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/39' 2022-04-03T21:52:16.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/10' 2022-04-03T21:52:16.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/34' 2022-04-03T21:52:16.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/38' 2022-04-03T21:52:16.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/11' 2022-04-03T21:52:16.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/16' 2022-04-03T21:52:16.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/32' 2022-04-03T21:52:16.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/30' 2022-04-03T21:52:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/14' 2022-04-03T21:52:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/18' 2022-04-03T21:52:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/13' 2022-04-03T21:52:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/33' 2022-04-03T21:52:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/17' 2022-04-03T21:52:16.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/35' 2022-04-03T21:52:16.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './119/37' 2022-04-03T21:52:16.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './119' 2022-04-03T21:52:16.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/19' 2022-04-03T21:52:16.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/15' 2022-04-03T21:52:16.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/31' 2022-04-03T21:52:16.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/36' 2022-04-03T21:52:16.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/20' 2022-04-03T21:52:16.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/12' 2022-04-03T21:52:16.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/39' 2022-04-03T21:52:16.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/10' 2022-04-03T21:52:16.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/34' 2022-04-03T21:52:16.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/38' 2022-04-03T21:52:16.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/11' 2022-04-03T21:52:16.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/16' 2022-04-03T21:52:16.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/32' 2022-04-03T21:52:16.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/30' 2022-04-03T21:52:16.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/14' 2022-04-03T21:52:16.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/18' 2022-04-03T21:52:16.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/13' 2022-04-03T21:52:16.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/33' 2022-04-03T21:52:16.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/17' 2022-04-03T21:52:16.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/35' 2022-04-03T21:52:16.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './120/37' 2022-04-03T21:52:16.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './120' 2022-04-03T21:52:16.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/19' 2022-04-03T21:52:16.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/15' 2022-04-03T21:52:16.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/31' 2022-04-03T21:52:16.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/36' 2022-04-03T21:52:16.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/20' 2022-04-03T21:52:16.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/12' 2022-04-03T21:52:16.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/39' 2022-04-03T21:52:16.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/10' 2022-04-03T21:52:16.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/34' 2022-04-03T21:52:16.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/38' 2022-04-03T21:52:16.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/11' 2022-04-03T21:52:16.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/16' 2022-04-03T21:52:16.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/32' 2022-04-03T21:52:16.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/30' 2022-04-03T21:52:16.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/14' 2022-04-03T21:52:16.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/18' 2022-04-03T21:52:16.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/13' 2022-04-03T21:52:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/33' 2022-04-03T21:52:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/17' 2022-04-03T21:52:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/35' 2022-04-03T21:52:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './121/37' 2022-04-03T21:52:16.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './121' 2022-04-03T21:52:16.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/19' 2022-04-03T21:52:16.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/15' 2022-04-03T21:52:16.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/31' 2022-04-03T21:52:16.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/36' 2022-04-03T21:52:16.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/20' 2022-04-03T21:52:16.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/12' 2022-04-03T21:52:16.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/39' 2022-04-03T21:52:16.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/10' 2022-04-03T21:52:16.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/34' 2022-04-03T21:52:16.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/38' 2022-04-03T21:52:16.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/11' 2022-04-03T21:52:16.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/16' 2022-04-03T21:52:16.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/32' 2022-04-03T21:52:16.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/30' 2022-04-03T21:52:16.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/14' 2022-04-03T21:52:16.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/18' 2022-04-03T21:52:16.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/13' 2022-04-03T21:52:16.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/33' 2022-04-03T21:52:16.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/17' 2022-04-03T21:52:16.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/35' 2022-04-03T21:52:16.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './122/37' 2022-04-03T21:52:16.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './122' 2022-04-03T21:52:16.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/19' 2022-04-03T21:52:16.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/15' 2022-04-03T21:52:16.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/31' 2022-04-03T21:52:16.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/36' 2022-04-03T21:52:16.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/20' 2022-04-03T21:52:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/12' 2022-04-03T21:52:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/39' 2022-04-03T21:52:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/10' 2022-04-03T21:52:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/34' 2022-04-03T21:52:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/38' 2022-04-03T21:52:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/11' 2022-04-03T21:52:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/16' 2022-04-03T21:52:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/32' 2022-04-03T21:52:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/30' 2022-04-03T21:52:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/14' 2022-04-03T21:52:16.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/18' 2022-04-03T21:52:16.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/13' 2022-04-03T21:52:16.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/33' 2022-04-03T21:52:16.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/17' 2022-04-03T21:52:16.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/35' 2022-04-03T21:52:16.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './123/37' 2022-04-03T21:52:16.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './123' 2022-04-03T21:52:16.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/19' 2022-04-03T21:52:16.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/15' 2022-04-03T21:52:16.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/31' 2022-04-03T21:52:16.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/36' 2022-04-03T21:52:16.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/20' 2022-04-03T21:52:16.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/12' 2022-04-03T21:52:16.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/39' 2022-04-03T21:52:16.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/10' 2022-04-03T21:52:16.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/34' 2022-04-03T21:52:16.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/38' 2022-04-03T21:52:16.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/11' 2022-04-03T21:52:16.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/16' 2022-04-03T21:52:16.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/32' 2022-04-03T21:52:16.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/30' 2022-04-03T21:52:16.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/14' 2022-04-03T21:52:16.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/18' 2022-04-03T21:52:16.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/13' 2022-04-03T21:52:16.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/33' 2022-04-03T21:52:16.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/17' 2022-04-03T21:52:16.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/35' 2022-04-03T21:52:16.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './124/37' 2022-04-03T21:52:16.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './124' 2022-04-03T21:52:16.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/19' 2022-04-03T21:52:16.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/15' 2022-04-03T21:52:16.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/31' 2022-04-03T21:52:16.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/36' 2022-04-03T21:52:16.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/20' 2022-04-03T21:52:16.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/12' 2022-04-03T21:52:16.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/39' 2022-04-03T21:52:16.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/10' 2022-04-03T21:52:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/34' 2022-04-03T21:52:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/38' 2022-04-03T21:52:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/11' 2022-04-03T21:52:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/16' 2022-04-03T21:52:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/32' 2022-04-03T21:52:16.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/30' 2022-04-03T21:52:16.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/14' 2022-04-03T21:52:16.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/18' 2022-04-03T21:52:16.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/13' 2022-04-03T21:52:16.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/33' 2022-04-03T21:52:16.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/17' 2022-04-03T21:52:16.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/35' 2022-04-03T21:52:16.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './125/37' 2022-04-03T21:52:16.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './125' 2022-04-03T21:52:16.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/19' 2022-04-03T21:52:16.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/15' 2022-04-03T21:52:16.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/31' 2022-04-03T21:52:16.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/36' 2022-04-03T21:52:16.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/20' 2022-04-03T21:52:16.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/12' 2022-04-03T21:52:16.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/39' 2022-04-03T21:52:16.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/10' 2022-04-03T21:52:16.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/34' 2022-04-03T21:52:16.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/38' 2022-04-03T21:52:16.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/11' 2022-04-03T21:52:16.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/16' 2022-04-03T21:52:16.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/32' 2022-04-03T21:52:16.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/30' 2022-04-03T21:52:16.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/14' 2022-04-03T21:52:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/18' 2022-04-03T21:52:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/13' 2022-04-03T21:52:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/33' 2022-04-03T21:52:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/17' 2022-04-03T21:52:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/35' 2022-04-03T21:52:16.935 INFO:tasks.workunit.client.0.smithi049.stdout:removed './126/37' 2022-04-03T21:52:16.935 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './126' 2022-04-03T21:52:16.935 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/19' 2022-04-03T21:52:16.935 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/15' 2022-04-03T21:52:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/31' 2022-04-03T21:52:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/36' 2022-04-03T21:52:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/20' 2022-04-03T21:52:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/12' 2022-04-03T21:52:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/39' 2022-04-03T21:52:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/10' 2022-04-03T21:52:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/34' 2022-04-03T21:52:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/38' 2022-04-03T21:52:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/11' 2022-04-03T21:52:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/16' 2022-04-03T21:52:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/32' 2022-04-03T21:52:16.938 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/30' 2022-04-03T21:52:16.938 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/14' 2022-04-03T21:52:16.938 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/18' 2022-04-03T21:52:16.938 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/13' 2022-04-03T21:52:16.939 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/33' 2022-04-03T21:52:16.939 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/17' 2022-04-03T21:52:16.939 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/35' 2022-04-03T21:52:16.939 INFO:tasks.workunit.client.0.smithi049.stdout:removed './127/37' 2022-04-03T21:52:16.939 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './127' 2022-04-03T21:52:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/19' 2022-04-03T21:52:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/15' 2022-04-03T21:52:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/31' 2022-04-03T21:52:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/36' 2022-04-03T21:52:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/20' 2022-04-03T21:52:16.941 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/12' 2022-04-03T21:52:16.941 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/39' 2022-04-03T21:52:16.941 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/10' 2022-04-03T21:52:16.941 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/34' 2022-04-03T21:52:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/38' 2022-04-03T21:52:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/11' 2022-04-03T21:52:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/16' 2022-04-03T21:52:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/32' 2022-04-03T21:52:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/30' 2022-04-03T21:52:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/14' 2022-04-03T21:52:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/18' 2022-04-03T21:52:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/13' 2022-04-03T21:52:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/33' 2022-04-03T21:52:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/17' 2022-04-03T21:52:16.944 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/35' 2022-04-03T21:52:17.440 INFO:tasks.workunit.client.0.smithi049.stdout:removed './128/37' 2022-04-03T21:52:17.440 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './128' 2022-04-03T21:52:17.440 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/19' 2022-04-03T21:52:17.441 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/15' 2022-04-03T21:52:17.441 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/31' 2022-04-03T21:52:17.441 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/36' 2022-04-03T21:52:17.441 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/20' 2022-04-03T21:52:17.441 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/12' 2022-04-03T21:52:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/39' 2022-04-03T21:52:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/10' 2022-04-03T21:52:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/34' 2022-04-03T21:52:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/38' 2022-04-03T21:52:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/11' 2022-04-03T21:52:17.443 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/16' 2022-04-03T21:52:17.443 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/32' 2022-04-03T21:52:17.443 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/30' 2022-04-03T21:52:17.443 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/14' 2022-04-03T21:52:17.443 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/18' 2022-04-03T21:52:17.444 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/13' 2022-04-03T21:52:17.444 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/33' 2022-04-03T21:52:17.444 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/17' 2022-04-03T21:52:17.444 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/35' 2022-04-03T21:52:17.444 INFO:tasks.workunit.client.0.smithi049.stdout:removed './129/37' 2022-04-03T21:52:17.445 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './129' 2022-04-03T21:52:17.445 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/19' 2022-04-03T21:52:17.445 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/15' 2022-04-03T21:52:17.445 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/31' 2022-04-03T21:52:17.445 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/36' 2022-04-03T21:52:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/20' 2022-04-03T21:52:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/12' 2022-04-03T21:52:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/39' 2022-04-03T21:52:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/10' 2022-04-03T21:52:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/34' 2022-04-03T21:52:17.447 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/38' 2022-04-03T21:52:17.447 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/11' 2022-04-03T21:52:17.447 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/16' 2022-04-03T21:52:17.447 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/32' 2022-04-03T21:52:17.447 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/30' 2022-04-03T21:52:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/14' 2022-04-03T21:52:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/18' 2022-04-03T21:52:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/13' 2022-04-03T21:52:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/33' 2022-04-03T21:52:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/17' 2022-04-03T21:52:17.449 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/35' 2022-04-03T21:52:17.449 INFO:tasks.workunit.client.0.smithi049.stdout:removed './130/37' 2022-04-03T21:52:17.449 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './130' 2022-04-03T21:52:17.449 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/19' 2022-04-03T21:52:17.449 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/15' 2022-04-03T21:52:17.450 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/31' 2022-04-03T21:52:17.450 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/36' 2022-04-03T21:52:17.450 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/20' 2022-04-03T21:52:17.450 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/12' 2022-04-03T21:52:17.451 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/39' 2022-04-03T21:52:17.451 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/10' 2022-04-03T21:52:17.451 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/34' 2022-04-03T21:52:17.451 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/38' 2022-04-03T21:52:17.451 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/11' 2022-04-03T21:52:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/16' 2022-04-03T21:52:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/32' 2022-04-03T21:52:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/30' 2022-04-03T21:52:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/14' 2022-04-03T21:52:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/18' 2022-04-03T21:52:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/13' 2022-04-03T21:52:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/33' 2022-04-03T21:52:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/17' 2022-04-03T21:52:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/35' 2022-04-03T21:52:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:removed './131/37' 2022-04-03T21:52:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './131' 2022-04-03T21:52:17.454 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/19' 2022-04-03T21:52:17.454 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/15' 2022-04-03T21:52:17.454 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/31' 2022-04-03T21:52:17.454 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/36' 2022-04-03T21:52:17.454 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/20' 2022-04-03T21:52:17.455 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/12' 2022-04-03T21:52:17.455 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/39' 2022-04-03T21:52:17.455 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/10' 2022-04-03T21:52:17.455 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/34' 2022-04-03T21:52:17.456 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/38' 2022-04-03T21:52:17.456 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/11' 2022-04-03T21:52:17.456 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/16' 2022-04-03T21:52:17.456 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/32' 2022-04-03T21:52:17.456 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/30' 2022-04-03T21:52:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/14' 2022-04-03T21:52:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/18' 2022-04-03T21:52:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/13' 2022-04-03T21:52:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/33' 2022-04-03T21:52:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/17' 2022-04-03T21:52:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/35' 2022-04-03T21:52:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:removed './132/37' 2022-04-03T21:52:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './132' 2022-04-03T21:52:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/19' 2022-04-03T21:52:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/15' 2022-04-03T21:52:17.459 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/31' 2022-04-03T21:52:17.459 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/36' 2022-04-03T21:52:17.459 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/20' 2022-04-03T21:52:17.459 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/12' 2022-04-03T21:52:17.460 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/39' 2022-04-03T21:52:17.460 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/10' 2022-04-03T21:52:17.460 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/34' 2022-04-03T21:52:17.460 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/38' 2022-04-03T21:52:17.460 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/11' 2022-04-03T21:52:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/16' 2022-04-03T21:52:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/32' 2022-04-03T21:52:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/30' 2022-04-03T21:52:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/14' 2022-04-03T21:52:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/18' 2022-04-03T21:52:17.462 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/13' 2022-04-03T21:52:17.462 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/33' 2022-04-03T21:52:17.462 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/17' 2022-04-03T21:52:17.462 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/35' 2022-04-03T21:52:17.462 INFO:tasks.workunit.client.0.smithi049.stdout:removed './133/37' 2022-04-03T21:52:17.462 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './133' 2022-04-03T21:52:17.463 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/19' 2022-04-03T21:52:17.463 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/15' 2022-04-03T21:52:17.463 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/31' 2022-04-03T21:52:17.463 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/36' 2022-04-03T21:52:17.463 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/20' 2022-04-03T21:52:17.464 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/12' 2022-04-03T21:52:17.464 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/39' 2022-04-03T21:52:17.464 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/10' 2022-04-03T21:52:17.464 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/34' 2022-04-03T21:52:17.464 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/38' 2022-04-03T21:52:17.465 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/11' 2022-04-03T21:52:17.465 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/16' 2022-04-03T21:52:17.465 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/32' 2022-04-03T21:52:17.465 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/30' 2022-04-03T21:52:17.465 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/14' 2022-04-03T21:52:17.466 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/18' 2022-04-03T21:52:17.466 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/13' 2022-04-03T21:52:17.466 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/33' 2022-04-03T21:52:17.466 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/17' 2022-04-03T21:52:17.466 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/35' 2022-04-03T21:52:17.467 INFO:tasks.workunit.client.0.smithi049.stdout:removed './134/37' 2022-04-03T21:52:17.467 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './134' 2022-04-03T21:52:17.467 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/19' 2022-04-03T21:52:17.467 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/15' 2022-04-03T21:52:17.467 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/31' 2022-04-03T21:52:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/36' 2022-04-03T21:52:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/20' 2022-04-03T21:52:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/12' 2022-04-03T21:52:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/39' 2022-04-03T21:52:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/10' 2022-04-03T21:52:17.469 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/34' 2022-04-03T21:52:17.469 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/38' 2022-04-03T21:52:17.469 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/11' 2022-04-03T21:52:17.469 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/16' 2022-04-03T21:52:17.470 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/32' 2022-04-03T21:52:17.470 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/30' 2022-04-03T21:52:17.470 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/14' 2022-04-03T21:52:17.470 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/18' 2022-04-03T21:52:17.470 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/13' 2022-04-03T21:52:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/33' 2022-04-03T21:52:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/17' 2022-04-03T21:52:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/35' 2022-04-03T21:52:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:removed './135/37' 2022-04-03T21:52:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './135' 2022-04-03T21:52:17.472 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/19' 2022-04-03T21:52:17.472 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/15' 2022-04-03T21:52:17.472 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/31' 2022-04-03T21:52:17.472 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/36' 2022-04-03T21:52:17.472 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/20' 2022-04-03T21:52:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/12' 2022-04-03T21:52:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/39' 2022-04-03T21:52:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/10' 2022-04-03T21:52:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/34' 2022-04-03T21:52:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/38' 2022-04-03T21:52:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/11' 2022-04-03T21:52:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/16' 2022-04-03T21:52:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/32' 2022-04-03T21:52:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/30' 2022-04-03T21:52:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/14' 2022-04-03T21:52:17.475 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/18' 2022-04-03T21:52:17.475 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/13' 2022-04-03T21:52:17.475 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/33' 2022-04-03T21:52:17.475 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/17' 2022-04-03T21:52:17.475 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/35' 2022-04-03T21:52:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:removed './136/37' 2022-04-03T21:52:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './136' 2022-04-03T21:52:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/19' 2022-04-03T21:52:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/15' 2022-04-03T21:52:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/31' 2022-04-03T21:52:17.477 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/36' 2022-04-03T21:52:17.477 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/20' 2022-04-03T21:52:17.477 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/12' 2022-04-03T21:52:17.477 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/39' 2022-04-03T21:52:17.477 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/10' 2022-04-03T21:52:17.478 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/34' 2022-04-03T21:52:17.478 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/38' 2022-04-03T21:52:17.478 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/11' 2022-04-03T21:52:17.478 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/16' 2022-04-03T21:52:17.479 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/32' 2022-04-03T21:52:17.479 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/30' 2022-04-03T21:52:17.479 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/14' 2022-04-03T21:52:17.479 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/18' 2022-04-03T21:52:17.479 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/13' 2022-04-03T21:52:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/33' 2022-04-03T21:52:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/17' 2022-04-03T21:52:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/35' 2022-04-03T21:52:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:removed './137/37' 2022-04-03T21:52:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './137' 2022-04-03T21:52:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/19' 2022-04-03T21:52:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/15' 2022-04-03T21:52:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/31' 2022-04-03T21:52:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/36' 2022-04-03T21:52:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/20' 2022-04-03T21:52:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/12' 2022-04-03T21:52:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/39' 2022-04-03T21:52:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/10' 2022-04-03T21:52:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/34' 2022-04-03T21:52:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/38' 2022-04-03T21:52:17.483 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/11' 2022-04-03T21:52:17.483 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/16' 2022-04-03T21:52:18.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/32' 2022-04-03T21:52:18.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/30' 2022-04-03T21:52:18.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/14' 2022-04-03T21:52:18.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/18' 2022-04-03T21:52:18.716 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/13' 2022-04-03T21:52:18.716 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/33' 2022-04-03T21:52:18.716 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/17' 2022-04-03T21:52:18.716 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/35' 2022-04-03T21:52:18.717 INFO:tasks.workunit.client.0.smithi049.stdout:removed './138/37' 2022-04-03T21:52:18.717 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './138' 2022-04-03T21:52:18.717 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/19' 2022-04-03T21:52:18.717 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/15' 2022-04-03T21:52:18.717 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/31' 2022-04-03T21:52:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/36' 2022-04-03T21:52:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/20' 2022-04-03T21:52:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/12' 2022-04-03T21:52:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/39' 2022-04-03T21:52:18.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/10' 2022-04-03T21:52:18.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/34' 2022-04-03T21:52:18.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/38' 2022-04-03T21:52:18.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/11' 2022-04-03T21:52:18.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/16' 2022-04-03T21:52:18.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/32' 2022-04-03T21:52:18.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/30' 2022-04-03T21:52:18.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/14' 2022-04-03T21:52:18.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/18' 2022-04-03T21:52:18.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/13' 2022-04-03T21:52:18.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/33' 2022-04-03T21:52:18.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/17' 2022-04-03T21:52:18.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/35' 2022-04-03T21:52:18.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './139/37' 2022-04-03T21:52:18.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './139' 2022-04-03T21:52:18.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/19' 2022-04-03T21:52:18.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/15' 2022-04-03T21:52:18.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/31' 2022-04-03T21:52:18.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/36' 2022-04-03T21:52:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/20' 2022-04-03T21:52:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/12' 2022-04-03T21:52:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/39' 2022-04-03T21:52:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/10' 2022-04-03T21:52:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/34' 2022-04-03T21:52:18.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/38' 2022-04-03T21:52:18.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/11' 2022-04-03T21:52:18.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/16' 2022-04-03T21:52:18.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/32' 2022-04-03T21:52:18.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/30' 2022-04-03T21:52:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/14' 2022-04-03T21:52:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/18' 2022-04-03T21:52:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/13' 2022-04-03T21:52:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/33' 2022-04-03T21:52:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/17' 2022-04-03T21:52:18.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/35' 2022-04-03T21:52:18.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed './140/37' 2022-04-03T21:52:18.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './140' 2022-04-03T21:52:18.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/19' 2022-04-03T21:52:18.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/15' 2022-04-03T21:52:18.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/31' 2022-04-03T21:52:18.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/36' 2022-04-03T21:52:18.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/20' 2022-04-03T21:52:18.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/12' 2022-04-03T21:52:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/39' 2022-04-03T21:52:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/10' 2022-04-03T21:52:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/34' 2022-04-03T21:52:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/38' 2022-04-03T21:52:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/11' 2022-04-03T21:52:18.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/16' 2022-04-03T21:52:18.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/32' 2022-04-03T21:52:18.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/30' 2022-04-03T21:52:18.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/14' 2022-04-03T21:52:18.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/18' 2022-04-03T21:52:18.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/13' 2022-04-03T21:52:18.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/33' 2022-04-03T21:52:18.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/17' 2022-04-03T21:52:18.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/35' 2022-04-03T21:52:18.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed './141/37' 2022-04-03T21:52:18.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './141' 2022-04-03T21:52:18.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/19' 2022-04-03T21:52:18.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/15' 2022-04-03T21:52:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/31' 2022-04-03T21:52:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/36' 2022-04-03T21:52:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/20' 2022-04-03T21:52:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/12' 2022-04-03T21:52:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/39' 2022-04-03T21:52:18.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/10' 2022-04-03T21:52:18.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/34' 2022-04-03T21:52:18.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/38' 2022-04-03T21:52:18.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/11' 2022-04-03T21:52:18.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/16' 2022-04-03T21:52:18.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/32' 2022-04-03T21:52:18.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/30' 2022-04-03T21:52:18.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/14' 2022-04-03T21:52:18.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/18' 2022-04-03T21:52:18.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/13' 2022-04-03T21:52:18.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/33' 2022-04-03T21:52:18.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/17' 2022-04-03T21:52:18.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/35' 2022-04-03T21:52:18.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './142/37' 2022-04-03T21:52:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './142' 2022-04-03T21:52:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/19' 2022-04-03T21:52:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/15' 2022-04-03T21:52:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/31' 2022-04-03T21:52:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/36' 2022-04-03T21:52:18.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/20' 2022-04-03T21:52:18.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/12' 2022-04-03T21:52:18.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/39' 2022-04-03T21:52:18.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/10' 2022-04-03T21:52:18.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/34' 2022-04-03T21:52:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/38' 2022-04-03T21:52:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/11' 2022-04-03T21:52:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/16' 2022-04-03T21:52:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/32' 2022-04-03T21:52:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/30' 2022-04-03T21:52:18.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/14' 2022-04-03T21:52:18.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/18' 2022-04-03T21:52:18.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/13' 2022-04-03T21:52:18.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/33' 2022-04-03T21:52:18.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/17' 2022-04-03T21:52:18.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/35' 2022-04-03T21:52:18.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './143/37' 2022-04-03T21:52:18.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './143' 2022-04-03T21:52:18.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/19' 2022-04-03T21:52:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/15' 2022-04-03T21:52:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/31' 2022-04-03T21:52:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/36' 2022-04-03T21:52:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/20' 2022-04-03T21:52:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/12' 2022-04-03T21:52:18.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/39' 2022-04-03T21:52:18.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/10' 2022-04-03T21:52:18.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/34' 2022-04-03T21:52:18.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/38' 2022-04-03T21:52:18.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/11' 2022-04-03T21:52:18.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/16' 2022-04-03T21:52:18.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/32' 2022-04-03T21:52:18.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/30' 2022-04-03T21:52:18.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/14' 2022-04-03T21:52:18.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/18' 2022-04-03T21:52:18.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/13' 2022-04-03T21:52:18.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/33' 2022-04-03T21:52:18.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/17' 2022-04-03T21:52:18.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/35' 2022-04-03T21:52:18.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './144/37' 2022-04-03T21:52:18.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './144' 2022-04-03T21:52:18.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/19' 2022-04-03T21:52:18.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/15' 2022-04-03T21:52:18.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/31' 2022-04-03T21:52:18.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/36' 2022-04-03T21:52:18.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/20' 2022-04-03T21:52:18.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/12' 2022-04-03T21:52:18.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/39' 2022-04-03T21:52:18.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/10' 2022-04-03T21:52:18.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/34' 2022-04-03T21:52:18.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/38' 2022-04-03T21:52:18.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/11' 2022-04-03T21:52:18.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/16' 2022-04-03T21:52:18.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/32' 2022-04-03T21:52:18.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/30' 2022-04-03T21:52:18.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/14' 2022-04-03T21:52:18.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/18' 2022-04-03T21:52:18.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/13' 2022-04-03T21:52:18.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/33' 2022-04-03T21:52:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/17' 2022-04-03T21:52:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/35' 2022-04-03T21:52:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './145/37' 2022-04-03T21:52:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './145' 2022-04-03T21:52:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/19' 2022-04-03T21:52:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/15' 2022-04-03T21:52:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/31' 2022-04-03T21:52:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/36' 2022-04-03T21:52:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/20' 2022-04-03T21:52:18.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/12' 2022-04-03T21:52:18.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/39' 2022-04-03T21:52:18.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/10' 2022-04-03T21:52:18.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/34' 2022-04-03T21:52:18.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/38' 2022-04-03T21:52:18.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/11' 2022-04-03T21:52:18.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/16' 2022-04-03T21:52:18.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/32' 2022-04-03T21:52:18.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/30' 2022-04-03T21:52:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/14' 2022-04-03T21:52:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/18' 2022-04-03T21:52:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/13' 2022-04-03T21:52:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/33' 2022-04-03T21:52:18.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/17' 2022-04-03T21:52:18.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/35' 2022-04-03T21:52:18.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './146/37' 2022-04-03T21:52:18.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './146' 2022-04-03T21:52:18.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/19' 2022-04-03T21:52:18.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/15' 2022-04-03T21:52:18.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/31' 2022-04-03T21:52:18.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/36' 2022-04-03T21:52:18.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/20' 2022-04-03T21:52:18.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/12' 2022-04-03T21:52:18.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/39' 2022-04-03T21:52:18.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/10' 2022-04-03T21:52:18.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/34' 2022-04-03T21:52:18.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/38' 2022-04-03T21:52:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/11' 2022-04-03T21:52:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/16' 2022-04-03T21:52:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/32' 2022-04-03T21:52:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/30' 2022-04-03T21:52:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/14' 2022-04-03T21:52:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/18' 2022-04-03T21:52:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/13' 2022-04-03T21:52:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/33' 2022-04-03T21:52:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/17' 2022-04-03T21:52:18.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/35' 2022-04-03T21:52:18.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './147/37' 2022-04-03T21:52:18.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './147' 2022-04-03T21:52:18.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/19' 2022-04-03T21:52:18.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/15' 2022-04-03T21:52:18.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/31' 2022-04-03T21:52:18.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/36' 2022-04-03T21:52:19.986 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/20' 2022-04-03T21:52:19.987 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/12' 2022-04-03T21:52:19.987 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/39' 2022-04-03T21:52:19.987 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/10' 2022-04-03T21:52:19.987 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/34' 2022-04-03T21:52:19.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/38' 2022-04-03T21:52:19.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/11' 2022-04-03T21:52:19.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/16' 2022-04-03T21:52:19.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/32' 2022-04-03T21:52:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/30' 2022-04-03T21:52:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/14' 2022-04-03T21:52:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/18' 2022-04-03T21:52:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/13' 2022-04-03T21:52:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/33' 2022-04-03T21:52:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/17' 2022-04-03T21:52:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/35' 2022-04-03T21:52:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './148/37' 2022-04-03T21:52:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './148' 2022-04-03T21:52:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/19' 2022-04-03T21:52:19.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/15' 2022-04-03T21:52:19.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/31' 2022-04-03T21:52:19.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/36' 2022-04-03T21:52:19.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/20' 2022-04-03T21:52:19.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/12' 2022-04-03T21:52:19.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/39' 2022-04-03T21:52:19.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/10' 2022-04-03T21:52:19.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/34' 2022-04-03T21:52:19.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/38' 2022-04-03T21:52:19.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/11' 2022-04-03T21:52:19.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/16' 2022-04-03T21:52:19.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/32' 2022-04-03T21:52:19.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/30' 2022-04-03T21:52:19.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/14' 2022-04-03T21:52:19.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/18' 2022-04-03T21:52:19.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/13' 2022-04-03T21:52:19.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/33' 2022-04-03T21:52:19.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/17' 2022-04-03T21:52:19.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/35' 2022-04-03T21:52:19.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './149/37' 2022-04-03T21:52:19.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './149' 2022-04-03T21:52:19.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/19' 2022-04-03T21:52:19.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/15' 2022-04-03T21:52:19.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/31' 2022-04-03T21:52:19.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/36' 2022-04-03T21:52:19.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/20' 2022-04-03T21:52:19.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/12' 2022-04-03T21:52:19.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/39' 2022-04-03T21:52:19.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/10' 2022-04-03T21:52:19.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/34' 2022-04-03T21:52:19.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/38' 2022-04-03T21:52:19.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/11' 2022-04-03T21:52:19.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/16' 2022-04-03T21:52:19.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/32' 2022-04-03T21:52:19.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/30' 2022-04-03T21:52:19.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/14' 2022-04-03T21:52:19.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/18' 2022-04-03T21:52:19.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/13' 2022-04-03T21:52:19.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/33' 2022-04-03T21:52:19.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/17' 2022-04-03T21:52:19.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/35' 2022-04-03T21:52:20.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './150/37' 2022-04-03T21:52:20.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './150' 2022-04-03T21:52:20.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/19' 2022-04-03T21:52:20.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/15' 2022-04-03T21:52:20.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/31' 2022-04-03T21:52:20.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/36' 2022-04-03T21:52:20.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/20' 2022-04-03T21:52:20.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/12' 2022-04-03T21:52:20.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/39' 2022-04-03T21:52:20.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/10' 2022-04-03T21:52:20.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/34' 2022-04-03T21:52:20.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/38' 2022-04-03T21:52:20.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/11' 2022-04-03T21:52:20.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/16' 2022-04-03T21:52:20.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/32' 2022-04-03T21:52:20.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/30' 2022-04-03T21:52:20.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/14' 2022-04-03T21:52:20.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/18' 2022-04-03T21:52:20.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/13' 2022-04-03T21:52:20.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/33' 2022-04-03T21:52:20.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/17' 2022-04-03T21:52:20.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/35' 2022-04-03T21:52:20.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './151/37' 2022-04-03T21:52:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './151' 2022-04-03T21:52:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/19' 2022-04-03T21:52:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/15' 2022-04-03T21:52:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/31' 2022-04-03T21:52:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/36' 2022-04-03T21:52:20.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/20' 2022-04-03T21:52:20.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/12' 2022-04-03T21:52:20.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/39' 2022-04-03T21:52:20.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/10' 2022-04-03T21:52:20.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/34' 2022-04-03T21:52:20.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/38' 2022-04-03T21:52:20.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/11' 2022-04-03T21:52:20.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/16' 2022-04-03T21:52:20.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/32' 2022-04-03T21:52:20.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/30' 2022-04-03T21:52:20.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/14' 2022-04-03T21:52:20.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/18' 2022-04-03T21:52:20.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/13' 2022-04-03T21:52:20.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/33' 2022-04-03T21:52:20.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/17' 2022-04-03T21:52:20.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/35' 2022-04-03T21:52:20.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './152/37' 2022-04-03T21:52:20.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './152' 2022-04-03T21:52:20.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/19' 2022-04-03T21:52:20.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/15' 2022-04-03T21:52:20.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/31' 2022-04-03T21:52:20.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/36' 2022-04-03T21:52:20.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/20' 2022-04-03T21:52:20.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/12' 2022-04-03T21:52:20.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/39' 2022-04-03T21:52:20.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/10' 2022-04-03T21:52:20.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/34' 2022-04-03T21:52:20.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/38' 2022-04-03T21:52:20.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/11' 2022-04-03T21:52:20.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/16' 2022-04-03T21:52:20.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/32' 2022-04-03T21:52:20.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/30' 2022-04-03T21:52:20.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/14' 2022-04-03T21:52:20.013 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/18' 2022-04-03T21:52:20.013 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/13' 2022-04-03T21:52:20.013 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/33' 2022-04-03T21:52:20.013 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/17' 2022-04-03T21:52:20.013 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/35' 2022-04-03T21:52:20.014 INFO:tasks.workunit.client.0.smithi049.stdout:removed './153/37' 2022-04-03T21:52:20.014 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './153' 2022-04-03T21:52:20.014 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/19' 2022-04-03T21:52:20.014 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/15' 2022-04-03T21:52:20.015 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/31' 2022-04-03T21:52:20.015 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/36' 2022-04-03T21:52:20.015 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/20' 2022-04-03T21:52:20.015 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/12' 2022-04-03T21:52:20.015 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/39' 2022-04-03T21:52:20.016 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/10' 2022-04-03T21:52:20.016 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/34' 2022-04-03T21:52:20.016 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/38' 2022-04-03T21:52:20.016 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/11' 2022-04-03T21:52:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/16' 2022-04-03T21:52:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/32' 2022-04-03T21:52:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/30' 2022-04-03T21:52:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/14' 2022-04-03T21:52:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/18' 2022-04-03T21:52:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/13' 2022-04-03T21:52:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/33' 2022-04-03T21:52:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/17' 2022-04-03T21:52:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/35' 2022-04-03T21:52:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:removed './154/37' 2022-04-03T21:52:20.019 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './154' 2022-04-03T21:52:20.019 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/19' 2022-04-03T21:52:20.019 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/15' 2022-04-03T21:52:20.019 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/31' 2022-04-03T21:52:20.020 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/36' 2022-04-03T21:52:20.020 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/20' 2022-04-03T21:52:20.020 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/12' 2022-04-03T21:52:20.020 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/39' 2022-04-03T21:52:20.020 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/10' 2022-04-03T21:52:20.021 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/34' 2022-04-03T21:52:20.021 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/38' 2022-04-03T21:52:20.021 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/11' 2022-04-03T21:52:20.021 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/16' 2022-04-03T21:52:20.021 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/32' 2022-04-03T21:52:20.022 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/30' 2022-04-03T21:52:20.022 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/14' 2022-04-03T21:52:20.022 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/18' 2022-04-03T21:52:20.022 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/13' 2022-04-03T21:52:20.022 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/33' 2022-04-03T21:52:20.023 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/17' 2022-04-03T21:52:20.023 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/35' 2022-04-03T21:52:20.023 INFO:tasks.workunit.client.0.smithi049.stdout:removed './155/37' 2022-04-03T21:52:20.023 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './155' 2022-04-03T21:52:20.023 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/19' 2022-04-03T21:52:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/15' 2022-04-03T21:52:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/31' 2022-04-03T21:52:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/36' 2022-04-03T21:52:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/20' 2022-04-03T21:52:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/12' 2022-04-03T21:52:20.025 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/39' 2022-04-03T21:52:20.025 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/10' 2022-04-03T21:52:20.025 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/34' 2022-04-03T21:52:20.025 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/38' 2022-04-03T21:52:20.025 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/11' 2022-04-03T21:52:20.026 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/16' 2022-04-03T21:52:20.026 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/32' 2022-04-03T21:52:20.026 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/30' 2022-04-03T21:52:20.026 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/14' 2022-04-03T21:52:20.027 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/18' 2022-04-03T21:52:20.027 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/13' 2022-04-03T21:52:20.027 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/33' 2022-04-03T21:52:20.027 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/17' 2022-04-03T21:52:20.027 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/35' 2022-04-03T21:52:20.028 INFO:tasks.workunit.client.0.smithi049.stdout:removed './156/37' 2022-04-03T21:52:20.028 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './156' 2022-04-03T21:52:20.028 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/19' 2022-04-03T21:52:20.028 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/15' 2022-04-03T21:52:20.028 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/31' 2022-04-03T21:52:20.029 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/36' 2022-04-03T21:52:20.029 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/20' 2022-04-03T21:52:20.029 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/12' 2022-04-03T21:52:20.029 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/39' 2022-04-03T21:52:20.029 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/10' 2022-04-03T21:52:20.030 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/34' 2022-04-03T21:52:20.030 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/38' 2022-04-03T21:52:20.030 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/11' 2022-04-03T21:52:20.030 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/16' 2022-04-03T21:52:20.031 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/32' 2022-04-03T21:52:20.031 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/30' 2022-04-03T21:52:20.031 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/14' 2022-04-03T21:52:20.031 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/18' 2022-04-03T21:52:20.031 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/13' 2022-04-03T21:52:20.032 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/33' 2022-04-03T21:52:21.317 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/17' 2022-04-03T21:52:21.317 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/35' 2022-04-03T21:52:21.317 INFO:tasks.workunit.client.0.smithi049.stdout:removed './157/37' 2022-04-03T21:52:21.318 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './157' 2022-04-03T21:52:21.318 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/19' 2022-04-03T21:52:21.318 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/15' 2022-04-03T21:52:21.318 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/31' 2022-04-03T21:52:21.319 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/36' 2022-04-03T21:52:21.319 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/20' 2022-04-03T21:52:21.319 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/12' 2022-04-03T21:52:21.319 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/39' 2022-04-03T21:52:21.320 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/10' 2022-04-03T21:52:21.320 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/34' 2022-04-03T21:52:21.320 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/38' 2022-04-03T21:52:21.320 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/11' 2022-04-03T21:52:21.320 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/16' 2022-04-03T21:52:21.321 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/32' 2022-04-03T21:52:21.321 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/30' 2022-04-03T21:52:21.321 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/14' 2022-04-03T21:52:21.321 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/18' 2022-04-03T21:52:21.322 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/13' 2022-04-03T21:52:21.322 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/33' 2022-04-03T21:52:21.322 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/17' 2022-04-03T21:52:21.322 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/35' 2022-04-03T21:52:21.323 INFO:tasks.workunit.client.0.smithi049.stdout:removed './158/37' 2022-04-03T21:52:21.323 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './158' 2022-04-03T21:52:21.323 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/19' 2022-04-03T21:52:21.323 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/15' 2022-04-03T21:52:21.324 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/31' 2022-04-03T21:52:21.324 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/36' 2022-04-03T21:52:21.324 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/20' 2022-04-03T21:52:21.324 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/12' 2022-04-03T21:52:21.324 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/39' 2022-04-03T21:52:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/10' 2022-04-03T21:52:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/34' 2022-04-03T21:52:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/38' 2022-04-03T21:52:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/11' 2022-04-03T21:52:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/16' 2022-04-03T21:52:21.326 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/32' 2022-04-03T21:52:21.326 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/30' 2022-04-03T21:52:21.326 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/14' 2022-04-03T21:52:21.326 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/18' 2022-04-03T21:52:21.327 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/13' 2022-04-03T21:52:21.327 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/33' 2022-04-03T21:52:21.327 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/17' 2022-04-03T21:52:21.327 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/35' 2022-04-03T21:52:21.327 INFO:tasks.workunit.client.0.smithi049.stdout:removed './159/37' 2022-04-03T21:52:21.328 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './159' 2022-04-03T21:52:21.328 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/19' 2022-04-03T21:52:21.328 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/15' 2022-04-03T21:52:21.328 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/31' 2022-04-03T21:52:21.328 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/36' 2022-04-03T21:52:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/20' 2022-04-03T21:52:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/12' 2022-04-03T21:52:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/39' 2022-04-03T21:52:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/10' 2022-04-03T21:52:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/34' 2022-04-03T21:52:21.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/38' 2022-04-03T21:52:21.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/11' 2022-04-03T21:52:21.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/16' 2022-04-03T21:52:21.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/32' 2022-04-03T21:52:21.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/30' 2022-04-03T21:52:21.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/14' 2022-04-03T21:52:21.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/18' 2022-04-03T21:52:21.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/13' 2022-04-03T21:52:21.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/33' 2022-04-03T21:52:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/17' 2022-04-03T21:52:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/35' 2022-04-03T21:52:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './160/37' 2022-04-03T21:52:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './160' 2022-04-03T21:52:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/19' 2022-04-03T21:52:21.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/15' 2022-04-03T21:52:21.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/31' 2022-04-03T21:52:21.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/36' 2022-04-03T21:52:21.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/20' 2022-04-03T21:52:21.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/12' 2022-04-03T21:52:21.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/39' 2022-04-03T21:52:21.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/10' 2022-04-03T21:52:21.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/34' 2022-04-03T21:52:21.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/38' 2022-04-03T21:52:21.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/11' 2022-04-03T21:52:21.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/16' 2022-04-03T21:52:21.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/32' 2022-04-03T21:52:21.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/30' 2022-04-03T21:52:21.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/14' 2022-04-03T21:52:21.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/18' 2022-04-03T21:52:21.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/13' 2022-04-03T21:52:21.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/33' 2022-04-03T21:52:21.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/17' 2022-04-03T21:52:21.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/35' 2022-04-03T21:52:21.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './161/37' 2022-04-03T21:52:21.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './161' 2022-04-03T21:52:21.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/19' 2022-04-03T21:52:21.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/15' 2022-04-03T21:52:21.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/31' 2022-04-03T21:52:21.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/36' 2022-04-03T21:52:21.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/20' 2022-04-03T21:52:21.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/12' 2022-04-03T21:52:21.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/39' 2022-04-03T21:52:21.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/10' 2022-04-03T21:52:21.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/34' 2022-04-03T21:52:21.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/38' 2022-04-03T21:52:21.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/11' 2022-04-03T21:52:21.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/16' 2022-04-03T21:52:21.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/32' 2022-04-03T21:52:21.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/30' 2022-04-03T21:52:21.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/14' 2022-04-03T21:52:21.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/18' 2022-04-03T21:52:21.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/13' 2022-04-03T21:52:21.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/33' 2022-04-03T21:52:21.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/17' 2022-04-03T21:52:21.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/35' 2022-04-03T21:52:21.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './162/37' 2022-04-03T21:52:21.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './162' 2022-04-03T21:52:21.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/19' 2022-04-03T21:52:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/15' 2022-04-03T21:52:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/31' 2022-04-03T21:52:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/36' 2022-04-03T21:52:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/20' 2022-04-03T21:52:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/12' 2022-04-03T21:52:21.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/39' 2022-04-03T21:52:21.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/10' 2022-04-03T21:52:21.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/34' 2022-04-03T21:52:21.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/38' 2022-04-03T21:52:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/11' 2022-04-03T21:52:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/16' 2022-04-03T21:52:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/32' 2022-04-03T21:52:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/30' 2022-04-03T21:52:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/14' 2022-04-03T21:52:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/18' 2022-04-03T21:52:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/13' 2022-04-03T21:52:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/33' 2022-04-03T21:52:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/17' 2022-04-03T21:52:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/35' 2022-04-03T21:52:21.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './163/37' 2022-04-03T21:52:21.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './163' 2022-04-03T21:52:21.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/19' 2022-04-03T21:52:21.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/15' 2022-04-03T21:52:21.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/31' 2022-04-03T21:52:21.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/36' 2022-04-03T21:52:21.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/20' 2022-04-03T21:52:21.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/12' 2022-04-03T21:52:21.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/39' 2022-04-03T21:52:21.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/10' 2022-04-03T21:52:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/34' 2022-04-03T21:52:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/38' 2022-04-03T21:52:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/11' 2022-04-03T21:52:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/16' 2022-04-03T21:52:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/32' 2022-04-03T21:52:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/30' 2022-04-03T21:52:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/14' 2022-04-03T21:52:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/18' 2022-04-03T21:52:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/13' 2022-04-03T21:52:21.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/33' 2022-04-03T21:52:21.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/17' 2022-04-03T21:52:21.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/35' 2022-04-03T21:52:21.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './164/37' 2022-04-03T21:52:21.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './164' 2022-04-03T21:52:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/19' 2022-04-03T21:52:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/15' 2022-04-03T21:52:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/31' 2022-04-03T21:52:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/36' 2022-04-03T21:52:21.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/20' 2022-04-03T21:52:21.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/12' 2022-04-03T21:52:21.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/39' 2022-04-03T21:52:21.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/10' 2022-04-03T21:52:21.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/34' 2022-04-03T21:52:21.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/38' 2022-04-03T21:52:21.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/11' 2022-04-03T21:52:21.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/16' 2022-04-03T21:52:21.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/32' 2022-04-03T21:52:21.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/30' 2022-04-03T21:52:21.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/14' 2022-04-03T21:52:21.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/18' 2022-04-03T21:52:21.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/13' 2022-04-03T21:52:21.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/33' 2022-04-03T21:52:21.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/17' 2022-04-03T21:52:21.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/35' 2022-04-03T21:52:21.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './165/37' 2022-04-03T21:52:21.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './165' 2022-04-03T21:52:21.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/19' 2022-04-03T21:52:21.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/15' 2022-04-03T21:52:21.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/31' 2022-04-03T21:52:21.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/36' 2022-04-03T21:52:21.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/20' 2022-04-03T21:52:21.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/12' 2022-04-03T21:52:21.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/39' 2022-04-03T21:52:21.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/10' 2022-04-03T21:52:21.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/34' 2022-04-03T21:52:21.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/38' 2022-04-03T21:52:21.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/11' 2022-04-03T21:52:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/16' 2022-04-03T21:52:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/32' 2022-04-03T21:52:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/30' 2022-04-03T21:52:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/14' 2022-04-03T21:52:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/18' 2022-04-03T21:52:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/13' 2022-04-03T21:52:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/33' 2022-04-03T21:52:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/17' 2022-04-03T21:52:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/35' 2022-04-03T21:52:21.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './166/37' 2022-04-03T21:52:21.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './166' 2022-04-03T21:52:21.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/19' 2022-04-03T21:52:21.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/15' 2022-04-03T21:52:21.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/31' 2022-04-03T21:52:21.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/36' 2022-04-03T21:52:21.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/20' 2022-04-03T21:52:21.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/12' 2022-04-03T21:52:21.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/39' 2022-04-03T21:52:21.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/10' 2022-04-03T21:52:21.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/34' 2022-04-03T21:52:21.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/38' 2022-04-03T21:52:22.877 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/11' 2022-04-03T21:52:22.877 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/16' 2022-04-03T21:52:22.877 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/32' 2022-04-03T21:52:22.878 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/30' 2022-04-03T21:52:22.878 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/14' 2022-04-03T21:52:22.878 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/18' 2022-04-03T21:52:22.878 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/13' 2022-04-03T21:52:22.879 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/33' 2022-04-03T21:52:22.879 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/17' 2022-04-03T21:52:22.879 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/35' 2022-04-03T21:52:22.879 INFO:tasks.workunit.client.0.smithi049.stdout:removed './167/37' 2022-04-03T21:52:22.879 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './167' 2022-04-03T21:52:22.880 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/19' 2022-04-03T21:52:22.880 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/15' 2022-04-03T21:52:22.880 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/31' 2022-04-03T21:52:22.880 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/36' 2022-04-03T21:52:22.881 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/20' 2022-04-03T21:52:22.881 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/12' 2022-04-03T21:52:22.881 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/39' 2022-04-03T21:52:22.881 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/10' 2022-04-03T21:52:22.881 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/34' 2022-04-03T21:52:22.882 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/38' 2022-04-03T21:52:22.882 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/11' 2022-04-03T21:52:22.882 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/16' 2022-04-03T21:52:22.882 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/32' 2022-04-03T21:52:22.883 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/30' 2022-04-03T21:52:22.883 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/14' 2022-04-03T21:52:22.883 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/18' 2022-04-03T21:52:22.883 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/13' 2022-04-03T21:52:22.883 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/33' 2022-04-03T21:52:22.884 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/17' 2022-04-03T21:52:22.884 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/35' 2022-04-03T21:52:22.884 INFO:tasks.workunit.client.0.smithi049.stdout:removed './168/37' 2022-04-03T21:52:22.884 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './168' 2022-04-03T21:52:22.885 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/19' 2022-04-03T21:52:22.885 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/15' 2022-04-03T21:52:22.885 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/31' 2022-04-03T21:52:22.885 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/36' 2022-04-03T21:52:22.885 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/20' 2022-04-03T21:52:22.886 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/12' 2022-04-03T21:52:22.886 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/39' 2022-04-03T21:52:22.886 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/10' 2022-04-03T21:52:22.886 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/34' 2022-04-03T21:52:22.887 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/38' 2022-04-03T21:52:22.887 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/11' 2022-04-03T21:52:22.887 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/16' 2022-04-03T21:52:22.887 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/32' 2022-04-03T21:52:22.888 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/30' 2022-04-03T21:52:22.888 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/14' 2022-04-03T21:52:22.888 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/18' 2022-04-03T21:52:22.888 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/13' 2022-04-03T21:52:22.888 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/33' 2022-04-03T21:52:22.889 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/17' 2022-04-03T21:52:22.889 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/35' 2022-04-03T21:52:22.889 INFO:tasks.workunit.client.0.smithi049.stdout:removed './169/37' 2022-04-03T21:52:22.889 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './169' 2022-04-03T21:52:22.889 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/19' 2022-04-03T21:52:22.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/15' 2022-04-03T21:52:22.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/31' 2022-04-03T21:52:22.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/36' 2022-04-03T21:52:22.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/20' 2022-04-03T21:52:22.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/12' 2022-04-03T21:52:22.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/39' 2022-04-03T21:52:22.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/10' 2022-04-03T21:52:22.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/34' 2022-04-03T21:52:22.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/38' 2022-04-03T21:52:22.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/11' 2022-04-03T21:52:22.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/16' 2022-04-03T21:52:22.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/32' 2022-04-03T21:52:22.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/30' 2022-04-03T21:52:22.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/14' 2022-04-03T21:52:22.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/18' 2022-04-03T21:52:22.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/13' 2022-04-03T21:52:22.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/33' 2022-04-03T21:52:22.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/17' 2022-04-03T21:52:22.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/35' 2022-04-03T21:52:22.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './170/37' 2022-04-03T21:52:22.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './170' 2022-04-03T21:52:22.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/19' 2022-04-03T21:52:22.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/15' 2022-04-03T21:52:22.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/31' 2022-04-03T21:52:22.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/36' 2022-04-03T21:52:22.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/20' 2022-04-03T21:52:22.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/12' 2022-04-03T21:52:22.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/39' 2022-04-03T21:52:22.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/10' 2022-04-03T21:52:22.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/34' 2022-04-03T21:52:22.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/38' 2022-04-03T21:52:22.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/11' 2022-04-03T21:52:22.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/16' 2022-04-03T21:52:22.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/32' 2022-04-03T21:52:22.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/30' 2022-04-03T21:52:22.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/14' 2022-04-03T21:52:22.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/18' 2022-04-03T21:52:22.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/13' 2022-04-03T21:52:22.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/33' 2022-04-03T21:52:22.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/17' 2022-04-03T21:52:22.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/35' 2022-04-03T21:52:22.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './171/37' 2022-04-03T21:52:22.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './171' 2022-04-03T21:52:22.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/19' 2022-04-03T21:52:22.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/15' 2022-04-03T21:52:22.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/31' 2022-04-03T21:52:22.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/36' 2022-04-03T21:52:22.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/20' 2022-04-03T21:52:22.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/12' 2022-04-03T21:52:22.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/39' 2022-04-03T21:52:22.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/10' 2022-04-03T21:52:22.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/34' 2022-04-03T21:52:22.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/38' 2022-04-03T21:52:22.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/11' 2022-04-03T21:52:22.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/16' 2022-04-03T21:52:22.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/32' 2022-04-03T21:52:22.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/30' 2022-04-03T21:52:22.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/14' 2022-04-03T21:52:22.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/18' 2022-04-03T21:52:22.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/13' 2022-04-03T21:52:22.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/33' 2022-04-03T21:52:22.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/17' 2022-04-03T21:52:22.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/35' 2022-04-03T21:52:22.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './172/37' 2022-04-03T21:52:22.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './172' 2022-04-03T21:52:22.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/19' 2022-04-03T21:52:22.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/15' 2022-04-03T21:52:22.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/31' 2022-04-03T21:52:22.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/36' 2022-04-03T21:52:22.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/20' 2022-04-03T21:52:22.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/12' 2022-04-03T21:52:22.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/39' 2022-04-03T21:52:22.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/10' 2022-04-03T21:52:22.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/34' 2022-04-03T21:52:22.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/38' 2022-04-03T21:52:22.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/11' 2022-04-03T21:52:22.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/16' 2022-04-03T21:52:22.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/32' 2022-04-03T21:52:22.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/30' 2022-04-03T21:52:22.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/14' 2022-04-03T21:52:22.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/18' 2022-04-03T21:52:22.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/13' 2022-04-03T21:52:22.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/33' 2022-04-03T21:52:22.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/17' 2022-04-03T21:52:22.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/35' 2022-04-03T21:52:22.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './173/37' 2022-04-03T21:52:22.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './173' 2022-04-03T21:52:22.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/19' 2022-04-03T21:52:22.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/15' 2022-04-03T21:52:22.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/31' 2022-04-03T21:52:22.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/36' 2022-04-03T21:52:22.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/20' 2022-04-03T21:52:22.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/12' 2022-04-03T21:52:22.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/39' 2022-04-03T21:52:22.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/10' 2022-04-03T21:52:22.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/34' 2022-04-03T21:52:22.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/38' 2022-04-03T21:52:22.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/11' 2022-04-03T21:52:22.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/16' 2022-04-03T21:52:22.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/32' 2022-04-03T21:52:22.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/30' 2022-04-03T21:52:22.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/14' 2022-04-03T21:52:22.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/18' 2022-04-03T21:52:22.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/13' 2022-04-03T21:52:22.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/33' 2022-04-03T21:52:22.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/17' 2022-04-03T21:52:22.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/35' 2022-04-03T21:52:22.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './174/37' 2022-04-03T21:52:22.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './174' 2022-04-03T21:52:22.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/19' 2022-04-03T21:52:22.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/15' 2022-04-03T21:52:22.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/31' 2022-04-03T21:52:22.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/36' 2022-04-03T21:52:22.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/20' 2022-04-03T21:52:22.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/12' 2022-04-03T21:52:22.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/39' 2022-04-03T21:52:22.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/10' 2022-04-03T21:52:22.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/34' 2022-04-03T21:52:22.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/38' 2022-04-03T21:52:22.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/11' 2022-04-03T21:52:22.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/16' 2022-04-03T21:52:22.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/32' 2022-04-03T21:52:22.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/30' 2022-04-03T21:52:22.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/14' 2022-04-03T21:52:22.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/18' 2022-04-03T21:52:22.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/13' 2022-04-03T21:52:22.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/33' 2022-04-03T21:52:22.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/17' 2022-04-03T21:52:22.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/35' 2022-04-03T21:52:22.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './175/37' 2022-04-03T21:52:22.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './175' 2022-04-03T21:52:22.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/19' 2022-04-03T21:52:22.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/15' 2022-04-03T21:52:22.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/31' 2022-04-03T21:52:22.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/36' 2022-04-03T21:52:22.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/20' 2022-04-03T21:52:22.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/12' 2022-04-03T21:52:22.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/39' 2022-04-03T21:52:22.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/10' 2022-04-03T21:52:22.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/34' 2022-04-03T21:52:22.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/38' 2022-04-03T21:52:22.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/11' 2022-04-03T21:52:22.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/16' 2022-04-03T21:52:22.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/32' 2022-04-03T21:52:22.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/30' 2022-04-03T21:52:22.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/14' 2022-04-03T21:52:22.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/18' 2022-04-03T21:52:22.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/13' 2022-04-03T21:52:22.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/33' 2022-04-03T21:52:22.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/17' 2022-04-03T21:52:22.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/35' 2022-04-03T21:52:22.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './176/37' 2022-04-03T21:52:22.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './176' 2022-04-03T21:52:22.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/19' 2022-04-03T21:52:22.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/15' 2022-04-03T21:52:23.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:52:23.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:52:23.769 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/31' 2022-04-03T21:52:23.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/36' 2022-04-03T21:52:23.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/20' 2022-04-03T21:52:23.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/12' 2022-04-03T21:52:23.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/39' 2022-04-03T21:52:23.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/10' 2022-04-03T21:52:23.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/34' 2022-04-03T21:52:23.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/38' 2022-04-03T21:52:23.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/11' 2022-04-03T21:52:23.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/16' 2022-04-03T21:52:23.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/32' 2022-04-03T21:52:23.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/30' 2022-04-03T21:52:23.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/14' 2022-04-03T21:52:23.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/18' 2022-04-03T21:52:23.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/13' 2022-04-03T21:52:23.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/33' 2022-04-03T21:52:23.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/17' 2022-04-03T21:52:23.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/35' 2022-04-03T21:52:23.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './177/37' 2022-04-03T21:52:23.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './177' 2022-04-03T21:52:23.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/19' 2022-04-03T21:52:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/15' 2022-04-03T21:52:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/31' 2022-04-03T21:52:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/36' 2022-04-03T21:52:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/20' 2022-04-03T21:52:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/12' 2022-04-03T21:52:23.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/39' 2022-04-03T21:52:23.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/10' 2022-04-03T21:52:23.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/34' 2022-04-03T21:52:23.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/38' 2022-04-03T21:52:23.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/11' 2022-04-03T21:52:23.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/16' 2022-04-03T21:52:23.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/32' 2022-04-03T21:52:23.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/30' 2022-04-03T21:52:23.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/14' 2022-04-03T21:52:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/18' 2022-04-03T21:52:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/13' 2022-04-03T21:52:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/33' 2022-04-03T21:52:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/17' 2022-04-03T21:52:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/35' 2022-04-03T21:52:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './178/37' 2022-04-03T21:52:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './178' 2022-04-03T21:52:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/19' 2022-04-03T21:52:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/15' 2022-04-03T21:52:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/31' 2022-04-03T21:52:23.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/36' 2022-04-03T21:52:23.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/20' 2022-04-03T21:52:23.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/12' 2022-04-03T21:52:23.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/39' 2022-04-03T21:52:23.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/10' 2022-04-03T21:52:23.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/34' 2022-04-03T21:52:23.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/38' 2022-04-03T21:52:23.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/11' 2022-04-03T21:52:23.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/16' 2022-04-03T21:52:23.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/32' 2022-04-03T21:52:23.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/30' 2022-04-03T21:52:23.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/14' 2022-04-03T21:52:23.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/18' 2022-04-03T21:52:23.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/13' 2022-04-03T21:52:23.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/33' 2022-04-03T21:52:23.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/17' 2022-04-03T21:52:23.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/35' 2022-04-03T21:52:23.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './179/37' 2022-04-03T21:52:23.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './179' 2022-04-03T21:52:23.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/19' 2022-04-03T21:52:23.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/15' 2022-04-03T21:52:23.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/31' 2022-04-03T21:52:23.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/36' 2022-04-03T21:52:23.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/20' 2022-04-03T21:52:23.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/12' 2022-04-03T21:52:23.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/39' 2022-04-03T21:52:23.786 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/10' 2022-04-03T21:52:23.786 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/34' 2022-04-03T21:52:23.786 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/38' 2022-04-03T21:52:23.786 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/11' 2022-04-03T21:52:23.786 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/16' 2022-04-03T21:52:23.787 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/32' 2022-04-03T21:52:23.787 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/30' 2022-04-03T21:52:23.787 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/14' 2022-04-03T21:52:23.787 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/18' 2022-04-03T21:52:23.788 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/13' 2022-04-03T21:52:23.788 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/33' 2022-04-03T21:52:23.788 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/17' 2022-04-03T21:52:23.788 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/35' 2022-04-03T21:52:23.788 INFO:tasks.workunit.client.0.smithi049.stdout:removed './180/37' 2022-04-03T21:52:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './180' 2022-04-03T21:52:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/19' 2022-04-03T21:52:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/15' 2022-04-03T21:52:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/31' 2022-04-03T21:52:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/36' 2022-04-03T21:52:23.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/20' 2022-04-03T21:52:23.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/12' 2022-04-03T21:52:23.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/39' 2022-04-03T21:52:23.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/10' 2022-04-03T21:52:23.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/34' 2022-04-03T21:52:23.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/38' 2022-04-03T21:52:23.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/11' 2022-04-03T21:52:23.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/16' 2022-04-03T21:52:23.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/32' 2022-04-03T21:52:23.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/30' 2022-04-03T21:52:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/14' 2022-04-03T21:52:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/18' 2022-04-03T21:52:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/13' 2022-04-03T21:52:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/33' 2022-04-03T21:52:23.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/17' 2022-04-03T21:52:23.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/35' 2022-04-03T21:52:23.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './181/37' 2022-04-03T21:52:23.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './181' 2022-04-03T21:52:23.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/19' 2022-04-03T21:52:23.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/15' 2022-04-03T21:52:23.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/31' 2022-04-03T21:52:23.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/36' 2022-04-03T21:52:23.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/20' 2022-04-03T21:52:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/12' 2022-04-03T21:52:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/39' 2022-04-03T21:52:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/10' 2022-04-03T21:52:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/34' 2022-04-03T21:52:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/38' 2022-04-03T21:52:23.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/11' 2022-04-03T21:52:23.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/16' 2022-04-03T21:52:23.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/32' 2022-04-03T21:52:23.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/30' 2022-04-03T21:52:23.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/14' 2022-04-03T21:52:23.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/18' 2022-04-03T21:52:23.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/13' 2022-04-03T21:52:23.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/33' 2022-04-03T21:52:23.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/17' 2022-04-03T21:52:23.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/35' 2022-04-03T21:52:23.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './182/37' 2022-04-03T21:52:23.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './182' 2022-04-03T21:52:23.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/19' 2022-04-03T21:52:23.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/15' 2022-04-03T21:52:23.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/31' 2022-04-03T21:52:23.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/36' 2022-04-03T21:52:23.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/20' 2022-04-03T21:52:23.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/12' 2022-04-03T21:52:23.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/39' 2022-04-03T21:52:23.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/10' 2022-04-03T21:52:23.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/34' 2022-04-03T21:52:23.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/38' 2022-04-03T21:52:23.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/11' 2022-04-03T21:52:23.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/16' 2022-04-03T21:52:23.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/32' 2022-04-03T21:52:23.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/30' 2022-04-03T21:52:23.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/14' 2022-04-03T21:52:23.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/18' 2022-04-03T21:52:23.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/13' 2022-04-03T21:52:23.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/33' 2022-04-03T21:52:23.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/17' 2022-04-03T21:52:23.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/35' 2022-04-03T21:52:23.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './183/37' 2022-04-03T21:52:23.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './183' 2022-04-03T21:52:23.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/19' 2022-04-03T21:52:23.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/15' 2022-04-03T21:52:23.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/31' 2022-04-03T21:52:23.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/36' 2022-04-03T21:52:23.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/20' 2022-04-03T21:52:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/12' 2022-04-03T21:52:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/39' 2022-04-03T21:52:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/10' 2022-04-03T21:52:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/34' 2022-04-03T21:52:23.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/38' 2022-04-03T21:52:23.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/11' 2022-04-03T21:52:23.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/16' 2022-04-03T21:52:23.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/32' 2022-04-03T21:52:23.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/30' 2022-04-03T21:52:23.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/14' 2022-04-03T21:52:23.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/18' 2022-04-03T21:52:23.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/13' 2022-04-03T21:52:23.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/33' 2022-04-03T21:52:23.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/17' 2022-04-03T21:52:23.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/35' 2022-04-03T21:52:23.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './184/37' 2022-04-03T21:52:23.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './184' 2022-04-03T21:52:23.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/19' 2022-04-03T21:52:23.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/15' 2022-04-03T21:52:23.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/31' 2022-04-03T21:52:23.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/36' 2022-04-03T21:52:23.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/20' 2022-04-03T21:52:23.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/12' 2022-04-03T21:52:23.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/39' 2022-04-03T21:52:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/10' 2022-04-03T21:52:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/34' 2022-04-03T21:52:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/38' 2022-04-03T21:52:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/11' 2022-04-03T21:52:23.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/16' 2022-04-03T21:52:23.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/32' 2022-04-03T21:52:23.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/30' 2022-04-03T21:52:23.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/14' 2022-04-03T21:52:23.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/18' 2022-04-03T21:52:23.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/13' 2022-04-03T21:52:23.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/33' 2022-04-03T21:52:23.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/17' 2022-04-03T21:52:23.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/35' 2022-04-03T21:52:23.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './185/37' 2022-04-03T21:52:23.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './185' 2022-04-03T21:52:23.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/19' 2022-04-03T21:52:23.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/15' 2022-04-03T21:52:23.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/31' 2022-04-03T21:52:23.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/36' 2022-04-03T21:52:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/20' 2022-04-03T21:52:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/12' 2022-04-03T21:52:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/39' 2022-04-03T21:52:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/10' 2022-04-03T21:52:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/34' 2022-04-03T21:52:23.814 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/38' 2022-04-03T21:52:23.814 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/11' 2022-04-03T21:52:23.814 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/16' 2022-04-03T21:52:23.814 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/32' 2022-04-03T21:52:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/30' 2022-04-03T21:52:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/14' 2022-04-03T21:52:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/18' 2022-04-03T21:52:24.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/13' 2022-04-03T21:52:24.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/33' 2022-04-03T21:52:24.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/17' 2022-04-03T21:52:24.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/35' 2022-04-03T21:52:24.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './186/37' 2022-04-03T21:52:24.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './186' 2022-04-03T21:52:24.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/19' 2022-04-03T21:52:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/15' 2022-04-03T21:52:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/31' 2022-04-03T21:52:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/36' 2022-04-03T21:52:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/20' 2022-04-03T21:52:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/12' 2022-04-03T21:52:24.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/39' 2022-04-03T21:52:24.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/10' 2022-04-03T21:52:24.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/34' 2022-04-03T21:52:24.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/38' 2022-04-03T21:52:24.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/11' 2022-04-03T21:52:24.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/16' 2022-04-03T21:52:24.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/32' 2022-04-03T21:52:24.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/30' 2022-04-03T21:52:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/14' 2022-04-03T21:52:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/18' 2022-04-03T21:52:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/13' 2022-04-03T21:52:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/33' 2022-04-03T21:52:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/17' 2022-04-03T21:52:24.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/35' 2022-04-03T21:52:24.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './187/37' 2022-04-03T21:52:24.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './187' 2022-04-03T21:52:24.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/19' 2022-04-03T21:52:24.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/15' 2022-04-03T21:52:24.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/31' 2022-04-03T21:52:24.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/36' 2022-04-03T21:52:24.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/20' 2022-04-03T21:52:24.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/12' 2022-04-03T21:52:24.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/39' 2022-04-03T21:52:24.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/10' 2022-04-03T21:52:24.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/34' 2022-04-03T21:52:24.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/38' 2022-04-03T21:52:24.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/11' 2022-04-03T21:52:24.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/16' 2022-04-03T21:52:24.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/32' 2022-04-03T21:52:24.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/30' 2022-04-03T21:52:24.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/14' 2022-04-03T21:52:24.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/18' 2022-04-03T21:52:24.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/13' 2022-04-03T21:52:24.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/33' 2022-04-03T21:52:24.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/17' 2022-04-03T21:52:24.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/35' 2022-04-03T21:52:24.363 INFO:tasks.workunit.client.0.smithi049.stdout:removed './188/37' 2022-04-03T21:52:24.363 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './188' 2022-04-03T21:52:24.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/19' 2022-04-03T21:52:24.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/15' 2022-04-03T21:52:24.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/31' 2022-04-03T21:52:24.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/36' 2022-04-03T21:52:24.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/20' 2022-04-03T21:52:24.366 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/12' 2022-04-03T21:52:24.366 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/39' 2022-04-03T21:52:24.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/10' 2022-04-03T21:52:24.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/34' 2022-04-03T21:52:24.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/38' 2022-04-03T21:52:24.368 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/11' 2022-04-03T21:52:24.368 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/16' 2022-04-03T21:52:24.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/32' 2022-04-03T21:52:24.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/30' 2022-04-03T21:52:24.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/14' 2022-04-03T21:52:24.370 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/18' 2022-04-03T21:52:24.370 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/13' 2022-04-03T21:52:24.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/33' 2022-04-03T21:52:24.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/17' 2022-04-03T21:52:24.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/35' 2022-04-03T21:52:24.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './189/37' 2022-04-03T21:52:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './189' 2022-04-03T21:52:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/19' 2022-04-03T21:52:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/15' 2022-04-03T21:52:24.374 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/31' 2022-04-03T21:52:24.374 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/36' 2022-04-03T21:52:24.375 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/20' 2022-04-03T21:52:24.375 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/12' 2022-04-03T21:52:24.375 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/39' 2022-04-03T21:52:24.376 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/10' 2022-04-03T21:52:24.376 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/34' 2022-04-03T21:52:24.377 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/38' 2022-04-03T21:52:24.377 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/11' 2022-04-03T21:52:24.377 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/16' 2022-04-03T21:52:24.378 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/32' 2022-04-03T21:52:24.378 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/30' 2022-04-03T21:52:24.379 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/14' 2022-04-03T21:52:24.379 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/18' 2022-04-03T21:52:24.380 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/13' 2022-04-03T21:52:24.380 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/33' 2022-04-03T21:52:24.381 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/17' 2022-04-03T21:52:24.381 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/35' 2022-04-03T21:52:24.381 INFO:tasks.workunit.client.0.smithi049.stdout:removed './190/37' 2022-04-03T21:52:24.382 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './190' 2022-04-03T21:52:24.382 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/19' 2022-04-03T21:52:24.382 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/15' 2022-04-03T21:52:24.382 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/31' 2022-04-03T21:52:24.383 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/36' 2022-04-03T21:52:24.383 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/20' 2022-04-03T21:52:24.383 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/12' 2022-04-03T21:52:24.384 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/39' 2022-04-03T21:52:24.384 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/10' 2022-04-03T21:52:24.384 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/34' 2022-04-03T21:52:24.384 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/38' 2022-04-03T21:52:24.385 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/11' 2022-04-03T21:52:24.385 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/16' 2022-04-03T21:52:24.385 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/32' 2022-04-03T21:52:24.386 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/30' 2022-04-03T21:52:24.386 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/14' 2022-04-03T21:52:24.386 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/18' 2022-04-03T21:52:24.386 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/13' 2022-04-03T21:52:24.387 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/33' 2022-04-03T21:52:24.387 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/17' 2022-04-03T21:52:24.387 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/35' 2022-04-03T21:52:24.388 INFO:tasks.workunit.client.0.smithi049.stdout:removed './191/37' 2022-04-03T21:52:24.388 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './191' 2022-04-03T21:52:24.388 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/19' 2022-04-03T21:52:24.389 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/15' 2022-04-03T21:52:24.389 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/31' 2022-04-03T21:52:24.389 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/36' 2022-04-03T21:52:24.390 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/20' 2022-04-03T21:52:24.390 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/12' 2022-04-03T21:52:24.391 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/39' 2022-04-03T21:52:24.391 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/10' 2022-04-03T21:52:24.391 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/34' 2022-04-03T21:52:24.392 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/38' 2022-04-03T21:52:24.392 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/11' 2022-04-03T21:52:24.393 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/16' 2022-04-03T21:52:24.393 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/32' 2022-04-03T21:52:24.393 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/30' 2022-04-03T21:52:24.394 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/14' 2022-04-03T21:52:24.394 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/18' 2022-04-03T21:52:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/13' 2022-04-03T21:52:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/33' 2022-04-03T21:52:24.396 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/17' 2022-04-03T21:52:24.396 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/35' 2022-04-03T21:52:24.396 INFO:tasks.workunit.client.0.smithi049.stdout:removed './192/37' 2022-04-03T21:52:24.397 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './192' 2022-04-03T21:52:24.397 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/19' 2022-04-03T21:52:24.398 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/15' 2022-04-03T21:52:24.398 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/31' 2022-04-03T21:52:24.399 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/36' 2022-04-03T21:52:24.399 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/20' 2022-04-03T21:52:24.399 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/12' 2022-04-03T21:52:24.400 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/39' 2022-04-03T21:52:24.400 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/10' 2022-04-03T21:52:24.401 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/34' 2022-04-03T21:52:24.401 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/38' 2022-04-03T21:52:24.402 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/11' 2022-04-03T21:52:24.402 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/16' 2022-04-03T21:52:24.402 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/32' 2022-04-03T21:52:24.403 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/30' 2022-04-03T21:52:24.403 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/14' 2022-04-03T21:52:24.404 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/18' 2022-04-03T21:52:24.404 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/13' 2022-04-03T21:52:24.405 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/33' 2022-04-03T21:52:24.405 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/17' 2022-04-03T21:52:24.405 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/35' 2022-04-03T21:52:24.406 INFO:tasks.workunit.client.0.smithi049.stdout:removed './193/37' 2022-04-03T21:52:24.406 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './193' 2022-04-03T21:52:24.407 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/19' 2022-04-03T21:52:24.407 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/15' 2022-04-03T21:52:24.408 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/31' 2022-04-03T21:52:24.408 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/36' 2022-04-03T21:52:24.408 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/20' 2022-04-03T21:52:24.409 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/12' 2022-04-03T21:52:24.409 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/39' 2022-04-03T21:52:24.410 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/10' 2022-04-03T21:52:24.410 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/34' 2022-04-03T21:52:24.411 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/38' 2022-04-03T21:52:24.411 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/11' 2022-04-03T21:52:24.412 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/16' 2022-04-03T21:52:24.412 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/32' 2022-04-03T21:52:24.413 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/30' 2022-04-03T21:52:24.413 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/14' 2022-04-03T21:52:24.413 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/18' 2022-04-03T21:52:24.414 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/13' 2022-04-03T21:52:24.414 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/33' 2022-04-03T21:52:24.415 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/17' 2022-04-03T21:52:24.415 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/35' 2022-04-03T21:52:24.416 INFO:tasks.workunit.client.0.smithi049.stdout:removed './194/37' 2022-04-03T21:52:24.416 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './194' 2022-04-03T21:52:24.416 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/19' 2022-04-03T21:52:24.417 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/15' 2022-04-03T21:52:24.417 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/31' 2022-04-03T21:52:24.418 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/36' 2022-04-03T21:52:24.418 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/20' 2022-04-03T21:52:24.419 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/12' 2022-04-03T21:52:24.419 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/39' 2022-04-03T21:52:24.419 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/10' 2022-04-03T21:52:24.420 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/34' 2022-04-03T21:52:24.420 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/38' 2022-04-03T21:52:24.420 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/11' 2022-04-03T21:52:24.421 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/16' 2022-04-03T21:52:24.421 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/32' 2022-04-03T21:52:24.421 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/30' 2022-04-03T21:52:24.421 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/14' 2022-04-03T21:52:24.422 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/18' 2022-04-03T21:52:24.422 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/13' 2022-04-03T21:52:24.422 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/33' 2022-04-03T21:52:24.422 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/17' 2022-04-03T21:52:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/35' 2022-04-03T21:52:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:removed './195/37' 2022-04-03T21:52:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './195' 2022-04-03T21:52:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/19' 2022-04-03T21:52:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/15' 2022-04-03T21:52:24.424 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/31' 2022-04-03T21:52:24.424 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/36' 2022-04-03T21:52:24.424 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/20' 2022-04-03T21:52:24.424 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/12' 2022-04-03T21:52:24.425 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/39' 2022-04-03T21:52:24.425 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/10' 2022-04-03T21:52:26.267 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/34' 2022-04-03T21:52:26.268 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/38' 2022-04-03T21:52:26.268 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/11' 2022-04-03T21:52:26.268 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/16' 2022-04-03T21:52:26.268 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/32' 2022-04-03T21:52:26.269 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/30' 2022-04-03T21:52:26.269 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/14' 2022-04-03T21:52:26.269 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/18' 2022-04-03T21:52:26.269 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/13' 2022-04-03T21:52:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/33' 2022-04-03T21:52:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/17' 2022-04-03T21:52:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/35' 2022-04-03T21:52:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:removed './196/37' 2022-04-03T21:52:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './196' 2022-04-03T21:52:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/19' 2022-04-03T21:52:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/15' 2022-04-03T21:52:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/31' 2022-04-03T21:52:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/36' 2022-04-03T21:52:26.272 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/20' 2022-04-03T21:52:26.272 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/12' 2022-04-03T21:52:26.272 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/39' 2022-04-03T21:52:26.272 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/10' 2022-04-03T21:52:26.273 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/34' 2022-04-03T21:52:26.273 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/38' 2022-04-03T21:52:26.273 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/11' 2022-04-03T21:52:26.273 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/16' 2022-04-03T21:52:26.273 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/32' 2022-04-03T21:52:26.274 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/30' 2022-04-03T21:52:26.274 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/14' 2022-04-03T21:52:26.274 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/18' 2022-04-03T21:52:26.274 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/13' 2022-04-03T21:52:26.275 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/33' 2022-04-03T21:52:26.275 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/17' 2022-04-03T21:52:26.275 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/35' 2022-04-03T21:52:26.275 INFO:tasks.workunit.client.0.smithi049.stdout:removed './197/37' 2022-04-03T21:52:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './197' 2022-04-03T21:52:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/19' 2022-04-03T21:52:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/15' 2022-04-03T21:52:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/31' 2022-04-03T21:52:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/36' 2022-04-03T21:52:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/20' 2022-04-03T21:52:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/12' 2022-04-03T21:52:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/39' 2022-04-03T21:52:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/10' 2022-04-03T21:52:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/34' 2022-04-03T21:52:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/38' 2022-04-03T21:52:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/11' 2022-04-03T21:52:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/16' 2022-04-03T21:52:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/32' 2022-04-03T21:52:26.279 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/30' 2022-04-03T21:52:26.279 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/14' 2022-04-03T21:52:26.279 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/18' 2022-04-03T21:52:26.279 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/13' 2022-04-03T21:52:26.280 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/33' 2022-04-03T21:52:26.280 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/17' 2022-04-03T21:52:26.280 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/35' 2022-04-03T21:52:26.280 INFO:tasks.workunit.client.0.smithi049.stdout:removed './198/37' 2022-04-03T21:52:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './198' 2022-04-03T21:52:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/19' 2022-04-03T21:52:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/15' 2022-04-03T21:52:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/31' 2022-04-03T21:52:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/36' 2022-04-03T21:52:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/20' 2022-04-03T21:52:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/12' 2022-04-03T21:52:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/39' 2022-04-03T21:52:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/10' 2022-04-03T21:52:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/34' 2022-04-03T21:52:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/38' 2022-04-03T21:52:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/11' 2022-04-03T21:52:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/16' 2022-04-03T21:52:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/32' 2022-04-03T21:52:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/30' 2022-04-03T21:52:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/14' 2022-04-03T21:52:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/18' 2022-04-03T21:52:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/13' 2022-04-03T21:52:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/33' 2022-04-03T21:52:26.285 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/17' 2022-04-03T21:52:26.285 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/35' 2022-04-03T21:52:26.285 INFO:tasks.workunit.client.0.smithi049.stdout:removed './199/37' 2022-04-03T21:52:26.285 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './199' 2022-04-03T21:52:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/21' 2022-04-03T21:52:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/27' 2022-04-03T21:52:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/31' 2022-04-03T21:52:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/36' 2022-04-03T21:52:26.287 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/20' 2022-04-03T21:52:26.287 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/39' 2022-04-03T21:52:26.287 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/34' 2022-04-03T21:52:26.287 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/38' 2022-04-03T21:52:26.288 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/28' 2022-04-03T21:52:26.288 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/24' 2022-04-03T21:52:26.288 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/29' 2022-04-03T21:52:26.289 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/32' 2022-04-03T21:52:26.289 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/22' 2022-04-03T21:52:26.289 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/25' 2022-04-03T21:52:26.289 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/30' 2022-04-03T21:52:26.289 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/33' 2022-04-03T21:52:26.290 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/23' 2022-04-03T21:52:26.290 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/35' 2022-04-03T21:52:26.290 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/26' 2022-04-03T21:52:26.291 INFO:tasks.workunit.client.0.smithi049.stdout:removed './200/37' 2022-04-03T21:52:26.291 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './200' 2022-04-03T21:52:26.291 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/21' 2022-04-03T21:52:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/27' 2022-04-03T21:52:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/31' 2022-04-03T21:52:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/36' 2022-04-03T21:52:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/20' 2022-04-03T21:52:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/39' 2022-04-03T21:52:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/34' 2022-04-03T21:52:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/38' 2022-04-03T21:52:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/28' 2022-04-03T21:52:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/24' 2022-04-03T21:52:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/29' 2022-04-03T21:52:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/32' 2022-04-03T21:52:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/22' 2022-04-03T21:52:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/25' 2022-04-03T21:52:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/30' 2022-04-03T21:52:26.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/33' 2022-04-03T21:52:26.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/23' 2022-04-03T21:52:26.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/35' 2022-04-03T21:52:26.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/26' 2022-04-03T21:52:26.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './201/37' 2022-04-03T21:52:26.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './201' 2022-04-03T21:52:26.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/21' 2022-04-03T21:52:26.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/27' 2022-04-03T21:52:26.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/31' 2022-04-03T21:52:26.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/36' 2022-04-03T21:52:26.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/20' 2022-04-03T21:52:26.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/39' 2022-04-03T21:52:26.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/34' 2022-04-03T21:52:26.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/38' 2022-04-03T21:52:26.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/28' 2022-04-03T21:52:26.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/24' 2022-04-03T21:52:26.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/29' 2022-04-03T21:52:26.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/32' 2022-04-03T21:52:26.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/22' 2022-04-03T21:52:26.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/25' 2022-04-03T21:52:26.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/30' 2022-04-03T21:52:26.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/33' 2022-04-03T21:52:26.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/23' 2022-04-03T21:52:26.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/35' 2022-04-03T21:52:26.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/26' 2022-04-03T21:52:26.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './202/37' 2022-04-03T21:52:26.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './202' 2022-04-03T21:52:26.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/21' 2022-04-03T21:52:26.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/27' 2022-04-03T21:52:26.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/31' 2022-04-03T21:52:26.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/36' 2022-04-03T21:52:26.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/20' 2022-04-03T21:52:26.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/39' 2022-04-03T21:52:26.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/34' 2022-04-03T21:52:26.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/38' 2022-04-03T21:52:26.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/28' 2022-04-03T21:52:26.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/24' 2022-04-03T21:52:26.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/29' 2022-04-03T21:52:26.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/32' 2022-04-03T21:52:26.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/22' 2022-04-03T21:52:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/25' 2022-04-03T21:52:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/30' 2022-04-03T21:52:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/33' 2022-04-03T21:52:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/23' 2022-04-03T21:52:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/35' 2022-04-03T21:52:26.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/26' 2022-04-03T21:52:26.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './203/37' 2022-04-03T21:52:26.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './203' 2022-04-03T21:52:26.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/21' 2022-04-03T21:52:26.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/27' 2022-04-03T21:52:26.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/31' 2022-04-03T21:52:26.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/36' 2022-04-03T21:52:26.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/20' 2022-04-03T21:52:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/39' 2022-04-03T21:52:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/34' 2022-04-03T21:52:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/38' 2022-04-03T21:52:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/28' 2022-04-03T21:52:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/24' 2022-04-03T21:52:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/29' 2022-04-03T21:52:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/32' 2022-04-03T21:52:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/22' 2022-04-03T21:52:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/25' 2022-04-03T21:52:26.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/30' 2022-04-03T21:52:26.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/33' 2022-04-03T21:52:26.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/23' 2022-04-03T21:52:26.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/35' 2022-04-03T21:52:26.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/26' 2022-04-03T21:52:26.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './204/37' 2022-04-03T21:52:26.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './204' 2022-04-03T21:52:26.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/21' 2022-04-03T21:52:26.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/27' 2022-04-03T21:52:26.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/31' 2022-04-03T21:52:26.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/36' 2022-04-03T21:52:26.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/20' 2022-04-03T21:52:26.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/39' 2022-04-03T21:52:26.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/34' 2022-04-03T21:52:26.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/38' 2022-04-03T21:52:26.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/28' 2022-04-03T21:52:26.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/24' 2022-04-03T21:52:26.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/29' 2022-04-03T21:52:26.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/32' 2022-04-03T21:52:26.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/22' 2022-04-03T21:52:26.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/25' 2022-04-03T21:52:26.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/30' 2022-04-03T21:52:26.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/33' 2022-04-03T21:52:26.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/23' 2022-04-03T21:52:26.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/35' 2022-04-03T21:52:26.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/26' 2022-04-03T21:52:26.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './205/37' 2022-04-03T21:52:26.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './205' 2022-04-03T21:52:26.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/21' 2022-04-03T21:52:26.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/27' 2022-04-03T21:52:26.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/31' 2022-04-03T21:52:26.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/36' 2022-04-03T21:52:26.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/20' 2022-04-03T21:52:26.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/39' 2022-04-03T21:52:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/34' 2022-04-03T21:52:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/38' 2022-04-03T21:52:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/28' 2022-04-03T21:52:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/24' 2022-04-03T21:52:26.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/29' 2022-04-03T21:52:26.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/32' 2022-04-03T21:52:26.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/22' 2022-04-03T21:52:26.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/25' 2022-04-03T21:52:26.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/30' 2022-04-03T21:52:26.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/33' 2022-04-03T21:52:26.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/23' 2022-04-03T21:52:26.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/35' 2022-04-03T21:52:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/26' 2022-04-03T21:52:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './206/37' 2022-04-03T21:52:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './206' 2022-04-03T21:52:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/21' 2022-04-03T21:52:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/27' 2022-04-03T21:52:26.700 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/31' 2022-04-03T21:52:26.700 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/36' 2022-04-03T21:52:26.700 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/20' 2022-04-03T21:52:26.700 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/39' 2022-04-03T21:52:26.701 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/34' 2022-04-03T21:52:26.701 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/38' 2022-04-03T21:52:26.701 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/28' 2022-04-03T21:52:26.701 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/24' 2022-04-03T21:52:26.702 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/29' 2022-04-03T21:52:26.702 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/32' 2022-04-03T21:52:26.702 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/22' 2022-04-03T21:52:26.702 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/25' 2022-04-03T21:52:26.702 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/30' 2022-04-03T21:52:26.703 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/33' 2022-04-03T21:52:26.703 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/23' 2022-04-03T21:52:26.703 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/35' 2022-04-03T21:52:26.703 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/26' 2022-04-03T21:52:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:removed './207/37' 2022-04-03T21:52:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './207' 2022-04-03T21:52:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/21' 2022-04-03T21:52:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/27' 2022-04-03T21:52:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/31' 2022-04-03T21:52:26.705 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/36' 2022-04-03T21:52:26.705 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/20' 2022-04-03T21:52:26.705 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/39' 2022-04-03T21:52:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/34' 2022-04-03T21:52:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/38' 2022-04-03T21:52:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/28' 2022-04-03T21:52:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/24' 2022-04-03T21:52:26.707 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/29' 2022-04-03T21:52:26.707 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/32' 2022-04-03T21:52:26.707 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/22' 2022-04-03T21:52:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/25' 2022-04-03T21:52:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/30' 2022-04-03T21:52:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/33' 2022-04-03T21:52:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/23' 2022-04-03T21:52:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/35' 2022-04-03T21:52:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/26' 2022-04-03T21:52:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:removed './208/37' 2022-04-03T21:52:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './208' 2022-04-03T21:52:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/21' 2022-04-03T21:52:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/27' 2022-04-03T21:52:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/31' 2022-04-03T21:52:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/36' 2022-04-03T21:52:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/20' 2022-04-03T21:52:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/39' 2022-04-03T21:52:26.711 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/34' 2022-04-03T21:52:26.711 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/38' 2022-04-03T21:52:26.711 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/28' 2022-04-03T21:52:26.711 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/24' 2022-04-03T21:52:26.712 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/29' 2022-04-03T21:52:26.712 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/32' 2022-04-03T21:52:26.712 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/22' 2022-04-03T21:52:26.712 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/25' 2022-04-03T21:52:26.712 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/30' 2022-04-03T21:52:26.713 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/33' 2022-04-03T21:52:26.713 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/23' 2022-04-03T21:52:26.713 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/35' 2022-04-03T21:52:26.713 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/26' 2022-04-03T21:52:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:removed './209/37' 2022-04-03T21:52:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './209' 2022-04-03T21:52:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/21' 2022-04-03T21:52:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/27' 2022-04-03T21:52:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/31' 2022-04-03T21:52:26.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/36' 2022-04-03T21:52:26.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/20' 2022-04-03T21:52:26.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/39' 2022-04-03T21:52:26.715 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/34' 2022-04-03T21:52:26.716 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/38' 2022-04-03T21:52:26.716 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/28' 2022-04-03T21:52:26.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/24' 2022-04-03T21:52:26.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/29' 2022-04-03T21:52:26.718 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/32' 2022-04-03T21:52:26.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/22' 2022-04-03T21:52:26.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/25' 2022-04-03T21:52:26.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/30' 2022-04-03T21:52:26.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/33' 2022-04-03T21:52:26.719 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/23' 2022-04-03T21:52:26.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/35' 2022-04-03T21:52:26.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/26' 2022-04-03T21:52:26.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed './210/37' 2022-04-03T21:52:26.720 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './210' 2022-04-03T21:52:26.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/21' 2022-04-03T21:52:26.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/27' 2022-04-03T21:52:26.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/31' 2022-04-03T21:52:26.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/36' 2022-04-03T21:52:26.721 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/20' 2022-04-03T21:52:26.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/39' 2022-04-03T21:52:26.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/34' 2022-04-03T21:52:26.722 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/38' 2022-04-03T21:52:26.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/28' 2022-04-03T21:52:26.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/24' 2022-04-03T21:52:26.723 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/29' 2022-04-03T21:52:26.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/32' 2022-04-03T21:52:26.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/22' 2022-04-03T21:52:26.724 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/25' 2022-04-03T21:52:26.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/30' 2022-04-03T21:52:26.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/33' 2022-04-03T21:52:26.725 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/23' 2022-04-03T21:52:26.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/35' 2022-04-03T21:52:26.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/26' 2022-04-03T21:52:26.726 INFO:tasks.workunit.client.0.smithi049.stdout:removed './211/37' 2022-04-03T21:52:26.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './211' 2022-04-03T21:52:26.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/21' 2022-04-03T21:52:26.727 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/27' 2022-04-03T21:52:26.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/31' 2022-04-03T21:52:26.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/36' 2022-04-03T21:52:26.728 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/20' 2022-04-03T21:52:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/39' 2022-04-03T21:52:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/34' 2022-04-03T21:52:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/38' 2022-04-03T21:52:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/28' 2022-04-03T21:52:26.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/24' 2022-04-03T21:52:26.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/29' 2022-04-03T21:52:26.730 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/32' 2022-04-03T21:52:26.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/22' 2022-04-03T21:52:26.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/25' 2022-04-03T21:52:26.731 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/30' 2022-04-03T21:52:26.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/33' 2022-04-03T21:52:26.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/23' 2022-04-03T21:52:26.732 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/35' 2022-04-03T21:52:26.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/26' 2022-04-03T21:52:26.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed './212/37' 2022-04-03T21:52:26.733 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './212' 2022-04-03T21:52:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/21' 2022-04-03T21:52:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/27' 2022-04-03T21:52:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/31' 2022-04-03T21:52:26.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/36' 2022-04-03T21:52:26.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/20' 2022-04-03T21:52:26.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/39' 2022-04-03T21:52:26.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/34' 2022-04-03T21:52:26.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/38' 2022-04-03T21:52:26.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/28' 2022-04-03T21:52:26.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/24' 2022-04-03T21:52:26.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/29' 2022-04-03T21:52:26.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/32' 2022-04-03T21:52:26.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/22' 2022-04-03T21:52:26.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/25' 2022-04-03T21:52:26.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/30' 2022-04-03T21:52:26.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/33' 2022-04-03T21:52:26.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/23' 2022-04-03T21:52:26.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/35' 2022-04-03T21:52:26.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/26' 2022-04-03T21:52:26.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './213/37' 2022-04-03T21:52:26.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './213' 2022-04-03T21:52:26.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/21' 2022-04-03T21:52:26.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/27' 2022-04-03T21:52:26.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/31' 2022-04-03T21:52:26.741 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/36' 2022-04-03T21:52:26.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/20' 2022-04-03T21:52:26.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/39' 2022-04-03T21:52:26.742 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/34' 2022-04-03T21:52:26.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/38' 2022-04-03T21:52:26.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/28' 2022-04-03T21:52:26.743 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/24' 2022-04-03T21:52:26.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/29' 2022-04-03T21:52:26.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/32' 2022-04-03T21:52:26.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/22' 2022-04-03T21:52:26.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/25' 2022-04-03T21:52:26.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/30' 2022-04-03T21:52:26.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/33' 2022-04-03T21:52:26.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/23' 2022-04-03T21:52:26.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/35' 2022-04-03T21:52:26.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/26' 2022-04-03T21:52:26.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './214/37' 2022-04-03T21:52:26.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './214' 2022-04-03T21:52:26.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/21' 2022-04-03T21:52:26.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/27' 2022-04-03T21:52:26.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/31' 2022-04-03T21:52:26.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/36' 2022-04-03T21:52:26.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/20' 2022-04-03T21:52:26.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/39' 2022-04-03T21:52:26.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/34' 2022-04-03T21:52:26.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/38' 2022-04-03T21:52:26.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/28' 2022-04-03T21:52:26.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/24' 2022-04-03T21:52:26.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/29' 2022-04-03T21:52:26.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/32' 2022-04-03T21:52:26.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/22' 2022-04-03T21:52:26.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/25' 2022-04-03T21:52:26.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/30' 2022-04-03T21:52:26.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/33' 2022-04-03T21:52:26.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/23' 2022-04-03T21:52:26.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/35' 2022-04-03T21:52:26.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/26' 2022-04-03T21:52:26.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './215/37' 2022-04-03T21:52:26.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './215' 2022-04-03T21:52:26.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/21' 2022-04-03T21:52:26.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/27' 2022-04-03T21:52:26.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/31' 2022-04-03T21:52:26.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/36' 2022-04-03T21:52:26.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/20' 2022-04-03T21:52:26.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/39' 2022-04-03T21:52:26.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/34' 2022-04-03T21:52:26.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/38' 2022-04-03T21:52:27.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/28' 2022-04-03T21:52:27.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/24' 2022-04-03T21:52:27.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/29' 2022-04-03T21:52:27.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/32' 2022-04-03T21:52:27.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/22' 2022-04-03T21:52:27.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/25' 2022-04-03T21:52:27.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/30' 2022-04-03T21:52:27.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/33' 2022-04-03T21:52:27.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/23' 2022-04-03T21:52:27.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/35' 2022-04-03T21:52:27.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/26' 2022-04-03T21:52:27.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './216/37' 2022-04-03T21:52:27.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './216' 2022-04-03T21:52:27.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/21' 2022-04-03T21:52:27.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/27' 2022-04-03T21:52:27.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/31' 2022-04-03T21:52:27.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/36' 2022-04-03T21:52:27.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/20' 2022-04-03T21:52:27.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/39' 2022-04-03T21:52:27.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/34' 2022-04-03T21:52:27.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/38' 2022-04-03T21:52:27.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/28' 2022-04-03T21:52:27.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/24' 2022-04-03T21:52:27.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/29' 2022-04-03T21:52:27.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/32' 2022-04-03T21:52:27.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/22' 2022-04-03T21:52:27.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/25' 2022-04-03T21:52:27.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/30' 2022-04-03T21:52:27.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/33' 2022-04-03T21:52:27.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/23' 2022-04-03T21:52:27.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/35' 2022-04-03T21:52:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/26' 2022-04-03T21:52:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './217/37' 2022-04-03T21:52:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './217' 2022-04-03T21:52:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/21' 2022-04-03T21:52:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/27' 2022-04-03T21:52:27.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/31' 2022-04-03T21:52:27.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/36' 2022-04-03T21:52:27.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/20' 2022-04-03T21:52:27.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/39' 2022-04-03T21:52:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/34' 2022-04-03T21:52:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/38' 2022-04-03T21:52:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/28' 2022-04-03T21:52:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/24' 2022-04-03T21:52:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/29' 2022-04-03T21:52:27.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/32' 2022-04-03T21:52:27.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/22' 2022-04-03T21:52:27.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/25' 2022-04-03T21:52:27.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/30' 2022-04-03T21:52:27.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/33' 2022-04-03T21:52:27.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/23' 2022-04-03T21:52:27.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/35' 2022-04-03T21:52:27.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/26' 2022-04-03T21:52:27.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './218/37' 2022-04-03T21:52:27.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './218' 2022-04-03T21:52:27.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/21' 2022-04-03T21:52:27.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/27' 2022-04-03T21:52:27.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/31' 2022-04-03T21:52:27.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/36' 2022-04-03T21:52:27.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/20' 2022-04-03T21:52:27.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/39' 2022-04-03T21:52:27.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/34' 2022-04-03T21:52:27.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/38' 2022-04-03T21:52:27.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/28' 2022-04-03T21:52:27.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/24' 2022-04-03T21:52:27.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/29' 2022-04-03T21:52:27.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/32' 2022-04-03T21:52:27.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/22' 2022-04-03T21:52:27.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/25' 2022-04-03T21:52:27.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/30' 2022-04-03T21:52:27.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/33' 2022-04-03T21:52:27.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/23' 2022-04-03T21:52:27.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/35' 2022-04-03T21:52:27.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/26' 2022-04-03T21:52:27.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './219/37' 2022-04-03T21:52:27.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './219' 2022-04-03T21:52:27.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/21' 2022-04-03T21:52:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/27' 2022-04-03T21:52:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/31' 2022-04-03T21:52:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/36' 2022-04-03T21:52:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/20' 2022-04-03T21:52:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/39' 2022-04-03T21:52:27.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/34' 2022-04-03T21:52:27.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/38' 2022-04-03T21:52:27.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/28' 2022-04-03T21:52:27.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/24' 2022-04-03T21:52:27.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/29' 2022-04-03T21:52:27.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/32' 2022-04-03T21:52:27.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/22' 2022-04-03T21:52:27.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/25' 2022-04-03T21:52:27.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/30' 2022-04-03T21:52:27.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/33' 2022-04-03T21:52:27.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/23' 2022-04-03T21:52:27.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/35' 2022-04-03T21:52:27.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/26' 2022-04-03T21:52:27.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './220/37' 2022-04-03T21:52:27.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './220' 2022-04-03T21:52:27.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/21' 2022-04-03T21:52:27.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/27' 2022-04-03T21:52:27.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/31' 2022-04-03T21:52:27.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/36' 2022-04-03T21:52:27.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/20' 2022-04-03T21:52:27.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/39' 2022-04-03T21:52:27.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/34' 2022-04-03T21:52:27.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/38' 2022-04-03T21:52:27.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/28' 2022-04-03T21:52:27.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/24' 2022-04-03T21:52:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/29' 2022-04-03T21:52:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/32' 2022-04-03T21:52:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/22' 2022-04-03T21:52:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/25' 2022-04-03T21:52:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/30' 2022-04-03T21:52:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/33' 2022-04-03T21:52:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/23' 2022-04-03T21:52:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/35' 2022-04-03T21:52:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/26' 2022-04-03T21:52:27.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './221/37' 2022-04-03T21:52:27.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './221' 2022-04-03T21:52:27.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/21' 2022-04-03T21:52:27.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/27' 2022-04-03T21:52:27.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/31' 2022-04-03T21:52:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/36' 2022-04-03T21:52:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/20' 2022-04-03T21:52:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/39' 2022-04-03T21:52:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/34' 2022-04-03T21:52:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/38' 2022-04-03T21:52:27.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/28' 2022-04-03T21:52:27.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/24' 2022-04-03T21:52:27.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/29' 2022-04-03T21:52:27.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/32' 2022-04-03T21:52:27.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/22' 2022-04-03T21:52:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/25' 2022-04-03T21:52:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/30' 2022-04-03T21:52:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/33' 2022-04-03T21:52:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/23' 2022-04-03T21:52:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/35' 2022-04-03T21:52:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/26' 2022-04-03T21:52:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './222/37' 2022-04-03T21:52:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './222' 2022-04-03T21:52:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/21' 2022-04-03T21:52:27.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/27' 2022-04-03T21:52:27.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/31' 2022-04-03T21:52:27.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/36' 2022-04-03T21:52:27.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/20' 2022-04-03T21:52:27.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/39' 2022-04-03T21:52:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/34' 2022-04-03T21:52:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/38' 2022-04-03T21:52:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/28' 2022-04-03T21:52:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/24' 2022-04-03T21:52:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/29' 2022-04-03T21:52:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/32' 2022-04-03T21:52:27.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/22' 2022-04-03T21:52:27.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/25' 2022-04-03T21:52:27.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/30' 2022-04-03T21:52:27.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/33' 2022-04-03T21:52:27.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/23' 2022-04-03T21:52:27.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/35' 2022-04-03T21:52:27.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/26' 2022-04-03T21:52:27.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './223/37' 2022-04-03T21:52:27.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './223' 2022-04-03T21:52:27.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/21' 2022-04-03T21:52:27.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/27' 2022-04-03T21:52:27.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/31' 2022-04-03T21:52:27.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/36' 2022-04-03T21:52:27.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/20' 2022-04-03T21:52:27.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/39' 2022-04-03T21:52:27.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/34' 2022-04-03T21:52:27.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/38' 2022-04-03T21:52:27.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/28' 2022-04-03T21:52:27.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/24' 2022-04-03T21:52:27.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/29' 2022-04-03T21:52:27.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/32' 2022-04-03T21:52:27.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/22' 2022-04-03T21:52:27.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/25' 2022-04-03T21:52:27.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/30' 2022-04-03T21:52:27.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/33' 2022-04-03T21:52:27.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/23' 2022-04-03T21:52:27.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/35' 2022-04-03T21:52:27.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/26' 2022-04-03T21:52:27.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './224/37' 2022-04-03T21:52:27.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './224' 2022-04-03T21:52:27.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/21' 2022-04-03T21:52:27.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/27' 2022-04-03T21:52:27.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/31' 2022-04-03T21:52:27.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/36' 2022-04-03T21:52:27.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/20' 2022-04-03T21:52:27.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/39' 2022-04-03T21:52:27.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/34' 2022-04-03T21:52:27.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/38' 2022-04-03T21:52:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/28' 2022-04-03T21:52:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/24' 2022-04-03T21:52:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/29' 2022-04-03T21:52:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/32' 2022-04-03T21:52:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/22' 2022-04-03T21:52:27.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/25' 2022-04-03T21:52:27.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/30' 2022-04-03T21:52:27.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/33' 2022-04-03T21:52:27.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/23' 2022-04-03T21:52:27.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/35' 2022-04-03T21:52:27.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/26' 2022-04-03T21:52:27.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './225/37' 2022-04-03T21:52:27.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './225' 2022-04-03T21:52:27.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/21' 2022-04-03T21:52:27.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/27' 2022-04-03T21:52:27.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/31' 2022-04-03T21:52:27.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/36' 2022-04-03T21:52:27.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/20' 2022-04-03T21:52:27.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/39' 2022-04-03T21:52:27.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/34' 2022-04-03T21:52:27.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/38' 2022-04-03T21:52:27.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/28' 2022-04-03T21:52:27.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/24' 2022-04-03T21:52:27.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/29' 2022-04-03T21:52:27.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/32' 2022-04-03T21:52:27.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/22' 2022-04-03T21:52:27.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/25' 2022-04-03T21:52:27.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/30' 2022-04-03T21:52:27.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/33' 2022-04-03T21:52:27.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/23' 2022-04-03T21:52:27.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/35' 2022-04-03T21:52:27.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/26' 2022-04-03T21:52:27.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './226/37' 2022-04-03T21:52:27.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './226' 2022-04-03T21:52:27.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/21' 2022-04-03T21:52:27.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/27' 2022-04-03T21:52:27.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/31' 2022-04-03T21:52:27.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/36' 2022-04-03T21:52:27.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/20' 2022-04-03T21:52:27.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/39' 2022-04-03T21:52:27.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/34' 2022-04-03T21:52:27.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/38' 2022-04-03T21:52:27.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/28' 2022-04-03T21:52:27.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/24' 2022-04-03T21:52:27.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/29' 2022-04-03T21:52:27.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/32' 2022-04-03T21:52:27.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/22' 2022-04-03T21:52:27.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/25' 2022-04-03T21:52:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/30' 2022-04-03T21:52:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/33' 2022-04-03T21:52:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/23' 2022-04-03T21:52:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/35' 2022-04-03T21:52:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/26' 2022-04-03T21:52:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './227/37' 2022-04-03T21:52:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './227' 2022-04-03T21:52:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/21' 2022-04-03T21:52:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/27' 2022-04-03T21:52:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/31' 2022-04-03T21:52:27.662 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/36' 2022-04-03T21:52:27.662 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/20' 2022-04-03T21:52:27.662 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/39' 2022-04-03T21:52:27.662 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/34' 2022-04-03T21:52:27.663 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/38' 2022-04-03T21:52:27.663 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/28' 2022-04-03T21:52:27.663 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/24' 2022-04-03T21:52:27.663 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/29' 2022-04-03T21:52:27.663 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/32' 2022-04-03T21:52:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/22' 2022-04-03T21:52:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/25' 2022-04-03T21:52:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/30' 2022-04-03T21:52:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/33' 2022-04-03T21:52:27.665 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/23' 2022-04-03T21:52:27.665 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/35' 2022-04-03T21:52:27.665 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/26' 2022-04-03T21:52:27.665 INFO:tasks.workunit.client.0.smithi049.stdout:removed './228/37' 2022-04-03T21:52:27.665 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './228' 2022-04-03T21:52:27.666 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/21' 2022-04-03T21:52:27.666 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/27' 2022-04-03T21:52:27.666 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/31' 2022-04-03T21:52:27.666 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/36' 2022-04-03T21:52:27.667 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/20' 2022-04-03T21:52:27.667 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/39' 2022-04-03T21:52:27.667 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/34' 2022-04-03T21:52:27.667 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/38' 2022-04-03T21:52:27.667 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/28' 2022-04-03T21:52:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/24' 2022-04-03T21:52:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/29' 2022-04-03T21:52:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/32' 2022-04-03T21:52:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/22' 2022-04-03T21:52:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/25' 2022-04-03T21:52:27.669 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/30' 2022-04-03T21:52:27.669 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/33' 2022-04-03T21:52:27.669 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/23' 2022-04-03T21:52:27.669 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/35' 2022-04-03T21:52:27.670 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/26' 2022-04-03T21:52:27.670 INFO:tasks.workunit.client.0.smithi049.stdout:removed './229/37' 2022-04-03T21:52:27.670 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './229' 2022-04-03T21:52:27.670 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/21' 2022-04-03T21:52:27.670 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/27' 2022-04-03T21:52:27.671 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/31' 2022-04-03T21:52:27.671 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/36' 2022-04-03T21:52:27.671 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/20' 2022-04-03T21:52:27.671 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/39' 2022-04-03T21:52:27.672 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/34' 2022-04-03T21:52:27.672 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/38' 2022-04-03T21:52:27.672 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/28' 2022-04-03T21:52:27.672 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/24' 2022-04-03T21:52:27.672 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/29' 2022-04-03T21:52:27.673 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/32' 2022-04-03T21:52:27.673 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/22' 2022-04-03T21:52:27.673 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/25' 2022-04-03T21:52:27.673 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/30' 2022-04-03T21:52:27.673 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/33' 2022-04-03T21:52:27.674 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/23' 2022-04-03T21:52:27.674 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/35' 2022-04-03T21:52:27.674 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/26' 2022-04-03T21:52:27.674 INFO:tasks.workunit.client.0.smithi049.stdout:removed './230/37' 2022-04-03T21:52:27.675 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './230' 2022-04-03T21:52:27.675 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/21' 2022-04-03T21:52:27.675 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/27' 2022-04-03T21:52:27.675 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/31' 2022-04-03T21:52:27.675 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/36' 2022-04-03T21:52:27.676 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/20' 2022-04-03T21:52:27.676 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/39' 2022-04-03T21:52:27.676 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/34' 2022-04-03T21:52:27.676 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/38' 2022-04-03T21:52:27.677 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/28' 2022-04-03T21:52:27.677 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/24' 2022-04-03T21:52:27.677 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/29' 2022-04-03T21:52:27.677 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/32' 2022-04-03T21:52:27.677 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/22' 2022-04-03T21:52:27.678 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/25' 2022-04-03T21:52:27.678 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/30' 2022-04-03T21:52:27.678 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/33' 2022-04-03T21:52:27.678 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/23' 2022-04-03T21:52:27.678 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/35' 2022-04-03T21:52:27.679 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/26' 2022-04-03T21:52:27.679 INFO:tasks.workunit.client.0.smithi049.stdout:removed './231/37' 2022-04-03T21:52:27.679 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './231' 2022-04-03T21:52:27.679 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/21' 2022-04-03T21:52:27.679 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/27' 2022-04-03T21:52:27.680 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/31' 2022-04-03T21:52:27.680 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/36' 2022-04-03T21:52:27.680 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/20' 2022-04-03T21:52:27.680 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/39' 2022-04-03T21:52:27.680 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/34' 2022-04-03T21:52:27.681 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/38' 2022-04-03T21:52:27.681 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/28' 2022-04-03T21:52:27.681 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/24' 2022-04-03T21:52:27.681 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/29' 2022-04-03T21:52:27.682 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/32' 2022-04-03T21:52:27.682 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/22' 2022-04-03T21:52:27.682 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/25' 2022-04-03T21:52:27.682 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/30' 2022-04-03T21:52:27.682 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/33' 2022-04-03T21:52:27.683 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/23' 2022-04-03T21:52:27.683 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/35' 2022-04-03T21:52:27.683 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/26' 2022-04-03T21:52:27.683 INFO:tasks.workunit.client.0.smithi049.stdout:removed './232/37' 2022-04-03T21:52:27.683 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './232' 2022-04-03T21:52:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/21' 2022-04-03T21:52:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/27' 2022-04-03T21:52:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/31' 2022-04-03T21:52:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/36' 2022-04-03T21:52:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/20' 2022-04-03T21:52:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/39' 2022-04-03T21:52:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/34' 2022-04-03T21:52:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/38' 2022-04-03T21:52:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/28' 2022-04-03T21:52:27.686 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/24' 2022-04-03T21:52:27.686 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/29' 2022-04-03T21:52:27.686 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/32' 2022-04-03T21:52:27.686 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/22' 2022-04-03T21:52:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/25' 2022-04-03T21:52:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/30' 2022-04-03T21:52:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/33' 2022-04-03T21:52:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/23' 2022-04-03T21:52:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/35' 2022-04-03T21:52:27.688 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/26' 2022-04-03T21:52:27.688 INFO:tasks.workunit.client.0.smithi049.stdout:removed './233/37' 2022-04-03T21:52:27.688 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './233' 2022-04-03T21:52:27.688 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/21' 2022-04-03T21:52:27.688 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/27' 2022-04-03T21:52:27.689 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/31' 2022-04-03T21:52:27.689 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/36' 2022-04-03T21:52:27.689 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/20' 2022-04-03T21:52:27.689 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/39' 2022-04-03T21:52:27.690 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/34' 2022-04-03T21:52:27.690 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/38' 2022-04-03T21:52:27.690 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/28' 2022-04-03T21:52:27.690 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/24' 2022-04-03T21:52:27.690 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/29' 2022-04-03T21:52:27.691 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/32' 2022-04-03T21:52:27.691 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/22' 2022-04-03T21:52:27.691 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/25' 2022-04-03T21:52:27.691 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/30' 2022-04-03T21:52:27.691 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/33' 2022-04-03T21:52:27.692 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/23' 2022-04-03T21:52:27.692 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/35' 2022-04-03T21:52:27.692 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/26' 2022-04-03T21:52:27.692 INFO:tasks.workunit.client.0.smithi049.stdout:removed './234/37' 2022-04-03T21:52:27.692 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './234' 2022-04-03T21:52:27.693 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/21' 2022-04-03T21:52:27.693 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/27' 2022-04-03T21:52:27.693 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/31' 2022-04-03T21:52:27.693 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/36' 2022-04-03T21:52:27.693 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/20' 2022-04-03T21:52:27.694 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/39' 2022-04-03T21:52:27.694 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/34' 2022-04-03T21:52:27.694 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/38' 2022-04-03T21:52:27.694 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/28' 2022-04-03T21:52:27.694 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/24' 2022-04-03T21:52:27.695 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/29' 2022-04-03T21:52:27.695 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/32' 2022-04-03T21:52:27.695 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/22' 2022-04-03T21:52:27.695 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/25' 2022-04-03T21:52:27.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/30' 2022-04-03T21:52:27.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/33' 2022-04-03T21:52:27.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/23' 2022-04-03T21:52:27.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/35' 2022-04-03T21:52:27.696 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/26' 2022-04-03T21:52:27.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './235/37' 2022-04-03T21:52:27.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './235' 2022-04-03T21:52:27.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/21' 2022-04-03T21:52:27.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/27' 2022-04-03T21:52:27.697 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/31' 2022-04-03T21:52:27.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/36' 2022-04-03T21:52:27.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/20' 2022-04-03T21:52:27.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/39' 2022-04-03T21:52:27.698 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/34' 2022-04-03T21:52:27.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/38' 2022-04-03T21:52:27.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/28' 2022-04-03T21:52:27.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/24' 2022-04-03T21:52:27.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/29' 2022-04-03T21:52:27.699 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/32' 2022-04-03T21:52:28.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/22' 2022-04-03T21:52:28.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/25' 2022-04-03T21:52:28.890 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/30' 2022-04-03T21:52:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/33' 2022-04-03T21:52:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/23' 2022-04-03T21:52:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/35' 2022-04-03T21:52:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/26' 2022-04-03T21:52:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:removed './236/37' 2022-04-03T21:52:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './236' 2022-04-03T21:52:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/21' 2022-04-03T21:52:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/27' 2022-04-03T21:52:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/31' 2022-04-03T21:52:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/36' 2022-04-03T21:52:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/20' 2022-04-03T21:52:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/39' 2022-04-03T21:52:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/34' 2022-04-03T21:52:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/38' 2022-04-03T21:52:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/28' 2022-04-03T21:52:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/24' 2022-04-03T21:52:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/29' 2022-04-03T21:52:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/32' 2022-04-03T21:52:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/22' 2022-04-03T21:52:28.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/25' 2022-04-03T21:52:28.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/30' 2022-04-03T21:52:28.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/33' 2022-04-03T21:52:28.895 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/23' 2022-04-03T21:52:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/35' 2022-04-03T21:52:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/26' 2022-04-03T21:52:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './237/37' 2022-04-03T21:52:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './237' 2022-04-03T21:52:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/21' 2022-04-03T21:52:28.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/27' 2022-04-03T21:52:28.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/31' 2022-04-03T21:52:28.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/36' 2022-04-03T21:52:28.897 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/20' 2022-04-03T21:52:28.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/39' 2022-04-03T21:52:28.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/34' 2022-04-03T21:52:28.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/38' 2022-04-03T21:52:28.898 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/28' 2022-04-03T21:52:28.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/24' 2022-04-03T21:52:28.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/29' 2022-04-03T21:52:28.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/32' 2022-04-03T21:52:28.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/22' 2022-04-03T21:52:28.899 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/25' 2022-04-03T21:52:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/30' 2022-04-03T21:52:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/33' 2022-04-03T21:52:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/23' 2022-04-03T21:52:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/35' 2022-04-03T21:52:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/26' 2022-04-03T21:52:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './238/37' 2022-04-03T21:52:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './238' 2022-04-03T21:52:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/21' 2022-04-03T21:52:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/27' 2022-04-03T21:52:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/31' 2022-04-03T21:52:28.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/36' 2022-04-03T21:52:28.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/20' 2022-04-03T21:52:28.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/39' 2022-04-03T21:52:28.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/34' 2022-04-03T21:52:28.902 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/38' 2022-04-03T21:52:28.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/28' 2022-04-03T21:52:28.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/24' 2022-04-03T21:52:28.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/29' 2022-04-03T21:52:28.903 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/32' 2022-04-03T21:52:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/22' 2022-04-03T21:52:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/25' 2022-04-03T21:52:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/30' 2022-04-03T21:52:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/33' 2022-04-03T21:52:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/23' 2022-04-03T21:52:28.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/35' 2022-04-03T21:52:28.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/26' 2022-04-03T21:52:28.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './239/37' 2022-04-03T21:52:28.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './239' 2022-04-03T21:52:28.905 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/21' 2022-04-03T21:52:28.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/27' 2022-04-03T21:52:28.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/31' 2022-04-03T21:52:28.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/36' 2022-04-03T21:52:28.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/20' 2022-04-03T21:52:28.906 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/39' 2022-04-03T21:52:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/34' 2022-04-03T21:52:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/38' 2022-04-03T21:52:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/28' 2022-04-03T21:52:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/24' 2022-04-03T21:52:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/29' 2022-04-03T21:52:28.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/32' 2022-04-03T21:52:28.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/22' 2022-04-03T21:52:28.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/25' 2022-04-03T21:52:28.908 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/30' 2022-04-03T21:52:28.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/33' 2022-04-03T21:52:28.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/23' 2022-04-03T21:52:28.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/35' 2022-04-03T21:52:28.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/26' 2022-04-03T21:52:28.909 INFO:tasks.workunit.client.0.smithi049.stdout:removed './240/37' 2022-04-03T21:52:28.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './240' 2022-04-03T21:52:28.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/21' 2022-04-03T21:52:28.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/27' 2022-04-03T21:52:28.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/31' 2022-04-03T21:52:28.910 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/36' 2022-04-03T21:52:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/20' 2022-04-03T21:52:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/39' 2022-04-03T21:52:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/34' 2022-04-03T21:52:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/38' 2022-04-03T21:52:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/28' 2022-04-03T21:52:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/24' 2022-04-03T21:52:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/29' 2022-04-03T21:52:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/32' 2022-04-03T21:52:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/22' 2022-04-03T21:52:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/25' 2022-04-03T21:52:28.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/30' 2022-04-03T21:52:28.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/33' 2022-04-03T21:52:28.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/23' 2022-04-03T21:52:28.913 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/35' 2022-04-03T21:52:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/26' 2022-04-03T21:52:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './241/37' 2022-04-03T21:52:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './241' 2022-04-03T21:52:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/21' 2022-04-03T21:52:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/27' 2022-04-03T21:52:28.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/31' 2022-04-03T21:52:28.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/36' 2022-04-03T21:52:28.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/20' 2022-04-03T21:52:28.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/39' 2022-04-03T21:52:28.915 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/34' 2022-04-03T21:52:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/38' 2022-04-03T21:52:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/28' 2022-04-03T21:52:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/24' 2022-04-03T21:52:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/29' 2022-04-03T21:52:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/32' 2022-04-03T21:52:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/22' 2022-04-03T21:52:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/25' 2022-04-03T21:52:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/30' 2022-04-03T21:52:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/33' 2022-04-03T21:52:28.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/23' 2022-04-03T21:52:28.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/35' 2022-04-03T21:52:28.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/26' 2022-04-03T21:52:28.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed './242/37' 2022-04-03T21:52:28.918 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './242' 2022-04-03T21:52:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/21' 2022-04-03T21:52:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/27' 2022-04-03T21:52:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/31' 2022-04-03T21:52:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/36' 2022-04-03T21:52:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/20' 2022-04-03T21:52:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/39' 2022-04-03T21:52:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/34' 2022-04-03T21:52:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/38' 2022-04-03T21:52:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/28' 2022-04-03T21:52:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/24' 2022-04-03T21:52:28.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/29' 2022-04-03T21:52:28.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/32' 2022-04-03T21:52:28.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/22' 2022-04-03T21:52:28.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/25' 2022-04-03T21:52:28.921 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/30' 2022-04-03T21:52:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/33' 2022-04-03T21:52:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/23' 2022-04-03T21:52:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/35' 2022-04-03T21:52:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/26' 2022-04-03T21:52:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:removed './243/37' 2022-04-03T21:52:28.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './243' 2022-04-03T21:52:28.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/21' 2022-04-03T21:52:28.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/27' 2022-04-03T21:52:28.923 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/31' 2022-04-03T21:52:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/36' 2022-04-03T21:52:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/20' 2022-04-03T21:52:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/39' 2022-04-03T21:52:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/34' 2022-04-03T21:52:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/38' 2022-04-03T21:52:28.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/28' 2022-04-03T21:52:28.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/24' 2022-04-03T21:52:28.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/29' 2022-04-03T21:52:28.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/32' 2022-04-03T21:52:28.925 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/22' 2022-04-03T21:52:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/25' 2022-04-03T21:52:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/30' 2022-04-03T21:52:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/33' 2022-04-03T21:52:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/23' 2022-04-03T21:52:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/35' 2022-04-03T21:52:28.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/26' 2022-04-03T21:52:28.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './244/37' 2022-04-03T21:52:28.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './244' 2022-04-03T21:52:28.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/21' 2022-04-03T21:52:28.927 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/27' 2022-04-03T21:52:28.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/31' 2022-04-03T21:52:28.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/36' 2022-04-03T21:52:28.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/20' 2022-04-03T21:52:28.928 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/39' 2022-04-03T21:52:28.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/34' 2022-04-03T21:52:28.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/38' 2022-04-03T21:52:28.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/28' 2022-04-03T21:52:28.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/24' 2022-04-03T21:52:28.929 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/29' 2022-04-03T21:52:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/32' 2022-04-03T21:52:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/22' 2022-04-03T21:52:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/25' 2022-04-03T21:52:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/30' 2022-04-03T21:52:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/33' 2022-04-03T21:52:28.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/23' 2022-04-03T21:52:28.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/35' 2022-04-03T21:52:28.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/26' 2022-04-03T21:52:28.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed './245/37' 2022-04-03T21:52:28.931 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './245' 2022-04-03T21:52:28.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/21' 2022-04-03T21:52:28.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/27' 2022-04-03T21:52:28.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/31' 2022-04-03T21:52:28.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/36' 2022-04-03T21:52:28.932 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/20' 2022-04-03T21:52:28.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/39' 2022-04-03T21:52:28.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/34' 2022-04-03T21:52:28.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/38' 2022-04-03T21:52:28.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/28' 2022-04-03T21:52:28.933 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/24' 2022-04-03T21:52:28.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/29' 2022-04-03T21:52:28.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/32' 2022-04-03T21:52:28.934 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/22' 2022-04-03T21:52:29.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/25' 2022-04-03T21:52:29.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/30' 2022-04-03T21:52:29.329 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/33' 2022-04-03T21:52:29.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/23' 2022-04-03T21:52:29.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/35' 2022-04-03T21:52:29.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/26' 2022-04-03T21:52:29.330 INFO:tasks.workunit.client.0.smithi049.stdout:removed './246/37' 2022-04-03T21:52:29.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './246' 2022-04-03T21:52:29.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/21' 2022-04-03T21:52:29.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/27' 2022-04-03T21:52:29.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/31' 2022-04-03T21:52:29.331 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/36' 2022-04-03T21:52:29.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/20' 2022-04-03T21:52:29.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/39' 2022-04-03T21:52:29.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/34' 2022-04-03T21:52:29.332 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/38' 2022-04-03T21:52:29.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/28' 2022-04-03T21:52:29.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/24' 2022-04-03T21:52:29.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/29' 2022-04-03T21:52:29.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/32' 2022-04-03T21:52:29.333 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/22' 2022-04-03T21:52:29.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/25' 2022-04-03T21:52:29.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/30' 2022-04-03T21:52:29.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/33' 2022-04-03T21:52:29.334 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/23' 2022-04-03T21:52:29.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/35' 2022-04-03T21:52:29.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/26' 2022-04-03T21:52:29.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './247/37' 2022-04-03T21:52:29.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './247' 2022-04-03T21:52:29.335 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/21' 2022-04-03T21:52:29.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/27' 2022-04-03T21:52:29.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/31' 2022-04-03T21:52:29.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/36' 2022-04-03T21:52:29.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/20' 2022-04-03T21:52:29.336 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/39' 2022-04-03T21:52:29.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/34' 2022-04-03T21:52:29.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/38' 2022-04-03T21:52:29.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/28' 2022-04-03T21:52:29.337 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/24' 2022-04-03T21:52:29.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/29' 2022-04-03T21:52:29.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/32' 2022-04-03T21:52:29.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/22' 2022-04-03T21:52:29.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/25' 2022-04-03T21:52:29.338 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/30' 2022-04-03T21:52:29.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/33' 2022-04-03T21:52:29.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/23' 2022-04-03T21:52:29.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/35' 2022-04-03T21:52:29.339 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/26' 2022-04-03T21:52:29.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './248/37' 2022-04-03T21:52:29.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './248' 2022-04-03T21:52:29.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/21' 2022-04-03T21:52:29.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/27' 2022-04-03T21:52:29.340 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/31' 2022-04-03T21:52:29.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/36' 2022-04-03T21:52:29.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/20' 2022-04-03T21:52:29.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/39' 2022-04-03T21:52:29.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/34' 2022-04-03T21:52:29.341 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/38' 2022-04-03T21:52:29.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/28' 2022-04-03T21:52:29.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/24' 2022-04-03T21:52:29.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/29' 2022-04-03T21:52:29.342 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/32' 2022-04-03T21:52:29.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/22' 2022-04-03T21:52:29.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/25' 2022-04-03T21:52:29.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/30' 2022-04-03T21:52:29.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/33' 2022-04-03T21:52:29.343 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/23' 2022-04-03T21:52:29.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/35' 2022-04-03T21:52:29.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/26' 2022-04-03T21:52:29.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed './249/37' 2022-04-03T21:52:29.344 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './249' 2022-04-03T21:52:29.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/21' 2022-04-03T21:52:29.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/27' 2022-04-03T21:52:29.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/31' 2022-04-03T21:52:29.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/36' 2022-04-03T21:52:29.345 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/20' 2022-04-03T21:52:29.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/39' 2022-04-03T21:52:29.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/34' 2022-04-03T21:52:29.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/38' 2022-04-03T21:52:29.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/28' 2022-04-03T21:52:29.346 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/24' 2022-04-03T21:52:29.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/29' 2022-04-03T21:52:29.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/32' 2022-04-03T21:52:29.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/22' 2022-04-03T21:52:29.347 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/25' 2022-04-03T21:52:29.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/30' 2022-04-03T21:52:29.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/33' 2022-04-03T21:52:29.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/23' 2022-04-03T21:52:29.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/35' 2022-04-03T21:52:29.348 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/26' 2022-04-03T21:52:29.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './250/37' 2022-04-03T21:52:29.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './250' 2022-04-03T21:52:29.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/21' 2022-04-03T21:52:29.349 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/27' 2022-04-03T21:52:29.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/31' 2022-04-03T21:52:29.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/36' 2022-04-03T21:52:29.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/20' 2022-04-03T21:52:29.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/39' 2022-04-03T21:52:29.350 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/34' 2022-04-03T21:52:29.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/38' 2022-04-03T21:52:29.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/28' 2022-04-03T21:52:29.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/24' 2022-04-03T21:52:29.351 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/29' 2022-04-03T21:52:29.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/32' 2022-04-03T21:52:29.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/22' 2022-04-03T21:52:29.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/25' 2022-04-03T21:52:29.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/30' 2022-04-03T21:52:29.352 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/33' 2022-04-03T21:52:29.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/23' 2022-04-03T21:52:29.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/35' 2022-04-03T21:52:29.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/26' 2022-04-03T21:52:29.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed './251/37' 2022-04-03T21:52:29.353 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './251' 2022-04-03T21:52:29.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/21' 2022-04-03T21:52:29.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/27' 2022-04-03T21:52:29.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/31' 2022-04-03T21:52:29.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/36' 2022-04-03T21:52:29.354 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/20' 2022-04-03T21:52:29.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/39' 2022-04-03T21:52:29.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/34' 2022-04-03T21:52:29.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/38' 2022-04-03T21:52:29.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/28' 2022-04-03T21:52:29.355 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/24' 2022-04-03T21:52:29.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/29' 2022-04-03T21:52:29.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/32' 2022-04-03T21:52:29.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/22' 2022-04-03T21:52:29.356 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/25' 2022-04-03T21:52:29.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/30' 2022-04-03T21:52:29.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/33' 2022-04-03T21:52:29.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/23' 2022-04-03T21:52:29.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/35' 2022-04-03T21:52:29.357 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/26' 2022-04-03T21:52:29.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './252/37' 2022-04-03T21:52:29.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './252' 2022-04-03T21:52:29.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/21' 2022-04-03T21:52:29.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/27' 2022-04-03T21:52:29.358 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/31' 2022-04-03T21:52:29.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/36' 2022-04-03T21:52:29.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/20' 2022-04-03T21:52:29.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/39' 2022-04-03T21:52:29.359 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/34' 2022-04-03T21:52:29.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/38' 2022-04-03T21:52:29.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/28' 2022-04-03T21:52:29.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/24' 2022-04-03T21:52:29.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/29' 2022-04-03T21:52:29.360 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/32' 2022-04-03T21:52:29.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/22' 2022-04-03T21:52:29.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/25' 2022-04-03T21:52:29.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/30' 2022-04-03T21:52:29.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/33' 2022-04-03T21:52:29.361 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/23' 2022-04-03T21:52:29.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/35' 2022-04-03T21:52:29.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/26' 2022-04-03T21:52:29.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './253/37' 2022-04-03T21:52:29.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './253' 2022-04-03T21:52:29.362 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/21' 2022-04-03T21:52:29.363 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/27' 2022-04-03T21:52:29.363 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/31' 2022-04-03T21:52:29.363 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/36' 2022-04-03T21:52:29.363 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/20' 2022-04-03T21:52:29.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/39' 2022-04-03T21:52:29.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/34' 2022-04-03T21:52:29.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/38' 2022-04-03T21:52:29.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/28' 2022-04-03T21:52:29.364 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/24' 2022-04-03T21:52:29.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/29' 2022-04-03T21:52:29.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/32' 2022-04-03T21:52:29.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/22' 2022-04-03T21:52:29.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/25' 2022-04-03T21:52:29.365 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/30' 2022-04-03T21:52:29.366 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/33' 2022-04-03T21:52:29.366 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/23' 2022-04-03T21:52:29.366 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/35' 2022-04-03T21:52:29.366 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/26' 2022-04-03T21:52:29.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './254/37' 2022-04-03T21:52:29.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './254' 2022-04-03T21:52:29.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/21' 2022-04-03T21:52:29.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/27' 2022-04-03T21:52:29.367 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/31' 2022-04-03T21:52:29.368 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/36' 2022-04-03T21:52:29.368 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/20' 2022-04-03T21:52:29.368 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/39' 2022-04-03T21:52:29.368 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/34' 2022-04-03T21:52:29.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/38' 2022-04-03T21:52:29.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/28' 2022-04-03T21:52:29.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/24' 2022-04-03T21:52:29.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/29' 2022-04-03T21:52:29.369 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/32' 2022-04-03T21:52:29.370 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/22' 2022-04-03T21:52:29.370 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/25' 2022-04-03T21:52:29.370 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/30' 2022-04-03T21:52:29.370 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/33' 2022-04-03T21:52:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/23' 2022-04-03T21:52:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/35' 2022-04-03T21:52:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/26' 2022-04-03T21:52:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed './255/37' 2022-04-03T21:52:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './255' 2022-04-03T21:52:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/21' 2022-04-03T21:52:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/27' 2022-04-03T21:52:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/31' 2022-04-03T21:52:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/36' 2022-04-03T21:52:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/20' 2022-04-03T21:52:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/39' 2022-04-03T21:52:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/34' 2022-04-03T21:52:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/38' 2022-04-03T21:52:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/28' 2022-04-03T21:52:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/24' 2022-04-03T21:52:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/29' 2022-04-03T21:52:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/32' 2022-04-03T21:52:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/22' 2022-04-03T21:52:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/25' 2022-04-03T21:52:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/30' 2022-04-03T21:52:29.734 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/33' 2022-04-03T21:52:29.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/23' 2022-04-03T21:52:29.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/35' 2022-04-03T21:52:29.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/26' 2022-04-03T21:52:29.735 INFO:tasks.workunit.client.0.smithi049.stdout:removed './256/37' 2022-04-03T21:52:29.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './256' 2022-04-03T21:52:29.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/21' 2022-04-03T21:52:29.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/27' 2022-04-03T21:52:29.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/31' 2022-04-03T21:52:29.736 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/36' 2022-04-03T21:52:29.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/20' 2022-04-03T21:52:29.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/39' 2022-04-03T21:52:29.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/34' 2022-04-03T21:52:29.737 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/38' 2022-04-03T21:52:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/28' 2022-04-03T21:52:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/24' 2022-04-03T21:52:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/29' 2022-04-03T21:52:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/32' 2022-04-03T21:52:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/22' 2022-04-03T21:52:29.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/25' 2022-04-03T21:52:29.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/30' 2022-04-03T21:52:29.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/33' 2022-04-03T21:52:29.739 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/23' 2022-04-03T21:52:29.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/35' 2022-04-03T21:52:29.740 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/26' 2022-04-03T21:52:29.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed './257/37' 2022-04-03T21:52:29.744 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './257' 2022-04-03T21:52:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/21' 2022-04-03T21:52:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/27' 2022-04-03T21:52:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/31' 2022-04-03T21:52:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/36' 2022-04-03T21:52:29.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/20' 2022-04-03T21:52:29.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/39' 2022-04-03T21:52:29.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/34' 2022-04-03T21:52:29.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/38' 2022-04-03T21:52:29.746 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/28' 2022-04-03T21:52:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/24' 2022-04-03T21:52:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/29' 2022-04-03T21:52:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/32' 2022-04-03T21:52:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/22' 2022-04-03T21:52:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/25' 2022-04-03T21:52:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/30' 2022-04-03T21:52:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/33' 2022-04-03T21:52:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/23' 2022-04-03T21:52:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/35' 2022-04-03T21:52:29.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/26' 2022-04-03T21:52:29.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './258/37' 2022-04-03T21:52:29.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './258' 2022-04-03T21:52:29.749 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/21' 2022-04-03T21:52:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/27' 2022-04-03T21:52:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/31' 2022-04-03T21:52:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/36' 2022-04-03T21:52:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/20' 2022-04-03T21:52:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/39' 2022-04-03T21:52:29.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/34' 2022-04-03T21:52:29.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/38' 2022-04-03T21:52:29.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/28' 2022-04-03T21:52:29.751 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/24' 2022-04-03T21:52:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/29' 2022-04-03T21:52:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/32' 2022-04-03T21:52:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/22' 2022-04-03T21:52:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/25' 2022-04-03T21:52:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/30' 2022-04-03T21:52:29.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/33' 2022-04-03T21:52:29.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/23' 2022-04-03T21:52:29.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/35' 2022-04-03T21:52:29.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/26' 2022-04-03T21:52:29.753 INFO:tasks.workunit.client.0.smithi049.stdout:removed './259/37' 2022-04-03T21:52:29.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './259' 2022-04-03T21:52:29.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/21' 2022-04-03T21:52:29.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/27' 2022-04-03T21:52:29.754 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/31' 2022-04-03T21:52:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/36' 2022-04-03T21:52:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/20' 2022-04-03T21:52:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/39' 2022-04-03T21:52:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/34' 2022-04-03T21:52:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/38' 2022-04-03T21:52:29.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/28' 2022-04-03T21:52:29.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/24' 2022-04-03T21:52:29.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/29' 2022-04-03T21:52:29.756 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/32' 2022-04-03T21:52:29.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/22' 2022-04-03T21:52:29.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/25' 2022-04-03T21:52:29.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/30' 2022-04-03T21:52:29.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/33' 2022-04-03T21:52:29.757 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/23' 2022-04-03T21:52:29.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/35' 2022-04-03T21:52:29.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/26' 2022-04-03T21:52:29.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed './260/37' 2022-04-03T21:52:29.758 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './260' 2022-04-03T21:52:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/21' 2022-04-03T21:52:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/27' 2022-04-03T21:52:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/31' 2022-04-03T21:52:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/36' 2022-04-03T21:52:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/20' 2022-04-03T21:52:29.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/39' 2022-04-03T21:52:29.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/34' 2022-04-03T21:52:29.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/38' 2022-04-03T21:52:29.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/28' 2022-04-03T21:52:29.760 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/24' 2022-04-03T21:52:29.761 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/29' 2022-04-03T21:52:29.761 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/32' 2022-04-03T21:52:29.761 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/22' 2022-04-03T21:52:29.761 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/25' 2022-04-03T21:52:29.762 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/30' 2022-04-03T21:52:29.762 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/33' 2022-04-03T21:52:29.762 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/23' 2022-04-03T21:52:29.762 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/35' 2022-04-03T21:52:29.762 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/26' 2022-04-03T21:52:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:removed './261/37' 2022-04-03T21:52:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './261' 2022-04-03T21:52:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/21' 2022-04-03T21:52:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/27' 2022-04-03T21:52:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/31' 2022-04-03T21:52:29.764 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/36' 2022-04-03T21:52:29.764 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/20' 2022-04-03T21:52:29.764 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/39' 2022-04-03T21:52:29.764 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/34' 2022-04-03T21:52:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/38' 2022-04-03T21:52:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/28' 2022-04-03T21:52:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/24' 2022-04-03T21:52:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/29' 2022-04-03T21:52:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/32' 2022-04-03T21:52:29.766 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/22' 2022-04-03T21:52:29.766 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/25' 2022-04-03T21:52:29.766 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/30' 2022-04-03T21:52:29.766 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/33' 2022-04-03T21:52:29.766 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/23' 2022-04-03T21:52:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/35' 2022-04-03T21:52:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/26' 2022-04-03T21:52:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:removed './262/37' 2022-04-03T21:52:29.768 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './262' 2022-04-03T21:52:29.768 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/21' 2022-04-03T21:52:29.768 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/27' 2022-04-03T21:52:29.768 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/31' 2022-04-03T21:52:29.769 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/36' 2022-04-03T21:52:29.769 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/20' 2022-04-03T21:52:29.769 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/39' 2022-04-03T21:52:29.769 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/34' 2022-04-03T21:52:29.769 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/38' 2022-04-03T21:52:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/28' 2022-04-03T21:52:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/24' 2022-04-03T21:52:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/29' 2022-04-03T21:52:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/32' 2022-04-03T21:52:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/22' 2022-04-03T21:52:29.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/25' 2022-04-03T21:52:29.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/30' 2022-04-03T21:52:29.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/33' 2022-04-03T21:52:29.771 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/23' 2022-04-03T21:52:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/35' 2022-04-03T21:52:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/26' 2022-04-03T21:52:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './263/37' 2022-04-03T21:52:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './263' 2022-04-03T21:52:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/21' 2022-04-03T21:52:29.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/27' 2022-04-03T21:52:29.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/31' 2022-04-03T21:52:29.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/36' 2022-04-03T21:52:29.773 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/20' 2022-04-03T21:52:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/39' 2022-04-03T21:52:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/34' 2022-04-03T21:52:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/38' 2022-04-03T21:52:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/28' 2022-04-03T21:52:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/24' 2022-04-03T21:52:29.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/29' 2022-04-03T21:52:29.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/32' 2022-04-03T21:52:29.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/22' 2022-04-03T21:52:29.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/25' 2022-04-03T21:52:29.775 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/30' 2022-04-03T21:52:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/33' 2022-04-03T21:52:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/23' 2022-04-03T21:52:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/35' 2022-04-03T21:52:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/26' 2022-04-03T21:52:29.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './264/37' 2022-04-03T21:52:29.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './264' 2022-04-03T21:52:29.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/21' 2022-04-03T21:52:29.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/27' 2022-04-03T21:52:29.777 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/31' 2022-04-03T21:52:29.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/36' 2022-04-03T21:52:29.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/20' 2022-04-03T21:52:29.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/39' 2022-04-03T21:52:29.778 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/34' 2022-04-03T21:52:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/38' 2022-04-03T21:52:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/28' 2022-04-03T21:52:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/24' 2022-04-03T21:52:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/29' 2022-04-03T21:52:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/32' 2022-04-03T21:52:29.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/22' 2022-04-03T21:52:29.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/25' 2022-04-03T21:52:29.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/30' 2022-04-03T21:52:29.780 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/33' 2022-04-03T21:52:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/23' 2022-04-03T21:52:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/35' 2022-04-03T21:52:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/26' 2022-04-03T21:52:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed './265/37' 2022-04-03T21:52:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './265' 2022-04-03T21:52:29.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/21' 2022-04-03T21:52:29.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/27' 2022-04-03T21:52:29.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/31' 2022-04-03T21:52:29.782 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/36' 2022-04-03T21:52:29.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/20' 2022-04-03T21:52:29.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/39' 2022-04-03T21:52:29.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/34' 2022-04-03T21:52:29.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/38' 2022-04-03T21:52:29.783 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/28' 2022-04-03T21:52:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/24' 2022-04-03T21:52:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/29' 2022-04-03T21:52:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/32' 2022-04-03T21:52:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/22' 2022-04-03T21:52:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/25' 2022-04-03T21:52:29.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/30' 2022-04-03T21:52:29.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/33' 2022-04-03T21:52:29.785 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/23' 2022-04-03T21:52:30.615 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/35' 2022-04-03T21:52:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/26' 2022-04-03T21:52:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './266/37' 2022-04-03T21:52:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './266' 2022-04-03T21:52:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/21' 2022-04-03T21:52:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/27' 2022-04-03T21:52:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/31' 2022-04-03T21:52:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/36' 2022-04-03T21:52:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/20' 2022-04-03T21:52:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/39' 2022-04-03T21:52:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/34' 2022-04-03T21:52:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/38' 2022-04-03T21:52:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/28' 2022-04-03T21:52:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/24' 2022-04-03T21:52:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/29' 2022-04-03T21:52:30.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/32' 2022-04-03T21:52:30.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/22' 2022-04-03T21:52:30.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/25' 2022-04-03T21:52:30.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/30' 2022-04-03T21:52:30.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/33' 2022-04-03T21:52:30.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/23' 2022-04-03T21:52:30.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/35' 2022-04-03T21:52:30.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/26' 2022-04-03T21:52:30.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './267/37' 2022-04-03T21:52:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './267' 2022-04-03T21:52:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/21' 2022-04-03T21:52:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/27' 2022-04-03T21:52:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/31' 2022-04-03T21:52:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/36' 2022-04-03T21:52:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/20' 2022-04-03T21:52:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/39' 2022-04-03T21:52:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/34' 2022-04-03T21:52:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/38' 2022-04-03T21:52:30.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/28' 2022-04-03T21:52:30.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/24' 2022-04-03T21:52:30.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/29' 2022-04-03T21:52:30.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/32' 2022-04-03T21:52:30.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/22' 2022-04-03T21:52:30.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/25' 2022-04-03T21:52:30.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/30' 2022-04-03T21:52:30.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/33' 2022-04-03T21:52:30.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/23' 2022-04-03T21:52:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/35' 2022-04-03T21:52:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/26' 2022-04-03T21:52:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './268/37' 2022-04-03T21:52:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './268' 2022-04-03T21:52:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/21' 2022-04-03T21:52:30.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/27' 2022-04-03T21:52:30.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/31' 2022-04-03T21:52:30.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/36' 2022-04-03T21:52:30.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/20' 2022-04-03T21:52:30.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/39' 2022-04-03T21:52:30.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/34' 2022-04-03T21:52:30.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/38' 2022-04-03T21:52:30.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/28' 2022-04-03T21:52:30.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/24' 2022-04-03T21:52:30.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/29' 2022-04-03T21:52:30.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/32' 2022-04-03T21:52:30.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/22' 2022-04-03T21:52:30.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/25' 2022-04-03T21:52:30.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/30' 2022-04-03T21:52:30.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/33' 2022-04-03T21:52:30.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/23' 2022-04-03T21:52:30.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/35' 2022-04-03T21:52:30.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/26' 2022-04-03T21:52:30.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './269/37' 2022-04-03T21:52:30.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './269' 2022-04-03T21:52:30.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/21' 2022-04-03T21:52:30.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/27' 2022-04-03T21:52:30.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/31' 2022-04-03T21:52:30.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/36' 2022-04-03T21:52:30.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/20' 2022-04-03T21:52:30.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/39' 2022-04-03T21:52:30.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/34' 2022-04-03T21:52:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/38' 2022-04-03T21:52:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/28' 2022-04-03T21:52:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/24' 2022-04-03T21:52:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/29' 2022-04-03T21:52:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/32' 2022-04-03T21:52:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/22' 2022-04-03T21:52:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/25' 2022-04-03T21:52:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/30' 2022-04-03T21:52:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/33' 2022-04-03T21:52:30.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/23' 2022-04-03T21:52:30.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/35' 2022-04-03T21:52:30.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/26' 2022-04-03T21:52:30.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './270/37' 2022-04-03T21:52:30.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './270' 2022-04-03T21:52:30.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/21' 2022-04-03T21:52:30.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/27' 2022-04-03T21:52:30.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/31' 2022-04-03T21:52:30.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/36' 2022-04-03T21:52:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/20' 2022-04-03T21:52:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/39' 2022-04-03T21:52:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/34' 2022-04-03T21:52:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/38' 2022-04-03T21:52:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/28' 2022-04-03T21:52:30.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/24' 2022-04-03T21:52:30.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/29' 2022-04-03T21:52:30.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/32' 2022-04-03T21:52:30.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/22' 2022-04-03T21:52:30.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/25' 2022-04-03T21:52:30.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/30' 2022-04-03T21:52:30.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/33' 2022-04-03T21:52:30.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/23' 2022-04-03T21:52:30.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/35' 2022-04-03T21:52:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/26' 2022-04-03T21:52:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './271/37' 2022-04-03T21:52:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './271' 2022-04-03T21:52:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/21' 2022-04-03T21:52:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/27' 2022-04-03T21:52:30.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/31' 2022-04-03T21:52:30.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/36' 2022-04-03T21:52:30.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/20' 2022-04-03T21:52:30.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/39' 2022-04-03T21:52:30.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/34' 2022-04-03T21:52:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/38' 2022-04-03T21:52:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/28' 2022-04-03T21:52:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/24' 2022-04-03T21:52:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/29' 2022-04-03T21:52:30.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/32' 2022-04-03T21:52:30.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/22' 2022-04-03T21:52:30.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/25' 2022-04-03T21:52:30.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/30' 2022-04-03T21:52:30.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/33' 2022-04-03T21:52:30.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/23' 2022-04-03T21:52:30.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/35' 2022-04-03T21:52:30.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/26' 2022-04-03T21:52:30.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './272/37' 2022-04-03T21:52:30.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './272' 2022-04-03T21:52:30.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/21' 2022-04-03T21:52:30.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/27' 2022-04-03T21:52:30.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/31' 2022-04-03T21:52:30.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/36' 2022-04-03T21:52:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/20' 2022-04-03T21:52:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/39' 2022-04-03T21:52:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/34' 2022-04-03T21:52:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/38' 2022-04-03T21:52:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/28' 2022-04-03T21:52:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/24' 2022-04-03T21:52:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/29' 2022-04-03T21:52:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/32' 2022-04-03T21:52:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/22' 2022-04-03T21:52:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/25' 2022-04-03T21:52:30.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/30' 2022-04-03T21:52:30.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/33' 2022-04-03T21:52:30.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/23' 2022-04-03T21:52:30.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/35' 2022-04-03T21:52:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/26' 2022-04-03T21:52:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './273/37' 2022-04-03T21:52:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './273' 2022-04-03T21:52:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/21' 2022-04-03T21:52:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/27' 2022-04-03T21:52:30.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/31' 2022-04-03T21:52:30.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/36' 2022-04-03T21:52:30.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/20' 2022-04-03T21:52:30.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/39' 2022-04-03T21:52:30.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/34' 2022-04-03T21:52:30.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/38' 2022-04-03T21:52:30.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/28' 2022-04-03T21:52:30.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/24' 2022-04-03T21:52:30.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/29' 2022-04-03T21:52:30.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/32' 2022-04-03T21:52:30.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/22' 2022-04-03T21:52:30.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/25' 2022-04-03T21:52:30.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/30' 2022-04-03T21:52:30.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/33' 2022-04-03T21:52:30.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/23' 2022-04-03T21:52:30.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/35' 2022-04-03T21:52:30.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/26' 2022-04-03T21:52:30.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './274/37' 2022-04-03T21:52:30.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './274' 2022-04-03T21:52:30.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/21' 2022-04-03T21:52:30.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/27' 2022-04-03T21:52:30.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/31' 2022-04-03T21:52:30.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/36' 2022-04-03T21:52:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/20' 2022-04-03T21:52:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/39' 2022-04-03T21:52:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/34' 2022-04-03T21:52:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/38' 2022-04-03T21:52:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/28' 2022-04-03T21:52:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/24' 2022-04-03T21:52:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/29' 2022-04-03T21:52:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/32' 2022-04-03T21:52:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/22' 2022-04-03T21:52:30.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/25' 2022-04-03T21:52:30.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/30' 2022-04-03T21:52:30.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/33' 2022-04-03T21:52:30.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/23' 2022-04-03T21:52:30.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/35' 2022-04-03T21:52:30.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/26' 2022-04-03T21:52:30.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './275/37' 2022-04-03T21:52:30.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './275' 2022-04-03T21:52:30.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/21' 2022-04-03T21:52:30.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/27' 2022-04-03T21:52:30.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/31' 2022-04-03T21:52:30.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/36' 2022-04-03T21:52:30.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/20' 2022-04-03T21:52:30.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/39' 2022-04-03T21:52:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/34' 2022-04-03T21:52:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/38' 2022-04-03T21:52:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/28' 2022-04-03T21:52:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/24' 2022-04-03T21:52:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/29' 2022-04-03T21:52:30.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/32' 2022-04-03T21:52:30.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/22' 2022-04-03T21:52:30.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/25' 2022-04-03T21:52:30.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/30' 2022-04-03T21:52:30.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/33' 2022-04-03T21:52:30.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/23' 2022-04-03T21:52:30.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/35' 2022-04-03T21:52:30.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/26' 2022-04-03T21:52:31.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './276/37' 2022-04-03T21:52:31.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './276' 2022-04-03T21:52:31.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/21' 2022-04-03T21:52:31.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/27' 2022-04-03T21:52:31.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/31' 2022-04-03T21:52:31.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/36' 2022-04-03T21:52:31.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/20' 2022-04-03T21:52:31.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/39' 2022-04-03T21:52:31.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/34' 2022-04-03T21:52:31.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/38' 2022-04-03T21:52:31.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/28' 2022-04-03T21:52:31.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/24' 2022-04-03T21:52:31.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/29' 2022-04-03T21:52:31.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/32' 2022-04-03T21:52:31.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/22' 2022-04-03T21:52:31.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/25' 2022-04-03T21:52:31.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/30' 2022-04-03T21:52:31.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/33' 2022-04-03T21:52:31.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/23' 2022-04-03T21:52:31.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/35' 2022-04-03T21:52:31.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/26' 2022-04-03T21:52:31.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './277/37' 2022-04-03T21:52:31.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './277' 2022-04-03T21:52:31.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/21' 2022-04-03T21:52:31.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/27' 2022-04-03T21:52:31.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/31' 2022-04-03T21:52:31.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/36' 2022-04-03T21:52:31.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/20' 2022-04-03T21:52:31.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/39' 2022-04-03T21:52:31.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/34' 2022-04-03T21:52:31.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/38' 2022-04-03T21:52:31.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/28' 2022-04-03T21:52:31.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/24' 2022-04-03T21:52:31.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/29' 2022-04-03T21:52:31.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/32' 2022-04-03T21:52:31.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/22' 2022-04-03T21:52:31.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/25' 2022-04-03T21:52:31.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/30' 2022-04-03T21:52:31.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/33' 2022-04-03T21:52:31.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/23' 2022-04-03T21:52:31.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/35' 2022-04-03T21:52:31.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/26' 2022-04-03T21:52:31.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './278/37' 2022-04-03T21:52:31.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './278' 2022-04-03T21:52:31.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/21' 2022-04-03T21:52:31.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/27' 2022-04-03T21:52:31.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/31' 2022-04-03T21:52:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/36' 2022-04-03T21:52:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/20' 2022-04-03T21:52:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/39' 2022-04-03T21:52:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/34' 2022-04-03T21:52:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/38' 2022-04-03T21:52:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/28' 2022-04-03T21:52:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/24' 2022-04-03T21:52:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/29' 2022-04-03T21:52:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/32' 2022-04-03T21:52:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/22' 2022-04-03T21:52:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/25' 2022-04-03T21:52:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/30' 2022-04-03T21:52:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/33' 2022-04-03T21:52:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/23' 2022-04-03T21:52:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/35' 2022-04-03T21:52:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/26' 2022-04-03T21:52:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed './279/37' 2022-04-03T21:52:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './279' 2022-04-03T21:52:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/21' 2022-04-03T21:52:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/27' 2022-04-03T21:52:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/31' 2022-04-03T21:52:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/36' 2022-04-03T21:52:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/20' 2022-04-03T21:52:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/39' 2022-04-03T21:52:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/34' 2022-04-03T21:52:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/38' 2022-04-03T21:52:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/28' 2022-04-03T21:52:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/24' 2022-04-03T21:52:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/29' 2022-04-03T21:52:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/32' 2022-04-03T21:52:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/22' 2022-04-03T21:52:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/25' 2022-04-03T21:52:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/30' 2022-04-03T21:52:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/33' 2022-04-03T21:52:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/23' 2022-04-03T21:52:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/35' 2022-04-03T21:52:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/26' 2022-04-03T21:52:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './280/37' 2022-04-03T21:52:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './280' 2022-04-03T21:52:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/21' 2022-04-03T21:52:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/27' 2022-04-03T21:52:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/31' 2022-04-03T21:52:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/36' 2022-04-03T21:52:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/20' 2022-04-03T21:52:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/39' 2022-04-03T21:52:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/34' 2022-04-03T21:52:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/38' 2022-04-03T21:52:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/28' 2022-04-03T21:52:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/24' 2022-04-03T21:52:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/29' 2022-04-03T21:52:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/32' 2022-04-03T21:52:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/22' 2022-04-03T21:52:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/25' 2022-04-03T21:52:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/30' 2022-04-03T21:52:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/33' 2022-04-03T21:52:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/23' 2022-04-03T21:52:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/35' 2022-04-03T21:52:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/26' 2022-04-03T21:52:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:removed './281/37' 2022-04-03T21:52:31.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './281' 2022-04-03T21:52:31.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/21' 2022-04-03T21:52:31.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/27' 2022-04-03T21:52:31.225 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/31' 2022-04-03T21:52:31.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/36' 2022-04-03T21:52:31.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/20' 2022-04-03T21:52:31.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/39' 2022-04-03T21:52:31.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/34' 2022-04-03T21:52:31.226 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/38' 2022-04-03T21:52:31.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/28' 2022-04-03T21:52:31.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/24' 2022-04-03T21:52:31.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/29' 2022-04-03T21:52:31.227 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/32' 2022-04-03T21:52:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/22' 2022-04-03T21:52:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/25' 2022-04-03T21:52:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/30' 2022-04-03T21:52:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/33' 2022-04-03T21:52:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/23' 2022-04-03T21:52:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/35' 2022-04-03T21:52:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/26' 2022-04-03T21:52:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed './282/37' 2022-04-03T21:52:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './282' 2022-04-03T21:52:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/21' 2022-04-03T21:52:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/27' 2022-04-03T21:52:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/31' 2022-04-03T21:52:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/36' 2022-04-03T21:52:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/20' 2022-04-03T21:52:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/39' 2022-04-03T21:52:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/34' 2022-04-03T21:52:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/38' 2022-04-03T21:52:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/28' 2022-04-03T21:52:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/24' 2022-04-03T21:52:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/29' 2022-04-03T21:52:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/32' 2022-04-03T21:52:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/22' 2022-04-03T21:52:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/25' 2022-04-03T21:52:31.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/30' 2022-04-03T21:52:31.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/33' 2022-04-03T21:52:31.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/23' 2022-04-03T21:52:31.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/35' 2022-04-03T21:52:31.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/26' 2022-04-03T21:52:31.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './283/37' 2022-04-03T21:52:31.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './283' 2022-04-03T21:52:31.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/21' 2022-04-03T21:52:31.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/27' 2022-04-03T21:52:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/31' 2022-04-03T21:52:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/36' 2022-04-03T21:52:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/20' 2022-04-03T21:52:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/39' 2022-04-03T21:52:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/34' 2022-04-03T21:52:31.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/38' 2022-04-03T21:52:31.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/28' 2022-04-03T21:52:31.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/24' 2022-04-03T21:52:31.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/29' 2022-04-03T21:52:31.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/32' 2022-04-03T21:52:31.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/22' 2022-04-03T21:52:31.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/25' 2022-04-03T21:52:31.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/30' 2022-04-03T21:52:31.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/33' 2022-04-03T21:52:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/23' 2022-04-03T21:52:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/35' 2022-04-03T21:52:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/26' 2022-04-03T21:52:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './284/37' 2022-04-03T21:52:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './284' 2022-04-03T21:52:31.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/21' 2022-04-03T21:52:31.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/27' 2022-04-03T21:52:31.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/31' 2022-04-03T21:52:31.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/36' 2022-04-03T21:52:31.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/20' 2022-04-03T21:52:31.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/39' 2022-04-03T21:52:31.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/34' 2022-04-03T21:52:31.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/38' 2022-04-03T21:52:31.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/28' 2022-04-03T21:52:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/24' 2022-04-03T21:52:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/29' 2022-04-03T21:52:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/32' 2022-04-03T21:52:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/22' 2022-04-03T21:52:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/25' 2022-04-03T21:52:31.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/30' 2022-04-03T21:52:31.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/33' 2022-04-03T21:52:31.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/23' 2022-04-03T21:52:31.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/35' 2022-04-03T21:52:31.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/26' 2022-04-03T21:52:31.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './285/37' 2022-04-03T21:52:31.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './285' 2022-04-03T21:52:31.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/21' 2022-04-03T21:52:31.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/27' 2022-04-03T21:52:31.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/31' 2022-04-03T21:52:31.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/36' 2022-04-03T21:52:31.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/20' 2022-04-03T21:52:31.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/39' 2022-04-03T21:52:31.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/34' 2022-04-03T21:52:31.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/38' 2022-04-03T21:52:31.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/28' 2022-04-03T21:52:31.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/24' 2022-04-03T21:52:31.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/29' 2022-04-03T21:52:31.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/32' 2022-04-03T21:52:31.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/22' 2022-04-03T21:52:31.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/25' 2022-04-03T21:52:31.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/30' 2022-04-03T21:52:31.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/33' 2022-04-03T21:52:31.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/23' 2022-04-03T21:52:31.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/35' 2022-04-03T21:52:31.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/26' 2022-04-03T21:52:31.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './286/37' 2022-04-03T21:52:31.248 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './286' 2022-04-03T21:52:31.615 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/21' 2022-04-03T21:52:31.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/27' 2022-04-03T21:52:31.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/31' 2022-04-03T21:52:31.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/36' 2022-04-03T21:52:31.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/20' 2022-04-03T21:52:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/39' 2022-04-03T21:52:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/34' 2022-04-03T21:52:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/38' 2022-04-03T21:52:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/28' 2022-04-03T21:52:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/24' 2022-04-03T21:52:31.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/29' 2022-04-03T21:52:31.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/32' 2022-04-03T21:52:31.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/22' 2022-04-03T21:52:31.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/25' 2022-04-03T21:52:31.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/30' 2022-04-03T21:52:31.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/33' 2022-04-03T21:52:31.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/23' 2022-04-03T21:52:31.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/35' 2022-04-03T21:52:31.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/26' 2022-04-03T21:52:31.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './287/37' 2022-04-03T21:52:31.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './287' 2022-04-03T21:52:31.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/21' 2022-04-03T21:52:31.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/27' 2022-04-03T21:52:31.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/31' 2022-04-03T21:52:31.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/36' 2022-04-03T21:52:31.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/20' 2022-04-03T21:52:31.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/39' 2022-04-03T21:52:31.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/34' 2022-04-03T21:52:31.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/38' 2022-04-03T21:52:31.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/28' 2022-04-03T21:52:31.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/24' 2022-04-03T21:52:31.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/29' 2022-04-03T21:52:31.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/32' 2022-04-03T21:52:31.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/22' 2022-04-03T21:52:31.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/25' 2022-04-03T21:52:31.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/30' 2022-04-03T21:52:31.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/33' 2022-04-03T21:52:31.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/23' 2022-04-03T21:52:31.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/35' 2022-04-03T21:52:31.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/26' 2022-04-03T21:52:31.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './288/37' 2022-04-03T21:52:31.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './288' 2022-04-03T21:52:31.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/21' 2022-04-03T21:52:31.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/27' 2022-04-03T21:52:31.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/31' 2022-04-03T21:52:31.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/36' 2022-04-03T21:52:31.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/20' 2022-04-03T21:52:31.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/39' 2022-04-03T21:52:31.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/34' 2022-04-03T21:52:31.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/38' 2022-04-03T21:52:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/28' 2022-04-03T21:52:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/24' 2022-04-03T21:52:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/29' 2022-04-03T21:52:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/32' 2022-04-03T21:52:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/22' 2022-04-03T21:52:31.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/25' 2022-04-03T21:52:31.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/30' 2022-04-03T21:52:31.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/33' 2022-04-03T21:52:31.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/23' 2022-04-03T21:52:31.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/35' 2022-04-03T21:52:31.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/26' 2022-04-03T21:52:31.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './289/37' 2022-04-03T21:52:31.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './289' 2022-04-03T21:52:31.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/21' 2022-04-03T21:52:31.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/27' 2022-04-03T21:52:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/31' 2022-04-03T21:52:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/36' 2022-04-03T21:52:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/20' 2022-04-03T21:52:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/39' 2022-04-03T21:52:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/34' 2022-04-03T21:52:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/38' 2022-04-03T21:52:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/28' 2022-04-03T21:52:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/24' 2022-04-03T21:52:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/29' 2022-04-03T21:52:31.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/32' 2022-04-03T21:52:31.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/22' 2022-04-03T21:52:31.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/25' 2022-04-03T21:52:31.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/30' 2022-04-03T21:52:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/33' 2022-04-03T21:52:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/23' 2022-04-03T21:52:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/35' 2022-04-03T21:52:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/26' 2022-04-03T21:52:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './290/37' 2022-04-03T21:52:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './290' 2022-04-03T21:52:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/21' 2022-04-03T21:52:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/27' 2022-04-03T21:52:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/31' 2022-04-03T21:52:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/36' 2022-04-03T21:52:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/20' 2022-04-03T21:52:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/39' 2022-04-03T21:52:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/34' 2022-04-03T21:52:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/38' 2022-04-03T21:52:31.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/28' 2022-04-03T21:52:31.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/24' 2022-04-03T21:52:31.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/29' 2022-04-03T21:52:31.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/32' 2022-04-03T21:52:31.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/22' 2022-04-03T21:52:31.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/25' 2022-04-03T21:52:31.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/30' 2022-04-03T21:52:31.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/33' 2022-04-03T21:52:31.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/23' 2022-04-03T21:52:31.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/35' 2022-04-03T21:52:31.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/26' 2022-04-03T21:52:31.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './291/37' 2022-04-03T21:52:31.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './291' 2022-04-03T21:52:31.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/21' 2022-04-03T21:52:31.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/27' 2022-04-03T21:52:31.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/31' 2022-04-03T21:52:31.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/36' 2022-04-03T21:52:31.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/20' 2022-04-03T21:52:31.639 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/39' 2022-04-03T21:52:31.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/34' 2022-04-03T21:52:31.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/38' 2022-04-03T21:52:31.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/28' 2022-04-03T21:52:31.640 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/24' 2022-04-03T21:52:31.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/29' 2022-04-03T21:52:31.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/32' 2022-04-03T21:52:31.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/22' 2022-04-03T21:52:31.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/25' 2022-04-03T21:52:31.641 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/30' 2022-04-03T21:52:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/33' 2022-04-03T21:52:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/23' 2022-04-03T21:52:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/35' 2022-04-03T21:52:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/26' 2022-04-03T21:52:31.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './292/37' 2022-04-03T21:52:31.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './292' 2022-04-03T21:52:31.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/21' 2022-04-03T21:52:31.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/27' 2022-04-03T21:52:31.643 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/31' 2022-04-03T21:52:31.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/36' 2022-04-03T21:52:31.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/20' 2022-04-03T21:52:31.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/39' 2022-04-03T21:52:31.644 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/34' 2022-04-03T21:52:31.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/38' 2022-04-03T21:52:31.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/28' 2022-04-03T21:52:31.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/24' 2022-04-03T21:52:31.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/29' 2022-04-03T21:52:31.645 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/32' 2022-04-03T21:52:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/22' 2022-04-03T21:52:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/25' 2022-04-03T21:52:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/30' 2022-04-03T21:52:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/33' 2022-04-03T21:52:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/23' 2022-04-03T21:52:31.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/35' 2022-04-03T21:52:31.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/26' 2022-04-03T21:52:31.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './293/37' 2022-04-03T21:52:31.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './293' 2022-04-03T21:52:31.647 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/21' 2022-04-03T21:52:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/27' 2022-04-03T21:52:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/31' 2022-04-03T21:52:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/36' 2022-04-03T21:52:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/20' 2022-04-03T21:52:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/39' 2022-04-03T21:52:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/34' 2022-04-03T21:52:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/38' 2022-04-03T21:52:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/28' 2022-04-03T21:52:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/24' 2022-04-03T21:52:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/29' 2022-04-03T21:52:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/32' 2022-04-03T21:52:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/22' 2022-04-03T21:52:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/25' 2022-04-03T21:52:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/30' 2022-04-03T21:52:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/33' 2022-04-03T21:52:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/23' 2022-04-03T21:52:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/35' 2022-04-03T21:52:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/26' 2022-04-03T21:52:31.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './294/37' 2022-04-03T21:52:31.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './294' 2022-04-03T21:52:31.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/21' 2022-04-03T21:52:31.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/27' 2022-04-03T21:52:31.652 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/31' 2022-04-03T21:52:31.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/36' 2022-04-03T21:52:31.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/20' 2022-04-03T21:52:31.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/39' 2022-04-03T21:52:31.653 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/34' 2022-04-03T21:52:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/38' 2022-04-03T21:52:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/28' 2022-04-03T21:52:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/24' 2022-04-03T21:52:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/29' 2022-04-03T21:52:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/32' 2022-04-03T21:52:31.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/22' 2022-04-03T21:52:31.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/25' 2022-04-03T21:52:31.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/30' 2022-04-03T21:52:31.655 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/33' 2022-04-03T21:52:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/23' 2022-04-03T21:52:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/35' 2022-04-03T21:52:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/26' 2022-04-03T21:52:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed './295/37' 2022-04-03T21:52:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './295' 2022-04-03T21:52:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/21' 2022-04-03T21:52:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/27' 2022-04-03T21:52:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/31' 2022-04-03T21:52:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/36' 2022-04-03T21:52:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/20' 2022-04-03T21:52:31.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/39' 2022-04-03T21:52:31.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/34' 2022-04-03T21:52:31.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/38' 2022-04-03T21:52:31.658 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/28' 2022-04-03T21:52:31.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/24' 2022-04-03T21:52:31.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/29' 2022-04-03T21:52:31.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/32' 2022-04-03T21:52:31.659 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/22' 2022-04-03T21:52:31.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/25' 2022-04-03T21:52:31.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/30' 2022-04-03T21:52:31.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/33' 2022-04-03T21:52:31.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/23' 2022-04-03T21:52:31.660 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/35' 2022-04-03T21:52:31.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/26' 2022-04-03T21:52:31.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './296/37' 2022-04-03T21:52:31.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './296' 2022-04-03T21:52:31.661 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/21' 2022-04-03T21:52:31.662 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/27' 2022-04-03T21:52:32.233 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/31' 2022-04-03T21:52:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/36' 2022-04-03T21:52:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/20' 2022-04-03T21:52:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/39' 2022-04-03T21:52:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/34' 2022-04-03T21:52:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/38' 2022-04-03T21:52:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/28' 2022-04-03T21:52:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/24' 2022-04-03T21:52:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/29' 2022-04-03T21:52:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/32' 2022-04-03T21:52:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/22' 2022-04-03T21:52:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/25' 2022-04-03T21:52:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/30' 2022-04-03T21:52:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/33' 2022-04-03T21:52:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/23' 2022-04-03T21:52:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/35' 2022-04-03T21:52:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/26' 2022-04-03T21:52:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed './297/37' 2022-04-03T21:52:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './297' 2022-04-03T21:52:32.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/21' 2022-04-03T21:52:32.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/27' 2022-04-03T21:52:32.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/31' 2022-04-03T21:52:32.238 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/36' 2022-04-03T21:52:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/20' 2022-04-03T21:52:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/39' 2022-04-03T21:52:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/34' 2022-04-03T21:52:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/38' 2022-04-03T21:52:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/28' 2022-04-03T21:52:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/24' 2022-04-03T21:52:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/29' 2022-04-03T21:52:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/32' 2022-04-03T21:52:32.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/22' 2022-04-03T21:52:32.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/25' 2022-04-03T21:52:32.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/30' 2022-04-03T21:52:32.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/33' 2022-04-03T21:52:32.241 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/23' 2022-04-03T21:52:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/35' 2022-04-03T21:52:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/26' 2022-04-03T21:52:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './298/37' 2022-04-03T21:52:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './298' 2022-04-03T21:52:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/21' 2022-04-03T21:52:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/27' 2022-04-03T21:52:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/31' 2022-04-03T21:52:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/36' 2022-04-03T21:52:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/20' 2022-04-03T21:52:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/39' 2022-04-03T21:52:32.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/34' 2022-04-03T21:52:32.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/38' 2022-04-03T21:52:32.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/28' 2022-04-03T21:52:32.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/24' 2022-04-03T21:52:32.244 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/29' 2022-04-03T21:52:32.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/32' 2022-04-03T21:52:32.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/22' 2022-04-03T21:52:32.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/25' 2022-04-03T21:52:32.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/30' 2022-04-03T21:52:32.245 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/33' 2022-04-03T21:52:32.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/23' 2022-04-03T21:52:32.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/35' 2022-04-03T21:52:32.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/26' 2022-04-03T21:52:32.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed './299/37' 2022-04-03T21:52:32.246 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './299' 2022-04-03T21:52:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/19' 2022-04-03T21:52:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/15' 2022-04-03T21:52:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/20' 2022-04-03T21:52:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/12' 2022-04-03T21:52:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/10' 2022-04-03T21:52:32.248 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/11' 2022-04-03T21:52:32.248 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/16' 2022-04-03T21:52:32.248 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/14' 2022-04-03T21:52:32.248 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/18' 2022-04-03T21:52:32.249 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/13' 2022-04-03T21:52:32.249 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/166/17' 2022-04-03T21:52:32.249 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/166' 2022-04-03T21:52:32.249 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/19' 2022-04-03T21:52:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/15' 2022-04-03T21:52:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/20' 2022-04-03T21:52:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/12' 2022-04-03T21:52:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/10' 2022-04-03T21:52:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/11' 2022-04-03T21:52:32.251 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/16' 2022-04-03T21:52:32.251 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/14' 2022-04-03T21:52:32.251 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/18' 2022-04-03T21:52:32.251 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/13' 2022-04-03T21:52:32.251 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/147/17' 2022-04-03T21:52:32.252 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/147' 2022-04-03T21:52:32.252 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/19' 2022-04-03T21:52:32.252 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/15' 2022-04-03T21:52:32.252 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/20' 2022-04-03T21:52:32.252 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/12' 2022-04-03T21:52:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/10' 2022-04-03T21:52:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/11' 2022-04-03T21:52:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/16' 2022-04-03T21:52:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/14' 2022-04-03T21:52:32.254 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/18' 2022-04-03T21:52:32.254 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/13' 2022-04-03T21:52:32.254 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/151/17' 2022-04-03T21:52:32.254 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/151' 2022-04-03T21:52:32.254 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/19' 2022-04-03T21:52:32.255 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/15' 2022-04-03T21:52:32.255 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/20' 2022-04-03T21:52:32.255 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/12' 2022-04-03T21:52:32.255 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/10' 2022-04-03T21:52:32.256 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/11' 2022-04-03T21:52:32.256 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/16' 2022-04-03T21:52:32.256 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/14' 2022-04-03T21:52:32.256 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/18' 2022-04-03T21:52:32.256 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/13' 2022-04-03T21:52:32.257 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/170/17' 2022-04-03T21:52:32.257 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/170' 2022-04-03T21:52:32.257 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/19' 2022-04-03T21:52:32.257 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/15' 2022-04-03T21:52:32.257 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/20' 2022-04-03T21:52:32.258 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/12' 2022-04-03T21:52:32.258 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/10' 2022-04-03T21:52:32.258 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/11' 2022-04-03T21:52:32.258 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/16' 2022-04-03T21:52:32.258 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/14' 2022-04-03T21:52:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/18' 2022-04-03T21:52:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/13' 2022-04-03T21:52:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/167/17' 2022-04-03T21:52:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/167' 2022-04-03T21:52:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/19' 2022-04-03T21:52:32.260 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/15' 2022-04-03T21:52:32.260 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/20' 2022-04-03T21:52:32.260 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/12' 2022-04-03T21:52:32.260 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/10' 2022-04-03T21:52:32.261 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/11' 2022-04-03T21:52:32.261 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/16' 2022-04-03T21:52:32.261 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/14' 2022-04-03T21:52:32.261 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/18' 2022-04-03T21:52:32.261 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/13' 2022-04-03T21:52:32.262 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/140/17' 2022-04-03T21:52:32.262 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/140' 2022-04-03T21:52:32.262 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/19' 2022-04-03T21:52:32.262 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/15' 2022-04-03T21:52:32.262 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/20' 2022-04-03T21:52:32.263 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/12' 2022-04-03T21:52:32.263 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/10' 2022-04-03T21:52:32.614 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/11' 2022-04-03T21:52:32.615 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/16' 2022-04-03T21:52:32.615 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/14' 2022-04-03T21:52:32.615 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/18' 2022-04-03T21:52:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/13' 2022-04-03T21:52:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/142/17' 2022-04-03T21:52:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/142' 2022-04-03T21:52:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/19' 2022-04-03T21:52:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/15' 2022-04-03T21:52:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/20' 2022-04-03T21:52:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/12' 2022-04-03T21:52:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/10' 2022-04-03T21:52:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/11' 2022-04-03T21:52:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/16' 2022-04-03T21:52:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/14' 2022-04-03T21:52:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/18' 2022-04-03T21:52:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/13' 2022-04-03T21:52:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/150/17' 2022-04-03T21:52:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/150' 2022-04-03T21:52:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/19' 2022-04-03T21:52:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/15' 2022-04-03T21:52:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/20' 2022-04-03T21:52:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/12' 2022-04-03T21:52:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/10' 2022-04-03T21:52:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/11' 2022-04-03T21:52:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/16' 2022-04-03T21:52:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/14' 2022-04-03T21:52:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/18' 2022-04-03T21:52:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/13' 2022-04-03T21:52:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/105/17' 2022-04-03T21:52:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/105' 2022-04-03T21:52:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/19' 2022-04-03T21:52:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/15' 2022-04-03T21:52:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/20' 2022-04-03T21:52:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/12' 2022-04-03T21:52:32.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/10' 2022-04-03T21:52:32.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/11' 2022-04-03T21:52:32.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/16' 2022-04-03T21:52:32.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/14' 2022-04-03T21:52:32.623 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/18' 2022-04-03T21:52:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/13' 2022-04-03T21:52:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/149/17' 2022-04-03T21:52:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/149' 2022-04-03T21:52:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/19' 2022-04-03T21:52:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/15' 2022-04-03T21:52:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/20' 2022-04-03T21:52:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/12' 2022-04-03T21:52:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/10' 2022-04-03T21:52:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/11' 2022-04-03T21:52:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/16' 2022-04-03T21:52:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/14' 2022-04-03T21:52:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/18' 2022-04-03T21:52:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/13' 2022-04-03T21:52:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/109/17' 2022-04-03T21:52:32.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/109' 2022-04-03T21:52:32.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/19' 2022-04-03T21:52:32.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/15' 2022-04-03T21:52:32.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/20' 2022-04-03T21:52:32.627 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/12' 2022-04-03T21:52:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/10' 2022-04-03T21:52:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/11' 2022-04-03T21:52:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/16' 2022-04-03T21:52:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/14' 2022-04-03T21:52:32.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/18' 2022-04-03T21:52:32.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/13' 2022-04-03T21:52:32.629 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/158/17' 2022-04-03T21:52:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/158' 2022-04-03T21:52:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/19' 2022-04-03T21:52:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/15' 2022-04-03T21:52:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/20' 2022-04-03T21:52:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/12' 2022-04-03T21:52:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/10' 2022-04-03T21:52:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/11' 2022-04-03T21:52:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/16' 2022-04-03T21:52:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/14' 2022-04-03T21:52:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/18' 2022-04-03T21:52:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/13' 2022-04-03T21:52:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/106/17' 2022-04-03T21:52:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/106' 2022-04-03T21:52:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/19' 2022-04-03T21:52:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/15' 2022-04-03T21:52:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/20' 2022-04-03T21:52:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/12' 2022-04-03T21:52:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/10' 2022-04-03T21:52:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/11' 2022-04-03T21:52:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/16' 2022-04-03T21:52:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/14' 2022-04-03T21:52:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/18' 2022-04-03T21:52:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/13' 2022-04-03T21:52:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/189/17' 2022-04-03T21:52:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/189' 2022-04-03T21:52:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/19' 2022-04-03T21:52:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/15' 2022-04-03T21:52:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/20' 2022-04-03T21:52:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/12' 2022-04-03T21:52:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/10' 2022-04-03T21:52:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/11' 2022-04-03T21:52:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/16' 2022-04-03T21:52:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/14' 2022-04-03T21:52:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/18' 2022-04-03T21:52:32.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/13' 2022-04-03T21:52:32.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/133/17' 2022-04-03T21:52:32.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/133' 2022-04-03T21:52:32.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/19' 2022-04-03T21:52:32.637 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/15' 2022-04-03T21:52:32.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/20' 2022-04-03T21:52:32.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/12' 2022-04-03T21:52:32.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/10' 2022-04-03T21:52:32.638 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/11' 2022-04-03T21:52:32.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/16' 2022-04-03T21:52:32.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/14' 2022-04-03T21:52:32.988 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/18' 2022-04-03T21:52:32.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/13' 2022-04-03T21:52:32.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/173/17' 2022-04-03T21:52:32.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/173' 2022-04-03T21:52:32.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/19' 2022-04-03T21:52:32.989 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/15' 2022-04-03T21:52:32.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/20' 2022-04-03T21:52:32.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/12' 2022-04-03T21:52:32.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/10' 2022-04-03T21:52:32.990 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/11' 2022-04-03T21:52:32.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/16' 2022-04-03T21:52:32.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/14' 2022-04-03T21:52:32.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/18' 2022-04-03T21:52:32.991 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/13' 2022-04-03T21:52:32.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/174/17' 2022-04-03T21:52:32.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/174' 2022-04-03T21:52:32.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/19' 2022-04-03T21:52:32.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/15' 2022-04-03T21:52:32.992 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/20' 2022-04-03T21:52:32.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/12' 2022-04-03T21:52:32.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/10' 2022-04-03T21:52:32.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/11' 2022-04-03T21:52:32.993 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/16' 2022-04-03T21:52:32.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/14' 2022-04-03T21:52:32.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/18' 2022-04-03T21:52:32.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/13' 2022-04-03T21:52:32.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/155/17' 2022-04-03T21:52:32.994 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/155' 2022-04-03T21:52:32.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/19' 2022-04-03T21:52:32.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/15' 2022-04-03T21:52:32.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/20' 2022-04-03T21:52:32.995 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/12' 2022-04-03T21:52:32.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/10' 2022-04-03T21:52:32.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/11' 2022-04-03T21:52:32.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/16' 2022-04-03T21:52:32.996 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/14' 2022-04-03T21:52:32.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/18' 2022-04-03T21:52:32.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/13' 2022-04-03T21:52:32.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/114/17' 2022-04-03T21:52:32.997 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/114' 2022-04-03T21:52:32.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/19' 2022-04-03T21:52:32.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/15' 2022-04-03T21:52:32.998 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/20' 2022-04-03T21:52:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/12' 2022-04-03T21:52:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/10' 2022-04-03T21:52:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/11' 2022-04-03T21:52:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/16' 2022-04-03T21:52:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/14' 2022-04-03T21:52:33.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/18' 2022-04-03T21:52:33.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/13' 2022-04-03T21:52:33.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/159/17' 2022-04-03T21:52:33.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/159' 2022-04-03T21:52:33.000 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/19' 2022-04-03T21:52:33.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/15' 2022-04-03T21:52:33.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/20' 2022-04-03T21:52:33.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/12' 2022-04-03T21:52:33.001 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/10' 2022-04-03T21:52:33.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/11' 2022-04-03T21:52:33.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/16' 2022-04-03T21:52:33.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/14' 2022-04-03T21:52:33.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/18' 2022-04-03T21:52:33.002 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/13' 2022-04-03T21:52:33.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/187/17' 2022-04-03T21:52:33.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/187' 2022-04-03T21:52:33.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/19' 2022-04-03T21:52:33.003 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/15' 2022-04-03T21:52:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/20' 2022-04-03T21:52:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/12' 2022-04-03T21:52:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/10' 2022-04-03T21:52:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/11' 2022-04-03T21:52:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/16' 2022-04-03T21:52:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/14' 2022-04-03T21:52:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/18' 2022-04-03T21:52:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/13' 2022-04-03T21:52:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/185/17' 2022-04-03T21:52:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/185' 2022-04-03T21:52:33.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/19' 2022-04-03T21:52:33.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/15' 2022-04-03T21:52:33.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/20' 2022-04-03T21:52:33.006 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/12' 2022-04-03T21:52:33.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/10' 2022-04-03T21:52:33.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/11' 2022-04-03T21:52:33.007 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/16' 2022-04-03T21:52:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/14' 2022-04-03T21:52:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/18' 2022-04-03T21:52:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/13' 2022-04-03T21:52:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/120/17' 2022-04-03T21:52:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/120' 2022-04-03T21:52:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/19' 2022-04-03T21:52:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/15' 2022-04-03T21:52:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/20' 2022-04-03T21:52:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/12' 2022-04-03T21:52:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/10' 2022-04-03T21:52:33.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/11' 2022-04-03T21:52:33.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/16' 2022-04-03T21:52:33.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/14' 2022-04-03T21:52:33.010 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/18' 2022-04-03T21:52:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/13' 2022-04-03T21:52:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/110/17' 2022-04-03T21:52:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/110' 2022-04-03T21:52:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/19' 2022-04-03T21:52:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/15' 2022-04-03T21:52:33.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/20' 2022-04-03T21:52:33.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/12' 2022-04-03T21:52:33.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/10' 2022-04-03T21:52:33.012 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/11' 2022-04-03T21:52:33.013 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/16' 2022-04-03T21:52:33.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/14' 2022-04-03T21:52:33.292 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/18' 2022-04-03T21:52:33.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/13' 2022-04-03T21:52:33.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/137/17' 2022-04-03T21:52:33.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/137' 2022-04-03T21:52:33.293 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/19' 2022-04-03T21:52:33.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/15' 2022-04-03T21:52:33.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/20' 2022-04-03T21:52:33.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/12' 2022-04-03T21:52:33.294 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/10' 2022-04-03T21:52:33.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/11' 2022-04-03T21:52:33.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/16' 2022-04-03T21:52:33.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/14' 2022-04-03T21:52:33.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/18' 2022-04-03T21:52:33.295 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/13' 2022-04-03T21:52:33.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/198/17' 2022-04-03T21:52:33.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/198' 2022-04-03T21:52:33.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/19' 2022-04-03T21:52:33.296 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/15' 2022-04-03T21:52:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/20' 2022-04-03T21:52:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/12' 2022-04-03T21:52:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/10' 2022-04-03T21:52:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/11' 2022-04-03T21:52:33.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/16' 2022-04-03T21:52:33.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/14' 2022-04-03T21:52:33.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/18' 2022-04-03T21:52:33.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/13' 2022-04-03T21:52:33.298 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/136/17' 2022-04-03T21:52:33.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/136' 2022-04-03T21:52:33.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/19' 2022-04-03T21:52:33.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/15' 2022-04-03T21:52:33.299 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/20' 2022-04-03T21:52:33.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/12' 2022-04-03T21:52:33.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/10' 2022-04-03T21:52:33.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/11' 2022-04-03T21:52:33.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/16' 2022-04-03T21:52:33.300 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/14' 2022-04-03T21:52:33.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/18' 2022-04-03T21:52:33.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/13' 2022-04-03T21:52:33.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/125/17' 2022-04-03T21:52:33.301 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/125' 2022-04-03T21:52:33.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/19' 2022-04-03T21:52:33.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/15' 2022-04-03T21:52:33.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/20' 2022-04-03T21:52:33.302 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/12' 2022-04-03T21:52:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/10' 2022-04-03T21:52:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/11' 2022-04-03T21:52:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/16' 2022-04-03T21:52:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/14' 2022-04-03T21:52:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/18' 2022-04-03T21:52:33.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/13' 2022-04-03T21:52:33.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/194/17' 2022-04-03T21:52:33.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/194' 2022-04-03T21:52:33.304 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/19' 2022-04-03T21:52:33.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/15' 2022-04-03T21:52:33.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/20' 2022-04-03T21:52:33.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/12' 2022-04-03T21:52:33.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/10' 2022-04-03T21:52:33.305 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/11' 2022-04-03T21:52:33.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/16' 2022-04-03T21:52:33.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/14' 2022-04-03T21:52:33.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/18' 2022-04-03T21:52:33.306 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/13' 2022-04-03T21:52:33.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/119/17' 2022-04-03T21:52:33.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/119' 2022-04-03T21:52:33.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/19' 2022-04-03T21:52:33.307 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/15' 2022-04-03T21:52:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/20' 2022-04-03T21:52:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/12' 2022-04-03T21:52:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/10' 2022-04-03T21:52:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/11' 2022-04-03T21:52:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/16' 2022-04-03T21:52:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/14' 2022-04-03T21:52:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/18' 2022-04-03T21:52:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/13' 2022-04-03T21:52:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/157/17' 2022-04-03T21:52:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/157' 2022-04-03T21:52:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/19' 2022-04-03T21:52:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/15' 2022-04-03T21:52:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/20' 2022-04-03T21:52:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/12' 2022-04-03T21:52:33.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/10' 2022-04-03T21:52:33.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/11' 2022-04-03T21:52:33.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/16' 2022-04-03T21:52:33.311 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/14' 2022-04-03T21:52:33.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/18' 2022-04-03T21:52:33.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/13' 2022-04-03T21:52:33.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/172/17' 2022-04-03T21:52:33.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/172' 2022-04-03T21:52:33.312 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/19' 2022-04-03T21:52:33.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/15' 2022-04-03T21:52:33.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/20' 2022-04-03T21:52:33.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/12' 2022-04-03T21:52:33.313 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/10' 2022-04-03T21:52:33.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/11' 2022-04-03T21:52:33.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/16' 2022-04-03T21:52:33.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/14' 2022-04-03T21:52:33.314 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/18' 2022-04-03T21:52:33.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/13' 2022-04-03T21:52:33.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/186/17' 2022-04-03T21:52:33.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/186' 2022-04-03T21:52:33.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/19' 2022-04-03T21:52:33.315 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/15' 2022-04-03T21:52:33.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/20' 2022-04-03T21:52:33.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/12' 2022-04-03T21:52:33.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/10' 2022-04-03T21:52:33.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/11' 2022-04-03T21:52:33.316 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/16' 2022-04-03T21:52:33.317 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/14' 2022-04-03T21:52:33.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/18' 2022-04-03T21:52:33.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/13' 2022-04-03T21:52:33.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/190/17' 2022-04-03T21:52:33.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/190' 2022-04-03T21:52:33.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/19' 2022-04-03T21:52:33.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/15' 2022-04-03T21:52:33.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/20' 2022-04-03T21:52:33.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/12' 2022-04-03T21:52:33.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/10' 2022-04-03T21:52:33.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/11' 2022-04-03T21:52:33.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/16' 2022-04-03T21:52:33.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/14' 2022-04-03T21:52:33.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/18' 2022-04-03T21:52:33.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/13' 2022-04-03T21:52:33.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/104/17' 2022-04-03T21:52:33.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/104' 2022-04-03T21:52:33.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/19' 2022-04-03T21:52:33.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/15' 2022-04-03T21:52:33.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/20' 2022-04-03T21:52:33.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/12' 2022-04-03T21:52:33.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/10' 2022-04-03T21:52:33.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/11' 2022-04-03T21:52:33.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/16' 2022-04-03T21:52:33.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/14' 2022-04-03T21:52:33.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/18' 2022-04-03T21:52:33.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/13' 2022-04-03T21:52:33.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/164/17' 2022-04-03T21:52:33.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/164' 2022-04-03T21:52:33.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/19' 2022-04-03T21:52:33.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/15' 2022-04-03T21:52:33.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/20' 2022-04-03T21:52:33.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/12' 2022-04-03T21:52:33.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/10' 2022-04-03T21:52:33.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/11' 2022-04-03T21:52:33.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/16' 2022-04-03T21:52:33.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/14' 2022-04-03T21:52:33.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/18' 2022-04-03T21:52:33.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/13' 2022-04-03T21:52:33.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/112/17' 2022-04-03T21:52:33.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/112' 2022-04-03T21:52:33.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/19' 2022-04-03T21:52:33.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/15' 2022-04-03T21:52:33.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/20' 2022-04-03T21:52:33.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/12' 2022-04-03T21:52:33.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/10' 2022-04-03T21:52:33.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/11' 2022-04-03T21:52:33.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/16' 2022-04-03T21:52:33.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/14' 2022-04-03T21:52:33.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/18' 2022-04-03T21:52:33.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/13' 2022-04-03T21:52:33.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/100/17' 2022-04-03T21:52:33.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/100' 2022-04-03T21:52:33.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/19' 2022-04-03T21:52:33.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/15' 2022-04-03T21:52:33.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/20' 2022-04-03T21:52:33.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/12' 2022-04-03T21:52:33.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/10' 2022-04-03T21:52:33.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/11' 2022-04-03T21:52:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/16' 2022-04-03T21:52:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/14' 2022-04-03T21:52:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/18' 2022-04-03T21:52:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/13' 2022-04-03T21:52:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/134/17' 2022-04-03T21:52:33.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/134' 2022-04-03T21:52:33.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/19' 2022-04-03T21:52:33.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/15' 2022-04-03T21:52:33.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/20' 2022-04-03T21:52:33.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/12' 2022-04-03T21:52:33.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/10' 2022-04-03T21:52:33.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/11' 2022-04-03T21:52:33.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/16' 2022-04-03T21:52:33.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/14' 2022-04-03T21:52:33.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/18' 2022-04-03T21:52:33.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/13' 2022-04-03T21:52:33.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/115/17' 2022-04-03T21:52:33.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/115' 2022-04-03T21:52:33.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/19' 2022-04-03T21:52:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/15' 2022-04-03T21:52:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/20' 2022-04-03T21:52:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/12' 2022-04-03T21:52:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/10' 2022-04-03T21:52:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/11' 2022-04-03T21:52:33.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/16' 2022-04-03T21:52:33.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/14' 2022-04-03T21:52:33.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/18' 2022-04-03T21:52:33.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/13' 2022-04-03T21:52:33.597 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/116/17' 2022-04-03T21:52:33.597 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/116' 2022-04-03T21:52:33.597 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/19' 2022-04-03T21:52:33.597 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/15' 2022-04-03T21:52:33.597 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/20' 2022-04-03T21:52:33.598 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/12' 2022-04-03T21:52:33.598 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/10' 2022-04-03T21:52:33.598 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/11' 2022-04-03T21:52:33.598 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/16' 2022-04-03T21:52:33.599 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/14' 2022-04-03T21:52:33.599 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/18' 2022-04-03T21:52:33.599 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/13' 2022-04-03T21:52:33.599 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/195/17' 2022-04-03T21:52:33.599 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/195' 2022-04-03T21:52:33.600 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/19' 2022-04-03T21:52:33.600 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/15' 2022-04-03T21:52:33.600 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/20' 2022-04-03T21:52:33.600 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/12' 2022-04-03T21:52:33.600 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/10' 2022-04-03T21:52:33.601 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/11' 2022-04-03T21:52:33.601 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/16' 2022-04-03T21:52:33.601 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/14' 2022-04-03T21:52:33.601 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/18' 2022-04-03T21:52:34.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/13' 2022-04-03T21:52:34.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/138/17' 2022-04-03T21:52:34.187 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/138' 2022-04-03T21:52:34.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/19' 2022-04-03T21:52:34.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/15' 2022-04-03T21:52:34.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/20' 2022-04-03T21:52:34.188 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/12' 2022-04-03T21:52:34.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/10' 2022-04-03T21:52:34.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/11' 2022-04-03T21:52:34.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/16' 2022-04-03T21:52:34.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/14' 2022-04-03T21:52:34.189 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/18' 2022-04-03T21:52:34.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/13' 2022-04-03T21:52:34.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/135/17' 2022-04-03T21:52:34.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/135' 2022-04-03T21:52:34.190 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/19' 2022-04-03T21:52:34.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/15' 2022-04-03T21:52:34.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/20' 2022-04-03T21:52:34.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/12' 2022-04-03T21:52:34.191 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/10' 2022-04-03T21:52:34.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/11' 2022-04-03T21:52:34.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/16' 2022-04-03T21:52:34.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/14' 2022-04-03T21:52:34.192 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/18' 2022-04-03T21:52:34.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/13' 2022-04-03T21:52:34.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/117/17' 2022-04-03T21:52:34.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/117' 2022-04-03T21:52:34.193 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/19' 2022-04-03T21:52:34.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/15' 2022-04-03T21:52:34.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/20' 2022-04-03T21:52:34.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/12' 2022-04-03T21:52:34.194 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/10' 2022-04-03T21:52:34.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/11' 2022-04-03T21:52:34.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/16' 2022-04-03T21:52:34.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/14' 2022-04-03T21:52:34.195 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/18' 2022-04-03T21:52:34.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/13' 2022-04-03T21:52:34.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/143/17' 2022-04-03T21:52:34.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/143' 2022-04-03T21:52:34.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/19' 2022-04-03T21:52:34.196 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/15' 2022-04-03T21:52:34.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/20' 2022-04-03T21:52:34.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/12' 2022-04-03T21:52:34.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/10' 2022-04-03T21:52:34.197 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/11' 2022-04-03T21:52:34.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/16' 2022-04-03T21:52:34.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/14' 2022-04-03T21:52:34.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/18' 2022-04-03T21:52:34.198 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/13' 2022-04-03T21:52:34.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/180/17' 2022-04-03T21:52:34.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/180' 2022-04-03T21:52:34.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/19' 2022-04-03T21:52:34.199 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/15' 2022-04-03T21:52:34.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/20' 2022-04-03T21:52:34.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/12' 2022-04-03T21:52:34.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/10' 2022-04-03T21:52:34.200 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/11' 2022-04-03T21:52:34.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/16' 2022-04-03T21:52:34.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/14' 2022-04-03T21:52:34.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/18' 2022-04-03T21:52:34.201 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/13' 2022-04-03T21:52:34.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/126/17' 2022-04-03T21:52:34.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/126' 2022-04-03T21:52:34.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/19' 2022-04-03T21:52:34.202 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/15' 2022-04-03T21:52:34.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/20' 2022-04-03T21:52:34.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/12' 2022-04-03T21:52:34.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/10' 2022-04-03T21:52:34.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/11' 2022-04-03T21:52:34.203 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/16' 2022-04-03T21:52:34.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/14' 2022-04-03T21:52:34.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/18' 2022-04-03T21:52:34.204 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/13' 2022-04-03T21:52:34.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/161/17' 2022-04-03T21:52:34.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/161' 2022-04-03T21:52:34.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/19' 2022-04-03T21:52:34.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/15' 2022-04-03T21:52:34.205 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/20' 2022-04-03T21:52:34.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/12' 2022-04-03T21:52:34.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/10' 2022-04-03T21:52:34.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/11' 2022-04-03T21:52:34.206 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/16' 2022-04-03T21:52:34.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/14' 2022-04-03T21:52:34.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/18' 2022-04-03T21:52:34.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/13' 2022-04-03T21:52:34.207 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/176/17' 2022-04-03T21:52:34.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/176' 2022-04-03T21:52:34.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/19' 2022-04-03T21:52:34.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/15' 2022-04-03T21:52:34.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/20' 2022-04-03T21:52:34.208 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/12' 2022-04-03T21:52:34.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/10' 2022-04-03T21:52:34.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/11' 2022-04-03T21:52:34.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/16' 2022-04-03T21:52:34.209 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/14' 2022-04-03T21:52:34.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/18' 2022-04-03T21:52:34.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/13' 2022-04-03T21:52:34.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/111/17' 2022-04-03T21:52:34.210 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/111' 2022-04-03T21:52:34.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/19' 2022-04-03T21:52:34.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/15' 2022-04-03T21:52:34.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/20' 2022-04-03T21:52:34.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/12' 2022-04-03T21:52:34.211 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/10' 2022-04-03T21:52:34.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/11' 2022-04-03T21:52:34.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/16' 2022-04-03T21:52:34.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/14' 2022-04-03T21:52:34.212 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/18' 2022-04-03T21:52:34.213 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/13' 2022-04-03T21:52:34.569 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/191/17' 2022-04-03T21:52:34.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/191' 2022-04-03T21:52:34.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/19' 2022-04-03T21:52:34.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/15' 2022-04-03T21:52:34.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/20' 2022-04-03T21:52:34.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/12' 2022-04-03T21:52:34.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/10' 2022-04-03T21:52:34.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/11' 2022-04-03T21:52:34.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/16' 2022-04-03T21:52:34.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/14' 2022-04-03T21:52:34.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/18' 2022-04-03T21:52:34.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/13' 2022-04-03T21:52:34.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/184/17' 2022-04-03T21:52:34.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/184' 2022-04-03T21:52:34.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/19' 2022-04-03T21:52:34.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/15' 2022-04-03T21:52:34.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/20' 2022-04-03T21:52:34.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/12' 2022-04-03T21:52:34.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/10' 2022-04-03T21:52:34.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/11' 2022-04-03T21:52:34.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/16' 2022-04-03T21:52:34.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/14' 2022-04-03T21:52:34.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/18' 2022-04-03T21:52:34.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/13' 2022-04-03T21:52:34.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/192/17' 2022-04-03T21:52:34.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/192' 2022-04-03T21:52:34.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/19' 2022-04-03T21:52:34.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/15' 2022-04-03T21:52:34.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/20' 2022-04-03T21:52:34.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/12' 2022-04-03T21:52:34.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/10' 2022-04-03T21:52:34.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/11' 2022-04-03T21:52:34.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/16' 2022-04-03T21:52:34.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/14' 2022-04-03T21:52:34.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/18' 2022-04-03T21:52:34.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/13' 2022-04-03T21:52:34.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/103/17' 2022-04-03T21:52:34.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/103' 2022-04-03T21:52:34.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/19' 2022-04-03T21:52:34.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/15' 2022-04-03T21:52:34.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/20' 2022-04-03T21:52:34.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/12' 2022-04-03T21:52:34.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/10' 2022-04-03T21:52:34.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/11' 2022-04-03T21:52:34.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/16' 2022-04-03T21:52:34.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/14' 2022-04-03T21:52:34.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/18' 2022-04-03T21:52:34.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/13' 2022-04-03T21:52:34.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/128/17' 2022-04-03T21:52:34.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/128' 2022-04-03T21:52:34.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/19' 2022-04-03T21:52:34.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/15' 2022-04-03T21:52:34.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/20' 2022-04-03T21:52:34.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/12' 2022-04-03T21:52:34.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/10' 2022-04-03T21:52:34.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/11' 2022-04-03T21:52:34.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/16' 2022-04-03T21:52:34.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/14' 2022-04-03T21:52:34.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/18' 2022-04-03T21:52:34.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/13' 2022-04-03T21:52:34.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/144/17' 2022-04-03T21:52:34.585 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/144' 2022-04-03T21:52:34.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/19' 2022-04-03T21:52:34.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/15' 2022-04-03T21:52:34.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/20' 2022-04-03T21:52:34.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/12' 2022-04-03T21:52:34.586 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/10' 2022-04-03T21:52:34.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/11' 2022-04-03T21:52:34.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/16' 2022-04-03T21:52:34.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/14' 2022-04-03T21:52:34.587 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/18' 2022-04-03T21:52:34.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/13' 2022-04-03T21:52:34.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/146/17' 2022-04-03T21:52:34.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/146' 2022-04-03T21:52:34.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/19' 2022-04-03T21:52:34.588 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/15' 2022-04-03T21:52:34.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/20' 2022-04-03T21:52:34.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/12' 2022-04-03T21:52:34.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/10' 2022-04-03T21:52:34.589 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/11' 2022-04-03T21:52:34.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/16' 2022-04-03T21:52:34.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/14' 2022-04-03T21:52:34.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/18' 2022-04-03T21:52:34.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/13' 2022-04-03T21:52:34.590 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/141/17' 2022-04-03T21:52:34.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/141' 2022-04-03T21:52:34.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/19' 2022-04-03T21:52:34.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/15' 2022-04-03T21:52:34.591 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/20' 2022-04-03T21:52:34.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/12' 2022-04-03T21:52:34.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/10' 2022-04-03T21:52:34.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/11' 2022-04-03T21:52:34.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/16' 2022-04-03T21:52:34.592 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/14' 2022-04-03T21:52:34.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/18' 2022-04-03T21:52:34.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/13' 2022-04-03T21:52:34.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/182/17' 2022-04-03T21:52:34.593 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/182' 2022-04-03T21:52:34.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/19' 2022-04-03T21:52:34.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/15' 2022-04-03T21:52:34.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/20' 2022-04-03T21:52:34.594 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/12' 2022-04-03T21:52:34.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/10' 2022-04-03T21:52:34.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/11' 2022-04-03T21:52:34.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/16' 2022-04-03T21:52:34.595 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/14' 2022-04-03T21:52:34.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/18' 2022-04-03T21:52:34.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/13' 2022-04-03T21:52:34.596 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/107/17' 2022-04-03T21:52:34.819 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/107' 2022-04-03T21:52:34.819 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/19' 2022-04-03T21:52:34.819 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/15' 2022-04-03T21:52:34.819 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/20' 2022-04-03T21:52:34.820 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/12' 2022-04-03T21:52:34.820 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/10' 2022-04-03T21:52:34.820 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/11' 2022-04-03T21:52:34.820 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/16' 2022-04-03T21:52:34.821 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/14' 2022-04-03T21:52:34.821 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/18' 2022-04-03T21:52:34.821 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/13' 2022-04-03T21:52:34.821 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/178/17' 2022-04-03T21:52:34.821 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/178' 2022-04-03T21:52:34.822 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/19' 2022-04-03T21:52:34.822 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/15' 2022-04-03T21:52:34.822 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/20' 2022-04-03T21:52:34.822 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/12' 2022-04-03T21:52:34.823 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/10' 2022-04-03T21:52:34.823 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/11' 2022-04-03T21:52:34.823 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/16' 2022-04-03T21:52:34.823 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/14' 2022-04-03T21:52:34.823 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/18' 2022-04-03T21:52:34.824 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/13' 2022-04-03T21:52:34.824 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/156/17' 2022-04-03T21:52:34.824 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/156' 2022-04-03T21:52:34.824 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/19' 2022-04-03T21:52:34.824 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/15' 2022-04-03T21:52:34.825 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/20' 2022-04-03T21:52:34.825 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/12' 2022-04-03T21:52:34.825 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/10' 2022-04-03T21:52:34.825 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/11' 2022-04-03T21:52:34.826 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/16' 2022-04-03T21:52:34.826 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/14' 2022-04-03T21:52:34.826 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/18' 2022-04-03T21:52:34.826 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/13' 2022-04-03T21:52:34.826 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/131/17' 2022-04-03T21:52:34.827 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/131' 2022-04-03T21:52:34.827 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/19' 2022-04-03T21:52:34.827 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/15' 2022-04-03T21:52:34.827 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/20' 2022-04-03T21:52:34.827 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/12' 2022-04-03T21:52:34.828 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/10' 2022-04-03T21:52:34.828 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/11' 2022-04-03T21:52:34.828 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/16' 2022-04-03T21:52:34.828 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/14' 2022-04-03T21:52:34.829 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/18' 2022-04-03T21:52:34.829 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/13' 2022-04-03T21:52:34.829 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/123/17' 2022-04-03T21:52:34.829 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/123' 2022-04-03T21:52:34.829 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/19' 2022-04-03T21:52:34.830 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/15' 2022-04-03T21:52:34.830 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/20' 2022-04-03T21:52:34.830 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/12' 2022-04-03T21:52:34.830 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/10' 2022-04-03T21:52:34.831 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/11' 2022-04-03T21:52:34.831 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/16' 2022-04-03T21:52:34.831 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/14' 2022-04-03T21:52:34.831 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/18' 2022-04-03T21:52:34.832 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/13' 2022-04-03T21:52:34.832 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/160/17' 2022-04-03T21:52:34.832 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/160' 2022-04-03T21:52:34.832 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/19' 2022-04-03T21:52:34.833 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/15' 2022-04-03T21:52:34.833 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/20' 2022-04-03T21:52:34.833 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/12' 2022-04-03T21:52:34.833 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/10' 2022-04-03T21:52:34.833 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/11' 2022-04-03T21:52:34.834 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/16' 2022-04-03T21:52:34.834 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/14' 2022-04-03T21:52:34.834 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/18' 2022-04-03T21:52:34.835 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/13' 2022-04-03T21:52:34.835 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/165/17' 2022-04-03T21:52:34.835 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/165' 2022-04-03T21:52:34.836 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/19' 2022-04-03T21:52:34.836 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/15' 2022-04-03T21:52:34.836 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/20' 2022-04-03T21:52:34.836 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/12' 2022-04-03T21:52:34.837 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/10' 2022-04-03T21:52:34.837 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/11' 2022-04-03T21:52:34.837 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/16' 2022-04-03T21:52:34.837 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/14' 2022-04-03T21:52:34.837 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/18' 2022-04-03T21:52:34.838 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/13' 2022-04-03T21:52:34.838 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/101/17' 2022-04-03T21:52:34.838 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/101' 2022-04-03T21:52:34.838 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/19' 2022-04-03T21:52:34.839 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/15' 2022-04-03T21:52:34.839 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/20' 2022-04-03T21:52:34.839 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/12' 2022-04-03T21:52:34.839 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/10' 2022-04-03T21:52:34.840 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/11' 2022-04-03T21:52:34.840 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/16' 2022-04-03T21:52:34.840 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/14' 2022-04-03T21:52:34.840 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/18' 2022-04-03T21:52:34.840 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/13' 2022-04-03T21:52:34.841 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/148/17' 2022-04-03T21:52:34.841 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/148' 2022-04-03T21:52:34.841 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/19' 2022-04-03T21:52:34.841 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/15' 2022-04-03T21:52:34.842 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/20' 2022-04-03T21:52:34.842 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/12' 2022-04-03T21:52:34.842 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/10' 2022-04-03T21:52:34.842 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/11' 2022-04-03T21:52:34.842 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/16' 2022-04-03T21:52:34.843 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/14' 2022-04-03T21:52:34.843 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/18' 2022-04-03T21:52:34.843 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/13' 2022-04-03T21:52:34.843 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/168/17' 2022-04-03T21:52:34.843 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/168' 2022-04-03T21:52:35.078 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/19' 2022-04-03T21:52:35.079 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/15' 2022-04-03T21:52:35.079 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/20' 2022-04-03T21:52:35.079 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/12' 2022-04-03T21:52:35.080 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/10' 2022-04-03T21:52:35.080 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/11' 2022-04-03T21:52:35.080 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/16' 2022-04-03T21:52:35.080 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/14' 2022-04-03T21:52:35.081 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/18' 2022-04-03T21:52:35.081 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/13' 2022-04-03T21:52:35.081 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/179/17' 2022-04-03T21:52:35.081 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/179' 2022-04-03T21:52:35.082 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/19' 2022-04-03T21:52:35.082 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/15' 2022-04-03T21:52:35.082 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/20' 2022-04-03T21:52:35.082 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/12' 2022-04-03T21:52:35.082 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/10' 2022-04-03T21:52:35.083 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/11' 2022-04-03T21:52:35.083 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/16' 2022-04-03T21:52:35.083 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/14' 2022-04-03T21:52:35.083 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/18' 2022-04-03T21:52:35.084 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/13' 2022-04-03T21:52:35.084 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/132/17' 2022-04-03T21:52:35.084 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/132' 2022-04-03T21:52:35.084 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/19' 2022-04-03T21:52:35.084 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/15' 2022-04-03T21:52:35.085 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/20' 2022-04-03T21:52:35.085 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/12' 2022-04-03T21:52:35.085 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/10' 2022-04-03T21:52:35.085 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/11' 2022-04-03T21:52:35.086 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/16' 2022-04-03T21:52:35.086 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/14' 2022-04-03T21:52:35.086 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/18' 2022-04-03T21:52:35.086 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/13' 2022-04-03T21:52:35.086 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/199/17' 2022-04-03T21:52:35.087 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/199' 2022-04-03T21:52:35.087 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/19' 2022-04-03T21:52:35.087 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/15' 2022-04-03T21:52:35.087 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/20' 2022-04-03T21:52:35.088 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/12' 2022-04-03T21:52:35.088 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/10' 2022-04-03T21:52:35.088 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/11' 2022-04-03T21:52:35.088 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/16' 2022-04-03T21:52:35.089 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/14' 2022-04-03T21:52:35.089 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/18' 2022-04-03T21:52:35.089 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/13' 2022-04-03T21:52:35.089 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/163/17' 2022-04-03T21:52:35.089 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/163' 2022-04-03T21:52:35.090 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/19' 2022-04-03T21:52:35.090 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/15' 2022-04-03T21:52:35.090 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/20' 2022-04-03T21:52:35.090 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/12' 2022-04-03T21:52:35.091 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/10' 2022-04-03T21:52:35.091 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/11' 2022-04-03T21:52:35.091 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/16' 2022-04-03T21:52:35.091 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/14' 2022-04-03T21:52:35.091 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/18' 2022-04-03T21:52:35.092 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/13' 2022-04-03T21:52:35.092 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/153/17' 2022-04-03T21:52:35.092 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/153' 2022-04-03T21:52:35.092 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/19' 2022-04-03T21:52:35.093 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/15' 2022-04-03T21:52:35.093 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/20' 2022-04-03T21:52:35.093 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/12' 2022-04-03T21:52:35.094 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/10' 2022-04-03T21:52:35.094 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/11' 2022-04-03T21:52:35.094 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/16' 2022-04-03T21:52:35.094 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/14' 2022-04-03T21:52:35.094 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/18' 2022-04-03T21:52:35.095 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/13' 2022-04-03T21:52:35.095 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/122/17' 2022-04-03T21:52:35.095 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/122' 2022-04-03T21:52:35.095 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/19' 2022-04-03T21:52:35.096 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/15' 2022-04-03T21:52:35.096 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/20' 2022-04-03T21:52:35.096 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/12' 2022-04-03T21:52:35.096 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/10' 2022-04-03T21:52:35.096 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/11' 2022-04-03T21:52:35.097 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/16' 2022-04-03T21:52:35.097 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/14' 2022-04-03T21:52:35.097 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/18' 2022-04-03T21:52:35.097 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/13' 2022-04-03T21:52:35.097 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/162/17' 2022-04-03T21:52:35.098 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/162' 2022-04-03T21:52:35.098 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/19' 2022-04-03T21:52:35.098 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/15' 2022-04-03T21:52:35.098 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/20' 2022-04-03T21:52:35.099 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/12' 2022-04-03T21:52:35.099 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/10' 2022-04-03T21:52:35.099 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/11' 2022-04-03T21:52:35.099 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/16' 2022-04-03T21:52:35.099 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/14' 2022-04-03T21:52:35.100 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/18' 2022-04-03T21:52:35.100 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/13' 2022-04-03T21:52:35.100 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/197/17' 2022-04-03T21:52:35.100 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/197' 2022-04-03T21:52:35.101 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/19' 2022-04-03T21:52:35.101 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/15' 2022-04-03T21:52:35.101 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/20' 2022-04-03T21:52:35.101 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/12' 2022-04-03T21:52:35.101 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/10' 2022-04-03T21:52:35.102 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/11' 2022-04-03T21:52:35.102 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/16' 2022-04-03T21:52:35.102 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/14' 2022-04-03T21:52:35.102 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/18' 2022-04-03T21:52:35.102 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/13' 2022-04-03T21:52:35.103 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/113/17' 2022-04-03T21:52:35.103 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/113' 2022-04-03T21:52:35.103 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/19' 2022-04-03T21:52:35.559 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/15' 2022-04-03T21:52:35.559 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/20' 2022-04-03T21:52:35.559 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/12' 2022-04-03T21:52:35.560 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/10' 2022-04-03T21:52:35.560 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/11' 2022-04-03T21:52:35.560 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/16' 2022-04-03T21:52:35.560 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/14' 2022-04-03T21:52:35.561 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/18' 2022-04-03T21:52:35.561 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/13' 2022-04-03T21:52:35.561 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/152/17' 2022-04-03T21:52:35.561 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/152' 2022-04-03T21:52:35.561 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/19' 2022-04-03T21:52:35.562 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/15' 2022-04-03T21:52:35.562 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/20' 2022-04-03T21:52:35.562 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/12' 2022-04-03T21:52:35.562 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/10' 2022-04-03T21:52:35.563 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/11' 2022-04-03T21:52:35.563 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/16' 2022-04-03T21:52:35.563 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/14' 2022-04-03T21:52:35.563 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/18' 2022-04-03T21:52:35.564 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/13' 2022-04-03T21:52:35.564 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/121/17' 2022-04-03T21:52:35.564 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/121' 2022-04-03T21:52:35.564 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/19' 2022-04-03T21:52:35.565 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/15' 2022-04-03T21:52:35.565 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/20' 2022-04-03T21:52:35.565 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/12' 2022-04-03T21:52:35.565 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/10' 2022-04-03T21:52:35.566 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/11' 2022-04-03T21:52:35.566 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/16' 2022-04-03T21:52:35.566 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/14' 2022-04-03T21:52:35.566 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/18' 2022-04-03T21:52:35.567 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/13' 2022-04-03T21:52:35.567 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/118/17' 2022-04-03T21:52:35.567 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/118' 2022-04-03T21:52:35.567 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/19' 2022-04-03T21:52:35.568 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/15' 2022-04-03T21:52:35.568 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/20' 2022-04-03T21:52:35.568 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/12' 2022-04-03T21:52:35.568 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/10' 2022-04-03T21:52:35.568 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/11' 2022-04-03T21:52:35.569 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/16' 2022-04-03T21:52:35.569 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/14' 2022-04-03T21:52:35.569 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/18' 2022-04-03T21:52:35.569 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/13' 2022-04-03T21:52:35.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/196/17' 2022-04-03T21:52:35.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/196' 2022-04-03T21:52:35.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/19' 2022-04-03T21:52:35.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/15' 2022-04-03T21:52:35.570 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/20' 2022-04-03T21:52:35.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/12' 2022-04-03T21:52:35.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/10' 2022-04-03T21:52:35.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/11' 2022-04-03T21:52:35.571 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/16' 2022-04-03T21:52:35.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/14' 2022-04-03T21:52:35.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/18' 2022-04-03T21:52:35.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/13' 2022-04-03T21:52:35.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/124/17' 2022-04-03T21:52:35.572 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/124' 2022-04-03T21:52:35.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/19' 2022-04-03T21:52:35.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/15' 2022-04-03T21:52:35.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/20' 2022-04-03T21:52:35.573 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/12' 2022-04-03T21:52:35.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/10' 2022-04-03T21:52:35.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/11' 2022-04-03T21:52:35.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/16' 2022-04-03T21:52:35.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/14' 2022-04-03T21:52:35.574 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/18' 2022-04-03T21:52:35.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/13' 2022-04-03T21:52:35.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/188/17' 2022-04-03T21:52:35.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/188' 2022-04-03T21:52:35.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/19' 2022-04-03T21:52:35.575 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/15' 2022-04-03T21:52:35.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/20' 2022-04-03T21:52:35.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/12' 2022-04-03T21:52:35.576 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/10' 2022-04-03T21:52:35.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/11' 2022-04-03T21:52:35.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/16' 2022-04-03T21:52:35.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/14' 2022-04-03T21:52:35.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/18' 2022-04-03T21:52:35.577 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/13' 2022-04-03T21:52:35.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/145/17' 2022-04-03T21:52:35.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/145' 2022-04-03T21:52:35.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/19' 2022-04-03T21:52:35.578 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/15' 2022-04-03T21:52:35.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/20' 2022-04-03T21:52:35.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/12' 2022-04-03T21:52:35.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/10' 2022-04-03T21:52:35.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/11' 2022-04-03T21:52:35.579 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/16' 2022-04-03T21:52:35.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/14' 2022-04-03T21:52:35.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/18' 2022-04-03T21:52:35.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/13' 2022-04-03T21:52:35.580 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/130/17' 2022-04-03T21:52:35.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/130' 2022-04-03T21:52:35.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/19' 2022-04-03T21:52:35.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/15' 2022-04-03T21:52:35.581 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/20' 2022-04-03T21:52:35.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/12' 2022-04-03T21:52:35.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/10' 2022-04-03T21:52:35.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/11' 2022-04-03T21:52:35.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/16' 2022-04-03T21:52:35.582 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/14' 2022-04-03T21:52:35.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/18' 2022-04-03T21:52:35.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/13' 2022-04-03T21:52:35.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/193/17' 2022-04-03T21:52:35.583 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/193' 2022-04-03T21:52:35.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/19' 2022-04-03T21:52:35.584 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/15' 2022-04-03T21:52:35.788 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/20' 2022-04-03T21:52:35.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/12' 2022-04-03T21:52:35.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/10' 2022-04-03T21:52:35.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/11' 2022-04-03T21:52:35.789 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/16' 2022-04-03T21:52:35.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/14' 2022-04-03T21:52:35.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/18' 2022-04-03T21:52:35.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/13' 2022-04-03T21:52:35.790 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/175/17' 2022-04-03T21:52:35.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/175' 2022-04-03T21:52:35.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/19' 2022-04-03T21:52:35.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/15' 2022-04-03T21:52:35.791 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/20' 2022-04-03T21:52:35.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/12' 2022-04-03T21:52:35.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/10' 2022-04-03T21:52:35.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/11' 2022-04-03T21:52:35.792 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/16' 2022-04-03T21:52:35.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/14' 2022-04-03T21:52:35.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/18' 2022-04-03T21:52:35.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/13' 2022-04-03T21:52:35.793 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/181/17' 2022-04-03T21:52:35.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/181' 2022-04-03T21:52:35.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/19' 2022-04-03T21:52:35.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/15' 2022-04-03T21:52:35.794 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/20' 2022-04-03T21:52:35.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/12' 2022-04-03T21:52:35.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/10' 2022-04-03T21:52:35.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/11' 2022-04-03T21:52:35.795 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/16' 2022-04-03T21:52:35.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/14' 2022-04-03T21:52:35.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/18' 2022-04-03T21:52:35.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/13' 2022-04-03T21:52:35.796 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/127/17' 2022-04-03T21:52:35.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/127' 2022-04-03T21:52:35.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/19' 2022-04-03T21:52:35.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/15' 2022-04-03T21:52:35.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/20' 2022-04-03T21:52:35.797 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/12' 2022-04-03T21:52:35.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/10' 2022-04-03T21:52:35.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/11' 2022-04-03T21:52:35.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/16' 2022-04-03T21:52:35.798 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/14' 2022-04-03T21:52:35.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/18' 2022-04-03T21:52:35.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/13' 2022-04-03T21:52:35.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/108/17' 2022-04-03T21:52:35.799 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/108' 2022-04-03T21:52:35.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/19' 2022-04-03T21:52:35.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/15' 2022-04-03T21:52:35.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/20' 2022-04-03T21:52:35.800 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/12' 2022-04-03T21:52:35.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/10' 2022-04-03T21:52:35.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/11' 2022-04-03T21:52:35.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/16' 2022-04-03T21:52:35.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/14' 2022-04-03T21:52:35.801 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/18' 2022-04-03T21:52:35.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/13' 2022-04-03T21:52:35.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/183/17' 2022-04-03T21:52:35.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/183' 2022-04-03T21:52:35.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/19' 2022-04-03T21:52:35.802 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/15' 2022-04-03T21:52:35.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/20' 2022-04-03T21:52:35.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/12' 2022-04-03T21:52:35.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/10' 2022-04-03T21:52:35.803 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/11' 2022-04-03T21:52:35.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/16' 2022-04-03T21:52:35.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/14' 2022-04-03T21:52:35.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/18' 2022-04-03T21:52:35.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/13' 2022-04-03T21:52:35.804 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/177/17' 2022-04-03T21:52:35.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/177' 2022-04-03T21:52:35.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/19' 2022-04-03T21:52:35.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/15' 2022-04-03T21:52:35.805 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/20' 2022-04-03T21:52:35.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/12' 2022-04-03T21:52:35.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/10' 2022-04-03T21:52:35.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/11' 2022-04-03T21:52:35.806 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/16' 2022-04-03T21:52:35.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/14' 2022-04-03T21:52:35.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/18' 2022-04-03T21:52:35.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/13' 2022-04-03T21:52:35.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/169/17' 2022-04-03T21:52:35.807 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/169' 2022-04-03T21:52:35.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/19' 2022-04-03T21:52:35.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/15' 2022-04-03T21:52:35.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/20' 2022-04-03T21:52:35.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/12' 2022-04-03T21:52:35.808 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/10' 2022-04-03T21:52:35.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/11' 2022-04-03T21:52:35.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/16' 2022-04-03T21:52:35.809 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/14' 2022-04-03T21:52:35.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/18' 2022-04-03T21:52:35.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/13' 2022-04-03T21:52:35.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/154/17' 2022-04-03T21:52:35.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/154' 2022-04-03T21:52:35.810 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/19' 2022-04-03T21:52:35.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/15' 2022-04-03T21:52:35.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/20' 2022-04-03T21:52:35.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/12' 2022-04-03T21:52:35.811 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/10' 2022-04-03T21:52:35.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/11' 2022-04-03T21:52:35.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/16' 2022-04-03T21:52:35.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/14' 2022-04-03T21:52:35.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/18' 2022-04-03T21:52:35.812 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/13' 2022-04-03T21:52:35.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/171/17' 2022-04-03T21:52:35.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/171' 2022-04-03T21:52:35.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/19' 2022-04-03T21:52:35.813 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/15' 2022-04-03T21:52:35.814 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/20' 2022-04-03T21:52:35.869 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/12' 2022-04-03T21:52:35.870 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/10' 2022-04-03T21:52:35.870 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/11' 2022-04-03T21:52:35.870 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/16' 2022-04-03T21:52:35.870 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/14' 2022-04-03T21:52:35.871 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/18' 2022-04-03T21:52:35.871 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/13' 2022-04-03T21:52:35.871 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/139/17' 2022-04-03T21:52:35.871 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/139' 2022-04-03T21:52:35.871 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/19' 2022-04-03T21:52:35.872 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/15' 2022-04-03T21:52:35.872 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/20' 2022-04-03T21:52:35.872 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/12' 2022-04-03T21:52:35.872 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/10' 2022-04-03T21:52:35.873 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/11' 2022-04-03T21:52:35.873 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/16' 2022-04-03T21:52:35.873 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/14' 2022-04-03T21:52:35.873 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/18' 2022-04-03T21:52:35.873 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/13' 2022-04-03T21:52:35.874 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/102/17' 2022-04-03T21:52:35.874 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/102' 2022-04-03T21:52:35.874 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/19' 2022-04-03T21:52:35.874 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/15' 2022-04-03T21:52:35.875 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/20' 2022-04-03T21:52:35.875 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/12' 2022-04-03T21:52:35.875 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/10' 2022-04-03T21:52:35.875 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/11' 2022-04-03T21:52:35.876 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/16' 2022-04-03T21:52:35.876 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/14' 2022-04-03T21:52:35.876 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/18' 2022-04-03T21:52:35.876 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/13' 2022-04-03T21:52:35.876 INFO:tasks.workunit.client.0.smithi049.stdout:removed './copyofsnap1/test1/129/17' 2022-04-03T21:52:35.877 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1/129' 2022-04-03T21:52:35.877 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1/test1' 2022-04-03T21:52:35.877 INFO:tasks.workunit.client.0.smithi049.stdout:removed directory './copyofsnap1' 2022-04-03T21:52:35.878 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:52:35.879 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:52:35.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:52:35.977 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2022-04-03T21:52:35.977 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2022-04-03T21:52:36.084 INFO:tasks.workunit.client.0.smithi049.stderr:+ set -e 2022-04-03T21:52:36.084 INFO:tasks.workunit.client.0.smithi049.stderr:+ touch foo 2022-04-03T21:52:36.093 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod +x foo 2022-04-03T21:52:36.097 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir .snap/s 2022-04-03T21:52:36.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ find .snap/s/foo -executable 2022-04-03T21:52:36.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep foo 2022-04-03T21:52:36.180 INFO:tasks.workunit.client.0.smithi049.stdout:.snap/s/foo 2022-04-03T21:52:36.181 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir .snap/s 2022-04-03T21:52:36.189 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm foo 2022-04-03T21:52:36.193 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:52:36.193 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:52:36.194 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:52:36.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:52:36.280 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2022-04-03T21:52:36.281 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2022-04-03T21:52:36.351 INFO:tasks.workunit.client.0.smithi049.stderr:+ set -e 2022-04-03T21:52:36.351 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir foo 2022-04-03T21:52:36.355 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo x 2022-04-03T21:52:36.356 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:38.809 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir foo/.snap/ss 2022-04-03T21:52:38.821 INFO:tasks.workunit.client.0.smithi049.stderr:+ ln foo/x foo/xx 2022-04-03T21:52:38.843 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat foo/.snap/ss/x 2022-04-03T21:52:38.857 INFO:tasks.workunit.client.0.smithi049.stdout:x 2022-04-03T21:52:38.857 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir foo/.snap/ss 2022-04-03T21:52:38.867 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo a 2022-04-03T21:52:38.868 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo b 2022-04-03T21:52:38.868 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir foo/.snap/s 2022-04-03T21:52:38.881 INFO:tasks.workunit.client.0.smithi049.stderr:++ cat foo/.snap/s/a 2022-04-03T21:52:38.897 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=a 2022-04-03T21:52:38.898 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z a ']' 2022-04-03T21:52:38.898 INFO:tasks.workunit.client.0.smithi049.stderr:+ ln foo/b foo/b2 2022-04-03T21:52:38.901 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat foo/.snap/s/b 2022-04-03T21:52:38.920 INFO:tasks.workunit.client.0.smithi049.stdout:b 2022-04-03T21:52:38.920 INFO:tasks.workunit.client.0.smithi049.stdout:this used to hang: 2022-04-03T21:52:38.921 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'this used to hang:' 2022-04-03T21:52:38.921 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo more 2022-04-03T21:52:38.921 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2022-04-03T21:52:38.922 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat foo/b 2022-04-03T21:52:38.922 INFO:tasks.workunit.client.0.smithi049.stdout:oh, it didn't hang! good job. 2022-04-03T21:52:38.922 INFO:tasks.workunit.client.0.smithi049.stdout:b 2022-04-03T21:52:38.923 INFO:tasks.workunit.client.0.smithi049.stdout:more 2022-04-03T21:52:38.924 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir foo/.snap/s 2022-04-03T21:52:38.933 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -r foo 2022-04-03T21:52:38.950 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:52:38.951 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:52:38.952 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:52:38.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:52:39.040 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2022-04-03T21:52:39.041 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2022-04-03T21:52:39.110 INFO:tasks.workunit.client.0.smithi049.stderr:+ set -e 2022-04-03T21:52:39.111 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:39.114 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir .snap/bar 2022-04-03T21:52:39.127 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/foo 2022-04-03T21:52:39.135 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/foo 2022-04-03T21:52:39.142 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:39.146 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/bar/a 2022-04-03T21:52:39.151 INFO:tasks.workunit.client.0.smithi049.stdout: File: .snap/bar/a 2022-04-03T21:52:39.151 INFO:tasks.workunit.client.0.smithi049.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-04-03T21:52:39.151 INFO:tasks.workunit.client.0.smithi049.stdout:Device: fch/252d Inode: 1099511633648 Links: 2 2022-04-03T21:52:39.152 INFO:tasks.workunit.client.0.smithi049.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1258/ ubuntu) 2022-04-03T21:52:39.152 INFO:tasks.workunit.client.0.smithi049.stdout:Context: system_u:object_r:cephfs_t:s0 2022-04-03T21:52:39.152 INFO:tasks.workunit.client.0.smithi049.stdout:Access: 2022-04-03 21:52:39.111370290 +0000 2022-04-03T21:52:39.152 INFO:tasks.workunit.client.0.smithi049.stdout:Modify: 2022-04-03 21:52:39.111370290 +0000 2022-04-03T21:52:39.153 INFO:tasks.workunit.client.0.smithi049.stdout:Change: 2022-04-03 21:52:39.111370290 +0000 2022-04-03T21:52:39.153 INFO:tasks.workunit.client.0.smithi049.stdout: Birth: 2022-04-03 21:52:39.111370290 +0000 2022-04-03T21:52:39.153 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir .snap/bar 2022-04-03T21:52:39.163 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:52:39.163 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:52:39.164 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:52:39.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:52:39.248 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2022-04-03T21:52:39.249 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2022-04-03T21:52:39.318 INFO:tasks.workunit.client.0.smithi049.stderr:+ set -e 2022-04-03T21:52:39.319 INFO:tasks.workunit.client.0.smithi049.stderr:++ seq 1 20 2022-04-03T21:52:39.321 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:39.321 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:39.325 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:39.326 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:39.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:39.346 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:39.349 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:39.480 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:39.540 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:39.540 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:39.540 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:39.541 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:39.541 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:39.541 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:39.541 INFO:tasks.workunit.client.0.smithi049.stdout: 32500 ? 00:00:00 ps 2022-04-03T21:52:39.542 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:39.553 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:39.557 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:39.565 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:39.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:39.570 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:39.571 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:39.584 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:39.592 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:39.594 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:39.669 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:39.714 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:39.714 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:39.714 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:39.714 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:39.715 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:39.715 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:39.715 INFO:tasks.workunit.client.0.smithi049.stdout: 32510 ? 00:00:00 ps 2022-04-03T21:52:39.716 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:39.728 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:39.732 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:39.740 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:39.740 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:39.745 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:39.745 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:39.757 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:39.766 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:39.768 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:39.831 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:39.875 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:39.875 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:39.876 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:39.876 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:39.876 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:39.876 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:39.876 INFO:tasks.workunit.client.0.smithi049.stdout: 32520 ? 00:00:00 ps 2022-04-03T21:52:39.877 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:39.889 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:39.892 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:39.904 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:39.905 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:39.909 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:39.909 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:39.923 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:39.932 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:39.934 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:40.013 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:40.091 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:40.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:40.091 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:40.092 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:40.092 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:40.092 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:40.092 INFO:tasks.workunit.client.0.smithi049.stdout: 32530 ? 00:00:00 ps 2022-04-03T21:52:40.097 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:40.164 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:40.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:40.175 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:40.175 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:40.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:40.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:40.191 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:40.199 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:40.201 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:40.388 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:40.433 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:40.434 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:40.434 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:40.434 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:40.435 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:40.435 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:40.435 INFO:tasks.workunit.client.0.smithi049.stdout: 32540 ? 00:00:00 ps 2022-04-03T21:52:40.436 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:40.447 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:40.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:40.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:40.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:40.465 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:40.465 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:40.477 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:40.485 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:40.488 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:40.555 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:40.600 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:40.600 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:40.601 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:40.601 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:40.601 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:40.601 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:40.602 INFO:tasks.workunit.client.0.smithi049.stdout: 32550 ? 00:00:00 ps 2022-04-03T21:52:40.602 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:40.614 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:40.618 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:40.626 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:40.626 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:40.631 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:40.631 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:40.643 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:40.652 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:40.654 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:40.705 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:40.749 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:40.750 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:40.750 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:40.750 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:40.751 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:40.751 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:40.751 INFO:tasks.workunit.client.0.smithi049.stdout: 32560 ? 00:00:00 ps 2022-04-03T21:52:40.752 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:40.764 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:40.769 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:40.779 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:40.779 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:40.784 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:40.784 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:40.796 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:40.804 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:40.807 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:40.872 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:40.917 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:40.918 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:40.918 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:40.918 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:40.919 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:40.919 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:40.919 INFO:tasks.workunit.client.0.smithi049.stdout: 32570 ? 00:00:00 ps 2022-04-03T21:52:40.920 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:40.931 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:40.935 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:40.943 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:40.943 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:40.948 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:40.948 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:40.960 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:40.968 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:40.971 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:41.031 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:41.076 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:41.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:41.077 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:41.077 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:41.077 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:41.077 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:41.078 INFO:tasks.workunit.client.0.smithi049.stdout: 32580 ? 00:00:00 ps 2022-04-03T21:52:41.078 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:41.089 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:41.093 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:41.101 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:41.101 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:41.106 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:41.106 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:41.117 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:41.125 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:41.127 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:41.191 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:41.235 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:41.236 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:41.236 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:41.236 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:41.236 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:41.237 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:41.237 INFO:tasks.workunit.client.0.smithi049.stdout: 32590 ? 00:00:00 ps 2022-04-03T21:52:41.237 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:41.251 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:41.255 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:41.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:41.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:41.267 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:41.267 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:41.279 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:41.288 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:41.290 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:41.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:41.428 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:41.428 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:41.428 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:41.428 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:41.429 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:41.429 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:41.429 INFO:tasks.workunit.client.0.smithi049.stdout: 32600 ? 00:00:00 ps 2022-04-03T21:52:41.430 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:41.442 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:41.446 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:41.454 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:41.454 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:41.459 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:41.459 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:41.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:41.480 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:41.482 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:41.531 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:41.576 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:41.577 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:41.577 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:41.577 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:41.577 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:41.578 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:41.578 INFO:tasks.workunit.client.0.smithi049.stdout: 32610 ? 00:00:00 ps 2022-04-03T21:52:41.579 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:41.589 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:41.593 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:41.600 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:41.601 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:41.605 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:41.605 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:41.618 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:41.626 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:41.629 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:41.707 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:41.752 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:41.752 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:41.752 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:41.753 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:41.753 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:41.753 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:41.753 INFO:tasks.workunit.client.0.smithi049.stdout: 32620 ? 00:00:00 ps 2022-04-03T21:52:41.754 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:41.765 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:41.769 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:41.778 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:41.779 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:41.783 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:41.783 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:41.795 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:41.803 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:41.806 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:41.866 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:41.911 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:41.911 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:41.911 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:41.912 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:41.912 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:41.912 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:41.912 INFO:tasks.workunit.client.0.smithi049.stdout: 32630 ? 00:00:00 ps 2022-04-03T21:52:41.913 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:41.925 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:41.929 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:41.937 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:41.937 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:41.942 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:41.943 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:41.955 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:41.963 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:41.966 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:42.032 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:42.078 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:42.078 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:42.079 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:42.079 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:42.079 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:42.080 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:42.080 INFO:tasks.workunit.client.0.smithi049.stdout: 32640 ? 00:00:00 ps 2022-04-03T21:52:42.081 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:42.092 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:42.096 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:42.104 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:42.105 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:42.109 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:42.109 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:42.121 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:42.130 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:42.132 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:42.196 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:42.241 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:42.241 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:42.242 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:42.242 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:42.242 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:42.242 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:42.243 INFO:tasks.workunit.client.0.smithi049.stdout: 32650 ? 00:00:00 ps 2022-04-03T21:52:42.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:42.254 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:42.258 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:42.266 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:42.267 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:42.271 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:42.271 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:42.288 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:42.297 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:42.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:42.357 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:42.403 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:42.403 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:42.403 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:42.403 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:42.404 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:42.404 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:42.404 INFO:tasks.workunit.client.0.smithi049.stdout: 32660 ? 00:00:00 ps 2022-04-03T21:52:42.405 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:42.419 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:42.423 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:42.432 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:42.432 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:42.438 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:42.438 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:42.453 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:42.462 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:42.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:42.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:42.611 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:42.611 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:42.611 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:42.612 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:42.612 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:42.612 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:42.612 INFO:tasks.workunit.client.0.smithi049.stdout: 32670 ? 00:00:00 ps 2022-04-03T21:52:42.613 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:42.627 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:42.630 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:42.639 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:42.639 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:42.643 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:42.644 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:42.657 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:42.666 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:42.669 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:42.725 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:42.769 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:42.770 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:42.770 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:42.770 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:42.770 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:42.771 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:42.771 INFO:tasks.workunit.client.0.smithi049.stdout: 32680 ? 00:00:00 ps 2022-04-03T21:52:42.771 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:42.785 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:42.789 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:42.797 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 20` 2022-04-03T21:52:42.797 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a 2022-04-03T21:52:42.802 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/one 2022-04-03T21:52:42.802 INFO:tasks.workunit.client.0.smithi049.stderr:+ cat 2022-04-03T21:52:42.816 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir a/.snap/two 2022-04-03T21:52:42.825 INFO:tasks.workunit.client.0.smithi049.stderr:+ chmod 777 a/foo 2022-04-03T21:52:42.827 INFO:tasks.workunit.client.0.smithi049.stderr:+ sync 2022-04-03T21:52:42.911 INFO:tasks.workunit.client.0.smithi049.stderr:+ ps 2022-04-03T21:52:43.003 INFO:tasks.workunit.client.0.smithi049.stdout: PID TTY TIME CMD 2022-04-03T21:52:43.003 INFO:tasks.workunit.client.0.smithi049.stdout: 1056 ? 00:00:00 systemd 2022-04-03T21:52:43.004 INFO:tasks.workunit.client.0.smithi049.stdout: 1059 ? 00:00:00 (sd-pam) 2022-04-03T21:52:43.004 INFO:tasks.workunit.client.0.smithi049.stdout: 9103 ? 00:00:01 sshd 2022-04-03T21:52:43.004 INFO:tasks.workunit.client.0.smithi049.stdout: 32471 ? 00:00:00 timeout 2022-04-03T21:52:43.004 INFO:tasks.workunit.client.0.smithi049.stdout: 32492 ? 00:00:00 snaptest-double 2022-04-03T21:52:43.005 INFO:tasks.workunit.client.0.smithi049.stdout: 32690 ? 00:00:00 ps 2022-04-03T21:52:43.008 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a/.snap/one a/.snap/two 2022-04-03T21:52:43.093 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm a/foo 2022-04-03T21:52:43.106 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir a 2022-04-03T21:52:43.143 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:52:43.144 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:52:43.149 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:52:43.149 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:52:43.378 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2022-04-03T21:52:43.378 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2022-04-03T21:52:43.546 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir .snap/foo 2022-04-03T21:52:43.579 INFO:tasks.workunit.client.0.smithi049.stdout:We want ENOENT, not ESTALE, here. 2022-04-03T21:52:43.579 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2022-04-03T21:52:43.580 INFO:tasks.workunit.client.0.smithi049.stderr:++ seq 1 100 2022-04-03T21:52:43.584 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.585 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/1 2022-04-03T21:52:43.586 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.594 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2022-04-03T21:52:43.594 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.596 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/2 2022-04-03T21:52:43.597 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.603 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2022-04-03T21:52:43.603 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.609 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/3 2022-04-03T21:52:43.610 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.612 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2022-04-03T21:52:43.615 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.615 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/4 2022-04-03T21:52:43.616 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.623 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2022-04-03T21:52:43.625 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.626 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/5 2022-04-03T21:52:43.628 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.633 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2022-04-03T21:52:43.639 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.639 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/6 2022-04-03T21:52:43.640 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.641 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2022-04-03T21:52:43.642 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.647 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/7 2022-04-03T21:52:43.647 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.651 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2022-04-03T21:52:43.651 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.653 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/8 2022-04-03T21:52:43.653 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.660 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2022-04-03T21:52:43.660 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.661 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/9 2022-04-03T21:52:43.662 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.667 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2022-04-03T21:52:43.670 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.670 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/10 2022-04-03T21:52:43.671 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.674 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2022-04-03T21:52:43.675 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.680 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/11 2022-04-03T21:52:43.681 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.682 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2022-04-03T21:52:43.683 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.684 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/12 2022-04-03T21:52:43.685 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.690 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2022-04-03T21:52:43.691 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.692 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/13 2022-04-03T21:52:43.693 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.699 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2022-04-03T21:52:43.701 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.701 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/14 2022-04-03T21:52:43.702 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.711 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2022-04-03T21:52:43.711 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.712 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/15 2022-04-03T21:52:43.713 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.719 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2022-04-03T21:52:43.722 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.723 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/16 2022-04-03T21:52:43.723 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.728 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2022-04-03T21:52:43.732 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.734 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/17 2022-04-03T21:52:43.741 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2022-04-03T21:52:43.741 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.742 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.743 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/18 2022-04-03T21:52:43.743 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.750 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2022-04-03T21:52:43.752 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.752 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/19 2022-04-03T21:52:43.753 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.757 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2022-04-03T21:52:43.757 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.758 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/20 2022-04-03T21:52:43.759 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.761 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2022-04-03T21:52:43.761 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.762 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/21 2022-04-03T21:52:43.763 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.765 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2022-04-03T21:52:43.765 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.766 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/22 2022-04-03T21:52:43.767 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.769 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2022-04-03T21:52:43.769 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.770 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/23 2022-04-03T21:52:43.771 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.773 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2022-04-03T21:52:43.773 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.774 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/24 2022-04-03T21:52:43.775 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.777 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2022-04-03T21:52:43.777 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.778 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/25 2022-04-03T21:52:43.779 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.781 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2022-04-03T21:52:43.781 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.782 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/26 2022-04-03T21:52:43.783 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.785 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2022-04-03T21:52:43.785 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.786 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/27 2022-04-03T21:52:43.787 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.789 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2022-04-03T21:52:43.789 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.790 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/28 2022-04-03T21:52:43.791 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.793 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2022-04-03T21:52:43.793 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.794 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/29 2022-04-03T21:52:43.795 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.797 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2022-04-03T21:52:43.797 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.798 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/30 2022-04-03T21:52:43.799 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.801 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2022-04-03T21:52:43.801 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.802 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/31 2022-04-03T21:52:43.803 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.805 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2022-04-03T21:52:43.805 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.806 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/32 2022-04-03T21:52:43.807 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.809 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2022-04-03T21:52:43.809 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.810 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/33 2022-04-03T21:52:43.811 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.813 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2022-04-03T21:52:43.813 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.814 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/34 2022-04-03T21:52:43.815 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.817 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2022-04-03T21:52:43.817 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.818 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/35 2022-04-03T21:52:43.819 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.821 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2022-04-03T21:52:43.821 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.822 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/36 2022-04-03T21:52:43.823 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.825 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2022-04-03T21:52:43.826 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.826 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/37 2022-04-03T21:52:43.827 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.829 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2022-04-03T21:52:43.830 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.830 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/38 2022-04-03T21:52:43.831 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.833 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2022-04-03T21:52:43.834 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.834 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/39 2022-04-03T21:52:43.835 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.837 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2022-04-03T21:52:43.838 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.838 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/40 2022-04-03T21:52:43.839 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.841 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2022-04-03T21:52:43.842 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.842 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/41 2022-04-03T21:52:43.843 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.845 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2022-04-03T21:52:43.846 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.846 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/42 2022-04-03T21:52:43.847 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.849 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2022-04-03T21:52:43.850 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.851 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/43 2022-04-03T21:52:43.851 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.856 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2022-04-03T21:52:43.857 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.857 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/44 2022-04-03T21:52:43.857 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.858 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2022-04-03T21:52:43.858 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.859 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/45 2022-04-03T21:52:43.859 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.861 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2022-04-03T21:52:43.862 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.862 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/46 2022-04-03T21:52:43.863 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.865 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2022-04-03T21:52:43.866 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.866 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/47 2022-04-03T21:52:43.867 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.869 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2022-04-03T21:52:43.870 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.870 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/48 2022-04-03T21:52:43.871 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.873 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2022-04-03T21:52:43.874 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.874 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/49 2022-04-03T21:52:43.875 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.877 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2022-04-03T21:52:43.878 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.878 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/50 2022-04-03T21:52:43.879 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.881 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2022-04-03T21:52:43.882 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.882 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/51 2022-04-03T21:52:43.883 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.886 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2022-04-03T21:52:43.886 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.887 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/52 2022-04-03T21:52:43.888 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.893 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2022-04-03T21:52:43.894 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.896 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.898 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/53 2022-04-03T21:52:43.904 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2022-04-03T21:52:43.905 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.907 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/54 2022-04-03T21:52:43.908 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.913 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2022-04-03T21:52:43.916 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.916 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/55 2022-04-03T21:52:43.918 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.922 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2022-04-03T21:52:43.922 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.924 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/56 2022-04-03T21:52:43.924 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.929 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2022-04-03T21:52:43.931 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.931 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/57 2022-04-03T21:52:43.932 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.936 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2022-04-03T21:52:43.937 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.938 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/58 2022-04-03T21:52:43.939 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.945 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2022-04-03T21:52:43.945 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.946 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/59 2022-04-03T21:52:43.947 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.953 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2022-04-03T21:52:43.954 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.955 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/60 2022-04-03T21:52:43.956 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.963 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2022-04-03T21:52:43.964 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.967 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.967 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/61 2022-04-03T21:52:43.973 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2022-04-03T21:52:43.974 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.974 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/62 2022-04-03T21:52:43.975 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.980 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2022-04-03T21:52:43.981 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.983 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/63 2022-04-03T21:52:43.984 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:43.989 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2022-04-03T21:52:43.990 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:43.995 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/64 2022-04-03T21:52:43.995 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.000 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2022-04-03T21:52:44.001 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.004 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/65 2022-04-03T21:52:44.004 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.008 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2022-04-03T21:52:44.010 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.011 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.012 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/66 2022-04-03T21:52:44.018 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2022-04-03T21:52:44.019 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.021 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.021 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/67 2022-04-03T21:52:44.028 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2022-04-03T21:52:44.028 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.028 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/68 2022-04-03T21:52:44.031 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.033 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2022-04-03T21:52:44.034 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.035 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/69 2022-04-03T21:52:44.036 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.042 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2022-04-03T21:52:44.043 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.045 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/70 2022-04-03T21:52:44.047 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.053 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2022-04-03T21:52:44.054 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.054 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/71 2022-04-03T21:52:44.055 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.062 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2022-04-03T21:52:44.063 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.064 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/72 2022-04-03T21:52:44.065 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.070 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2022-04-03T21:52:44.070 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.072 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/73 2022-04-03T21:52:44.072 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.077 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2022-04-03T21:52:44.078 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.079 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/74 2022-04-03T21:52:44.080 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.092 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2022-04-03T21:52:44.095 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.095 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.099 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/75 2022-04-03T21:52:44.102 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2022-04-03T21:52:44.106 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.108 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.112 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/76 2022-04-03T21:52:44.123 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2022-04-03T21:52:44.124 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.126 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/77 2022-04-03T21:52:44.126 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.130 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2022-04-03T21:52:44.132 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.133 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/78 2022-04-03T21:52:44.134 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.140 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2022-04-03T21:52:44.142 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.144 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/79 2022-04-03T21:52:44.145 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.150 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2022-04-03T21:52:44.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.152 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/80 2022-04-03T21:52:44.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.161 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2022-04-03T21:52:44.165 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.165 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/81 2022-04-03T21:52:44.166 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.170 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2022-04-03T21:52:44.174 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.174 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/82 2022-04-03T21:52:44.175 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.179 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2022-04-03T21:52:44.182 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.182 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/83 2022-04-03T21:52:44.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.188 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2022-04-03T21:52:44.190 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.192 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/84 2022-04-03T21:52:44.192 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.196 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2022-04-03T21:52:44.197 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.198 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/85 2022-04-03T21:52:44.199 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.202 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2022-04-03T21:52:44.203 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.204 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/86 2022-04-03T21:52:44.204 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.206 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2022-04-03T21:52:44.207 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.208 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/87 2022-04-03T21:52:44.208 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.210 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2022-04-03T21:52:44.211 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/88 2022-04-03T21:52:44.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.214 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2022-04-03T21:52:44.215 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.216 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/89 2022-04-03T21:52:44.216 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.219 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2022-04-03T21:52:44.220 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.220 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/90 2022-04-03T21:52:44.221 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.222 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2022-04-03T21:52:44.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/91 2022-04-03T21:52:44.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.226 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2022-04-03T21:52:44.227 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.228 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/92 2022-04-03T21:52:44.228 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.230 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2022-04-03T21:52:44.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.232 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/93 2022-04-03T21:52:44.232 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.234 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2022-04-03T21:52:44.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.236 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/94 2022-04-03T21:52:44.236 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.238 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2022-04-03T21:52:44.239 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.240 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/95 2022-04-03T21:52:44.240 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.242 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2022-04-03T21:52:44.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/96 2022-04-03T21:52:44.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.246 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2022-04-03T21:52:44.247 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.248 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/97 2022-04-03T21:52:44.248 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.251 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2022-04-03T21:52:44.251 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.252 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/98 2022-04-03T21:52:44.252 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.255 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2022-04-03T21:52:44.255 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.256 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/99 2022-04-03T21:52:44.257 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.259 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2022-04-03T21:52:44.259 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in `seq 1 100` 2022-04-03T21:52:44.260 INFO:tasks.workunit.client.0.smithi049.stderr:+ stat .snap/foo/100 2022-04-03T21:52:44.261 INFO:tasks.workunit.client.0.smithi049.stderr:+ grep 'No such file' 2022-04-03T21:52:44.263 INFO:tasks.workunit.client.0.smithi049.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2022-04-03T21:52:44.263 INFO:tasks.workunit.client.0.smithi049.stderr:+ rmdir .snap/foo 2022-04-03T21:52:44.314 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2022-04-03T21:52:44.315 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2022-04-03T21:52:44.317 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-04-03T21:52:44.317 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-04-03T21:52:44.401 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2022-04-03T21:52:44.402 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2022-04-03T21:52:44.471 INFO:tasks.workunit.client.0.smithi049.stderr:+ set -e 2022-04-03T21:52:44.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ retried=false 2022-04-03T21:52:44.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ trap -- retry EXIT 2022-04-03T21:52:44.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -rf ceph 2022-04-03T21:52:44.474 INFO:tasks.workunit.client.0.smithi049.stderr:+ timeout 1800 git clone git://git.ceph.com/ceph.git 2022-04-03T21:52:44.481 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into 'ceph'... 2022-04-03T21:52:53.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:52:53.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:53:23.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:53:23.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:53:53.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:53:53.874 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:54:00.420 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 7% (899/11299) Updating files: 8% (904/11299) Updating files: 9% (1017/11299) Updating files: 10% (1130/11299) Updating files: 11% (1243/11299) Updating files: 12% (1356/11299) Updating files: 13% (1469/11299) Updating files: 14% (1582/11299) Updating files: 14% (1612/11299) Updating files: 15% (1695/11299) Updating files: 16% (1808/11299) Updating files: 17% (1921/11299) Updating files: 18% (2034/11299) Updating files: 19% (2147/11299) Updating files: 19% (2153/11299) Updating files: 20% (2260/11299) Updating files: 21% (2373/11299) Updating files: 22% (2486/11299) Updating files: 23% (2599/11299) Updating files: 24% (2712/11299) Updating files: 25% (2825/11299) Updating files: 26% (2938/11299) Updating files: 26% (2950/11299) Updating files: 27% (3051/11299) Updating files: 28% (3164/11299) Updating files: 29% (3277/11299) Updating files: 30% (3390/11299) Updating files: 30% (3452/11299) Updating files: 31% (3503/11299) Updating files: 32% (3616/11299) Updating files: 33% (3729/11299) Updating files: 34% (3842/11299) Updating files: 35% (3955/11299) Updating files: 36% (4068/11299) Updating files: 37% (4181/11299) Updating files: 38% (4294/11299) Updating files: 38% (4297/11299) Updating files: 39% (4407/11299) Updating files: 40% (4520/11299) Updating files: 41% (4633/11299) Updating files: 42% (4746/11299) Updating files: 43% (4859/11299) Updating files: 43% (4956/11299) Updating files: 44% (4972/11299) Updating files: 45% (5085/11299) Updating files: 46% (5198/11299) Updating files: 47% (5311/11299) Updating files: 48% (5424/11299) Updating files: 49% (5537/11299) Updating files: 50% (5650/11299) Updating files: 50% (5658/11299) Updating files: 51% (5763/11299) Updating files: 52% (5876/11299) Updating files: 53% (5989/11299) Updating files: 54% (6102/11299) Updating files: 55% (6215/11299) Updating files: 56% (6328/11299) Updating files: 57% (6441/11299) Updating files: 58% (6554/11299) Updating files: 58% (6582/11299) Updating files: 59% (6667/11299) Updating files: 60% (6780/11299) Updating files: 61% (6893/11299) Updating files: 62% (7006/11299) Updating files: 63% (7119/11299) Updating files: 64% (7232/11299) Updating files: 65% (7345/11299) Updating files: 66% (7458/11299) Updating files: 66% (7515/11299) Updating files: 67% (7571/11299) Updating files: 67% (7678/11299) Updating files: 68% (7684/11299) Updating files: 68% (7718/11299) Updating files: 69% (7797/11299) Updating files: 70% (7910/11299) Updating files: 71% (8023/11299) Updating files: 71% (8135/11299) Updating files: 72% (8136/11299) Updating files: 73% (8249/11299) Updating files: 74% (8362/11299) Updating files: 75% (8475/11299) Updating files: 76% (8588/11299) Updating files: 77% (8701/11299) Updating files: 77% (8746/11299) Updating files: 78% (8814/11299) Updating files: 79% (8927/11299) Updating files: 80% (9040/11299) Updating files: 80% (9147/11299) Updating files: 81% (9153/11299) Updating files: 81% (9158/11299) Updating files: 82% (9266/11299) Updating files: 82% (9280/11299) Updating files: 83% (9379/11299) Updating files: 84% (9492/11299) Updating files: 85% (9605/11299) Updating files: 86% (9718/11299) Updating files: 87% (9831/11299) Updating files: 88% (9944/11299) Updating files: 89% (10057/11299) Updating files: 90% (10170/11299) Updating files: 90% (10230/11299) Updating files: 91% (10283/11299) Updating files: 92% (10396/11299) Updating files: 93% (10509/11299) Updating files: 94% (10622/11299) Updating files: 95% (10735/11299) Updating files: 96% (10848/11299) Updating files: 97% (10961/11299) Updating files: 98% (11074/11299) Updating files: 98% (11143/11299) Updating files: 99% (11187/11299) Updating files: 100% (11299/11299) Updating files: 100% (11299/11299), done. 2022-04-03T21:54:00.487 INFO:tasks.workunit.client.0.smithi049.stderr:+ trap - EXIT 2022-04-03T21:54:00.487 INFO:tasks.workunit.client.0.smithi049.stderr:+ cd ceph 2022-04-03T21:54:00.488 INFO:tasks.workunit.client.0.smithi049.stderr:++ seq 1 21 2022-04-03T21:54:00.489 INFO:tasks.workunit.client.0.smithi049.stderr:+ versions='1 2022-04-03T21:54:00.490 INFO:tasks.workunit.client.0.smithi049.stderr:2 2022-04-03T21:54:00.490 INFO:tasks.workunit.client.0.smithi049.stderr:3 2022-04-03T21:54:00.490 INFO:tasks.workunit.client.0.smithi049.stderr:4 2022-04-03T21:54:00.491 INFO:tasks.workunit.client.0.smithi049.stderr:5 2022-04-03T21:54:00.491 INFO:tasks.workunit.client.0.smithi049.stderr:6 2022-04-03T21:54:00.491 INFO:tasks.workunit.client.0.smithi049.stderr:7 2022-04-03T21:54:00.491 INFO:tasks.workunit.client.0.smithi049.stderr:8 2022-04-03T21:54:00.491 INFO:tasks.workunit.client.0.smithi049.stderr:9 2022-04-03T21:54:00.492 INFO:tasks.workunit.client.0.smithi049.stderr:10 2022-04-03T21:54:00.492 INFO:tasks.workunit.client.0.smithi049.stderr:11 2022-04-03T21:54:00.492 INFO:tasks.workunit.client.0.smithi049.stderr:12 2022-04-03T21:54:00.492 INFO:tasks.workunit.client.0.smithi049.stderr:13 2022-04-03T21:54:00.493 INFO:tasks.workunit.client.0.smithi049.stderr:14 2022-04-03T21:54:00.493 INFO:tasks.workunit.client.0.smithi049.stderr:15 2022-04-03T21:54:00.493 INFO:tasks.workunit.client.0.smithi049.stderr:16 2022-04-03T21:54:00.493 INFO:tasks.workunit.client.0.smithi049.stderr:17 2022-04-03T21:54:00.494 INFO:tasks.workunit.client.0.smithi049.stderr:18 2022-04-03T21:54:00.494 INFO:tasks.workunit.client.0.smithi049.stderr:19 2022-04-03T21:54:00.494 INFO:tasks.workunit.client.0.smithi049.stderr:20 2022-04-03T21:54:00.494 INFO:tasks.workunit.client.0.smithi049.stderr:21' 2022-04-03T21:54:00.494 INFO:tasks.workunit.client.0.smithi049.stderr:+ for v in $versions 2022-04-03T21:54:00.495 INFO:tasks.workunit.client.0.smithi049.stderr:+ ver=v0.1 2022-04-03T21:54:00.495 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo v0.1 2022-04-03T21:54:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:v0.1 2022-04-03T21:54:00.496 INFO:tasks.workunit.client.0.smithi049.stderr:+ git reset --hard v0.1 2022-04-03T21:54:24.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:54:24.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:54:46.242 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 3% (432/12089) Updating files: 4% (484/12089) Updating files: 5% (605/12089) Updating files: 5% (696/12089) Updating files: 6% (726/12089) Updating files: 7% (847/12089) Updating files: 8% (968/12089) Updating files: 8% (1018/12089) Updating files: 9% (1089/12089) Updating files: 10% (1209/12089) Updating files: 10% (1255/12089) Updating files: 11% (1330/12089) Updating files: 12% (1451/12089) Updating files: 12% (1474/12089) Updating files: 13% (1572/12089) Updating files: 14% (1693/12089) Updating files: 14% (1720/12089) Updating files: 15% (1814/12089) Updating files: 15% (1919/12089) Updating files: 16% (1935/12089) Updating files: 17% (2056/12089) Updating files: 17% (2176/12089) Updating files: 18% (2177/12089) Updating files: 19% (2297/12089) Updating files: 19% (2356/12089) Updating files: 20% (2418/12089) Updating files: 21% (2539/12089) Updating files: 21% (2578/12089) Updating files: 21% (2624/12089) Updating files: 21% (2638/12089) Updating files: 22% (2660/12089) Updating files: 23% (2781/12089) Updating files: 24% (2902/12089) Updating files: 24% (2971/12089) Updating files: 25% (3023/12089) Updating files: 26% (3144/12089) Updating files: 26% (3165/12089) Updating files: 27% (3265/12089) Updating files: 28% (3385/12089) Updating files: 28% (3400/12089) Updating files: 29% (3506/12089) Updating files: 30% (3627/12089) Updating files: 30% (3660/12089) Updating files: 31% (3748/12089) Updating files: 32% (3869/12089) Updating files: 32% (3874/12089) Updating files: 33% (3990/12089) Updating files: 33% (4025/12089) Updating files: 34% (4111/12089) Updating files: 35% (4232/12089) Updating files: 36% (4353/12089) Updating files: 36% (4377/12089) Updating files: 37% (4473/12089) Updating files: 37% (4582/12089) Updating files: 38% (4594/12089) Updating files: 39% (4715/12089) Updating files: 40% (4836/12089) Updating files: 40% (4871/12089) Updating files: 41% (4957/12089) Updating files: 42% (5078/12089) Updating files: 42% (5082/12089) Updating files: 43% (5199/12089) Updating files: 44% (5320/12089) Updating files: 45% (5441/12089) Updating files: 45% (5492/12089) Updating files: 46% (5561/12089) Updating files: 47% (5682/12089) Updating files: 47% (5742/12089) Updating files: 48% (5803/12089) Updating files: 49% (5924/12089) Updating files: 49% (6032/12089) Updating files: 50% (6045/12089) Updating files: 51% (6166/12089) Updating files: 52% (6287/12089) Updating files: 53% (6408/12089) Updating files: 53% (6430/12089) Updating files: 54% (6529/12089) Updating files: 55% (6649/12089) Updating files: 56% (6770/12089) Updating files: 56% (6844/12089) Updating files: 57% (6891/12089) Updating files: 58% (7012/12089) Updating files: 58% (7117/12089) Updating files: 59% (7133/12089) Updating files: 60% (7254/12089) Updating files: 61% (7375/12089) Updating files: 61% (7415/12089) Updating files: 62% (7496/12089) Updating files: 63% (7617/12089) Updating files: 63% (7672/12089) Updating files: 64% (7737/12089) Updating files: 65% (7858/12089) Updating files: 65% (7882/12089) Updating files: 66% (7979/12089) Updating files: 66% (8089/12089) Updating files: 67% (8100/12089) Updating files: 68% (8221/12089) Updating files: 69% (8342/12089) Updating files: 69% (8367/12089) Updating files: 70% (8463/12089) Updating files: 71% (8584/12089) Updating files: 72% (8705/12089) Updating files: 72% (8766/12089) Updating files: 73% (8825/12089) Updating files: 73% (8905/12089) Updating files: 74% (8946/12089) Updating files: 75% (9067/12089) Updating files: 76% (9188/12089) Updating files: 77% (9309/12089) Updating files: 78% (9430/12089) Updating files: 78% (9459/12089) Updating files: 79% (9551/12089) Updating files: 80% (9672/12089) Updating files: 80% (9675/12089) Updating files: 81% (9793/12089) Updating files: 82% (9913/12089) Updating files: 82% (9923/12089) Updating files: 83% (10034/12089) Updating files: 84% (10155/12089) Updating files: 84% (10194/12089) Updating files: 85% (10276/12089) Updating files: 86% (10397/12089) Updating files: 86% (10481/12089) Updating files: 87% (10518/12089) Updating files: 88% (10639/12089) Updating files: 89% (10760/12089) Updating files: 89% (10801/12089) Updating files: 90% (10881/12089) Updating files: 91% (11001/12089) Updating files: 91% (11043/12089) Updating files: 92% (11122/12089) Updating files: 93% (11243/12089) Updating files: 94% (11364/12089) Updating files: 95% (11485/12089) Updating files: 96% (11606/12089) Updating files: 97% (11727/12089) Updating files: 97% (11807/12089) Updating files: 98% (11848/12089) Updating files: 99% (11969/12089) Updating files: 100% (12089/12089) Updating files: 100% (12089/12089), done. 2022-04-03T21:54:46.624 INFO:tasks.workunit.client.0.smithi049.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2022-04-03T21:54:46.657 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir .snap/v0.1 2022-04-03T21:54:46.703 INFO:tasks.workunit.client.0.smithi049.stderr:+ for v in $versions 2022-04-03T21:54:46.703 INFO:tasks.workunit.client.0.smithi049.stderr:+ ver=v0.2 2022-04-03T21:54:46.703 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo v0.2 2022-04-03T21:54:46.704 INFO:tasks.workunit.client.0.smithi049.stdout:v0.2 2022-04-03T21:54:46.704 INFO:tasks.workunit.client.0.smithi049.stderr:+ git reset --hard v0.2 2022-04-03T21:54:54.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:54:54.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:55:24.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:55:24.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:55:48.606 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:55:48.604+0000 7fcc48783700 -1 bdev(0x55f8a760b800 /var/lib/ceph/osd/ceph-3/block) _aio_thread stalled aio 0x55f8a775d810 since 2022-04-03T21:54:48.573929+0000, timeout is 60s, suicide 2022-04-03T21:55:48.607 INFO:tasks.ceph.osd.3.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fcc48783700 time 2022-04-03T21:55:48.604397+0000 2022-04-03T21:55:48.607 INFO:tasks.ceph.osd.3.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.608 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.608 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55f8a3ddd0eb] 2022-04-03T21:55:48.608 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.608 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.609 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.609 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.609 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:55:48.605+0000 7fcc48783700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fcc48783700 time 2022-04-03T21:55:48.604397+0000 2022-04-03T21:55:48.609 INFO:tasks.ceph.osd.3.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.610 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.610 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.610 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55f8a3ddd0eb] 2022-04-03T21:55:48.611 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.611 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.611 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.611 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.611 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.612 INFO:tasks.ceph.osd.3.smithi049.stderr:*** Caught signal (Aborted) ** 2022-04-03T21:55:48.612 INFO:tasks.ceph.osd.3.smithi049.stderr: in thread 7fcc48783700 thread_name:bstore_aio 2022-04-03T21:55:48.613 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.613 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fcc593e2ce0] 2022-04-03T21:55:48.613 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.613 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.614 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55f8a3ddd1be] 2022-04-03T21:55:48.614 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.614 INFO:tasks.ceph.osd.3.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.614 INFO:tasks.ceph.osd.3.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.615 INFO:tasks.ceph.osd.3.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.615 INFO:tasks.ceph.osd.3.smithi049.stderr:2022-04-03T21:55:48.607+0000 7fcc48783700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:48.615 INFO:tasks.ceph.osd.3.smithi049.stderr: in thread 7fcc48783700 thread_name:bstore_aio 2022-04-03T21:55:48.615 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.616 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.616 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fcc593e2ce0] 2022-04-03T21:55:48.616 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.617 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.617 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55f8a3ddd1be] 2022-04-03T21:55:48.617 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.617 INFO:tasks.ceph.osd.3.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.618 INFO:tasks.ceph.osd.3.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.618 INFO:tasks.ceph.osd.3.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.618 INFO:tasks.ceph.osd.3.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:48.618 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.629 INFO:tasks.ceph.osd.3.smithi049.stderr: -2> 2022-04-03T21:55:48.604+0000 7fcc48783700 -1 bdev(0x55f8a760b800 /var/lib/ceph/osd/ceph-3/block) _aio_thread stalled aio 0x55f8a775d810 since 2022-04-03T21:54:48.573929+0000, timeout is 60s, suicide 2022-04-03T21:55:48.629 INFO:tasks.ceph.osd.3.smithi049.stderr: -1> 2022-04-03T21:55:48.605+0000 7fcc48783700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fcc48783700 time 2022-04-03T21:55:48.604397+0000 2022-04-03T21:55:48.629 INFO:tasks.ceph.osd.3.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.630 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.630 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.630 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55f8a3ddd0eb] 2022-04-03T21:55:48.631 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.631 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.631 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.631 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.632 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.632 INFO:tasks.ceph.osd.3.smithi049.stderr: 0> 2022-04-03T21:55:48.607+0000 7fcc48783700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:48.632 INFO:tasks.ceph.osd.3.smithi049.stderr: in thread 7fcc48783700 thread_name:bstore_aio 2022-04-03T21:55:48.632 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.632 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.633 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fcc593e2ce0] 2022-04-03T21:55:48.633 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.633 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.633 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55f8a3ddd1be] 2022-04-03T21:55:48.634 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.634 INFO:tasks.ceph.osd.3.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.634 INFO:tasks.ceph.osd.3.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.635 INFO:tasks.ceph.osd.3.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.635 INFO:tasks.ceph.osd.3.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:48.635 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.636 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:55:48.634+0000 7f026cb36700 -1 bdev(0x559dd2759800 /var/lib/ceph/osd/ceph-2/block) _aio_thread stalled aio 0x559dd2937810 since 2022-04-03T21:54:48.606987+0000, timeout is 60s, suicide 2022-04-03T21:55:48.637 INFO:tasks.ceph.osd.2.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f026cb36700 time 2022-04-03T21:55:48.634683+0000 2022-04-03T21:55:48.637 INFO:tasks.ceph.osd.2.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.638 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.638 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x559dce9dd0eb] 2022-04-03T21:55:48.638 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.638 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.639 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.639 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.639 INFO:tasks.ceph.osd.2.smithi049.stderr:*** Caught signal (Aborted) ** 2022-04-03T21:55:48.639 INFO:tasks.ceph.osd.2.smithi049.stderr: in thread 7f026cb36700 thread_name:bstore_aio 2022-04-03T21:55:48.640 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:55:48.636+0000 7f026cb36700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f026cb36700 time 2022-04-03T21:55:48.634683+0000 2022-04-03T21:55:48.640 INFO:tasks.ceph.osd.2.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.640 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.640 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.640 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x559dce9dd0eb] 2022-04-03T21:55:48.641 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.641 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.641 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.641 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.641 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.642 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.643 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f027d795ce0] 2022-04-03T21:55:48.643 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.643 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.643 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x559dce9dd1be] 2022-04-03T21:55:48.643 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.644 INFO:tasks.ceph.osd.2.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.644 INFO:tasks.ceph.osd.2.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.644 INFO:tasks.ceph.osd.2.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.644 INFO:tasks.ceph.osd.2.smithi049.stderr:2022-04-03T21:55:48.638+0000 7f026cb36700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:48.645 INFO:tasks.ceph.osd.2.smithi049.stderr: in thread 7f026cb36700 thread_name:bstore_aio 2022-04-03T21:55:48.645 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.645 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.646 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f027d795ce0] 2022-04-03T21:55:48.646 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.646 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.646 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x559dce9dd1be] 2022-04-03T21:55:48.647 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.647 INFO:tasks.ceph.osd.2.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.647 INFO:tasks.ceph.osd.2.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.647 INFO:tasks.ceph.osd.2.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.647 INFO:tasks.ceph.osd.2.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:48.648 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.648 INFO:tasks.ceph.osd.3.smithi049.stderr: -3> 2022-04-03T21:55:48.604+0000 7fcc48783700 -1 bdev(0x55f8a760b800 /var/lib/ceph/osd/ceph-3/block) _aio_thread stalled aio 0x55f8a775d810 since 2022-04-03T21:54:48.573929+0000, timeout is 60s, suicide 2022-04-03T21:55:48.648 INFO:tasks.ceph.osd.3.smithi049.stderr: -2> 2022-04-03T21:55:48.605+0000 7fcc48783700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fcc48783700 time 2022-04-03T21:55:48.604397+0000 2022-04-03T21:55:48.649 INFO:tasks.ceph.osd.3.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.649 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.649 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.649 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55f8a3ddd0eb] 2022-04-03T21:55:48.649 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.650 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.650 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.650 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.650 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.651 INFO:tasks.ceph.osd.3.smithi049.stderr: -1> 2022-04-03T21:55:48.607+0000 7fcc48783700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:48.651 INFO:tasks.ceph.osd.3.smithi049.stderr: in thread 7fcc48783700 thread_name:bstore_aio 2022-04-03T21:55:48.651 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.651 INFO:tasks.ceph.osd.3.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.651 INFO:tasks.ceph.osd.3.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fcc593e2ce0] 2022-04-03T21:55:48.652 INFO:tasks.ceph.osd.3.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.652 INFO:tasks.ceph.osd.3.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.652 INFO:tasks.ceph.osd.3.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55f8a3ddd1be] 2022-04-03T21:55:48.652 INFO:tasks.ceph.osd.3.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55f8a4a2fd95] 2022-04-03T21:55:48.653 INFO:tasks.ceph.osd.3.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f8a4a3d2f1] 2022-04-03T21:55:48.653 INFO:tasks.ceph.osd.3.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fcc593d81cf] 2022-04-03T21:55:48.653 INFO:tasks.ceph.osd.3.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.653 INFO:tasks.ceph.osd.3.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:48.653 INFO:tasks.ceph.osd.3.smithi049.stderr: 2022-04-03T21:55:48.659 INFO:tasks.ceph.osd.2.smithi049.stderr: -2> 2022-04-03T21:55:48.634+0000 7f026cb36700 -1 bdev(0x559dd2759800 /var/lib/ceph/osd/ceph-2/block) _aio_thread stalled aio 0x559dd2937810 since 2022-04-03T21:54:48.606987+0000, timeout is 60s, suicide 2022-04-03T21:55:48.659 INFO:tasks.ceph.osd.2.smithi049.stderr: -1> 2022-04-03T21:55:48.636+0000 7f026cb36700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f026cb36700 time 2022-04-03T21:55:48.634683+0000 2022-04-03T21:55:48.660 INFO:tasks.ceph.osd.2.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.660 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.660 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.660 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x559dce9dd0eb] 2022-04-03T21:55:48.660 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.661 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.661 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.661 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.661 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.662 INFO:tasks.ceph.osd.2.smithi049.stderr: 0> 2022-04-03T21:55:48.638+0000 7f026cb36700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:48.662 INFO:tasks.ceph.osd.2.smithi049.stderr: in thread 7f026cb36700 thread_name:bstore_aio 2022-04-03T21:55:48.662 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.662 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.662 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f027d795ce0] 2022-04-03T21:55:48.663 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.663 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.663 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x559dce9dd1be] 2022-04-03T21:55:48.663 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.664 INFO:tasks.ceph.osd.2.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.664 INFO:tasks.ceph.osd.2.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.664 INFO:tasks.ceph.osd.2.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.664 INFO:tasks.ceph.osd.2.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:48.665 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.673 INFO:tasks.ceph.osd.2.smithi049.stderr: -2> 2022-04-03T21:55:48.634+0000 7f026cb36700 -1 bdev(0x559dd2759800 /var/lib/ceph/osd/ceph-2/block) _aio_thread stalled aio 0x559dd2937810 since 2022-04-03T21:54:48.606987+0000, timeout is 60s, suicide 2022-04-03T21:55:48.673 INFO:tasks.ceph.osd.2.smithi049.stderr: -1> 2022-04-03T21:55:48.636+0000 7f026cb36700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f026cb36700 time 2022-04-03T21:55:48.634683+0000 2022-04-03T21:55:48.673 INFO:tasks.ceph.osd.2.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:48.673 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.674 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.674 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x559dce9dd0eb] 2022-04-03T21:55:48.674 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.674 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.675 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.675 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: clone() 2022-04-03T21:55:48.675 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.675 INFO:tasks.ceph.osd.2.smithi049.stderr: 0> 2022-04-03T21:55:48.638+0000 7f026cb36700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:48.675 INFO:tasks.ceph.osd.2.smithi049.stderr: in thread 7f026cb36700 thread_name:bstore_aio 2022-04-03T21:55:48.676 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:48.676 INFO:tasks.ceph.osd.2.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:48.676 INFO:tasks.ceph.osd.2.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f027d795ce0] 2022-04-03T21:55:48.677 INFO:tasks.ceph.osd.2.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:48.677 INFO:tasks.ceph.osd.2.smithi049.stderr: 3: abort() 2022-04-03T21:55:48.677 INFO:tasks.ceph.osd.2.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x559dce9dd1be] 2022-04-03T21:55:48.677 INFO:tasks.ceph.osd.2.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x559dcf62fd95] 2022-04-03T21:55:48.677 INFO:tasks.ceph.osd.2.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559dcf63d2f1] 2022-04-03T21:55:48.678 INFO:tasks.ceph.osd.2.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f027d78b1cf] 2022-04-03T21:55:48.678 INFO:tasks.ceph.osd.2.smithi049.stderr: 8: clone() 2022-04-03T21:55:48.678 INFO:tasks.ceph.osd.2.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:48.678 INFO:tasks.ceph.osd.2.smithi049.stderr: 2022-04-03T21:55:52.145 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:55:52.143+0000 7fc060d01700 -1 bdev(0x55a15622b800 /var/lib/ceph/osd/ceph-0/block) _aio_thread stalled aio 0x55a156393810 since 2022-04-03T21:54:52.114678+0000, timeout is 60s, suicide 2022-04-03T21:55:52.146 INFO:tasks.ceph.osd.0.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc060d01700 time 2022-04-03T21:55:52.143707+0000 2022-04-03T21:55:52.147 INFO:tasks.ceph.osd.0.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.147 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.147 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a1531dd0eb] 2022-04-03T21:55:52.147 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.148 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.148 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.148 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.148 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:55:52.145+0000 7fc060d01700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc060d01700 time 2022-04-03T21:55:52.143707+0000 2022-04-03T21:55:52.148 INFO:tasks.ceph.osd.0.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.149 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.149 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.149 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a1531dd0eb] 2022-04-03T21:55:52.149 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.150 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.150 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.150 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.150 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.151 INFO:tasks.ceph.osd.0.smithi049.stderr:*** Caught signal (Aborted) ** 2022-04-03T21:55:52.151 INFO:tasks.ceph.osd.0.smithi049.stderr: in thread 7fc060d01700 thread_name:bstore_aio 2022-04-03T21:55:52.151 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.152 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fc071960ce0] 2022-04-03T21:55:52.152 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.152 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.152 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55a1531dd1be] 2022-04-03T21:55:52.153 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.153 INFO:tasks.ceph.osd.0.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.153 INFO:tasks.ceph.osd.0.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.153 INFO:tasks.ceph.osd.0.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.153 INFO:tasks.ceph.osd.0.smithi049.stderr:2022-04-03T21:55:52.147+0000 7fc060d01700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:52.154 INFO:tasks.ceph.osd.0.smithi049.stderr: in thread 7fc060d01700 thread_name:bstore_aio 2022-04-03T21:55:52.154 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.154 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.154 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fc071960ce0] 2022-04-03T21:55:52.155 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.155 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.155 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55a1531dd1be] 2022-04-03T21:55:52.155 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.156 INFO:tasks.ceph.osd.0.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.156 INFO:tasks.ceph.osd.0.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.156 INFO:tasks.ceph.osd.0.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.156 INFO:tasks.ceph.osd.0.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:52.157 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.168 INFO:tasks.ceph.osd.0.smithi049.stderr: -2> 2022-04-03T21:55:52.143+0000 7fc060d01700 -1 bdev(0x55a15622b800 /var/lib/ceph/osd/ceph-0/block) _aio_thread stalled aio 0x55a156393810 since 2022-04-03T21:54:52.114678+0000, timeout is 60s, suicide 2022-04-03T21:55:52.168 INFO:tasks.ceph.osd.0.smithi049.stderr: -1> 2022-04-03T21:55:52.145+0000 7fc060d01700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc060d01700 time 2022-04-03T21:55:52.143707+0000 2022-04-03T21:55:52.169 INFO:tasks.ceph.osd.0.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.169 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.169 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.169 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a1531dd0eb] 2022-04-03T21:55:52.170 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.170 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.170 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.170 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.171 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.171 INFO:tasks.ceph.osd.0.smithi049.stderr: 0> 2022-04-03T21:55:52.147+0000 7fc060d01700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:52.171 INFO:tasks.ceph.osd.0.smithi049.stderr: in thread 7fc060d01700 thread_name:bstore_aio 2022-04-03T21:55:52.171 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.171 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.172 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fc071960ce0] 2022-04-03T21:55:52.172 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.172 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.172 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55a1531dd1be] 2022-04-03T21:55:52.173 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.173 INFO:tasks.ceph.osd.0.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.173 INFO:tasks.ceph.osd.0.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.173 INFO:tasks.ceph.osd.0.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.174 INFO:tasks.ceph.osd.0.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:52.174 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.181 INFO:tasks.ceph.osd.0.smithi049.stderr: -2> 2022-04-03T21:55:52.143+0000 7fc060d01700 -1 bdev(0x55a15622b800 /var/lib/ceph/osd/ceph-0/block) _aio_thread stalled aio 0x55a156393810 since 2022-04-03T21:54:52.114678+0000, timeout is 60s, suicide 2022-04-03T21:55:52.182 INFO:tasks.ceph.osd.0.smithi049.stderr: -1> 2022-04-03T21:55:52.145+0000 7fc060d01700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc060d01700 time 2022-04-03T21:55:52.143707+0000 2022-04-03T21:55:52.182 INFO:tasks.ceph.osd.0.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.182 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.182 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.183 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a1531dd0eb] 2022-04-03T21:55:52.183 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.183 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.184 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.184 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.184 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.185 INFO:tasks.ceph.osd.0.smithi049.stderr: 0> 2022-04-03T21:55:52.147+0000 7fc060d01700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:52.185 INFO:tasks.ceph.osd.0.smithi049.stderr: in thread 7fc060d01700 thread_name:bstore_aio 2022-04-03T21:55:52.185 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.185 INFO:tasks.ceph.osd.0.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.186 INFO:tasks.ceph.osd.0.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fc071960ce0] 2022-04-03T21:55:52.186 INFO:tasks.ceph.osd.0.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.186 INFO:tasks.ceph.osd.0.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.186 INFO:tasks.ceph.osd.0.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55a1531dd1be] 2022-04-03T21:55:52.187 INFO:tasks.ceph.osd.0.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55a153e2fd95] 2022-04-03T21:55:52.187 INFO:tasks.ceph.osd.0.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a153e3d2f1] 2022-04-03T21:55:52.187 INFO:tasks.ceph.osd.0.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fc0719561cf] 2022-04-03T21:55:52.187 INFO:tasks.ceph.osd.0.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.188 INFO:tasks.ceph.osd.0.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:52.188 INFO:tasks.ceph.osd.0.smithi049.stderr: 2022-04-03T21:55:52.435 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:55:52.434+0000 7fd4a69f6700 -1 bdev(0x55fce1d87800 /var/lib/ceph/osd/ceph-1/block) _aio_thread stalled aio 0x55fce1e30110 since 2022-04-03T21:54:52.405512+0000, timeout is 60s, suicide 2022-04-03T21:55:52.437 INFO:tasks.ceph.osd.1.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fd4a69f6700 time 2022-04-03T21:55:52.434348+0000 2022-04-03T21:55:52.437 INFO:tasks.ceph.osd.1.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.437 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.437 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55fcdcfdd0eb] 2022-04-03T21:55:52.438 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.438 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.438 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.438 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.439 INFO:tasks.ceph.osd.1.smithi049.stderr:*** Caught signal (Aborted) ** 2022-04-03T21:55:52.439 INFO:tasks.ceph.osd.1.smithi049.stderr: in thread 7fd4a69f6700 thread_name:bstore_aio 2022-04-03T21:55:52.439 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:55:52.435+0000 7fd4a69f6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fd4a69f6700 time 2022-04-03T21:55:52.434348+0000 2022-04-03T21:55:52.439 INFO:tasks.ceph.osd.1.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.439 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.440 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.440 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55fcdcfdd0eb] 2022-04-03T21:55:52.440 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.440 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.441 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.441 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.441 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.442 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.442 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fd4b7655ce0] 2022-04-03T21:55:52.442 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.442 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.443 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55fcdcfdd1be] 2022-04-03T21:55:52.443 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.443 INFO:tasks.ceph.osd.1.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.443 INFO:tasks.ceph.osd.1.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.443 INFO:tasks.ceph.osd.1.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.444 INFO:tasks.ceph.osd.1.smithi049.stderr:2022-04-03T21:55:52.437+0000 7fd4a69f6700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:52.444 INFO:tasks.ceph.osd.1.smithi049.stderr: in thread 7fd4a69f6700 thread_name:bstore_aio 2022-04-03T21:55:52.444 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.444 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.445 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fd4b7655ce0] 2022-04-03T21:55:52.445 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.445 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.445 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55fcdcfdd1be] 2022-04-03T21:55:52.446 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.446 INFO:tasks.ceph.osd.1.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.446 INFO:tasks.ceph.osd.1.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.446 INFO:tasks.ceph.osd.1.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.447 INFO:tasks.ceph.osd.1.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:52.447 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.457 INFO:tasks.ceph.osd.1.smithi049.stderr: -2> 2022-04-03T21:55:52.434+0000 7fd4a69f6700 -1 bdev(0x55fce1d87800 /var/lib/ceph/osd/ceph-1/block) _aio_thread stalled aio 0x55fce1e30110 since 2022-04-03T21:54:52.405512+0000, timeout is 60s, suicide 2022-04-03T21:55:52.457 INFO:tasks.ceph.osd.1.smithi049.stderr: -1> 2022-04-03T21:55:52.435+0000 7fd4a69f6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fd4a69f6700 time 2022-04-03T21:55:52.434348+0000 2022-04-03T21:55:52.457 INFO:tasks.ceph.osd.1.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.458 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.458 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.458 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55fcdcfdd0eb] 2022-04-03T21:55:52.458 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.458 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.459 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.459 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.459 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.459 INFO:tasks.ceph.osd.1.smithi049.stderr: 0> 2022-04-03T21:55:52.437+0000 7fd4a69f6700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:52.460 INFO:tasks.ceph.osd.1.smithi049.stderr: in thread 7fd4a69f6700 thread_name:bstore_aio 2022-04-03T21:55:52.460 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.460 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.460 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fd4b7655ce0] 2022-04-03T21:55:52.460 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.461 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.461 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55fcdcfdd1be] 2022-04-03T21:55:52.461 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.461 INFO:tasks.ceph.osd.1.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.461 INFO:tasks.ceph.osd.1.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.462 INFO:tasks.ceph.osd.1.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.462 INFO:tasks.ceph.osd.1.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:52.462 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.469 INFO:tasks.ceph.osd.1.smithi049.stderr: -64> 2022-04-03T21:55:52.434+0000 7fd4a69f6700 -1 bdev(0x55fce1d87800 /var/lib/ceph/osd/ceph-1/block) _aio_thread stalled aio 0x55fce1e30110 since 2022-04-03T21:54:52.405512+0000, timeout is 60s, suicide 2022-04-03T21:55:52.469 INFO:tasks.ceph.osd.1.smithi049.stderr: -63> 2022-04-03T21:55:52.435+0000 7fd4a69f6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fd4a69f6700 time 2022-04-03T21:55:52.434348+0000 2022-04-03T21:55:52.470 INFO:tasks.ceph.osd.1.smithi049.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11442-gcfb8f943/rpm/el8/BUILD/ceph-17.0.0-11442-gcfb8f943/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("stalled aio... buggy kernel or bad device?") 2022-04-03T21:55:52.470 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.470 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.470 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55fcdcfdd0eb] 2022-04-03T21:55:52.471 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.471 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.471 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.471 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: clone() 2022-04-03T21:55:52.471 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.472 INFO:tasks.ceph.osd.1.smithi049.stderr: -62> 2022-04-03T21:55:52.437+0000 7fd4a69f6700 -1 *** Caught signal (Aborted) ** 2022-04-03T21:55:52.472 INFO:tasks.ceph.osd.1.smithi049.stderr: in thread 7fd4a69f6700 thread_name:bstore_aio 2022-04-03T21:55:52.472 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:52.472 INFO:tasks.ceph.osd.1.smithi049.stderr: ceph version 17.0.0-11442-gcfb8f943 (cfb8f943163b374162da0d7b0240f267dd46e4e1) quincy (dev) 2022-04-03T21:55:52.472 INFO:tasks.ceph.osd.1.smithi049.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fd4b7655ce0] 2022-04-03T21:55:52.473 INFO:tasks.ceph.osd.1.smithi049.stderr: 2: gsignal() 2022-04-03T21:55:52.473 INFO:tasks.ceph.osd.1.smithi049.stderr: 3: abort() 2022-04-03T21:55:52.473 INFO:tasks.ceph.osd.1.smithi049.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x55fcdcfdd1be] 2022-04-03T21:55:52.473 INFO:tasks.ceph.osd.1.smithi049.stderr: 5: (KernelDevice::_aio_thread()+0x1275) [0x55fcddc2fd95] 2022-04-03T21:55:52.474 INFO:tasks.ceph.osd.1.smithi049.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55fcddc3d2f1] 2022-04-03T21:55:52.474 INFO:tasks.ceph.osd.1.smithi049.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7fd4b764b1cf] 2022-04-03T21:55:52.474 INFO:tasks.ceph.osd.1.smithi049.stderr: 8: clone() 2022-04-03T21:55:52.474 INFO:tasks.ceph.osd.1.smithi049.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-03T21:55:52.475 INFO:tasks.ceph.osd.1.smithi049.stderr: 2022-04-03T21:55:54.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:55:54.352 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:56:09.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:09.384+0000 7f6e44c9f700 -1 osd.7 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:46.524425+0000 front 2022-04-03T21:55:46.524507+0000 (oldest deadline 2022-04-03T21:56:08.824401+0000) 2022-04-03T21:56:09.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:09.384+0000 7f6e44c9f700 -1 osd.7 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:46.524538+0000 front 2022-04-03T21:55:46.524451+0000 (oldest deadline 2022-04-03T21:56:08.824401+0000) 2022-04-03T21:56:09.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:09.594+0000 7f596d92c700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:48.107727+0000 front 2022-04-03T21:55:48.107648+0000 (oldest deadline 2022-04-03T21:56:09.207596+0000) 2022-04-03T21:56:09.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:09.594+0000 7f596d92c700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:48.107670+0000 front 2022-04-03T21:55:48.107661+0000 (oldest deadline 2022-04-03T21:56:09.207596+0000) 2022-04-03T21:56:10.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:10.373+0000 7f6e44c9f700 -1 osd.7 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:46.524425+0000 front 2022-04-03T21:55:46.524507+0000 (oldest deadline 2022-04-03T21:56:08.824401+0000) 2022-04-03T21:56:10.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:10.373+0000 7f6e44c9f700 -1 osd.7 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:46.524538+0000 front 2022-04-03T21:55:46.524451+0000 (oldest deadline 2022-04-03T21:56:08.824401+0000) 2022-04-03T21:56:10.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:10.567+0000 7f596d92c700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:48.107727+0000 front 2022-04-03T21:55:48.107648+0000 (oldest deadline 2022-04-03T21:56:09.207596+0000) 2022-04-03T21:56:10.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:10.567+0000 7f596d92c700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:48.107670+0000 front 2022-04-03T21:55:48.107661+0000 (oldest deadline 2022-04-03T21:56:09.207596+0000) 2022-04-03T21:56:11.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:56:11.184+0000 7f72c425d700 -1 osd.5 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:45.656774+0000 front 2022-04-03T21:55:45.656703+0000 (oldest deadline 2022-04-03T21:56:10.956607+0000) 2022-04-03T21:56:11.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:56:11.184+0000 7f72c425d700 -1 osd.5 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:45.656853+0000 front 2022-04-03T21:55:45.656688+0000 (oldest deadline 2022-04-03T21:56:10.956607+0000) 2022-04-03T21:56:11.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:11.325+0000 7f6e44c9f700 -1 osd.7 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:46.524425+0000 front 2022-04-03T21:55:46.524507+0000 (oldest deadline 2022-04-03T21:56:08.824401+0000) 2022-04-03T21:56:11.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:11.325+0000 7f6e44c9f700 -1 osd.7 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:46.524538+0000 front 2022-04-03T21:55:46.524451+0000 (oldest deadline 2022-04-03T21:56:08.824401+0000) 2022-04-03T21:56:11.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:11.531+0000 7f596d92c700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.49:6817 osd.2 since back 2022-04-03T21:55:48.107727+0000 front 2022-04-03T21:55:48.107648+0000 (oldest deadline 2022-04-03T21:56:09.207596+0000) 2022-04-03T21:56:11.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:11.531+0000 7f596d92c700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.49:6816 osd.3 since back 2022-04-03T21:55:48.107670+0000 front 2022-04-03T21:55:48.107661+0000 (oldest deadline 2022-04-03T21:56:09.207596+0000) 2022-04-03T21:56:13.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:13.010+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:52.074114+0000 front 2022-04-03T21:55:52.074224+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:13.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:13.010+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:52.074127+0000 front 2022-04-03T21:55:52.074163+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:14.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:14.058+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:52.074114+0000 front 2022-04-03T21:55:52.074224+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:14.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:14.058+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:52.074127+0000 front 2022-04-03T21:55:52.074163+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:14.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:14.543+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:50.908641+0000 front 2022-04-03T21:55:50.908618+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:14.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:14.543+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:50.908584+0000 front 2022-04-03T21:55:50.908677+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:15.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:15.094+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:52.074114+0000 front 2022-04-03T21:55:52.074224+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:15.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:15.094+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:52.074127+0000 front 2022-04-03T21:55:52.074163+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:15.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:15.416+0000 7f6e44c9f700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:49.925294+0000 front 2022-04-03T21:55:49.925337+0000 (oldest deadline 2022-04-03T21:56:14.625316+0000) 2022-04-03T21:56:15.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:15.416+0000 7f6e44c9f700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:49.925348+0000 front 2022-04-03T21:55:49.925332+0000 (oldest deadline 2022-04-03T21:56:14.625316+0000) 2022-04-03T21:56:15.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:15.494+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:50.908641+0000 front 2022-04-03T21:55:50.908618+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:15.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:15.494+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:50.908584+0000 front 2022-04-03T21:55:50.908677+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:16.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:16.140+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:52.074114+0000 front 2022-04-03T21:55:52.074224+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:16.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:16.140+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:52.074127+0000 front 2022-04-03T21:55:52.074163+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:16.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:16.445+0000 7f6e44c9f700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:49.925294+0000 front 2022-04-03T21:55:49.925337+0000 (oldest deadline 2022-04-03T21:56:14.625316+0000) 2022-04-03T21:56:16.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:16.445+0000 7f6e44c9f700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:49.925348+0000 front 2022-04-03T21:55:49.925332+0000 (oldest deadline 2022-04-03T21:56:14.625316+0000) 2022-04-03T21:56:16.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:16.448+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:50.908641+0000 front 2022-04-03T21:55:50.908618+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:16.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:16.448+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:50.908584+0000 front 2022-04-03T21:55:50.908677+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:17.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:17.116+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:52.074114+0000 front 2022-04-03T21:55:52.074224+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:17.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T21:56:17.116+0000 7f389e18e700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:52.074127+0000 front 2022-04-03T21:55:52.074163+0000 (oldest deadline 2022-04-03T21:56:12.574248+0000) 2022-04-03T21:56:17.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:56:17.179+0000 7f72c425d700 -1 osd.5 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:50.957201+0000 front 2022-04-03T21:55:50.957177+0000 (oldest deadline 2022-04-03T21:56:16.257170+0000) 2022-04-03T21:56:17.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T21:56:17.179+0000 7f72c425d700 -1 osd.5 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:50.957248+0000 front 2022-04-03T21:55:50.957215+0000 (oldest deadline 2022-04-03T21:56:16.257170+0000) 2022-04-03T21:56:17.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:17.440+0000 7f6e44c9f700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:49.925294+0000 front 2022-04-03T21:55:49.925337+0000 (oldest deadline 2022-04-03T21:56:14.625316+0000) 2022-04-03T21:56:17.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T21:56:17.440+0000 7f6e44c9f700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:49.925348+0000 front 2022-04-03T21:55:49.925332+0000 (oldest deadline 2022-04-03T21:56:14.625316+0000) 2022-04-03T21:56:17.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:17.469+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6828 osd.0 since back 2022-04-03T21:55:50.908641+0000 front 2022-04-03T21:55:50.908618+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:17.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T21:56:17.469+0000 7f596d92c700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2022-04-03T21:55:50.908584+0000 front 2022-04-03T21:55:50.908677+0000 (oldest deadline 2022-04-03T21:56:14.408596+0000) 2022-04-03T21:56:25.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:56:25.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:56:55.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:56:55.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:57:26.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:57:26.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:57:56.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:57:56.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:58:26.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:58:26.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:58:56.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:58:56.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:59:26.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:59:26.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:59:56.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T21:59:56.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:00:26.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:00:26.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:00:56.631 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:00:56.635 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:01:26.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:01:26.714 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:01:56.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:01:56.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:02:26.905 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:02:26.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:02:56.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:02:56.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:03:27.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:03:27.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:03:57.192 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:03:57.196 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:04:27.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:04:27.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:04:57.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:04:57.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:05:27.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:05:27.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:05:57.562 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:05:57.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:06:27.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:06:27.645 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:06:58.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:06:58.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:07:28.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:07:28.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:07:59.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:07:59.435 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:08:29.895 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:08:29.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:09:00.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:09:00.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:09:16.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:16.576+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:16.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:16.584+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:16.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:16.864+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:17.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:17.611+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:17.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:17.632+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:17.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:17.876+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:18.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:18.588+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:18.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:18.669+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:18.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:18.922+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:19.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:19.625+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:19.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:19.625+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:19.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:19.936+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:20.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:20.607+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 3 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:20.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:20.631+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:20.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:20.932+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:21.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:21.556+0000 7f72c425d700 -1 osd.5 78 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:21.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:21.586+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:21.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:21.629+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:21.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:21.910+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:22.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:22.551+0000 7f72c425d700 -1 osd.5 78 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:22.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:22.567+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:22.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:22.591+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:22.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:22.947+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:23.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:23.545+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:23.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:23.568+0000 7f72c425d700 -1 osd.5 78 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:23.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:23.578+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:23.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:23.928+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:24.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:24.548+0000 7f6e44c9f700 -1 osd.7 78 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:24.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:24.548+0000 7f72c425d700 -1 osd.5 78 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:24.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:24.566+0000 7f596d92c700 -1 osd.6 78 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:24.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:24.937+0000 7f389e18e700 -1 osd.4 78 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:25.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:25.557+0000 7f6e44c9f700 -1 osd.7 79 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:25.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:25.552+0000 7f596d92c700 -1 osd.6 79 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:25.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:25.696+0000 7f72c425d700 -1 osd.5 79 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:25.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:25.955+0000 7f389e18e700 -1 osd.4 79 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:26.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:26.577+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:26.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:26.596+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:26.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:26.657+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:26.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:26.966+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:27.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:27.576+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:27.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:27.598+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:27.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:27.702+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:27.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:27.955+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:28.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:28.599+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:28.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:28.638+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:28.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:28.657+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:28.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:28.927+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:29.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:29.592+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:29.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:29.642+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:29.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:29.682+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:29.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:29.899+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:30.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:30.609+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:30.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:30.680+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:30.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:30.685+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:30.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:30.923+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:30.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:09:30.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:09:31.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:31.581+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:31.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:31.647+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:31.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:31.693+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:31.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:31.904+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:32.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:32.613+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:32.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:32.622+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:32.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:32.660+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:32.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:32.879+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:33.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:33.592+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:33.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:33.599+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:33.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:33.690+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:33.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:33.878+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:34.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:34.575+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:34.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:34.642+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:34.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:34.680+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:34.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:34.855+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:35.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:35.536+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:35.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:35.651+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:35.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:35.658+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:35.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:35.839+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:36.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:36.556+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:36.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:36.651+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:36.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:36.652+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:36.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:36.825+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:37.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:37.544+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:37.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:37.633+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:37.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:37.641+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:37.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:37.837+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:38.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:38.536+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:38.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:38.621+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:38.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:38.634+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:38.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:38.867+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:39.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:39.546+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:39.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:39.665+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:39.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:39.669+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:39.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:39.820+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:40.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:40.585+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:40.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:40.666+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:40.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:40.708+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:40.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:40.842+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:41.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:41.587+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:41.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:41.661+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:41.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:41.712+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:41.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:41.796+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:42.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:42.548+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:42.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:42.664+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:42.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:42.704+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:42.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:42.771+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:43.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:43.536+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:43.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:43.666+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:43.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:43.669+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:43.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:43.806+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:44.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:44.510+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:44.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:44.640+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:44.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:44.691+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:44.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:44.852+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:45.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:45.554+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:45.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:45.649+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:45.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:45.664+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:45.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:45.896+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:46.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:46.525+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:46.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:46.638+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:46.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:46.649+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:46.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:46.848+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:47.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:47.503+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:47.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:47.626+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:47.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:47.658+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:47.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:47.870+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:48.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:48.536+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:48.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:48.603+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:48.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:48.654+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:48.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:48.893+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:49.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:49.527+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:49.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:49.559+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:49.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:49.689+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:49.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:49.894+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:50.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:50.501+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:50.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:50.549+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:50.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:50.658+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:50.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:50.863+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:51.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:51.503+0000 7f72c425d700 -1 osd.5 80 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:51.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:51.540+0000 7f596d92c700 -1 osd.6 80 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:51.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:51.647+0000 7f6e44c9f700 -1 osd.7 80 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:51.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:51.866+0000 7f389e18e700 -1 osd.4 80 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:52.087 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:09:52.085+0000 7f5a6deda700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (110) Connection timed out 2022-04-03T22:09:52.087 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:09:52.085+0000 7f5a6deda700 -1 mds.0.journaler.mdlog(rw) handle_write_error (110) Connection timed out 2022-04-03T22:09:52.088 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:09:52.085+0000 7f5a6deda700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:09:52.107 INFO:tasks.ceph.mds.c.smithi049.stderr: -4> 2022-04-03T22:09:52.085+0000 7f5a6deda700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (110) Connection timed out 2022-04-03T22:09:52.108 INFO:tasks.ceph.mds.c.smithi049.stderr: -3> 2022-04-03T22:09:52.085+0000 7f5a6deda700 -1 mds.0.journaler.mdlog(rw) handle_write_error (110) Connection timed out 2022-04-03T22:09:52.108 INFO:tasks.ceph.mds.c.smithi049.stderr: -1> 2022-04-03T22:09:52.085+0000 7f5a6deda700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:09:52.146 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2022-04-03T22:09:52.530 INFO:tasks.ceph.mon.b.smithi117.stderr:2022-04-03T22:09:52.527+0000 7fd4f925d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-04-03T22:09:52.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:52.624+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:52.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:52.684+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:52.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:52.759+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:52.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:52.900+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:53.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:53.617+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:53.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:53.667+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:53.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:53.711+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:53.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:53.895+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:54.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:54.571+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:54.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:54.666+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:54.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:54.669+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:54.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:54.889+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:55.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:55.562+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:55.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:55.684+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:55.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:55.704+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:55.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:55.852+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:56.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:56.548+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:56.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:56.720+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:56.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:56.722+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:56.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:56.804+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:57.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:57.502+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:57.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:57.682+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:57.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:57.737+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:57.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:57.824+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:58.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:58.532+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:58.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:58.690+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:58.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:58.712+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:58.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:58.799+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:59.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:09:59.537+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:59.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:09:59.670+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:59.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:09:59.678+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:09:59.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:09:59.840+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:00.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:00.554+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:00.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:00.644+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:00.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:00.688+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:00.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:00.880+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:01.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:10:01.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:10:01.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:01.562+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:01.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:01.644+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:01.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:01.651+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:01.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:01.834+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:02.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:02.557+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:02.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:02.654+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:02.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:02.664+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:02.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:02.871+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:03.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:03.537+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:03.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:03.628+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:03.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:03.659+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:03.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:03.911+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:04.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:04.575+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:04.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:04.669+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:04.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:04.704+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:04.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:04.881+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:05.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:05.606+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:05.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:05.704+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:05.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:05.738+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:05.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:05.881+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:06.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:06.593+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:06.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:06.656+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:06.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:06.743+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:06.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:06.860+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:07.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:07.595+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:07.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:07.677+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:07.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:07.739+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:07.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:07.847+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:08.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:08.622+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:08.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:08.691+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:08.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:08.718+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:08.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:08.866+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:09.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:09.656+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:09.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:09.663+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:09.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:09.734+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:09.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:09.903+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:10.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:10.615+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:10.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:10.671+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:10.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:10.707+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:10.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:10.862+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:11.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:11.574+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:11.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:11.697+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:11.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:11.711+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:11.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:11.881+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:12.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:12.566+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:12.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:12.672+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:12.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:12.738+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:12.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:12.860+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:13.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:13.541+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:13.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:13.658+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:13.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:13.742+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:13.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:13.867+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:14.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:14.495+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:14.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:14.639+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:14.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:14.733+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:14.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:14.854+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:15.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:15.515+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:15.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:15.648+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:15.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:15.761+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:15.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:15.861+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:16.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:16.516+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:16.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:16.621+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:16.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:16.729+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:16.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:16.823+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:17.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:17.537+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:17.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:17.612+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:17.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:17.742+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:17.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:17.814+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:18.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:18.585+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:18.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:18.642+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:18.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:18.741+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:18.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:18.779+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:19.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:19.561+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:19.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:19.634+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:19.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:19.748+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:19.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:19.756+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:20.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:20.526+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:20.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:20.626+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:20.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:20.713+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:20.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:20.801+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:21.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:21.540+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:21.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:21.625+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:21.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:21.691+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:21.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:21.777+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:22.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:22.496+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:22.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:22.585+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:22.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:22.652+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:22.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:22.819+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:23.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:23.516+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:23.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:23.558+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:23.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:23.678+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:23.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:23.802+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:24.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:24.508+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:24.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:24.564+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:24.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:24.654+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:24.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:24.803+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:25.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:25.535+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:25.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:25.559+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:25.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:25.612+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:25.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:25.805+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:26.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:26.507+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:26.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:26.573+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:26.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:26.586+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:26.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:26.784+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:27.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:27.505+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:27.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:27.556+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:27.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:27.567+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:27.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:27.764+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:28.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:28.504+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:28.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:28.552+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:28.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:28.613+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:28.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:28.752+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:29.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:29.531+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:29.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:29.540+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:29.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:29.645+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:29.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:29.770+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:30.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:30.510+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:30.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:30.587+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:30.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:30.604+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:30.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:30.787+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:31.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:10:31.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:10:31.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:31.482+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:31.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:31.555+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:31.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:31.608+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:31.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:31.747+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:32.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:32.522+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:32.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:32.528+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:32.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:32.592+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:32.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:32.710+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:33.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:33.526+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:33.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:33.558+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:33.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:33.612+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:33.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:33.673+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:34.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:34.506+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:34.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:34.543+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:34.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:34.651+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:34.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:34.712+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:35.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:35.526+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:35.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:35.538+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:35.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:35.665+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:35.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:35.731+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:36.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:36.497+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:36.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:36.522+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:36.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:36.626+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:36.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:36.726+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:37.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:37.540+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:37.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:37.553+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:37.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:37.577+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:37.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:37.768+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:38.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:38.537+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:38.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:38.552+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:38.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:38.561+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:38.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:38.774+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:39.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:39.539+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:39.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:39.567+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:39.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:39.601+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:39.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:39.742+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:40.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:40.505+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:40.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:40.580+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:40.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:40.614+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:40.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:40.739+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:41.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:41.543+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:41.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:41.581+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:41.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:41.591+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:41.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:41.764+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:42.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:42.528+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:42.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:42.548+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:42.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:42.555+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:42.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:42.813+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:43.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:43.501+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:43.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:43.594+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:43.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:43.594+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:43.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:43.830+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:44.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:44.497+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:44.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:44.586+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:44.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:44.629+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:44.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:44.854+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:45.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:45.520+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:45.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:45.542+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:45.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:45.617+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:45.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:45.865+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:46.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:46.490+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:46.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:46.552+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:46.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:46.639+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:46.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:46.857+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:47.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:47.500+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:47.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:47.585+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:47.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:47.654+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:47.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:47.824+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:48.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:48.532+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:48.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:48.601+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:48.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:48.671+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:48.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:48.777+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:49.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:49.557+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:49.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:49.622+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:49.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:49.692+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:49.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:49.797+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:50.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:50.512+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:50.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:50.654+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:50.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:50.672+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:50.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:50.791+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:51.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:51.554+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:51.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:51.632+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:51.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:51.655+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:51.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:51.839+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:52.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:52.599+0000 7f72c425d700 -1 osd.5 81 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:52.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:52.619+0000 7f596d92c700 -1 osd.6 81 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:52.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:52.646+0000 7f6e44c9f700 -1 osd.7 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:52.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:52.801+0000 7f389e18e700 -1 osd.4 81 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:53.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:53.582+0000 7f72c425d700 -1 osd.5 82 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:53.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:53.635+0000 7f6e44c9f700 -1 osd.7 82 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:53.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:53.657+0000 7f596d92c700 -1 osd.6 82 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:53.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:53.759+0000 7f389e18e700 -1 osd.4 82 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:54.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:54.616+0000 7f596d92c700 -1 osd.6 83 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:54.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:54.616+0000 7f72c425d700 -1 osd.5 83 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:54.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:54.624+0000 7f6e44c9f700 -1 osd.7 83 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:54.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:54.755+0000 7f389e18e700 -1 osd.4 83 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:55.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:55.573+0000 7f72c425d700 -1 osd.5 84 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:55.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:55.591+0000 7f6e44c9f700 -1 osd.7 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:55.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:55.654+0000 7f596d92c700 -1 osd.6 84 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:55.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:55.726+0000 7f389e18e700 -1 osd.4 84 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:56.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:56.592+0000 7f72c425d700 -1 osd.5 84 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:56.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:56.612+0000 7f6e44c9f700 -1 osd.7 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:56.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:56.694+0000 7f596d92c700 -1 osd.6 84 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:56.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:56.741+0000 7f389e18e700 -1 osd.4 84 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:57.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:57.600+0000 7f72c425d700 -1 osd.5 84 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:57.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:57.650+0000 7f6e44c9f700 -1 osd.7 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:57.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:57.729+0000 7f596d92c700 -1 osd.6 84 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:57.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:57.744+0000 7f389e18e700 -1 osd.4 84 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:58.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:58.578+0000 7f72c425d700 -1 osd.5 84 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:58.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:58.695+0000 7f6e44c9f700 -1 osd.7 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:58.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:58.735+0000 7f596d92c700 -1 osd.6 84 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:58.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:58.754+0000 7f389e18e700 -1 osd.4 84 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:59.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:10:59.626+0000 7f72c425d700 -1 osd.5 84 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:59.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:10:59.650+0000 7f6e44c9f700 -1 osd.7 84 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:59.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:10:59.754+0000 7f596d92c700 -1 osd.6 84 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:10:59.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:10:59.793+0000 7f389e18e700 -1 osd.4 84 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:00.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:00.583+0000 7f72c425d700 -1 osd.5 85 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:00.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:00.666+0000 7f6e44c9f700 -1 osd.7 85 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:00.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:00.714+0000 7f596d92c700 -1 osd.6 85 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:00.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:00.789+0000 7f389e18e700 -1 osd.4 85 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:01.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:11:01.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:11:01.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:01.535+0000 7f72c425d700 -1 osd.5 86 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:01.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:01.645+0000 7f6e44c9f700 -1 osd.7 86 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:01.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:01.760+0000 7f596d92c700 -1 osd.6 86 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:01.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:01.828+0000 7f389e18e700 -1 osd.4 86 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:02.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:02.524+0000 7f72c425d700 -1 osd.5 87 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:02.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:02.679+0000 7f6e44c9f700 -1 osd.7 87 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:02.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:02.769+0000 7f596d92c700 -1 osd.6 87 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:02.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:02.852+0000 7f389e18e700 -1 osd.4 87 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:03.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:03.559+0000 7f72c425d700 -1 osd.5 88 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:03.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:03.666+0000 7f6e44c9f700 -1 osd.7 88 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:03.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:03.732+0000 7f596d92c700 -1 osd.6 88 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:03.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:03.893+0000 7f389e18e700 -1 osd.4 88 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:04.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:04.590+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:04.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:04.667+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:04.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:04.760+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:04.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:04.900+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:05.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:05.578+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:05.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:05.663+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:05.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:05.767+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:05.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:05.875+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:06.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:06.575+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:06.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:06.614+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:06.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:06.744+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:06.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:06.846+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:07.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:07.552+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:07.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:07.603+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:07.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:07.744+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:07.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:07.895+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:08.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:08.527+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:08.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:08.623+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:08.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:08.720+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:08.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:08.847+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:09.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:09.575+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:09.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:09.627+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:09.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:09.719+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:09.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:09.818+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:10.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:10.576+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:10.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:10.657+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:10.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:10.714+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:10.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:10.849+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:11.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:11.553+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:11.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:11.677+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:11.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:11.697+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:11.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:11.839+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:12.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:12.573+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:12.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:12.666+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:12.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:12.667+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:12.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:12.876+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:13.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:13.576+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:13.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:13.633+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:13.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:13.715+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:13.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:13.901+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:14.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:14.540+0000 7f72c425d700 -1 osd.5 89 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:14.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:14.664+0000 7f6e44c9f700 -1 osd.7 89 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:14.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:14.748+0000 7f596d92c700 -1 osd.6 89 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:14.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:14.900+0000 7f389e18e700 -1 osd.4 89 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:15.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:15.533+0000 7f72c425d700 -1 osd.5 90 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:15.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:15.629+0000 7f6e44c9f700 -1 osd.7 90 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:15.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:15.707+0000 7f596d92c700 -1 osd.6 90 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:15.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:15.931+0000 7f389e18e700 -1 osd.4 90 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:16.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:16.513+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:16.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:16.584+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:16.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:16.664+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:16.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:16.943+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:17.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:17.532+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:17.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:17.578+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:17.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:17.712+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:17.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:17.949+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:18.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:18.536+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:18.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:18.553+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:18.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:18.685+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:18.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:18.926+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:19.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:19.501+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:19.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:19.517+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:19.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:19.660+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:19.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:19.949+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:20.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:20.500+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:20.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:20.528+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:20.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:20.655+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:20.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:20.932+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:21.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:21.504+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:21.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:21.506+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:21.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:21.644+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:21.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:21.907+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:22.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:22.460+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:22.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:22.480+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:22.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:22.627+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:22.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:22.937+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:23.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:23.425+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:23.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:23.496+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:23.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:23.590+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:23.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:23.905+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:24.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:24.427+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:24.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:24.491+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:24.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:24.549+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:24.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:24.890+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:25.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:25.432+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:25.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:25.513+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:25.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:25.571+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:25.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:25.913+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:26.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:26.450+0000 7f6e44c9f700 -1 osd.7 91 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:26.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:26.556+0000 7f72c425d700 -1 osd.5 91 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:26.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:26.569+0000 7f596d92c700 -1 osd.6 91 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:26.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:26.894+0000 7f389e18e700 -1 osd.4 91 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:27.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:27.451+0000 7f6e44c9f700 -1 osd.7 92 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:27.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:27.543+0000 7f596d92c700 -1 osd.6 92 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:27.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:27.592+0000 7f72c425d700 -1 osd.5 92 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:27.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:27.845+0000 7f389e18e700 -1 osd.4 92 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:28.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:28.477+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:28.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:28.557+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:28.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:28.600+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:28.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:28.809+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:29.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:29.446+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:29.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:29.590+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:29.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:29.602+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:29.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:29.771+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:30.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:30.475+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:30.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:30.553+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:30.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:30.562+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:30.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:30.796+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:31.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:31.456+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:31.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:31.504+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:31.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:31.578+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:31.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:11:31.639 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:11:31.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:31.773+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:32.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:32.476+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:32.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:32.530+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:32.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:32.553+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:32.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:32.781+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:33.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:33.434+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:33.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:33.497+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:33.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:33.592+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:33.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:33.807+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:34.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:34.478+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:34.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:34.482+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:34.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:34.607+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:34.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:34.832+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:35.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:35.464+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:35.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:35.482+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:35.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:35.623+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:35.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:35.829+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:36.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:36.496+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:36.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:36.500+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:36.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:36.617+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:36.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:36.786+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:37.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:37.474+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:37.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:37.518+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:37.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:37.631+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:37.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:37.836+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:38.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:38.486+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:38.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:38.499+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:38.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:38.599+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:38.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:38.820+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:39.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:39.450+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:39.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:39.541+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:39.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:39.557+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:39.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:39.846+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:40.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:40.494+0000 7f596d92c700 -1 osd.6 93 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:40.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:40.567+0000 7f72c425d700 -1 osd.5 93 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:40.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:40.576+0000 7f6e44c9f700 -1 osd.7 93 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:40.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:40.889+0000 7f389e18e700 -1 osd.4 93 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:41.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:41.478+0000 7f596d92c700 -1 osd.6 94 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:41.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:41.534+0000 7f6e44c9f700 -1 osd.7 94 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:41.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:41.581+0000 7f72c425d700 -1 osd.5 94 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:41.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:41.904+0000 7f389e18e700 -1 osd.4 94 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:42.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:42.468+0000 7f596d92c700 -1 osd.6 95 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:42.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:42.503+0000 7f6e44c9f700 -1 osd.7 95 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:42.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:42.623+0000 7f72c425d700 -1 osd.5 95 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:42.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:42.908+0000 7f389e18e700 -1 osd.4 95 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:43.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:43.478+0000 7f596d92c700 -1 osd.6 96 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:43.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:43.545+0000 7f6e44c9f700 -1 osd.7 96 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:43.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:43.661+0000 7f72c425d700 -1 osd.5 96 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:43.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:43.943+0000 7f389e18e700 -1 osd.4 96 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:44.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:44.482+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:44.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:44.498+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:44.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:44.700+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:44.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:44.905+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:45.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:45.471+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:45.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:45.477+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:45.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:45.654+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:45.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:45.881+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:46.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:46.441+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:46.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:46.475+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:46.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:46.663+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:46.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:46.875+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:47.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:47.432+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:47.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:47.525+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:47.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:47.620+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:47.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:47.873+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:48.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:48.387+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:48.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:48.492+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:48.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:48.636+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:48.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:48.892+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:49.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:49.420+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:49.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:49.518+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:49.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:49.606+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:49.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:49.876+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:50.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:50.405+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:50.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:50.471+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:50.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:50.642+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:50.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:50.898+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:51.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:51.363+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:51.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:51.497+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:51.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:51.668+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:51.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:51.876+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:52.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:52.362+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:52.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:52.462+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:52.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:52.683+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:52.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:52.877+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:53.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:53.315+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:53.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:53.474+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:53.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:53.649+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:53.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:53.835+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:54.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:54.313+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:54.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:54.468+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:54.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:54.627+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:54.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:54.812+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:55.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:55.343+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:55.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:55.430+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:55.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:55.636+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:55.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:55.849+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:56.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:56.368+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:56.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:56.454+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:56.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:56.617+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:56.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:56.845+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:57.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:57.374+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:57.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:57.459+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:57.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:57.608+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:57.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:57.850+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:58.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:58.368+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:58.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:58.412+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:58.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:58.650+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:58.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:58.803+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:59.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:11:59.327+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:59.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:11:59.433+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:59.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:11:59.628+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:11:59.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:11:59.793+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:00.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:00.369+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:00.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:00.427+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:00.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:00.647+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:00.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:00.797+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:01.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:01.349+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:01.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:01.379+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:01.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:01.637+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:01.719 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:12:01.723 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:12:01.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:01.829+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:02.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:02.366+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:02.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:02.397+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:02.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:02.663+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:02.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:02.835+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:03.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:03.343+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:03.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:03.353+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:03.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:03.691+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:03.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:03.810+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:04.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:04.323+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:04.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:04.340+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:04.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:04.723+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:04.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:04.843+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:05.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:05.289+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:05.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:05.314+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:05.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:05.764+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:05.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:05.822+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:06.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:06.259+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:06.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:06.339+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:06.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:06.765+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:06.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:06.772+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:07.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:07.275+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:07.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:07.387+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:07.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:07.753+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:07.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:07.796+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:08.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:08.284+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:08.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:08.343+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:08.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:08.760+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:08.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:08.821+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:09.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:09.314+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:09.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:09.317+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:09.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:09.763+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:09.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:09.779+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:10.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:10.309+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:10.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:10.341+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:10.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:10.745+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:10.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:10.811+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:11.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:11.281+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:11.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:11.319+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:11.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:11.746+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:11.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:11.849+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:12.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:12.274+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:12.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:12.323+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:12.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:12.775+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:12.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:12.878+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:13.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:13.232+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:13.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:13.310+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:13.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:13.820+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:13.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:13.848+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:14.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:14.280+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:14.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:14.318+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:14.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:14.809+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:14.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:14.840+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:15.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:15.247+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:15.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:15.268+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:15.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:15.809+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:15.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:15.813+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:16.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:16.289+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:16.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:16.311+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:16.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:16.845+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:16.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:16.850+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:17.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:17.305+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:17.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:17.345+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:17.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:17.878+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:17.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:17.889+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:18.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:18.316+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:18.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:18.327+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:18.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:18.868+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:18.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:18.908+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:19.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:19.332+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:19.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:19.338+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:19.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:19.884+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:19.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:19.941+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:20.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:20.334+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:20.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:20.340+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:20.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:20.884+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:20.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:20.907+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:21.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:21.312+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:21.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:21.314+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:21.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:21.892+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:21.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:21.924+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:22.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:22.311+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:22.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:22.318+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:22.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:22.864+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:23.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:22.974+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:23.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:23.264+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:23.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:23.352+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:23.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:23.903+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:24.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:23.999+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:24.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:24.298+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:24.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:24.332+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:24.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:24.910+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:24.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:24.978+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:25.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:25.312+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:25.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:25.317+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:25.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:25.938+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:25.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:25.973+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:26.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:26.272+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:26.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:26.281+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:26.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:26.931+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 20 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:27.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:27.021+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:27.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:27.255+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:27.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:27.321+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:27.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:27.932+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:28.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:28.017+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:28.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:28.245+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:28.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:28.292+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:28.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:28.963+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:29.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:29.057+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:29.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:29.271+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:29.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:29.325+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:29.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:29.957+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:30.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:30.077+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:30.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:30.314+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:30.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:30.338+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:30.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:30.937+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:31.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:31.041+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:31.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:31.328+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:31.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:31.342+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:31.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:12:31.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:12:31.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:31.924+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:31.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:31.992+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:32.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:32.303+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:32.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:32.345+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:32.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:32.969+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:33.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:33.022+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:33.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:33.324+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:33.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:33.339+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:33.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:33.979+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:34.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:34.015+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:34.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:34.308+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:34.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:34.334+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:34.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:34.982+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:35.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:35.011+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:35.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:35.283+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:35.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:35.314+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:35.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:35.971+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:36.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:36.055+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:36.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:36.278+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:36.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:36.293+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:36.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:36.968+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:37.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:37.046+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:37.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:37.284+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:37.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:37.310+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:37.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:37.935+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:38.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:38.061+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:38.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:38.281+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:38.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:38.354+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:38.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:38.965+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:39.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:39.065+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:39.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:39.323+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:39.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:39.369+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:39.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:39.972+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:40.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:40.043+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:40.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:40.301+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:40.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:40.325+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:40.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:40.981+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:41.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:41.077+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:41.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:41.307+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:41.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:41.329+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:42.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:42.030+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:42.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:42.084+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:42.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:42.312+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:42.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:42.333+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:43.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:43.080+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:43.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:43.108+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:43.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:43.314+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:43.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:43.360+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:44.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:44.098+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:44.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:44.104+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:44.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:44.289+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:44.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:44.313+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:45.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:45.103+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:45.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:45.137+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:45.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:45.302+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:45.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:45.326+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:46.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:46.119+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:46.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:46.159+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:46.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:46.318+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:46.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:46.351+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:47.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:47.110+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:47.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:47.112+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:47.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:47.306+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:47.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:47.348+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 2 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:48.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:48.113+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:48.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:48.127+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:48.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:48.263+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 18 slow ops, oldest is osd_op(mds.0.4:38884 4.39 4.496ab839 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:48.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:48.360+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:49.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:49.124+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:49.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:49.137+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:49.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:49.275+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:49.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:49.322+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:50.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:50.118+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:50.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:50.133+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:50.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:50.289+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:50.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:50.291+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:51.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:51.088+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:51.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:51.133+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:51.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:51.261+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:51.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:51.326+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:52.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:52.100+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:52.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:52.138+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:52.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:52.219+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:52.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:52.309+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:53.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:53.061+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:53.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:53.135+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:53.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:53.218+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:53.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:53.262+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:54.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:54.078+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:54.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:54.182+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:54.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:54.258+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:54.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:54.291+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:55.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:55.031+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:55.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:55.188+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:55.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:55.269+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:55.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:55.288+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:56.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:56.031+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:56.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:56.153+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:56.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:56.318+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:56.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:56.322+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:57.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:57.039+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:57.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:57.166+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:57.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:57.285+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:57.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:57.287+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:58.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:58.004+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:58.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:58.215+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:58.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:58.260+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:58.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:58.303+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:58.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:58.966+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:59.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:12:59.246+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:59.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:12:59.252+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:59.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:12:59.332+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:12:59.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:12:59.980+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:00.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:00.238+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:00.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:00.245+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:00.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:00.320+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:00.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:00.963+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:01.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:01.237+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:01.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:01.283+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:01.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:01.306+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:01.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:13:01.891 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:13:01.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:01.922+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:02.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:02.235+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:02.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:02.242+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:02.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:02.320+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:02.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:02.894+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:03.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:03.237+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:03.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:03.282+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:03.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:03.329+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:03.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:03.902+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:04.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:04.249+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:04.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:04.324+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:04.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:04.327+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:04.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:04.898+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:05.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:05.261+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:05.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:05.284+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:05.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:05.294+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:05.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:05.920+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:06.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:06.281+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:06.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:06.287+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:06.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:06.313+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:06.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:06.897+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:07.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:07.240+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:07.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:07.284+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:07.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:07.291+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:07.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:07.903+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:08.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:08.239+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:08.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:08.273+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:08.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:08.290+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:08.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:08.920+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:09.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:09.268+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:09.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:09.280+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:09.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:09.293+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:09.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:09.878+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:10.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:10.230+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:10.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:10.256+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:10.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:10.316+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:10.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:10.900+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:11.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:11.238+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:11.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:11.238+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:11.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:11.337+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:11.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:11.918+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:12.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:12.221+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:12.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:12.269+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:12.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:12.309+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:12.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:12.879+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:13.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:13.248+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:13.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:13.248+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:13.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:13.342+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:13.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:13.838+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:14.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:14.210+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:14.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:14.256+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:14.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:14.370+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:14.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:14.789+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:15.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:15.212+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:15.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:15.218+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:15.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:15.368+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:15.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:15.790+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:16.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:16.196+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:16.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:16.255+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:16.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:16.354+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:16.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:16.776+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:17.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:17.185+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:17.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:17.284+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:17.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:17.324+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:17.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:17.773+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:18.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:18.159+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:18.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:18.237+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:18.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:18.309+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:18.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:18.802+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:19.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:19.135+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:19.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:19.277+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:19.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:19.359+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:19.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:19.783+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:20.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:20.119+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:20.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:20.252+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:20.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:20.328+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:20.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:20.826+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:21.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:21.102+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:21.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:21.296+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:21.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:21.305+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:21.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:21.862+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:22.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:22.140+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:22.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:22.332+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:22.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:22.348+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:22.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:22.892+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:23.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:23.190+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:23.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:23.345+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:23.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:23.382+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:23.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:23.880+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:24.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:24.212+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:24.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:24.392+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:24.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:24.403+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:24.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:24.868+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:25.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:25.254+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:25.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:25.433+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:25.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:25.453+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:25.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:25.876+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:26.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:26.264+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:26.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:26.441+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:26.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:26.483+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:26.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:26.871+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:27.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:27.249+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:27.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:27.469+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:27.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:27.480+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:27.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:27.861+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:28.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:28.250+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:28.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:28.445+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:28.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:28.453+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:28.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:28.832+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:29.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:29.227+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:29.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:29.400+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:29.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:29.483+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:29.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:29.877+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:30.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:30.208+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:30.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:30.418+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:30.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:30.483+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:30.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:30.864+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:31.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:31.249+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:31.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:31.457+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:31.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:31.470+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:31.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:31.874+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:32.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:13:32.015 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:13:32.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:32.278+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:32.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:32.450+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:32.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:32.455+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:32.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:32.894+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:33.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:33.261+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:33.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:33.441+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:33.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:33.492+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:33.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:33.868+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:34.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:34.247+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:34.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:34.406+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:34.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:34.449+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:34.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:34.896+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:35.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:35.218+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:35.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:35.406+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:35.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:35.467+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:35.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:35.920+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:36.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:36.186+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:36.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:36.372+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:36.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:36.459+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:36.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:36.957+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:37.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:37.158+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:37.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:37.370+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:37.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:37.473+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:37.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:37.949+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:38.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:38.124+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:38.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:38.419+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:38.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:38.440+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:38.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:38.980+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:39.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:39.103+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:39.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:39.392+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:39.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:39.462+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:39.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:39.982+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:40.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:40.107+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:40.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:40.407+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:40.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:40.482+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:40.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:40.970+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:41.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:41.145+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:41.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:41.435+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:41.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:41.519+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:41.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:41.941+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:42.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:42.155+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:42.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:42.436+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:42.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:42.488+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:42.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:42.912+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:43.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:43.163+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:43.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:43.448+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:43.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:43.468+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:43.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:43.898+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:44.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:44.210+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:44.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:44.460+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:44.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:44.490+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:44.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:44.945+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:45.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:45.198+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:45.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:45.442+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:45.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:45.498+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:45.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:45.948+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:46.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:46.199+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:46.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:46.478+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:46.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:46.542+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:46.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:46.960+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:47.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:47.227+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:47.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:47.526+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:47.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:47.572+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:47.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:47.983+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:48.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:48.264+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:48.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:48.550+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:48.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:48.566+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:48.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:48.989+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:49.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:49.298+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:49.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:49.521+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:49.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:49.554+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:50.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:49.998+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:50.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:50.296+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:50.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:50.564+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:50.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:50.596+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:51.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:51.010+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:51.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:51.291+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:51.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:51.546+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:51.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:51.561+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:52.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:52.052+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:52.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:52.248+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:52.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:52.526+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:52.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:52.526+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:53.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:53.096+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:53.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:53.213+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:53.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:53.521+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:53.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:53.575+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:54.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:54.138+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:54.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:54.189+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:54.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:54.514+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:54.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:54.559+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:55.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:55.184+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:55.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:55.187+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:55.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:55.500+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:55.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:55.567+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:56.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:56.152+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:56.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:56.168+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:56.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:56.486+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:56.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:56.606+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:57.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:57.136+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:57.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:57.146+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:57.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:57.487+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:57.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:57.571+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:58.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:58.122+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:58.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:58.124+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:58.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:58.524+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:58.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:58.610+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:59.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:13:59.086+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:59.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:13:59.170+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:59.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:13:59.511+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:13:59.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:13:59.630+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:00.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:00.089+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:00.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:00.131+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:00.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:00.531+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:00.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:00.622+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:01.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:01.051+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:01.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:01.163+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:01.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:01.521+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:01.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:01.576+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:02.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:02.073+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:02.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:14:02.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:14:02.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:02.148+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:02.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:02.550+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:02.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:02.579+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:03.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:03.088+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:03.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:03.104+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:03.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:03.538+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:03.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:03.539+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:04.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:04.104+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:04.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:04.127+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:04.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:04.543+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:04.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:04.550+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:05.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:05.089+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:05.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:05.116+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:05.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:05.568+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:05.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:05.590+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:06.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:06.070+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:06.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:06.086+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:06.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:06.556+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:06.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:06.586+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:07.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:07.072+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:07.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:07.124+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:07.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:07.546+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:07.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:07.549+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:08.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:08.103+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:08.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:08.173+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:08.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:08.538+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:08.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:08.586+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:09.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:09.126+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:09.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:09.173+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:09.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:09.493+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:09.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:09.584+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:10.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:10.128+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:10.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:10.163+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:10.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:10.464+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:10.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:10.616+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:11.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:11.170+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:11.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:11.179+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:11.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:11.465+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:11.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:11.661+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:12.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:12.179+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:12.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:12.187+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:12.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:12.467+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:12.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:12.666+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:13.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:13.190+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:13.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:13.223+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:13.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:13.457+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:13.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:13.681+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:14.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:14.178+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:14.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:14.207+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:14.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:14.500+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:14.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:14.675+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:15.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:15.138+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:15.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:15.217+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:15.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:15.549+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:15.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:15.706+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:16.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:16.109+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:16.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:16.189+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:16.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:16.539+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:16.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:16.691+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:17.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:17.141+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:17.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:17.183+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:17.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:17.491+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:17.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:17.690+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:18.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:18.126+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:18.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:18.223+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:18.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:18.495+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:18.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:18.697+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:19.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:19.102+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:19.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:19.215+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:19.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:19.517+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:19.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:19.714+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:20.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:20.107+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:20.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:20.248+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:20.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:20.525+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:20.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:20.706+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:21.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:21.087+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:21.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:21.208+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:21.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:21.554+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:21.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:21.703+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:22.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:22.087+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:22.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:22.210+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:22.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:22.563+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:22.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:22.662+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:23.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:23.131+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:23.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:23.224+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:23.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:23.539+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:23.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:23.633+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:24.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:24.099+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:24.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:24.192+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:24.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:24.536+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:24.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:24.643+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:25.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:25.138+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:25.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:25.216+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:25.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:25.527+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:25.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:25.688+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:26.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:26.144+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:26.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:26.179+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:26.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:26.503+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:26.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:26.674+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:27.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:27.122+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:27.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:27.225+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:27.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:27.498+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:27.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:27.719+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:28.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:28.137+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:28.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:28.271+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:28.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:28.485+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:28.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:28.672+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:29.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:29.126+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:29.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:29.317+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:29.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:29.451+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:29.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:29.710+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:30.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:30.169+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:30.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:30.362+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:30.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:30.447+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:30.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:30.711+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:31.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:31.136+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:31.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:31.391+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:31.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:31.441+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:31.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:31.716+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:32.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:32.161+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:32.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:14:32.188 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:14:32.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:32.410+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:32.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:32.482+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:32.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:32.711+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:33.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:33.140+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:33.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:33.366+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:33.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:33.439+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:33.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:33.748+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:34.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:34.118+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:34.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:34.338+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:34.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:34.427+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:34.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:34.765+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:35.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:35.136+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:35.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:35.363+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:35.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:35.426+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:35.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:35.738+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:36.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:36.139+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:36.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:36.346+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:36.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:36.467+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:36.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:36.777+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:37.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:37.132+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:37.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:37.345+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:37.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:37.515+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:37.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:37.743+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:38.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:38.126+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:38.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:38.345+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:38.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:38.498+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:38.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:38.697+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:39.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:39.158+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:39.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:39.337+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:39.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:39.514+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:39.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:39.747+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:40.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:40.164+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:40.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:40.312+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:40.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:40.523+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:40.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:40.724+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:41.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:41.159+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:41.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:41.290+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:41.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:41.499+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:41.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:41.736+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:42.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:42.191+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:42.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:42.275+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:42.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:42.453+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:42.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:42.717+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:43.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:43.153+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:43.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:43.245+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:43.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:43.422+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:43.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:43.682+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:44.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:44.164+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:44.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:44.271+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:44.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:44.425+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:44.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:44.687+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:45.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:45.116+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:45.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:45.262+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:45.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:45.398+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:45.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:45.677+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:46.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:46.157+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:46.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:46.238+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:46.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:46.383+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:46.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:46.644+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:47.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:47.146+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:47.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:47.280+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:47.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:47.366+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:47.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:47.605+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:48.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:48.109+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:48.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:48.240+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:48.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:48.335+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:48.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:48.613+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:49.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:49.125+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:49.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:49.246+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:49.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:49.327+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:49.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:49.613+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:50.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:50.140+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:50.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:50.235+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:50.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:50.292+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:50.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:50.635+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:51.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:51.095+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:51.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:51.244+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:51.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:51.266+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:51.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:51.631+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:52.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:52.094+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:52.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:52.194+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:52.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:52.249+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:52.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:52.644+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:53.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:53.107+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:53.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:53.216+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:53.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:53.288+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:53.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:53.600+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:54.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:54.155+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:54.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:54.230+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:54.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:54.292+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:54.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:54.637+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:55.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:55.150+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:55.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:55.266+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:55.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:55.304+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:55.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:55.643+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:56.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:56.180+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:56.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:56.218+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:56.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:56.264+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:56.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:56.658+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:57.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:57.169+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:57.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:57.220+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:57.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:57.256+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:57.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:57.650+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:58.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:58.174+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:58.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:58.217+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:58.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:58.272+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:58.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:58.690+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:59.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:14:59.161+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:59.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:14:59.197+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:59.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:14:59.278+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:14:59.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:14:59.721+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:00.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:00.130+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:00.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:00.169+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:00.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:00.260+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:00.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:00.686+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:01.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:01.118+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:01.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:01.160+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:01.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:01.264+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:01.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:01.692+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:02.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:02.081+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:02.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:02.182+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:02.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:02.226+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:02.280 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:15:02.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:15:02.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:02.668+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:03.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:03.070+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:03.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:03.181+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:03.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:03.189+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:03.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:03.686+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:04.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:04.102+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:04.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:04.157+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:04.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:04.161+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:04.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:04.658+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:05.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:05.146+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:05.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:05.173+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:05.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:05.178+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:05.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:05.660+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:06.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:06.116+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:06.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:06.180+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:06.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:06.181+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:06.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:06.709+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:07.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:07.153+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:07.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:07.156+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:07.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:07.156+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:07.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:07.748+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:08.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:08.112+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:08.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:08.167+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:08.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:08.199+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:08.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:08.782+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:09.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:09.122+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:09.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:09.142+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:09.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:09.158+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:09.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:09.809+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:10.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:10.138+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:10.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:10.142+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:10.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:10.163+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:10.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:10.797+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:11.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:11.114+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:11.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:11.171+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:11.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:11.201+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:11.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:11.817+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:12.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:12.156+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:12.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:12.173+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:12.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:12.200+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:12.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:12.809+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:13.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:13.135+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:13.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:13.185+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:13.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:13.189+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:13.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:13.826+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:14.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:14.149+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:14.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:14.177+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:14.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:14.202+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:14.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:14.781+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:15.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:15.153+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:15.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:15.177+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:15.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:15.221+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:15.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:15.739+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:16.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:16.182+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:16.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:16.192+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:16.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:16.198+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:16.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:16.713+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:17.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:17.180+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:17.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:17.222+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:17.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:17.242+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:17.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:17.710+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:18.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:18.220+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:18.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:18.221+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:18.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:18.231+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:18.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:18.700+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:19.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:19.186+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:19.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:19.198+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:19.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:19.223+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:19.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:19.653+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:20.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:20.189+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:20.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:20.217+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:20.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:20.257+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:20.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:20.676+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:21.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:21.161+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:21.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:21.253+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:21.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:21.303+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:21.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:21.627+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:22.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:22.196+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:22.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:22.212+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:22.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:22.315+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:22.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:22.672+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:23.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:23.174+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:23.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:23.254+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:23.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:23.290+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:23.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:23.694+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:24.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:24.178+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:24.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:24.274+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:24.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:24.294+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:24.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:24.676+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:25.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:25.162+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:25.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:25.261+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:25.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:25.320+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:25.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:25.631+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:26.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:26.174+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:26.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:26.288+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:26.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:26.305+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:26.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:26.657+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:27.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:27.163+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:27.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:27.260+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:27.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:27.272+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:27.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:27.679+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:28.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:28.187+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:28.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:28.228+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:28.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:28.247+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:28.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:28.689+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:29.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:29.189+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:29.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:29.268+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:29.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:29.292+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:29.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:29.695+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:30.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:30.144+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:30.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:30.255+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:30.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:30.339+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:30.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:30.704+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:31.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:31.150+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:31.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:31.298+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:31.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:31.359+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:31.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:31.687+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:32.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:32.185+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:32.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:32.257+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:32.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:32.338+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:32.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:15:32.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:15:32.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:32.690+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:33.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:33.215+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:33.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:33.221+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:33.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:33.367+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:33.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:33.703+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:34.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:34.215+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:34.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:34.231+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:34.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:34.349+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:34.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:34.746+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:35.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:35.179+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:35.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:35.207+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:35.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:35.325+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:35.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:35.778+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:36.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:36.194+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:36.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:36.256+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:36.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:36.344+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:36.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:36.752+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:37.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:37.152+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:37.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:37.294+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:37.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:37.374+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:37.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:37.721+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:38.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:38.158+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:38.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:38.341+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:38.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:38.344+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:38.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:38.722+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:39.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:39.177+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:39.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:39.299+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:39.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:39.313+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:39.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:39.757+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:40.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:40.145+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:40.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:40.266+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:40.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:40.333+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:40.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:40.805+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:41.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:41.171+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:41.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:41.237+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:41.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:41.378+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:41.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:41.761+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:42.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:42.147+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:42.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:42.274+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:42.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:42.360+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:42.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:42.735+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:43.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:43.134+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:43.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:43.314+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:43.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:43.332+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:43.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:43.733+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:44.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:44.169+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:44.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:44.305+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:44.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:44.340+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:44.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:44.714+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:45.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:45.218+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:45.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:45.307+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:45.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:45.310+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:45.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:45.695+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:46.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:46.173+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:46.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:46.324+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:46.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:46.331+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:46.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:46.721+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:47.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:47.207+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:47.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:47.275+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:47.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:47.321+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:47.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:47.756+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:48.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:48.208+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:48.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:48.285+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:48.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:48.310+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:48.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:48.778+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:49.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:49.182+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:49.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:49.264+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:49.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:49.270+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:49.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:49.759+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:50.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:50.136+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:50.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:50.241+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:50.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:50.244+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:50.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:50.725+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:51.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:51.181+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:51.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:51.202+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:51.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:51.238+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:51.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:51.714+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:52.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:52.152+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:52.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:52.251+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:52.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:52.275+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:52.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:52.733+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:53.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:53.161+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:53.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:53.249+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:53.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:53.288+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:53.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:53.699+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:54.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:54.198+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:54.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:54.290+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:54.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:54.326+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:54.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:54.662+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:55.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:55.160+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:55.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:55.248+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:55.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:55.283+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:55.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:55.688+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:56.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:56.131+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:56.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:56.227+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:56.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:56.273+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:56.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:56.692+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:57.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:57.161+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:57.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:57.221+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:57.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:57.290+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:57.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:57.658+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:58.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:58.165+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:58.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:58.250+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:58.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:58.311+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:58.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:58.689+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:59.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:15:59.212+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:59.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:15:59.277+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:59.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:15:59.335+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:15:59.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:15:59.723+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:00.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:00.238+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:00.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:00.254+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:00.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:00.349+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:00.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:00.689+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:01.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:01.236+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:01.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:01.237+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:01.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:01.339+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:01.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:01.697+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:02.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:02.221+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:02.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:02.277+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:02.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:02.341+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:02.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:16:02.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:16:02.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:02.682+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:03.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:03.227+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:03.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:03.236+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:03.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:03.364+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:03.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:03.641+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:04.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:04.213+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:04.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:04.229+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:04.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:04.402+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:04.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:04.662+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:05.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:05.221+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:05.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:05.246+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:05.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:05.446+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:05.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:05.679+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:06.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:06.249+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:06.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:06.274+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:06.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:06.419+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:06.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:06.661+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:07.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:07.210+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:07.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:07.260+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:07.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:07.445+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:07.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:07.629+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:08.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:08.214+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:08.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:08.252+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:08.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:08.456+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:08.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:08.613+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:09.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:09.242+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:09.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:09.286+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:09.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:09.485+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:09.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:09.599+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:10.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:10.266+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:10.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:10.331+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:10.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:10.517+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:10.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:10.596+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:11.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:11.247+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:11.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:11.324+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:11.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:11.534+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:11.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:11.587+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:12.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:12.283+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:12.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:12.364+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:12.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:12.521+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:12.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:12.606+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:13.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:13.324+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:13.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:13.340+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:13.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:13.522+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:13.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:13.650+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:14.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:14.279+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:14.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:14.298+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:14.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:14.568+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:14.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:14.648+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:15.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:15.256+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:15.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:15.332+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:15.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:15.600+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:15.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:15.668+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:16.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:16.224+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:16.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:16.316+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:16.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:16.572+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:16.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:16.633+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:17.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:17.271+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:17.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:17.347+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:17.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:17.603+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:17.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:17.612+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:18.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:18.316+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:18.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:18.319+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:18.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:18.632+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:18.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:18.646+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:19.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:19.274+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:19.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:19.285+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:19.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:19.608+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:19.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:19.665+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:20.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:20.228+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:20.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:20.249+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:20.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:20.620+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:20.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:20.652+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:21.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:21.219+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:21.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:21.250+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:21.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:21.601+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:21.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:21.654+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:22.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:22.246+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:22.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:22.274+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:22.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:22.632+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:22.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:22.696+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:23.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:23.207+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:23.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:23.292+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:23.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:23.620+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:23.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:23.652+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:24.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:24.192+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:24.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:24.284+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:24.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:24.578+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:24.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:24.640+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:25.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:25.193+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:25.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:25.289+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:25.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:25.616+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:25.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:25.674+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:26.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:26.208+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:26.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:26.320+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:26.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:26.615+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:26.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:26.698+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:27.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:27.208+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:27.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:27.310+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:27.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:27.580+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:27.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:27.676+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:28.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:28.179+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:28.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:28.342+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:28.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:28.619+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:28.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:28.689+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:29.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:29.159+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:29.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:29.300+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:29.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:29.595+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:29.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:29.714+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:30.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:30.121+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:30.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:30.294+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:30.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:30.546+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:30.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:30.712+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:31.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:31.114+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:31.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:31.331+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:31.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:31.554+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:31.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:31.734+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:32.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:32.072+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:32.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:32.371+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:32.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:32.507+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:32.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:16:32.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:16:32.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:32.775+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:33.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:33.041+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:33.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:33.417+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:33.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:33.499+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:33.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:33.801+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:34.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:34.017+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:34.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:34.421+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:34.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:34.483+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:34.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:34.793+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:35.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:34.998+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:35.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:35.427+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:35.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:35.506+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:35.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:35.830+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:36.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:36.011+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:36.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:36.460+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:36.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:36.493+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:36.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:36.816+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:36.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:36.963+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:37.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:37.437+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:37.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:37.539+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:37.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:37.841+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:37.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:37.938+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:38.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:38.448+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:38.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:38.549+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:38.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:38.832+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:38.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:38.984+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:39.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:39.486+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:39.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:39.541+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:39.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:39.858+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:39.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:39.950+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:40.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:40.485+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:40.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:40.580+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:40.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:40.815+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:40.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:40.941+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:41.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:41.498+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:41.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:41.568+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:41.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:41.768+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:41.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:41.951+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:42.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:42.482+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:42.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:42.565+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:42.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:42.775+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:42.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:42.936+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:43.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:43.476+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:43.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:43.523+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:43.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:43.769+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:43.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:43.917+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:44.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:44.495+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:44.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:44.541+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:44.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:44.729+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:44.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:44.949+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:45.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:45.496+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:45.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:45.536+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:45.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:45.728+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:45.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:45.929+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:46.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:46.535+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:46.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:46.585+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:46.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:46.733+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:46.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:46.883+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:47.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:47.490+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:47.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:47.583+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:47.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:47.734+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:47.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:47.870+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:48.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:48.513+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:48.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:48.606+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:48.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:48.777+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:48.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:48.921+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:49.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:49.536+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:49.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:49.559+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:49.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:49.820+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:49.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:49.919+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:50.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:50.488+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:50.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:50.601+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:50.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:50.786+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:50.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:50.959+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:51.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:51.470+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:51.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:51.594+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:51.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:51.813+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:51.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:51.947+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:52.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:52.424+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:52.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:52.632+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:52.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:52.827+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:52.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:52.974+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:53.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:53.392+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:53.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:53.648+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:53.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:53.849+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:54.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:54.022+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:54.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:54.349+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:54.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:54.609+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:54.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:54.853+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:54.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:54.982+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:55.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:55.362+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:55.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:55.617+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:55.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:55.898+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:55.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:55.945+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:56.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:56.359+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:56.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:56.626+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:56.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:56.869+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:56.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:56.974+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:57.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:57.329+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:57.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:57.587+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:57.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:57.873+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:57.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:57.936+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:58.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:58.347+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:58.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:58.549+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:58.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:58.849+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:58.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:58.971+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:59.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:16:59.355+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:59.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:16:59.584+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:59.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:16:59.822+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:16:59.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:16:59.955+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:00.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:00.349+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:00.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:00.595+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:00.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:00.773+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:00.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:00.917+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:01.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:01.355+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:01.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:01.620+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:01.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:01.756+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:01.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:01.869+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:02.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:02.363+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:02.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:02.588+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:02.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:17:02.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:17:02.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:02.744+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:02.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:02.856+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:03.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:03.327+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:03.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:03.603+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:03.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:03.770+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:03.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:03.902+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:04.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:04.363+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:04.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:04.620+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:04.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:04.763+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:04.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:04.943+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:05.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:05.390+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:05.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:05.659+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:05.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:05.761+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:05.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:05.914+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:06.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:06.346+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:06.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:06.627+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:06.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:06.760+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:06.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:06.919+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:07.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:07.310+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:07.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:07.677+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:07.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:07.713+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:07.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:07.942+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:08.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:08.319+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:08.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:08.655+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:08.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:08.762+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:08.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:08.967+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:09.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:09.320+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:09.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:09.696+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:09.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:09.773+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:10.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:09.998+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:10.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:10.274+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:10.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:10.733+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:10.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:10.791+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:11.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:11.015+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:11.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:11.320+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:11.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:11.776+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:11.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:11.785+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:11.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:11.980+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:12.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:12.342+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:12.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:12.742+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:12.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:12.791+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:12.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:12.992+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:13.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:13.342+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:13.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:13.779+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:13.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:13.782+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:14.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:14.030+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:14.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:14.300+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:14.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:14.753+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:14.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:14.796+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:15.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:15.026+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:15.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:15.344+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:15.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:15.768+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:15.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:15.789+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:15.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:15.982+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:16.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:16.385+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:16.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:16.783+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:16.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:16.823+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:16.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:16.977+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:17.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:17.380+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:17.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:17.820+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:17.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:17.853+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:17.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:17.967+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:18.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:18.391+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:18.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:18.782+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:18.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:18.904+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:18.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:18.926+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:19.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:19.438+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:19.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:19.781+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:19.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:19.906+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:19.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:19.964+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:20.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:20.442+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:20.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:20.815+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:20.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:20.887+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:20.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:20.977+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:21.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:21.454+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:21.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:21.854+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:21.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:21.855+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:21.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:21.980+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:22.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:22.457+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:22.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:22.824+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:22.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:22.891+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:22.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:22.947+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:23.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:23.448+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:23.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:23.789+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:23.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:23.935+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:23.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:23.951+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:24.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:24.462+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:24.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:24.829+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:24.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:24.946+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:24.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:24.988+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:25.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:25.506+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:25.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:25.834+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:25.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:25.994+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:26.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:26.026+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:26.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:26.525+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:26.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:26.790+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:26.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:26.992+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:27.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:27.032+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:27.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:27.499+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:27.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:27.765+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:27.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:27.994+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:28.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:28.081+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:28.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:28.494+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:28.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:28.812+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:28.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:28.957+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:29.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:29.083+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:29.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:29.495+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:29.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:29.789+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:29.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:29.945+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:30.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:30.047+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:30.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:30.449+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:30.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:30.831+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:30.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:30.969+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:31.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:31.011+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:31.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:31.452+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:31.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:31.851+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:31.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:31.949+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:32.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:32.009+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:32.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:32.480+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:32.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:17:32.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:17:32.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:32.822+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:32.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:32.986+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:33.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:33.006+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:33.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:33.523+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:33.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:33.870+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:34.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:34.019+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:34.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:34.038+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:34.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:34.537+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:34.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:34.836+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:35.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:35.051+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:35.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:35.055+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:35.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:35.521+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:35.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:35.880+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:36.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:36.084+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:36.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:36.088+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:36.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:36.527+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:36.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:36.900+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:37.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:37.084+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:37.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:37.116+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:37.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:37.501+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:37.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:37.896+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:38.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:38.075+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:38.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:38.076+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:38.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:38.497+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:38.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:38.880+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:39.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:39.068+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:39.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:39.093+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:39.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:39.485+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:39.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:39.867+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:40.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:40.027+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:40.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:40.060+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:40.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:40.435+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:40.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:40.908+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:41.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:41.018+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:41.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:41.107+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:41.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:41.390+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:41.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:41.886+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:42.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:42.037+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:42.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:42.140+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:42.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:42.431+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:42.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:42.846+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:43.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:43.045+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:43.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:43.182+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:43.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:43.421+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:43.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:43.883+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:44.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:44.055+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:44.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:44.145+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:44.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:44.468+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:44.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:44.837+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:45.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:45.058+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:45.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:45.183+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:45.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:45.471+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:45.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:45.887+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:46.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:46.060+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:46.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:46.168+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:46.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:46.435+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:46.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:46.910+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:47.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:47.016+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:47.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:47.130+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:47.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:47.481+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:47.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:47.954+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:48.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:48.002+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:48.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:48.167+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:48.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:48.519+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:48.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:48.984+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:49.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:49.006+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:49.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:49.204+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:49.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:49.537+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:49.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:49.975+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:50.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:50.016+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:50.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:50.192+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:50.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:50.508+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:50.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:50.955+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:51.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:51.058+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:51.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:51.225+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:51.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:51.467+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:51.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:51.952+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:52.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:52.070+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:52.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:52.199+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:52.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:52.434+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:52.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:52.910+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:53.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:53.022+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:53.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:53.170+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:53.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:53.433+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:53.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:53.910+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:54.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:54.059+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:54.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:54.211+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:54.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:54.418+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:54.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:54.894+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:55.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:55.099+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:55.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:55.170+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:55.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:55.381+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:55.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:55.945+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:56.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:56.105+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:56.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:56.187+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:56.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:56.342+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:56.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:56.918+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:57.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:57.063+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:57.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:57.224+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:57.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:57.343+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:57.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:57.958+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:58.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:58.083+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:58.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:58.231+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:58.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:58.388+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:58.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:58.979+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:59.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:17:59.124+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:59.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:17:59.273+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:59.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:17:59.384+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:17:59.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:17:59.935+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:00.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:00.079+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:00.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:00.286+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:00.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:00.399+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:00.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:00.952+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:01.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:01.122+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:01.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:01.326+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:01.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:01.360+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:01.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:01.945+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:02.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:02.136+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:02.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:02.328+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:02.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:02.330+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:02.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:18:02.811 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:18:02.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:02.918+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:03.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:03.134+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:03.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:03.305+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:03.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:03.378+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:03.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:03.938+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:04.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:04.121+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:04.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:04.265+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:04.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:04.368+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:04.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:04.985+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:05.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:05.074+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:05.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:05.259+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:05.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:05.339+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:05.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:05.973+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:06.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:06.038+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:06.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:06.216+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:06.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:06.356+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:06.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:06.993+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:07.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:07.013+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:07.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:07.207+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:07.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:07.386+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:07.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:07.947+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:08.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:08.008+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:08.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:08.207+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:08.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:08.405+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:08.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:08.925+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:09.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:09.030+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:09.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:09.251+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:09.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:09.393+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:09.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:09.900+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:10.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:10.003+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:10.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:10.247+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:10.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:10.390+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:10.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:10.860+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:11.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:11.022+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:11.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:11.282+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:11.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:11.387+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:11.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:11.857+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:12.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:12.060+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:12.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:12.264+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:12.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:12.348+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:12.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:12.855+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:13.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:13.065+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:13.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:13.241+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:13.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:13.309+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:13.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:13.870+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:14.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:14.063+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:14.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:14.192+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:14.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:14.322+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:14.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:14.879+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:15.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:15.095+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:15.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:15.174+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:15.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:15.280+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:15.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:15.917+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:16.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:16.066+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:16.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:16.132+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:16.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:16.297+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:16.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:16.963+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:17.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:17.089+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:17.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:17.103+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:17.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:17.339+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:17.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:17.975+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:18.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:18.109+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:18.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:18.113+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:18.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:18.316+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:18.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:18.952+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:19.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:19.130+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:19.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:19.133+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:19.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:19.276+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:19.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:19.939+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:20.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:20.106+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:20.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:20.155+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:20.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:20.248+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:20.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:20.904+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:21.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:21.120+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:21.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:21.124+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:21.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:21.268+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:21.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:21.895+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:22.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:22.109+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:22.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:22.120+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:22.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:22.279+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:22.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:22.905+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:23.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:23.127+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:23.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:23.141+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:23.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:23.306+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:23.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:23.914+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:24.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:24.098+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:24.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:24.105+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:24.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:24.353+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:24.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:24.948+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:25.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:25.072+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:25.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:25.092+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:25.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:25.383+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:25.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:25.916+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:26.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:26.074+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:26.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:26.101+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:26.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:26.370+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:26.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:26.962+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:27.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:27.102+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:27.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:27.141+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:27.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:27.407+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:27.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:27.936+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:28.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:28.129+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:28.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:28.171+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:28.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:28.367+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:28.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:28.960+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:29.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:29.158+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:29.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:29.171+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:29.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:29.350+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:30.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:30.002+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:30.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:30.111+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:30.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:30.144+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:30.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:30.312+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:31.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:31.030+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:31.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:31.099+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:31.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:31.180+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:31.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:31.312+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:32.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:32.053+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:32.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:32.066+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:32.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:32.206+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:32.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:32.318+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:32.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:18:32.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:18:33.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:33.064+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:33.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:33.113+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:33.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:33.208+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:33.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:33.335+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:34.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:34.027+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:34.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:34.163+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:34.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:34.184+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:34.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:34.335+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:35.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:35.035+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:35.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:35.150+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:35.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:35.229+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:35.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:35.302+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:36.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:36.066+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:36.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:36.142+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:36.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:36.212+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:36.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:36.294+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:37.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:37.084+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:37.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:37.163+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:37.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:37.174+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:37.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:37.263+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:38.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:38.059+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:38.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:38.170+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:38.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:38.196+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:38.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:38.311+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:39.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:39.068+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:39.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:39.209+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:39.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:39.221+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:39.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:39.270+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:40.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:40.089+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:40.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:40.180+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:40.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:40.231+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:40.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:40.259+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:41.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:41.043+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:41.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:41.167+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:41.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:41.216+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:41.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:41.228+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:42.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:42.038+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:42.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:42.166+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:42.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:42.217+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:42.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:42.278+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:43.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:43.008+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:43.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:43.140+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:43.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:43.233+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:43.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:43.287+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:44.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:44.052+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:44.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:44.114+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:44.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:44.211+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:44.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:44.307+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:45.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:45.074+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:45.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:45.159+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:45.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:45.191+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:45.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:45.286+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:46.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:46.083+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:46.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:46.156+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:46.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:46.225+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:46.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:46.299+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:47.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:47.038+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:47.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:47.109+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:47.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:47.232+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:47.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:47.331+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:48.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:48.045+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:48.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:48.067+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:48.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:48.232+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:48.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:48.324+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:49.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:49.024+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:49.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:49.084+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:49.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:49.279+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:49.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:49.371+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:49.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:49.977+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:50.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:50.118+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:50.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:50.233+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:50.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:50.365+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:51.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:51.022+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:51.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:51.103+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:51.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:51.248+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:51.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:51.383+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:52.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:52.003+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:52.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:52.093+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:52.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:52.227+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:52.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:52.407+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:53.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:53.034+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:53.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:53.082+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:53.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:53.226+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:53.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:53.407+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:54.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:54.070+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:54.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:54.073+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:54.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:54.220+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:54.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:54.419+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:55.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:55.056+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:55.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:55.117+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:55.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:55.204+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:55.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:55.371+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:56.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:56.020+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:56.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:56.115+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:56.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:56.237+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:56.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:56.337+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:57.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:56.997+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:57.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:57.147+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:57.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:57.269+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:57.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:57.331+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:57.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:57.989+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:58.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:58.101+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:58.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:58.291+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:58.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:58.339+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:59.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:18:59.010+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:59.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:18:59.090+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:59.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:18:59.274+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:18:59.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:18:59.353+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:00.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:00.050+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:00.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:00.111+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:00.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:00.246+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:00.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:00.331+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:01.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:01.034+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:01.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:01.084+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:01.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:01.281+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:01.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:01.313+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:02.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:02.053+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:02.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:02.069+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:02.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:02.279+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:02.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:02.358+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:02.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:19:02.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:19:03.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:03.031+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:03.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:03.059+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:03.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:03.301+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:03.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:03.311+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:03.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:03.983+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:04.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:04.043+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:04.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:04.312+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:04.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:04.339+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:04.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:04.975+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:05.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:05.032+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:05.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:05.289+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:05.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:05.320+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:06.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:06.020+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:06.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:06.024+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:06.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:06.267+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:06.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:06.280+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:06.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:06.981+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:07.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:07.039+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:07.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:07.257+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:07.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:07.300+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:07.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:07.990+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:08.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:08.083+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:08.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:08.258+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:08.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:08.265+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:09.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:09.005+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:09.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:09.122+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:09.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:09.225+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:09.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:09.248+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:09.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:09.963+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:10.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:10.160+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:10.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:10.250+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:10.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:10.262+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:11.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:11.002+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:11.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:11.142+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:11.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:11.238+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:11.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:11.243+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:12.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:12.041+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:12.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:12.163+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:12.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:12.221+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:12.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:12.285+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:13.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:13.087+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:13.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:13.183+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:13.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:13.241+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:13.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:13.266+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:14.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:14.088+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:14.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:14.210+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:14.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:14.289+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:14.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:14.314+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:15.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:15.058+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:15.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:15.228+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:15.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:15.274+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:15.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:15.298+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:16.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:16.068+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:16.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:16.261+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:16.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:16.278+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:16.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:16.319+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:17.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:17.042+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:17.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:17.220+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:17.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:17.263+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:17.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:17.277+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:18.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:18.053+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:18.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:18.240+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:18.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:18.256+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:18.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:18.278+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:19.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:19.032+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:19.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:19.200+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:19.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:19.237+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:19.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:19.278+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:19.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:19.991+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:20.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:20.166+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:20.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:20.201+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:20.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:20.321+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:21.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:20.998+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:21.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:21.142+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:21.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:21.192+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:21.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:21.337+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:22.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:22.014+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:22.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:22.113+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:22.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:22.185+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:22.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:22.333+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:22.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:22.996+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:23.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:23.087+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:23.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:23.195+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:23.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:23.353+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:23.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:23.970+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:24.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:24.049+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:24.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:24.165+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:24.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:24.373+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:24.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:24.954+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:25.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:25.047+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:25.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:25.191+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:25.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:25.384+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:25.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:25.969+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:26.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:26.058+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:26.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:26.240+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:26.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:26.361+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:26.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:26.974+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:27.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:27.084+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:27.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:27.201+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:27.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:27.331+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:28.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:28.012+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:28.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:28.093+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:28.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:28.218+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:28.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:28.287+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:29.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:29.050+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:29.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:29.132+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:29.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:29.191+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:29.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:29.291+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:30.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:30.067+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:30.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:30.102+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:30.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:30.183+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:30.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:30.309+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:31.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:31.067+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:31.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:31.148+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:31.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:31.226+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:31.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:31.335+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:32.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:32.024+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:32.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:32.137+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:32.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:32.262+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:32.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:32.301+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:32.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:32.977+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:33.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:19:33.049 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:19:33.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:33.088+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:33.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:33.267+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:33.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:33.309+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:34.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:34.007+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:34.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:34.075+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:34.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:34.245+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:34.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:34.338+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:34.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:34.965+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:35.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:35.107+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:35.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:35.263+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:35.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:35.356+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:35.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:35.944+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:36.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:36.092+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:36.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:36.233+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:36.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:36.406+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:36.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:36.897+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:37.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:37.098+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:37.100 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:37.098+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:37.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:37.235+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:37.302 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:37.299+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:37.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:37.406+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:37.703 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:37.700+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:37.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:37.872+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:38.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:38.052+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:38.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:38.231+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:38.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:38.390+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:38.504 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:38.502+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:38.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:38.891+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:39.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:39.090+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:39.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:39.240+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:39.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:39.350+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:39.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:39.898+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:40.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:40.074+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:40.106 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:40.104+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:40.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:40.235+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:40.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:40.309+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:40.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:40.907+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:41.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:41.032+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:41.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:41.267+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:41.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:41.299+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:41.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:41.927+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:42.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:42.057+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:42.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:42.236+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:42.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:42.283+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:42.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:42.927+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:43.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:43.052+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:43.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:43.191+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:43.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:43.263+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:43.310 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:43.308+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:43.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:43.897+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:44.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:44.082+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:44.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:44.218+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:44.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:44.224+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:44.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:44.912+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:45.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:45.036+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:45.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:45.245+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:45.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:45.264+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:45.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:45.954+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:46.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:46.009+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:46.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:46.218+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:46.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:46.238+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:46.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:46.959+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:47.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:47.015+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:47.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:47.172+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:47.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:47.236+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:47.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:47.932+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:48.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:48.056+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:48.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:48.172+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:48.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:48.190+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:48.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:48.947+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:49.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:49.021+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:49.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:49.169+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:49.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:49.196+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:49.718 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:19:49.715+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:19:49.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:49.931+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:49.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:49.991+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:50.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:50.131+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:50.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:50.234+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:50.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:50.922+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:50.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:50.992+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:51.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:51.091+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:51.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:51.249+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:51.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:51.893+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:51.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:51.973+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:52.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:52.066+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:52.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:52.248+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:52.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:52.876+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:52.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:52.962+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:53.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:53.049+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:53.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:53.245+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:53.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:53.903+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:53.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:53.978+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:54.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:54.051+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:54.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:54.203+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:54.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:54.860+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:55.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:55.009+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:55.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:55.018+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:55.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:55.183+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:55.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:55.870+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:56.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:56.003+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:56.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:56.004+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:56.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:56.145+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:56.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:56.878+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:56.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:56.988+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:57.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:57.020+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:57.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:57.139+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:57.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:57.834+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:57.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:57.995+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:58.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:58.060+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:58.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:58.156+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:58.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:58.849+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:58.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:19:58.995+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:59.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:19:59.052+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:59.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:19:59.152+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:19:59.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:19:59.835+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:00.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:00.021+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:00.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:00.081+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:00.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:00.151+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:00.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:00.883+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:01.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:01.071+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:01.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:01.102+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:01.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:01.143+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:01.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:01.850+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:02.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:02.083+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:02.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:02.140+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:02.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:02.166+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:02.531 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:20:02.529+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:20:02.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:02.852+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:03.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:03.067+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:03.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:03.119+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:03.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:03.121+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:03.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:20:03.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:20:03.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:03.816+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:04.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:04.045+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:04.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:04.076+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:04.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:04.101+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:04.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:04.780+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:05.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:05.057+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:05.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:05.062+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:05.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:05.141+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:05.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:05.750+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:06.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:06.013+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:06.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:06.041+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:06.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:06.182+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:06.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:06.704+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:07.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:07.035+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:07.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:07.060+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:07.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:07.223+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:07.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:07.694+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:08.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:08.063+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:08.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:08.067+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:08.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:08.254+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:08.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:08.695+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:09.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:09.028+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:09.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:09.048+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:09.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:09.217+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:09.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:09.740+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:10.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:10.026+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:10.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:10.032+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:10.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:10.251+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:10.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:10.762+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:10.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:10.977+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:11.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:11.041+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:11.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:11.263+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:11.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:11.719+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:11.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:11.975+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:12.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:12.079+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:12.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:12.311+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:12.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:12.754+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:13.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:13.024+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:13.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:13.036+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:13.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:13.280+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:13.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:13.800+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:14.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:14.038+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:14.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:14.083+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:14.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:14.321+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:14.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:14.847+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:15.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:15.038+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:15.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:15.054+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:15.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:15.307+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:15.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:15.816+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:16.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:16.082+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:16.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:16.104+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:16.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:16.274+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:16.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:16.806+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:17.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:17.076+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:17.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:17.139+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:17.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:17.314+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:17.547 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:20:17.545+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:20:17.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:17.822+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:18.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:18.109+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:18.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:18.182+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:18.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:18.338+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:18.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:18.780+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:19.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:19.136+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:19.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:19.150+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:19.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:19.382+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:19.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:19.790+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:20.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:20.131+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:20.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:20.181+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:20.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:20.348+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:20.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:20.765+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:21.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:21.084+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:21.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:21.193+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:21.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:21.340+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:21.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:21.778+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:22.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:22.058+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:22.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:22.214+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:22.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:22.362+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:22.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:22.821+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:23.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:23.084+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:23.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:23.210+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:23.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:23.408+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:23.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:23.810+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:24.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:24.043+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:24.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:24.236+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:24.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:24.374+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:24.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:24.826+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:25.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:25.070+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:25.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:25.218+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:25.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:25.422+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:25.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:25.826+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:26.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:26.042+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:26.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:26.238+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:26.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:26.434+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:26.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:26.843+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:27.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:27.013+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:27.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:27.193+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:27.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:27.446+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:27.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:27.826+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:27.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:27.988+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:28.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:28.204+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:28.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:28.488+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:28.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:28.873+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:29.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:29.034+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:29.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:29.242+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:29.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:29.536+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:29.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:29.848+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:30.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:30.035+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:30.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:30.199+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:30.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:30.574+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:30.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:30.804+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:31.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:31.028+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:31.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:31.236+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:31.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:31.585+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:31.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:31.800+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:32.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:32.000+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:32.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:32.189+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:32.563 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:20:32.561+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:20:32.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:32.595+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:32.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:32.781+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:32.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:32.961+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:33.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:20:33.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:20:33.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:33.210+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:33.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:33.642+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:33.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:33.767+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:33.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:33.970+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:34.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:34.253+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:34.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:34.632+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:34.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:34.763+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:34.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:34.979+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:35.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:35.300+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:35.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:35.678+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:35.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:35.749+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:35.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:35.970+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:36.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:36.306+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:36.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:36.629+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:36.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:36.769+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:36.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:36.969+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:37.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:37.286+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:37.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:37.653+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:37.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:37.734+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:37.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:37.985+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:38.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:38.309+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:38.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:38.683+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:38.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:38.693+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:39.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:39.013+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:39.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:39.337+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:39.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:39.652+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:39.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:39.702+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:40.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:40.001+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:40.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:40.378+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:40.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:40.607+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:40.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:40.723+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:41.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:41.015+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:41.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:41.429+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:41.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:41.582+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:41.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:41.757+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:42.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:42.057+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:42.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:42.411+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:42.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:42.538+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:42.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:42.774+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:43.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:43.046+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:43.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:43.401+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:43.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:43.505+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:43.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:43.807+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:44.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:44.001+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:44.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:44.432+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:44.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:44.539+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:44.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:44.853+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:44.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:44.976+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:45.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:45.445+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:45.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:45.558+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:45.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:45.887+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:46.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:45.998+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:46.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:46.454+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:46.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:46.600+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:46.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:46.902+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:47.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:47.045+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:47.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:47.472+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:47.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:47.557+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:47.579 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:20:47.577+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:20:47.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:47.868+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:48.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:48.081+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:48.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:48.430+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:48.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:48.511+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:48.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:48.843+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:49.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:49.043+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:49.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:49.408+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:49.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:49.509+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:49.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:49.833+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:50.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:50.082+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:50.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:50.387+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:50.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:50.470+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:50.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:50.849+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:51.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:51.086+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:51.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:51.423+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:51.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:51.520+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:51.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:51.879+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:52.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:52.067+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:52.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:52.389+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:52.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:52.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:52.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:52.862+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:53.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:53.107+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:53.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:53.397+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:53.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:53.450+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:53.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:53.823+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:54.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:54.117+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:54.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:54.379+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:54.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:54.407+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:54.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:54.832+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:55.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:55.069+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:55.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:55.334+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:55.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:55.437+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:55.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:55.865+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:56.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:56.067+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:56.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:56.369+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:56.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:56.476+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:56.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:56.859+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:57.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:57.028+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:57.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:57.418+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:57.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:57.449+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:57.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:57.909+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:58.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:57.999+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:58.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:58.375+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:58.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:58.460+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:58.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:58.924+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:59.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:20:59.040+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:59.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:20:59.360+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:59.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:20:59.449+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:20:59.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:20:59.962+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:00.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:00.000+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:00.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:00.344+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:00.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:00.429+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:00.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:00.924+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:01.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:01.015+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:01.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:01.358+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:01.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:01.410+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:01.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:01.906+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:01.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:01.974+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:02.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:02.389+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:02.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:02.416+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:02.595 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:21:02.592+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:21:02.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:02.916+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:02.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:02.925+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:03.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:21:03.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:21:03.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:03.384+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:03.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:03.448+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:03.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:03.912+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:03.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:03.944+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:04.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:04.351+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:04.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:04.455+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:04.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:04.891+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:04.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:04.959+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:05.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:05.379+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:05.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:05.499+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:05.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:05.879+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:05.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:05.931+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:06.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:06.351+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:06.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:06.507+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:06.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:06.884+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:06.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:06.926+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:07.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:07.389+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:07.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:07.500+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:07.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:07.886+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:07.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:07.887+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:08.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:08.369+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:08.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:08.542+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:08.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:08.886+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:08.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:08.926+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:09.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:09.355+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:09.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:09.577+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:09.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:09.916+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:09.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:09.927+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:10.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:10.395+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:10.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:10.552+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:10.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:10.886+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:10.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:10.949+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:11.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:11.428+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:11.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:11.586+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:11.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:11.884+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:11.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:11.913+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:12.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:12.435+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:12.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:12.579+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:12.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:12.864+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:12.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:12.887+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:13.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:13.461+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:13.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:13.600+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:13.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:13.875+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:13.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:13.886+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:14.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:14.507+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:14.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:14.564+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:14.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:14.853+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:14.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:14.858+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:15.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:15.474+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:15.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:15.517+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:15.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:15.824+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:15.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:15.850+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:16.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:16.490+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:16.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:16.500+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:16.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:16.824+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:16.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:16.875+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:17.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:17.496+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:17.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:17.509+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:17.602 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:21:17.601+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:21:17.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:17.849+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:17.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:17.878+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:18.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:18.458+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:18.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:18.497+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:18.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:18.876+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:18.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:18.894+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:19.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:19.435+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:19.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:19.467+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:19.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:19.857+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:19.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:19.886+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:20.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:20.420+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:20.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:20.421+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:20.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:20.835+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:20.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:20.925+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:21.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:21.396+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:21.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:21.409+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:21.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:21.866+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:21.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:21.968+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:22.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:22.365+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:22.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:22.367+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:22.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:22.852+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:22.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:22.977+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:23.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:23.327+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:23.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:23.377+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:23.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:23.840+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:24.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:24.006+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:24.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:24.367+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:24.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:24.401+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:24.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:24.874+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:24.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:24.957+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:25.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:25.354+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:25.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:25.408+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:25.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:25.880+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:25.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:25.941+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:26.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:26.334+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:26.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:26.363+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:26.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:26.845+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:26.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:26.933+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:27.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:27.350+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:27.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:27.389+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:27.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:27.866+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:27.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:27.924+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:28.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:28.388+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:28.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:28.420+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:28.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:28.847+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:28.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:28.950+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:29.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:29.403+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:29.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:29.405+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:29.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:29.866+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:29.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:29.941+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:30.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:30.413+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:30.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:30.445+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:30.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:30.896+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:30.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:30.907+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:31.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:31.432+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:31.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:31.460+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:31.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:31.904+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:31.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:31.956+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:32.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:32.426+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:32.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:32.502+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:32.618 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:21:32.615+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:21:32.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:32.866+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:32.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:32.947+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:33.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:21:33.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:21:33.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:33.433+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:33.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:33.534+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:33.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:33.829+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:33.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:33.902+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:34.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:34.456+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:34.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:34.535+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:34.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:34.793+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:34.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:34.888+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:35.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:35.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:35.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:35.581+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:35.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:35.780+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:35.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:35.899+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:36.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:36.503+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:36.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:36.571+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:36.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:36.778+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:36.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:36.917+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:37.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:37.488+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:37.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:37.584+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:37.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:37.811+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:37.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:37.901+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:38.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:38.486+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:38.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:38.594+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:38.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:38.840+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:38.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:38.950+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:39.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:39.480+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:39.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:39.571+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:39.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:39.859+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:39.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:39.943+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:40.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:40.448+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:40.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:40.605+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:40.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:40.833+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:40.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:40.921+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:41.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:41.441+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:41.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:41.641+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:41.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:41.882+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:41.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:41.967+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:42.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:42.452+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:42.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:42.603+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:42.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:42.851+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:42.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:42.922+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:43.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:43.492+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:43.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:43.556+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:43.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:43.866+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:43.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:43.965+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:44.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:44.485+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:44.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:44.603+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:44.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:44.821+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:45.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:45.008+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:45.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:45.511+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:45.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:45.619+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:45.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:45.815+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:45.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:45.989+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:46.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:46.542+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:46.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:46.578+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:46.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:46.771+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:46.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:46.970+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:47.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:47.558+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:47.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:47.558+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:47.633 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:21:47.630+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:21:47.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:47.816+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:47.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:47.961+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:48.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:48.511+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:48.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:48.537+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:48.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:48.802+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:48.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:48.944+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:49.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:49.493+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:49.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:49.531+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:49.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:49.769+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:49.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:49.945+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:50.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:50.491+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:50.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:50.497+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:50.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:50.799+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:50.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:50.903+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:51.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:51.467+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:51.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:51.524+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:51.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:51.836+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:51.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:51.856+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:52.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:52.479+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:52.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:52.505+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:52.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:52.808+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:52.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:52.837+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:53.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:53.492+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:53.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:53.550+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:53.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:53.791+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:53.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:53.872+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:54.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:54.487+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:54.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:54.564+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:54.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:54.822+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:54.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:54.856+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:55.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:55.498+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:55.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:55.525+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:55.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:55.827+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:55.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:55.839+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:56.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:56.477+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:56.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:56.480+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:56.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:56.817+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:56.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:56.843+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:57.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:57.467+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:57.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:57.520+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:57.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:57.848+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:57.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:57.851+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:58.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:58.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:58.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:58.553+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:58.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:58.809+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:58.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:58.823+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:59.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:21:59.469+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:59.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:21:59.515+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:59.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:21:59.817+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:21:59.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:21:59.859+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:00.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:00.490+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:00.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:00.513+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:00.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:00.862+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:00.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:00.907+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:01.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:01.498+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:01.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:01.499+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:01.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:01.871+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:01.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:01.935+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:02.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:02.469+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:02.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:02.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:02.649 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:22:02.646+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:22:02.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:02.910+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:02.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:02.964+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:03.418 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:22:03.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:22:03.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:03.489+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:03.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:03.489+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:03.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:03.887+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:03.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:03.915+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:04.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:04.461+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:04.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:04.482+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:04.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:04.870+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:04.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:04.907+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:05.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:05.443+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:05.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:05.482+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:05.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:05.881+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:05.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:05.908+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:06.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:06.417+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:06.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:06.460+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:06.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:06.889+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:06.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:06.955+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:07.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:07.422+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:07.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:07.475+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:07.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:07.874+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:07.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:07.929+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:08.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:08.452+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:08.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:08.460+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:08.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:08.905+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:08.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:08.972+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:09.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:09.483+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:09.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:09.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:09.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:09.946+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:10.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:10.010+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:10.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:10.466+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:10.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:10.510+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:10.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:10.934+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:10.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:10.979+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:11.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:11.507+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:11.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:11.516+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:11.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:11.885+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:12.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:12.019+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:12.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:12.493+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:12.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:12.516+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:12.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:12.901+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:12.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:12.975+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:13.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:13.460+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:13.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:13.500+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:13.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:13.877+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:13.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:13.985+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:14.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:14.502+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:14.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:14.531+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:14.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:14.827+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:14.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:14.985+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:15.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:15.533+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:15.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:15.562+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:15.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:15.812+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:15.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:15.946+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:16.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:16.498+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:16.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:16.560+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:16.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:16.845+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:16.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:16.950+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:17.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:17.523+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:17.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:17.564+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:17.664 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:22:17.662+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:22:17.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:17.886+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:17.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:17.988+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:18.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:18.516+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:18.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:18.564+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:18.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:18.838+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:18.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:18.964+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:19.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:19.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:19.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:19.588+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:19.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:19.830+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:19.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:19.990+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:20.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:20.498+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:20.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:20.577+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:20.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:20.804+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:21.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:21.005+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:21.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:21.483+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:21.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:21.551+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:21.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:21.781+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:21.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:21.984+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:22.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:22.513+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:22.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:22.514+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:22.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:22.786+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:22.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:22.972+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:23.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:23.485+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:23.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:23.521+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:23.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:23.764+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:23.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:23.989+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:24.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:24.477+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:24.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:24.534+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:24.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:24.793+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:24.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:24.948+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:25.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:25.473+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:25.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:25.584+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:25.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:25.766+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:25.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:25.923+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:26.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:26.513+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:26.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:26.587+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:26.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:26.780+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:26.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:26.948+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:27.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:27.530+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:27.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:27.579+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:27.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:27.827+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:27.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:27.910+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:28.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:28.501+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:28.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:28.607+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:28.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:28.823+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:28.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:28.887+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:29.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:29.541+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:29.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:29.605+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:29.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:29.786+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:29.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:29.892+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:30.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:30.571+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:30.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:30.586+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:30.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:30.796+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:30.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:30.930+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:31.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:31.586+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:31.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:31.611+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:31.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:31.838+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:31.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:31.946+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:32.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:32.590+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:32.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:32.596+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:32.680 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:22:32.679+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:22:32.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:32.833+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:32.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:32.988+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:33.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:22:33.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:22:33.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:33.566+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:33.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:33.589+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:33.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:33.784+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:33.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:33.940+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:34.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:34.613+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:34.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:34.615+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:34.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:34.779+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:34.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:34.920+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:35.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:35.600+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:35.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:35.636+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:35.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:35.783+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:35.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:35.922+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:36.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:36.573+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:36.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:36.675+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:36.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:36.749+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:36.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:36.893+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:37.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:37.617+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:37.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:37.662+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:37.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:37.797+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:37.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:37.893+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:38.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:38.576+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:38.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:38.694+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:38.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:38.836+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:38.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:38.918+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:39.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:39.615+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:39.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:39.734+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:39.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:39.829+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:39.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:39.943+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:40.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:40.645+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:40.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:40.764+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:40.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:40.795+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:40.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:40.922+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:41.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:41.664+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:41.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:41.774+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:41.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:41.787+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:41.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:41.928+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:42.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:42.691+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:42.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:42.763+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:42.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:42.765+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:42.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:42.964+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:43.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:43.670+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:43.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:43.734+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:43.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:43.805+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:43.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:43.988+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:44.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:44.694+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:44.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:44.710+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:44.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:44.824+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:44.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:44.974+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:45.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:45.660+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:45.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:45.748+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:45.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:45.808+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:46.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:46.015+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:46.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:46.706+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:46.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:46.715+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:46.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:46.794+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:47.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:47.063+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:47.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:47.686+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:47.696 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:22:47.694+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:22:47.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:47.703+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:47.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:47.823+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:48.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:48.070+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:48.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:48.660+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:48.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:48.708+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:48.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:48.799+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:49.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:49.083+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:49.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:49.618+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:49.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:49.701+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:49.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:49.848+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:50.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:50.112+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:50.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:50.569+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:50.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:50.675+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:50.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:50.813+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:51.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:51.126+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:51.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:51.526+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:51.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:51.694+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:51.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:51.802+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:52.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:52.153+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:52.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:52.498+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:52.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:52.652+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:52.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:52.822+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:53.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:53.171+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:53.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:53.483+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:53.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:53.661+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:53.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:53.790+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:54.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:54.133+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:54.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:54.497+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:54.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:54.634+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:54.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:54.774+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:55.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:55.171+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:55.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:55.482+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:55.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:55.599+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:55.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:55.761+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:56.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:56.204+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:56.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:56.447+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:56.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:56.575+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:56.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:56.785+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:57.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:57.165+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:57.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:57.478+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:57.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:57.561+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:57.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:57.808+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:58.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:58.133+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:58.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:58.468+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:58.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:58.568+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:58.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:58.806+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:59.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:22:59.182+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:59.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:22:59.480+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:59.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:22:59.560+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:22:59.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:22:59.830+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:00.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:00.206+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:00.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:00.492+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:00.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:00.511+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:00.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:00.821+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:01.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:01.251+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:01.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:01.463+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:01.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:01.479+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:01.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:01.811+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:02.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:02.293+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:02.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:02.425+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:02.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:02.447+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:02.712 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:23:02.710+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:23:02.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:02.838+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:03.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:03.309+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:03.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:03.419+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:03.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:03.467+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:03.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:23:03.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:23:03.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:03.828+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:04.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:04.339+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:04.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:04.424+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:04.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:04.514+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:04.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:04.848+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:05.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:05.337+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:05.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:05.384+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:05.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:05.533+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:05.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:05.879+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:06.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:06.338+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:06.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:06.428+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:06.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:06.576+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:06.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:06.908+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:07.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:07.318+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:07.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:07.400+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:07.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:07.584+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:07.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:07.895+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:08.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:08.318+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:08.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:08.373+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:08.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:08.608+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:08.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:08.856+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:09.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:09.317+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:09.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:09.394+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:09.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:09.640+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:09.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:09.879+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:10.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:10.320+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:10.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:10.443+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:10.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:10.675+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:10.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:10.843+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:11.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:11.363+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:11.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:11.418+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:11.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:11.696+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:11.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:11.796+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:12.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:12.324+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:12.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:12.397+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:12.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:12.718+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:12.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:12.773+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:13.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:13.361+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:13.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:13.414+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:13.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:13.707+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:13.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:13.788+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:14.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:14.345+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:14.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:14.455+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:14.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:14.708+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:14.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:14.815+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:15.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:15.368+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:15.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:15.489+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:15.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:15.721+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:15.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:15.828+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:16.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:16.369+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:16.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:16.506+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:16.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:16.677+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:16.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:16.780+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:17.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:17.372+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:17.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:17.512+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:17.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:17.656+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:17.728 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:23:17.726+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:23:17.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:17.769+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:18.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:18.412+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:18.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:18.559+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:18.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:18.692+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:18.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:18.762+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:19.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:19.454+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:19.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:19.541+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:19.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:19.655+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:19.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:19.782+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:20.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:20.421+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:20.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:20.556+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:20.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:20.686+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:20.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:20.776+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:21.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:21.378+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:21.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:21.568+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:21.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:21.704+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:21.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:21.806+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:22.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:22.406+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:22.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:22.592+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:22.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:22.714+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:22.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:22.787+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:23.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:23.451+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:23.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:23.630+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:23.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:23.729+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:23.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:23.749+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:24.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:24.456+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:24.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:24.606+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:24.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:24.740+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:24.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:24.740+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:25.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:25.452+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:25.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:25.631+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:25.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:25.739+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:25.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:25.775+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:26.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:26.427+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:26.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:26.606+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:26.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:26.752+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:26.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:26.763+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:27.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:27.450+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:27.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:27.584+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:27.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:27.760+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:27.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:27.765+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:28.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:28.495+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:28.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:28.554+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:28.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:28.747+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:28.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:28.788+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:29.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:29.526+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:29.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:29.560+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:29.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:29.725+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:29.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:29.800+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:30.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:30.563+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:30.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:30.568+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:30.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:30.708+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:30.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:30.791+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:31.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:31.553+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:31.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:31.573+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:31.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:31.715+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:31.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:31.824+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:32.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:32.527+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:32.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:32.556+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:32.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:32.709+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:32.744 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:23:32.742+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:23:32.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:32.784+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:33.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:33.565+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:33.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:33.577+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:33.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:23:33.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:23:33.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:33.706+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:33.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:33.759+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:34.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:34.568+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:34.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:34.587+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:34.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:34.746+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:34.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:34.771+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:35.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:35.564+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:35.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:35.608+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:35.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:35.734+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:35.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:35.737+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:36.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:36.603+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:36.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:36.652+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:36.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:36.706+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:36.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:36.749+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:37.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:37.648+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:37.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:37.665+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:37.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:37.668+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:37.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:37.786+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:38.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:38.614+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:38.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:38.669+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:38.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:38.674+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:38.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:38.826+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:39.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:39.645+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:39.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:39.701+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:39.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:39.708+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:39.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:39.815+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:40.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:40.691+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:40.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:40.736+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:40.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:40.740+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:40.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:40.834+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:41.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:41.713+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:41.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:41.715+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:41.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:41.715+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:41.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:41.802+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:42.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:42.675+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:42.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:42.710+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:42.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:42.713+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:42.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:42.816+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:43.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:43.646+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:43.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:43.719+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:43.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:43.742+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:43.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:43.792+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:44.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:44.684+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:44.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:44.713+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:44.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:44.721+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:44.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:44.790+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:45.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:45.673+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:45.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:45.687+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:45.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:45.703+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:45.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:45.839+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:46.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:46.642+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:46.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:46.667+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:46.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:46.737+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:46.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:46.847+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:47.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:47.638+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:47.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:47.650+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:47.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:47.742+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:47.760 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:23:47.758+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:23:47.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:47.852+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:48.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:48.599+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:48.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:48.650+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:48.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:48.753+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:48.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:48.891+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:49.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:49.563+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:49.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:49.695+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:49.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:49.754+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:49.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:49.924+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:50.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:50.566+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:50.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:50.734+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:50.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:50.777+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:50.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:50.928+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:51.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:51.527+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:51.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:51.731+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:51.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:51.767+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:51.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:51.953+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:52.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:52.526+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:52.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:52.739+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:52.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:52.776+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:52.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:52.964+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:53.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:53.495+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:53.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:53.756+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:53.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:53.795+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:54.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:54.002+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:54.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:54.464+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:54.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:54.780+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:54.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:54.843+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:54.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:54.991+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:55.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:55.471+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:55.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:55.794+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:55.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:55.845+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:56.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:56.012+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:56.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:56.474+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:56.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:56.791+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:56.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:56.861+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:57.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:57.021+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:57.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:57.517+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:57.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:57.830+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:57.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:57.858+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:58.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:58.046+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:58.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:58.538+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:58.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:58.815+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:58.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:58.877+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:59.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:23:59.055+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:59.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:23:59.535+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:59.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:23:59.828+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:23:59.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:23:59.858+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:00.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:00.017+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:00.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:00.514+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:00.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:00.817+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:00.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:00.891+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:01.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:01.008+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:01.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:01.478+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:01.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:01.775+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:01.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:01.865+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:01.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:01.958+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:02.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:02.459+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:02.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:02.764+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:02.775 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:24:02.773+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:24:02.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:02.889+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:02.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:02.937+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:03.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:03.479+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:03.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:24:03.723 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:24:03.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:03.768+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:03.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:03.862+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:03.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:03.947+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:04.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:04.460+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:04.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:04.759+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:04.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:04.896+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:04.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:04.928+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:05.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:05.450+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:05.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:05.731+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:05.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:05.892+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:05.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:05.930+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:06.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:06.417+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:06.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:06.710+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:06.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:06.866+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:06.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:06.928+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:07.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:07.397+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:07.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:07.664+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:07.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:07.858+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:07.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:07.939+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:08.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:08.386+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:08.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:08.696+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:08.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:08.872+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:08.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:08.962+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:09.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:09.408+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:09.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:09.661+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:09.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:09.833+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:09.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:09.982+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:10.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:10.428+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:10.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:10.709+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:10.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:10.836+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:10.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:10.974+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:11.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:11.425+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:11.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:11.712+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:11.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:11.809+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:11.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:11.937+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:12.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:12.440+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:12.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:12.701+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:12.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:12.772+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:12.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:12.946+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:13.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:13.486+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:13.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:13.721+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:13.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:13.773+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:13.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:13.951+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:14.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:14.526+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:14.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:14.721+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:14.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:14.763+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:14.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:14.971+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:15.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:15.517+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:15.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:15.689+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:15.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:15.768+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:15.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:15.931+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:16.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:16.498+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:16.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:16.725+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:16.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:16.803+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:16.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:16.971+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:17.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:17.540+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:17.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:17.713+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:17.791 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:24:17.789+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:24:17.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:17.794+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:18.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:18.012+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:18.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:18.501+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:18.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:18.721+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:18.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:18.833+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:19.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:19.051+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:19.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:19.499+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:19.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:19.687+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:19.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:19.799+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:20.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:20.051+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:20.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:20.546+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:20.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:20.709+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:20.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:20.792+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:21.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:21.008+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:21.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:21.546+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:21.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:21.690+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:21.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:21.794+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:21.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:21.966+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:22.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:22.579+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:22.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:22.681+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:22.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:22.781+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:23.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:23.002+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:23.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:23.530+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:23.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:23.672+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:23.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:23.805+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:24.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:24.023+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:24.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:24.534+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:24.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:24.710+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:24.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:24.834+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:25.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:25.059+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:25.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:25.582+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:25.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:25.682+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:25.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:25.869+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:26.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:26.059+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:26.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:26.626+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:26.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:26.666+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:26.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:26.824+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:27.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:27.088+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:27.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:27.666+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:27.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:27.680+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:27.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:27.849+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:28.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:28.110+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:28.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:28.667+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:28.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:28.706+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:28.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:28.815+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:29.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:29.110+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:29.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:29.657+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:29.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:29.673+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:29.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:29.827+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:30.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:30.065+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:30.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:30.629+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:30.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:30.675+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:30.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:30.781+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:31.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:31.113+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:31.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:31.615+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:31.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:31.707+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:31.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:31.774+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:32.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:32.140+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:32.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:32.607+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:32.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:32.707+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:32.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:32.802+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:32.807 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:24:32.805+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:24:33.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:33.105+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:33.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:33.654+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:33.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:33.723+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:33.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:24:33.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:24:33.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:33.821+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:34.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:34.126+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:34.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:34.692+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:34.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:34.695+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:34.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:34.860+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:35.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:35.139+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:35.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:35.669+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:35.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:35.677+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:35.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:35.891+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:36.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:36.157+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:36.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:36.668+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:36.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:36.723+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:36.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:36.929+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:37.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:37.128+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:37.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:37.689+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:37.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:37.758+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:37.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:37.922+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:38.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:38.090+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:38.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:38.652+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:38.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:38.742+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:38.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:38.894+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:39.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:39.056+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:39.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:39.668+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:39.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:39.741+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:39.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:39.933+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:40.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:40.013+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:40.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:40.710+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:40.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:40.733+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:40.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:40.952+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:41.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:41.005+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:41.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:41.674+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:41.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:41.701+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:41.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:41.923+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:42.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:42.009+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:42.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:42.682+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:42.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:42.684+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:42.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:42.946+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:43.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:43.026+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:43.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:43.643+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:43.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:43.649+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:43.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:43.966+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:44.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:44.066+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:44.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:44.623+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:44.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:44.673+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:45.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:45.006+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:45.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:45.040+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:45.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:45.635+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:45.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:45.643+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:46.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:46.003+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:46.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:46.089+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:46.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:46.661+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:46.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:46.676+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:46.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:46.978+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:47.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:47.112+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:47.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:47.653+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:47.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:47.702+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:47.823 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:24:47.821+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:24:47.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:47.952+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:48.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:48.117+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:48.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:48.675+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:48.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:48.743+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:48.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:48.978+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:49.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:49.088+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:49.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:49.634+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:49.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:49.753+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:50.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:50.004+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:50.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:50.057+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:50.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:50.642+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:50.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:50.778+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:51.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:51.021+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:51.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:51.074+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:51.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:51.663+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:51.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:51.788+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:52.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:52.066+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:52.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:52.087+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:52.575 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:24:52.572+0000 7f16dc21f700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:24:52.595 INFO:tasks.ceph.mds.c.smithi049.stderr: -1> 2022-04-03T22:24:52.572+0000 7f16dc21f700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:24:52.596 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:24:52.573+0000 7f16dba1e700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-03T22:24:52.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:52.676+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:52.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:52.795+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:53.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:53.081+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:53.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:53.083+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:53.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:53.654+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:53.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:53.840+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:54.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:54.083+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:54.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:54.095+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:54.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:54.671+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:54.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:54.805+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:55.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:55.113+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:55.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:55.121+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:55.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:55.687+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:55.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:55.816+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:56.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:56.093+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:56.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:56.139+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:56.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:56.659+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:56.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:56.862+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:57.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:57.136+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:57.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:57.145+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:57.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:57.668+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:57.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:57.851+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:58.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:58.132+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:58.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:58.168+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:58.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:58.688+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:58.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:58.804+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:59.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:24:59.090+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:59.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:24:59.185+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:59.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:24:59.657+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:24:59.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:24:59.830+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:00.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:00.072+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:00.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:00.175+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:00.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:00.629+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:00.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:00.805+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:01.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:01.080+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:01.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:01.211+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:01.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:01.656+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:01.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:01.822+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:02.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:02.114+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:02.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:02.168+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:02.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:02.624+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:02.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:02.776+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:02.827 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:25:02.826+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:25:03.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:03.116+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:03.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:03.146+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:03.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:03.633+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:03.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:03.793+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:03.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:25:03.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:25:04.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:04.072+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:04.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:04.124+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:04.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:04.602+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:04.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:04.753+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:05.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:05.082+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:05.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:05.157+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:05.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:05.630+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:05.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:05.718+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:06.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:06.067+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:06.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:06.182+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:06.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:06.619+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:06.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:06.767+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:07.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:07.041+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:07.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:07.228+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:07.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:07.608+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:07.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:07.719+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:08.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:08.058+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:08.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:08.227+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:08.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:08.592+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:08.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:08.722+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:09.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:09.023+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:09.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:09.271+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:09.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:09.630+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:09.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:09.712+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:10.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:10.027+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:10.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:10.286+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:10.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:10.642+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:10.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:10.700+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:11.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:11.066+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:11.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:11.292+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:11.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:11.616+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:11.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:11.715+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:12.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:12.042+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:12.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:12.286+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:12.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:12.582+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:12.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:12.699+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:13.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:13.025+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:13.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:13.330+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:13.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:13.598+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:13.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:13.717+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:14.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:14.002+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:14.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:14.360+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:14.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:14.616+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:14.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:14.732+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:14.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:14.995+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:15.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:15.348+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:15.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:15.573+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:15.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:15.761+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:16.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:16.035+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:16.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:16.363+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:16.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:16.587+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:16.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:16.790+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:17.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:17.059+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:17.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:17.402+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:17.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:17.567+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:17.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:17.798+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:17.836 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:25:17.833+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:25:18.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:18.075+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:18.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:18.381+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:18.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:18.585+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:18.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:18.830+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:19.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:19.070+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:19.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:19.388+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:19.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:19.625+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:19.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:19.857+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:20.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:20.098+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:20.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:20.383+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:20.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:20.630+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:20.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:20.859+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:21.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:21.107+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:21.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:21.396+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:21.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:21.674+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:21.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:21.907+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:22.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:22.097+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:22.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:22.382+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:22.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:22.714+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:22.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:22.895+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:23.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:23.058+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:23.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:23.373+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:23.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:23.673+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:23.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:23.874+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:24.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:24.055+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:24.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:24.412+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:24.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:24.715+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:24.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:24.841+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:25.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:25.050+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:25.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:25.388+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:25.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:25.674+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:25.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:25.842+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:26.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:26.069+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:26.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:26.411+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:26.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:26.700+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:26.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:26.803+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:27.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:27.110+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:27.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:27.432+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:27.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:27.704+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:27.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:27.850+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:28.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:28.146+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:28.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:28.404+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:28.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:28.717+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:28.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:28.895+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:29.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:29.143+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:29.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:29.435+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:29.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:29.723+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:29.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:29.943+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:30.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:30.191+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:30.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:30.419+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:30.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:30.756+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:30.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:30.993+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:31.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:31.190+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:31.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:31.429+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:31.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:31.796+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:31.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:31.987+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:32.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:32.180+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:32.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:32.455+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:32.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:32.809+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:32.850 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:25:32.848+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:25:32.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:32.971+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:33.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:33.227+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:33.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:33.430+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:33.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:33.852+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:33.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:33.988+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:34.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:25:34.040 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:25:34.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:34.197+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:34.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:34.479+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:34.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:34.823+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:34.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:34.951+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:35.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:35.242+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:35.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:35.495+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:35.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:35.787+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:36.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:35.999+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:36.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:36.195+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:36.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:36.518+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:36.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:36.779+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:37.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:37.025+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:37.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:37.226+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:37.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:37.496+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:37.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:37.785+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:38.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:38.051+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:38.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:38.223+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:38.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:38.543+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:38.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:38.757+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:39.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:39.044+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:39.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:39.176+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:39.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:39.523+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:39.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:39.762+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:40.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:40.025+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:40.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:40.208+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:40.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:40.570+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:40.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:40.800+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:41.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:41.042+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:41.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:41.194+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:41.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:41.528+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:41.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:41.758+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:42.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:42.048+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:42.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:42.187+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:42.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:42.487+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:42.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:42.785+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:43.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:43.078+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:43.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:43.226+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:43.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:43.515+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:43.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:43.753+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:44.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:44.044+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:44.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:44.195+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:44.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:44.494+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:44.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:44.754+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:45.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:45.056+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:45.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:45.203+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:45.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:45.510+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:45.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:45.744+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:46.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:46.024+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:46.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:46.187+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:46.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:46.548+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:46.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:46.727+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:47.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:47.023+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:47.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:47.199+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:47.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:47.590+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:47.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:47.772+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:47.865 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:25:47.863+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:25:48.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:48.011+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:48.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:48.174+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:48.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:48.603+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:48.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:48.787+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:48.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:48.976+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:49.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:49.151+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:49.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:49.596+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:49.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:49.784+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:49.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:49.984+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:50.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:50.108+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:50.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:50.582+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:50.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:50.828+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:50.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:50.992+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:51.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:51.122+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:51.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:51.627+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:51.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:51.871+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:52.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:52.028+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:52.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:52.104+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:52.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:52.655+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:52.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:52.862+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:53.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:53.008+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:53.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:53.114+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:53.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:53.695+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:53.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:53.877+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:54.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:54.026+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:54.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:54.133+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:54.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:54.675+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:54.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:54.903+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:55.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:55.050+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:55.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:55.127+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:55.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:55.668+0000 7f389e18e700 -1 osd.4 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:55.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:55.888+0000 7f596d92c700 -1 osd.6 97 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:56.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:56.060+0000 7f72c425d700 -1 osd.5 97 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:56.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:56.086+0000 7f6e44c9f700 -1 osd.7 97 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:56.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:56.662+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:56.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:56.926+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:57.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:57.018+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:57.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:57.136+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:57.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:57.652+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:57.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:57.883+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:58.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:58.008+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:58.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:58.164+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:58.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:58.688+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:58.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:58.907+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:58.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:58.961+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:59.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:25:59.122+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:59.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:25:59.731+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:59.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:25:59.869+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:25:59.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:25:59.972+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:00.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:00.115+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:00.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:00.776+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:00.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:00.916+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:00.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:00.940+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:01.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:01.110+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:01.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:01.763+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:01.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:01.876+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:01.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:01.955+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:02.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:02.084+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:02.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:02.748+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:02.870 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:26:02.868+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:26:02.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:02.897+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:02.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:02.919+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:03.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:03.047+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:03.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:03.732+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:03.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:03.883+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:03.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:03.894+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:04.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:04.020+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:04.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:26:04.115 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:26:04.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:04.759+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:04.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:04.863+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:04.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:04.880+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:05.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:05.031+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:05.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:05.760+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:05.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:05.843+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:05.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:05.908+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:05.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:05.982+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:06.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:06.713+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:06.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:06.872+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:06.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:06.943+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:06.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:06.977+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:07.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:07.696+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:07.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:07.835+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:07.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:07.924+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:07.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:07.949+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:08.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:08.704+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:08.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:08.866+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:08.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:08.932+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:08.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:08.963+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:09.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:09.725+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:09.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:09.853+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:09.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:09.893+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:09.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:09.984+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:10.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:10.734+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:10.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:10.870+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:10.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:10.898+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:11.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:11.004+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:11.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:11.701+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:11.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:11.853+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:11.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:11.895+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:12.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:12.028+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:12.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:12.735+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:12.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:12.806+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:12.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:12.867+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:13.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:13.011+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:13.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:13.745+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:13.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:13.783+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:13.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:13.852+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:13.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:13.962+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:14.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:14.743+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:14.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:14.792+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:14.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:14.902+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:14.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:14.918+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:15.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:15.702+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:15.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:15.841+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:15.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:15.891+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:15.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:15.922+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:16.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:16.723+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:16.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:16.807+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:16.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:16.861+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:16.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:16.955+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:17.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:17.754+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:17.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:17.765+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:17.884 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:26:17.881+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:26:17.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:17.908+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:17.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:17.977+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:18.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:18.740+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:18.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:18.741+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:18.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:18.945+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:18.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:18.967+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:19.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:19.736+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:19.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:19.772+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:19.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:19.958+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:19.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:19.976+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:20.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:20.767+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:20.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:20.779+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:20.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:20.996+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:20.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:20.996+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:21.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:21.733+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:21.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:21.786+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:21.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:21.978+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:22.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:22.028+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:22.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:22.781+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:22.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:22.782+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:22.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:22.991+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:23.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:23.013+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:23.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:23.749+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:23.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:23.788+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:23.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:23.969+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:24.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:24.007+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:24.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:24.701+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:24.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:24.767+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:24.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:24.966+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:24.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:24.983+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:25.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:25.743+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:25.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:25.756+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:25.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:25.925+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:26.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:26.015+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:26.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:26.711+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:26.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:26.793+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:26.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:26.928+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:26.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:26.972+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:27.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:27.701+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:27.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:27.803+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:27.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:27.904+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:27.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:27.970+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:28.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:28.718+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:28.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:28.826+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:28.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:28.904+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:28.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:28.992+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:29.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:29.697+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:29.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:29.863+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:29.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:29.874+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:29.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:29.959+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:30.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:30.741+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:30.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:30.858+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:30.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:30.864+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:30.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:30.973+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:31.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:31.765+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:31.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:31.830+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:31.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:31.884+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:32.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:32.005+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:32.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:32.800+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:32.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:32.819+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:32.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:32.843+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:32.900 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:26:32.897+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:26:32.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:32.988+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:33.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:33.756+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:33.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:33.779+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:33.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:33.890+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:34.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:33.998+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:34.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:26:34.188 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:26:34.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:34.771+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:34.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:34.819+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:34.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:34.853+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:35.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:35.039+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:35.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:35.735+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:35.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:35.805+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:35.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:35.819+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:35.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:35.992+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:36.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:36.734+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:36.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:36.819+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:36.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:36.821+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:37.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:37.010+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:37.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:37.745+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:37.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:37.772+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:37.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:37.796+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:38.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:38.054+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:38.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:38.743+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:38.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:38.776+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:38.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:38.793+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:39.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:39.076+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:39.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:39.773+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:39.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:39.793+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:39.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:39.814+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:40.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:40.087+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:40.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:40.733+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:40.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:40.792+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:40.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:40.854+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:41.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:41.043+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:41.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:41.690+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:41.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:41.808+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:41.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:41.841+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:42.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:42.020+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:42.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:42.738+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:42.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:42.808+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:42.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:42.867+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:43.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:43.058+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:43.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:43.764+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:43.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:43.844+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:43.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:43.857+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:44.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:44.104+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:44.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:44.753+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:44.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:44.822+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:44.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:44.884+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:45.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:45.099+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:45.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:45.787+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:45.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:45.806+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:45.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:45.842+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:46.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:46.079+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:46.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:46.770+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:46.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:46.822+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:46.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:46.827+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:47.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:47.120+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:47.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:47.782+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:47.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:47.799+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:47.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:47.819+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:47.905 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:26:47.903+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:26:48.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:48.087+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:48.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:48.814+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:48.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:48.816+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:48.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:48.834+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:49.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:49.120+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:49.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:49.785+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:49.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:49.802+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:49.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:49.848+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:50.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:50.095+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:50.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:50.798+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:50.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:50.831+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:50.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:50.882+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:51.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:51.123+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:51.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:51.766+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:51.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:51.787+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:51.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:51.852+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:52.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:52.079+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:52.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:52.749+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:52.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:52.775+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:52.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:52.861+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:53.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:53.080+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:53.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:53.742+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:53.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:53.802+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:53.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:53.820+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:54.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:54.061+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:54.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:54.696+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:54.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:54.784+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:54.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:54.825+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:55.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:55.064+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:55.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:55.662+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:55.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:55.788+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:55.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:55.834+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:56.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:56.038+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:56.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:56.706+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:56.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:56.778+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:56.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:56.811+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:57.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:57.035+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:57.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:57.707+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:57.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:57.741+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:57.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:57.850+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:58.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:58.067+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:58.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:58.698+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:58.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:58.781+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:58.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:58.860+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:59.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:26:59.029+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:59.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:26:59.746+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:59.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:26:59.800+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:26:59.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:26:59.818+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:00.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:00.004+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:00.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:00.772+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:00.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:00.788+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:00.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:00.792+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:00.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:00.994+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:01.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:01.763+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:01.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:01.796+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:01.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:01.814+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:01.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:01.964+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:02.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:02.794+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:02.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:02.800+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:02.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:02.809+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:02.916 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:27:02.914+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:27:02.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:02.950+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:03.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:03.774+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:03.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:03.790+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:03.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:03.847+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:03.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:03.928+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:04.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:27:04.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:27:04.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:04.762+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:04.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:04.763+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:04.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:04.885+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:04.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:04.896+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:05.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:05.742+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:05.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:05.782+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:05.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:05.883+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:05.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:05.940+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:06.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:06.785+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:06.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:06.790+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:06.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:06.853+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:06.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:06.937+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:07.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:07.781+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:07.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:07.833+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:07.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:07.894+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:07.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:07.903+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:08.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:08.814+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:08.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:08.829+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:08.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:08.877+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:08.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:08.886+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:09.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:09.782+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:09.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:09.796+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:09.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:09.848+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:09.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:09.866+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:10.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:10.779+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:10.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:10.811+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:10.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:10.878+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:10.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:10.898+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:11.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:11.768+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:11.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:11.853+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:11.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:11.856+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:11.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:11.884+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:12.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:12.732+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:12.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:12.807+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:12.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:12.817+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:12.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:12.919+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:13.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:13.704+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:13.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:13.838+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:13.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:13.850+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:13.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:13.877+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:14.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:14.689+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:14.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:14.811+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:14.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:14.842+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:14.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:14.871+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:15.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:15.711+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:15.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:15.808+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:15.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:15.827+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:15.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:15.853+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:16.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:16.693+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:16.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:16.766+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:16.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:16.808+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:16.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:16.821+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:17.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:17.738+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:17.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:17.743+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:17.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:17.810+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:17.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:17.828+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:17.932 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:27:17.930+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:27:18.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:18.711+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:18.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:18.768+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:18.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:18.809+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:18.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:18.819+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:19.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:19.700+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:19.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:19.757+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:19.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:19.809+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:19.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:19.837+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:20.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:20.663+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:20.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:20.783+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:20.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:20.798+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:20.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:20.853+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:21.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:21.637+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:21.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:21.780+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:21.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:21.818+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:21.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:21.834+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:22.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:22.644+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:22.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:22.782+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:22.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:22.799+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:22.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:22.846+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:23.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:23.595+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:23.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:23.732+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:23.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:23.768+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:23.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:23.857+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:24.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:24.592+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:24.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:24.696+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:24.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:24.753+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:24.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:24.845+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:25.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:25.584+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:25.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:25.713+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:25.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:25.786+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:25.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:25.796+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:26.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:26.576+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:26.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:26.729+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:26.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:26.768+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:26.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:26.784+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:27.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:27.579+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:27.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:27.705+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:27.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:27.720+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:27.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:27.777+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:28.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:28.620+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:28.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:28.684+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:28.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:28.715+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:28.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:28.789+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:29.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:29.635+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:29.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:29.687+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:29.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:29.717+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:29.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:29.752+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:30.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:30.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:30.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:30.684+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:30.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:30.710+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:30.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:30.742+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:31.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:31.621+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:31.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:31.716+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:31.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:31.733+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:31.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:31.744+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:32.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:32.644+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:32.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:32.703+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:32.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:32.745+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:32.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:32.758+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:32.937 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:27:32.935+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:27:33.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:33.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:33.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:33.701+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:33.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:33.736+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:33.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:33.779+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:34.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:27:34.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:27:34.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:34.673+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:34.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:34.686+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:34.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:34.689+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:34.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:34.793+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:35.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:35.639+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:35.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:35.674+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:35.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:35.702+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:35.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:35.815+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:36.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:36.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:36.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:36.668+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:36.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:36.722+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:36.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:36.856+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:37.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:37.648+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:37.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:37.696+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:37.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:37.706+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:37.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:37.848+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:38.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:38.698+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:38.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:38.699+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:38.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:38.743+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:38.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:38.865+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:39.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:39.652+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:39.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:39.715+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:39.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:39.746+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:39.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:39.866+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:40.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:40.618+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:40.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:40.751+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:40.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:40.770+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:40.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:40.907+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:41.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:41.595+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:41.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:41.721+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:41.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:41.725+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:41.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:41.921+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:42.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:42.588+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:42.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:42.693+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:42.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:42.709+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:42.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:42.879+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:43.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:43.539+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:43.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:43.684+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:43.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:43.752+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:43.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:43.894+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:44.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:44.527+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:44.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:44.679+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:44.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:44.798+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:44.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:44.926+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:45.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:45.567+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:45.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:45.659+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:45.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:45.818+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:45.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:45.939+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:46.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:46.582+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:46.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:46.707+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:46.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:46.784+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:46.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:46.975+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:47.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:47.610+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:47.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:47.720+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:47.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:47.750+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:47.953 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:27:47.951+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:27:48.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:48.024+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:48.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:48.627+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:48.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:48.705+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:48.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:48.733+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:49.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:49.016+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:49.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:49.654+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:49.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:49.727+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:49.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:49.770+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:50.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:50.045+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:50.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:50.613+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:50.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:50.708+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:50.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:50.740+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:51.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:51.036+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:51.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:51.642+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:51.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:51.716+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:51.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:51.716+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:51.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:51.997+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:52.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:52.661+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:52.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:52.684+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:52.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:52.699+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:53.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:53.029+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:53.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:53.627+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:53.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:53.708+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:53.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:53.732+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:54.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:54.051+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:54.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:54.665+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:54.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:54.714+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:54.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:54.779+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:55.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:55.050+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:55.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:55.644+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:55.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:55.720+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:55.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:55.750+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:56.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:56.025+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:56.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:56.603+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:56.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:56.685+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:56.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:56.703+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:57.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:57.029+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:57.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:57.605+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:57.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:57.685+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:57.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:57.746+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:57.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:57.989+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:58.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:58.638+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:58.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:58.686+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:58.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:58.757+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:59.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:27:59.033+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:59.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:27:59.617+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:59.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:27:59.685+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:27:59.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:27:59.759+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:00.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:00.031+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:00.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:00.617+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:00.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:00.693+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:00.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:00.790+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:00.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:00.990+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:01.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:01.625+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:01.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:01.659+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:01.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:01.808+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:01.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:01.950+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:02.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:02.666+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:02.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:02.667+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:02.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:02.816+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:02.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:02.916+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:02.969 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:28:02.968+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:28:03.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:03.687+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:03.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:03.703+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:03.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:03.815+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:03.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:03.950+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:04.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:28:04.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:28:04.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:04.649+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:04.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:04.686+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:04.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:04.767+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:04.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:04.982+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:05.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:05.665+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:05.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:05.699+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:05.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:05.770+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:05.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:05.996+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:06.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:06.653+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:06.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:06.727+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:06.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:06.765+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:06.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:06.964+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:07.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:07.665+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:07.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:07.740+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:07.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:07.808+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:07.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:07.931+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:08.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:08.667+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:08.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:08.700+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:08.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:08.848+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:08.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:08.928+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:09.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:09.647+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:09.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:09.676+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:09.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:09.848+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:09.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:09.879+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:10.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:10.636+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:10.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:10.639+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:10.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:10.814+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:10.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:10.883+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:11.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:11.679+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:11.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:11.679+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:11.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:11.818+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:11.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:11.852+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:12.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:12.633+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:12.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:12.681+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:12.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:12.832+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:12.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:12.894+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:13.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:13.590+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:13.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:13.633+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:13.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:13.850+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:13.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:13.939+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:14.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:14.567+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:14.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:14.605+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:14.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:14.805+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:14.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:14.924+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:15.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:15.588+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:15.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:15.641+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:15.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:15.826+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:15.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:15.952+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:16.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:16.560+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:16.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:16.620+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:16.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:16.858+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:16.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:16.959+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:17.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:17.565+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:17.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:17.618+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:17.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:17.857+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:17.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:17.944+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:17.972 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:28:17.969+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:28:18.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:18.536+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:18.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:18.578+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:18.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:18.809+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:18.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:18.933+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:19.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:19.549+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:19.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:19.552+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:19.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:19.760+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:19.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:19.933+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:20.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:20.504+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:20.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:20.509+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:20.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:20.746+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:20.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:20.930+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:21.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:21.466+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:21.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:21.508+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:21.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:21.778+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:21.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:21.979+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:22.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:22.449+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:22.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:22.557+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:22.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:22.795+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:22.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:22.995+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:23.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:23.495+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:23.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:23.522+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:23.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:23.802+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:24.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:24.031+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:24.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:24.492+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:24.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:24.499+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:24.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:24.808+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:25.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:25.041+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:25.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:25.476+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:25.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:25.484+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:25.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:25.856+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:26.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:26.035+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:26.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:26.494+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:26.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:26.527+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:26.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:26.832+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:27.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:27.026+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:27.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:27.514+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:27.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:27.537+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:27.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:27.820+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:28.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:28.022+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:28.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:28.495+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:28.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:28.514+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:28.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:28.791+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:29.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:29.050+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:29.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:29.495+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:29.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:29.517+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:29.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:29.758+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:30.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:30.091+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:30.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:30.493+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:30.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:30.530+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:30.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:30.764+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:31.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:31.084+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:31.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:31.509+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:31.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:31.541+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:31.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:31.809+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:32.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:32.064+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:32.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:32.504+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:32.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:32.557+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:32.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:32.858+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:32.984 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:28:32.981+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:28:33.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:33.085+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:33.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:33.487+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:33.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:33.534+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:33.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:33.816+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:34.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:34.110+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:34.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:28:34.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:28:34.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:34.507+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:34.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:34.578+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:34.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:34.838+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:35.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:35.133+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:35.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:35.543+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:35.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:35.551+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:35.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:35.881+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:36.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:36.087+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:36.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:36.511+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:36.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:36.551+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:36.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:36.930+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:37.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:37.044+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:37.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:37.528+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:37.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:37.539+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:37.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:37.921+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:38.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:38.046+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:38.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:38.535+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:38.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:38.573+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:38.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:38.894+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:39.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:39.086+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:39.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:39.494+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:39.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:39.559+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:39.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:39.907+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:40.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:40.085+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:40.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:40.457+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:40.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:40.518+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:40.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:40.898+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:41.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:41.103+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:41.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:41.412+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:41.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:41.518+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:41.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:41.892+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:42.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:42.122+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:42.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:42.364+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:42.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:42.562+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:42.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:42.907+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:43.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:43.109+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:43.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:43.363+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:43.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:43.535+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:43.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:43.892+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:44.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:44.131+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:44.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:44.318+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:44.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:44.529+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:44.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:44.914+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:45.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:45.164+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:45.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:45.276+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:45.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:45.570+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:45.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:45.898+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:46.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:46.149+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:46.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:46.273+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:46.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:46.534+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:46.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:46.936+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:47.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:47.193+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:47.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:47.256+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:47.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:47.518+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:47.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:47.960+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:47.999 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:28:47.997+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:28:48.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:48.227+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:48.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:48.237+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:48.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:48.478+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:48.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:48.990+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:49.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:49.200+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:49.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:49.205+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:49.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:49.484+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:49.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:49.965+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:50.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:50.188+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:50.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:50.209+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:50.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:50.451+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:50.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:50.933+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:51.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:51.161+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:51.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:51.180+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:51.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:51.427+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:51.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:51.938+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:52.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:52.144+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:52.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:52.148+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:52.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:52.443+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:52.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:52.894+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:53.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:53.112+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:53.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:53.195+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:53.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:53.422+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:53.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:53.937+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:54.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:54.073+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:54.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:54.148+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:54.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:54.379+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:54.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:54.929+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:55.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:55.107+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:55.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:55.174+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:55.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:55.380+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:55.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:55.969+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:56.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:56.123+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 32 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:56.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:56.184+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 7 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:56.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:56.340+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:56.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:56.975+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:57.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:57.135+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:57.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:57.211+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:57.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:57.314+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:58.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:58.005+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:58.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:58.110+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:58.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:58.169+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:58.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:58.299+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:59.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:28:59.047+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:59.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:28:59.135+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:59.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:28:59.138+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:28:59.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:28:59.273+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:00.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:00.033+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:00.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:00.136+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:00.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:00.166+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:00.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:00.293+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:01.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:01.018+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:01.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:01.127+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:01.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:01.180+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:01.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:01.281+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:01.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:01.978+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:02.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:02.081+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:02.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:02.158+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:02.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:02.307+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:02.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:02.984+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:03.004 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:29:03.002+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:29:03.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:03.074+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:03.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:03.152+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:03.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:03.302+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:04.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:04.010+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:04.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:04.102+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:04.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:04.191+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:04.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:04.278+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:04.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:29:04.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:29:04.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:04.992+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:05.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:05.101+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:05.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:05.175+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:05.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:05.257+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:05.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:05.981+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:06.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:06.110+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:06.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:06.163+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:06.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:06.233+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:06.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:06.974+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:07.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:07.110+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:07.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:07.192+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:07.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:07.269+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:07.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:07.948+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:08.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:08.132+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:08.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:08.191+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:08.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:08.287+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:08.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:08.991+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:09.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:09.169+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:09.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:09.241+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:09.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:09.263+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:09.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:09.960+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:10.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:10.207+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:10.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:10.221+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:10.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:10.251+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:11.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:11.007+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:11.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:11.191+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:11.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:11.191+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:11.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:11.221+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:11.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:11.962+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:12.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:12.188+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:12.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:12.200+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:12.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:12.200+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:13.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:13.008+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:13.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:13.166+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:13.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:13.200+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:13.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:13.208+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:13.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:13.965+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:14.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:14.157+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:14.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:14.189+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:14.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:14.217+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:14.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:14.943+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:15.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:15.160+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:15.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:15.188+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:15.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:15.241+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:15.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:15.923+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:16.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:16.128+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:16.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:16.199+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:16.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:16.206+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:16.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:16.927+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:17.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:17.095+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:17.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:17.159+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:17.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:17.204+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:17.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:17.902+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:18.017 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:29:18.015+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:29:18.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:18.061+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:18.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:18.183+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:18.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:18.202+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:18.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:18.899+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:19.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:19.045+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:19.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:19.213+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:19.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:19.248+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:19.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:19.926+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:20.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:20.001+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:20.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:20.186+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:20.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:20.216+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:20.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:20.888+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:20.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:20.965+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:21.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:21.140+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:21.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:21.180+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:21.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:21.841+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:21.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:21.974+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:22.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:22.163+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:22.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:22.189+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:22.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:22.821+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:22.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:22.979+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:23.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:23.116+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:23.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:23.229+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:23.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:23.826+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:23.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:23.955+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:24.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:24.097+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:24.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:24.268+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:24.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:24.815+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:24.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:24.946+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:25.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:25.132+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:25.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:25.268+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:25.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:25.799+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:25.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:25.982+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:26.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:26.100+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:26.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:26.225+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:26.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:26.842+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:27.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:27.011+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:27.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:27.056+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:27.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:27.224+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:27.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:27.835+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:28.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:28.059+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:28.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:28.076+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:28.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:28.244+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:28.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:28.848+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:29.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:29.070+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:29.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:29.094+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:29.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:29.210+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:29.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:29.807+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:30.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:30.038+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:30.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:30.067+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:30.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:30.194+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:30.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:30.770+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:31.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:31.017+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:31.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:31.051+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:31.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:31.205+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:31.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:31.764+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:31.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:31.988+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:32.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:32.101+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:32.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:32.172+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:32.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:32.784+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:33.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:33.012+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:33.021 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:29:33.019+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:29:33.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:33.086+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:33.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:33.193+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:33.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:33.818+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:33.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:33.989+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:34.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:34.130+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:34.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:34.226+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:34.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:29:34.664 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:29:34.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:34.769+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:35.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:35.002+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:35.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:35.101+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:35.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:35.224+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:35.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:35.739+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:36.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:36.037+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:36.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:36.109+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:36.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:36.215+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:36.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:36.700+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:37.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:37.085+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:37.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:37.130+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:37.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:37.260+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:37.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:37.689+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:38.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:38.039+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:38.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:38.166+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:38.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:38.282+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:38.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:38.711+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:39.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:39.089+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:39.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:39.184+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:39.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:39.256+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:39.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:39.665+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:40.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:40.112+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:40.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:40.201+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:40.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:40.255+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:40.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:40.701+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:41.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:41.105+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:41.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:41.188+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:41.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:41.288+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:41.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:41.687+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:42.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:42.113+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:42.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:42.215+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:42.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:42.255+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:42.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:42.670+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:43.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:43.151+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:43.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:43.244+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:43.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:43.273+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:43.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:43.711+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:44.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:44.130+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:44.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:44.262+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:44.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:44.269+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:44.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:44.754+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:45.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:45.128+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:45.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:45.281+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:45.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:45.312+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:45.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:45.764+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:46.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:46.141+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:46.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:46.238+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:46.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:46.336+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:46.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:46.731+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:47.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:47.150+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:47.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:47.224+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:47.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:47.373+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:47.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:47.756+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:48.023 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:29:48.021+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:29:48.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:48.164+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:48.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:48.193+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:48.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:48.412+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:48.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:48.709+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:49.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:49.203+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:49.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:49.226+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:49.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:49.443+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:49.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:49.678+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:50.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:50.187+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:50.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:50.240+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:50.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:50.444+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:50.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:50.670+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:51.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:51.173+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:51.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:51.223+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:51.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:51.485+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:51.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:51.647+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:52.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:52.137+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:52.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:52.199+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:52.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:52.453+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:52.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:52.599+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:52.621 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:29:52.620+0000 7f404c624900 -1 monclient: get_monmap_and_config failed to get config 2022-04-03T22:29:52.624 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2022-04-03T22:29:53.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:53.094+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:53.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:53.175+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:53.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:53.498+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:53.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:53.643+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:54.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:54.073+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:54.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:54.163+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:54.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:54.484+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:54.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:54.679+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:55.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:55.029+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:55.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:55.166+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:55.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:55.459+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:55.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:55.713+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:56.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:56.009+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:56.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:56.211+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:56.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:56.486+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:56.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:56.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:57.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:57.056+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:57.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:57.208+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:57.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:57.498+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:57.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:57.673+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:58.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:58.082+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:58.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:58.189+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:58.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:58.485+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:58.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:58.693+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:59.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:29:59.043+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:59.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:29:59.182+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:59.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:29:59.478+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:29:59.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:29:59.680+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:00.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:00.044+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:00.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:00.201+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:00.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:00.465+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:00.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:00.712+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:01.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:01.042+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:01.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:01.249+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:01.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:01.430+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:01.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:01.694+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:02.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:02.047+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:02.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:02.292+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:02.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:02.414+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:02.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:02.695+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:03.024 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:30:03.022+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:30:03.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:03.057+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:03.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:03.331+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:03.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:03.372+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:03.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:03.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:04.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:04.047+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:04.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:04.300+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:04.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:04.343+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:04.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:04.634+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:04.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:30:04.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:30:05.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:05.091+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:05.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:05.296+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:05.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:05.334+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:05.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:05.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:06.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:06.123+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:06.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:06.278+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:06.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:06.322+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:06.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:06.661+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:07.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:07.122+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:07.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:07.273+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:07.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:07.323+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:07.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:07.689+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:08.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:08.110+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:08.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:08.294+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:08.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:08.336+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:08.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:08.650+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:09.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:09.137+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:09.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:09.289+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:09.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:09.329+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:09.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:09.643+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:10.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:10.125+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:10.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:10.319+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:10.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:10.379+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:10.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:10.604+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:11.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:11.096+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:11.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:11.307+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:11.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:11.340+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:11.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:11.620+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:12.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:12.112+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:12.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:12.259+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:12.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:12.383+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:12.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:12.659+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:13.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:13.105+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:13.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:13.303+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:13.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:13.394+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:13.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:13.626+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:14.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:14.093+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:14.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:14.299+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:14.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:14.365+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:14.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:14.593+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:15.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:15.141+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:15.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:15.328+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:15.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:15.340+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:15.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:15.643+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:16.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:16.127+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:16.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:16.299+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:16.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:16.319+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:16.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:16.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:17.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:17.094+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:17.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:17.325+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:17.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:17.367+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:17.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:17.617+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:18.040 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:30:18.038+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:30:18.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:18.128+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:18.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:18.354+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:18.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:18.397+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:18.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:18.610+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:19.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:19.164+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:19.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:19.393+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:19.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:19.423+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:19.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:19.652+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:20.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:20.148+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:20.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:20.384+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:20.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:20.415+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:20.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:20.614+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:21.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:21.112+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:21.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:21.377+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:21.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:21.414+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:21.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:21.602+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:22.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:22.094+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:22.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:22.416+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:22.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:22.458+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:22.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:22.641+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:23.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:23.123+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:23.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:23.420+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:23.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:23.449+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:23.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:23.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:24.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:24.149+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:24.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:24.413+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:24.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:24.436+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:24.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:24.633+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:25.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:25.121+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:25.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:25.374+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:25.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:25.404+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:25.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:25.681+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:26.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:26.144+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:26.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:26.412+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:26.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:26.419+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:26.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:26.690+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:27.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:27.121+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:27.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:27.374+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:27.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:27.393+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:27.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:27.680+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:28.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:28.141+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:28.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:28.339+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:28.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:28.391+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:28.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:28.651+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:29.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:29.166+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:29.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:29.311+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:29.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:29.402+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:29.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:29.621+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:30.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:30.161+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:30.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:30.305+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:30.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:30.415+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:30.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:30.618+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:31.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:31.158+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:31.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:31.347+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:31.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:31.391+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:31.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:31.590+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:32.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:32.138+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:32.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:32.379+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:32.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:32.389+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:32.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:32.557+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:33.056 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:30:33.053+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:30:33.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:33.133+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:33.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:33.349+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:33.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:33.394+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:33.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:33.584+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:34.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:34.119+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:34.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:34.396+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:34.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:34.420+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:34.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:34.546+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:34.828 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:30:34.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:30:35.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:35.157+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:35.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:35.384+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:35.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:35.426+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:35.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:35.552+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:36.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:36.166+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:36.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:36.407+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:36.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:36.435+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:36.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:36.552+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:37.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:37.199+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:37.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:37.394+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:37.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:37.477+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:37.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:37.514+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:38.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:38.208+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:38.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:38.411+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:38.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:38.439+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:38.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:38.467+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:39.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:39.253+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:39.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:39.403+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:39.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:39.456+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:39.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:39.460+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:40.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:40.271+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:40.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:40.356+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:40.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:40.458+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:40.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:40.493+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:41.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:41.226+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:41.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:41.401+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:41.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:41.453+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:41.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:41.469+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:42.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:42.181+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:42.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:42.370+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:42.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:42.445+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:42.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:42.461+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:43.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:43.211+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:43.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:43.361+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:43.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:43.475+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:43.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:43.494+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:44.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:44.238+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:44.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:44.322+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:44.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:44.461+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:44.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:44.467+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:45.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:45.205+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:45.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:45.351+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:45.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:45.457+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:45.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:45.508+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:46.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:46.167+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:46.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:46.350+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:46.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:46.444+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:46.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:46.541+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:47.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:47.205+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:47.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:47.365+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:47.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:47.453+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:47.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:47.553+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:48.065 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:30:48.063+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:30:48.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:48.175+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:48.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:48.334+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:48.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:48.496+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:48.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:48.530+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:49.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:49.166+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:49.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:49.323+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:49.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:49.461+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:49.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:49.527+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:50.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:50.199+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:50.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:50.320+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:50.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:50.466+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:50.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:50.556+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:51.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:51.204+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:51.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:51.339+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:51.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:51.429+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:51.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:51.559+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:52.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:52.178+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:52.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:52.298+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:52.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:52.429+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:52.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:52.546+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:53.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:53.167+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:53.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:53.316+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:53.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:53.407+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:53.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:53.526+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:54.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:54.146+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:54.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:54.285+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:54.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:54.413+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:54.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:54.484+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:55.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:55.131+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:55.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:55.302+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:55.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:55.441+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:55.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:55.457+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:56.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:56.134+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:56.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:56.277+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:56.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:56.470+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:56.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:56.508+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:57.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:57.136+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:57.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:57.264+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:57.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:57.504+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:57.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:57.510+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:58.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:58.107+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:58.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:58.307+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:58.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:58.496+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:58.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:58.552+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:59.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:30:59.099+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:59.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:30:59.285+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:59.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:30:59.506+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:30:59.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:30:59.533+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:00.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:00.097+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:00.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:00.283+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:00.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:00.520+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:00.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:00.541+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:01.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:01.058+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:01.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:01.257+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:01.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:01.499+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:01.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:01.499+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:02.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:02.055+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:02.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:02.229+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:02.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:02.467+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:02.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:02.467+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:03.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:03.043+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:03.080 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:31:03.079+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:31:03.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:03.184+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:03.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:03.448+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:03.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:03.469+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:04.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:04.032+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:04.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:04.146+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:04.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:04.459+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:04.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:04.496+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:04.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:31:04.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:31:05.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:05.000+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:05.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:05.140+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:05.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:05.417+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:05.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:05.482+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:05.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:05.995+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:06.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:06.186+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:06.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:06.462+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:06.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:06.483+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:06.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:06.946+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:07.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:07.155+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:07.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:07.471+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:07.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:07.473+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:07.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:07.925+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:08.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:08.203+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:08.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:08.435+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:08.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:08.515+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:08.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:08.962+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:09.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:09.228+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:09.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:09.442+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:09.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:09.565+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:09.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:09.996+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:10.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:10.256+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:10.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:10.417+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:10.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:10.517+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:11.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:11.034+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:11.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:11.235+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:11.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:11.399+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:11.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:11.530+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:12.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:12.067+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:12.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:12.233+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:12.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:12.411+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:12.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:12.541+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:13.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:13.077+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:13.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:13.204+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:13.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:13.421+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:13.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:13.518+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:14.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:14.090+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:14.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:14.200+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:14.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:14.397+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:14.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:14.564+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:15.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:15.123+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:15.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:15.211+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:15.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:15.442+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:15.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:15.517+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:16.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:16.096+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:16.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:16.247+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:16.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:16.425+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:16.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:16.486+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:17.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:17.111+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:17.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:17.229+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:17.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:17.460+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:17.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:17.524+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:18.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:18.064+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:18.097 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:31:18.094+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:31:18.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:18.180+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:18.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:18.413+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:18.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:18.489+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:19.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:19.049+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:19.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:19.160+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:19.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:19.394+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:19.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:19.524+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:20.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:20.089+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:20.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:20.139+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:20.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:20.398+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:20.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:20.570+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:21.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:21.059+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:21.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:21.154+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:21.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:21.369+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:21.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:21.542+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:22.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:22.019+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:22.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:22.199+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:22.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:22.379+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:22.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:22.577+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:22.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:22.988+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:23.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:23.170+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:23.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:23.394+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:23.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:23.535+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:23.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:23.988+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:24.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:24.203+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:24.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:24.424+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:24.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:24.514+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:24.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:24.968+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:25.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:25.166+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:25.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:25.397+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:25.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:25.470+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:26.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:26.014+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:26.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:26.170+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:26.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:26.382+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:26.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:26.443+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:26.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:26.987+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:27.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:27.142+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:27.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:27.346+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:27.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:27.487+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:27.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:27.990+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:28.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:28.176+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:28.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:28.370+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:28.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:28.503+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:28.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:28.954+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:29.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:29.160+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:29.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:29.369+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:29.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:29.484+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:29.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:29.926+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:30.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:30.142+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:30.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:30.334+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:30.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:30.522+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:30.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:30.918+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:31.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:31.145+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:31.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:31.370+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:31.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:31.555+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:31.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:31.959+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:32.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:32.169+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:32.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:32.410+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:32.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:32.567+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:32.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:32.994+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:33.112 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:31:33.110+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:31:33.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:33.214+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:33.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:33.373+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:33.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:33.553+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:34.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:34.019+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:34.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:34.183+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:34.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:34.338+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:34.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:34.519+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:34.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:31:34.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:34.978+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:34.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:31:35.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:35.226+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:35.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:35.350+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:35.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:35.536+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:35.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:35.968+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:36.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:36.274+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:36.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:36.332+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:36.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:36.545+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:36.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:36.979+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:37.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:37.268+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:37.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:37.308+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:37.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:37.520+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:37.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:37.953+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:38.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:38.303+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:38.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:38.336+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:38.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:38.483+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:38.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:38.924+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:39.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:39.316+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:39.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:39.350+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:39.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:39.472+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:39.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:39.938+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:40.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:40.302+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:40.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:40.370+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:40.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:40.501+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:40.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:40.939+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:41.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:41.291+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:41.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:41.373+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:41.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:41.479+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:41.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:41.976+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:42.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:42.339+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:42.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:42.413+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:42.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:42.432+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:43.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:43.011+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:43.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:43.339+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:43.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:43.428+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:43.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:43.449+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:44.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:44.025+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:44.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:44.361+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:44.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:44.470+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:44.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:44.479+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:44.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:44.981+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:45.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:45.314+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:45.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:45.450+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:45.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:45.467+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:45.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:45.996+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:46.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:46.359+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:46.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:46.444+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:46.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:46.445+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:46.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:46.952+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:47.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:47.403+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:47.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:47.429+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:47.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:47.452+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:47.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:47.973+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:48.128 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:31:48.126+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:31:48.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:48.404+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:48.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:48.413+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:48.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:48.439+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:48.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:48.991+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:49.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:49.356+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:49.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:49.415+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:49.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:49.485+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:50.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:50.035+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:50.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:50.402+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:50.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:50.444+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:50.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:50.487+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:50.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:50.989+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:51.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:51.419+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:51.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:51.441+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:51.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:51.442+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:51.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:51.958+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:52.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:52.393+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:52.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:52.449+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:52.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:52.450+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:52.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:52.979+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:53.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:53.399+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:53.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:53.429+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:53.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:53.473+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:53.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:53.992+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:54.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:54.354+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:54.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:54.397+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:54.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:54.442+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:54.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:54.957+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:55.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:55.337+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:55.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:55.393+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:55.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:55.464+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:55.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:55.961+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:56.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:56.358+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:56.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:56.383+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:56.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:56.467+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:56.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:56.950+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:57.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:57.329+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:57.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:57.335+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:57.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:57.515+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:57.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:57.979+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:58.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:58.337+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:58.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:58.354+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:58.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:58.508+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:59.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:31:59.028+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:59.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:31:59.300+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:59.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:31:59.362+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:31:59.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:31:59.467+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:00.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:00.061+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:00.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:00.285+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:00.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:00.363+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:00.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:00.434+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:01.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:01.078+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:01.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:01.306+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:01.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:01.404+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:01.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:01.477+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:02.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:02.125+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:02.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:02.332+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:02.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:02.394+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:02.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:02.436+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:03.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:03.084+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:03.138 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:32:03.135+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:32:03.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:03.333+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:03.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:03.406+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:03.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:03.433+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:04.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:04.071+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:04.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:04.374+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:04.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:04.395+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:04.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:04.399+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:05.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:05.069+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:05.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:32:05.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:32:05.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:05.345+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:05.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:05.380+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:05.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:05.439+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:06.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:06.027+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:06.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:06.384+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:06.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:06.407+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:06.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:06.472+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:07.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:07.070+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:07.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:07.413+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:07.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:07.420+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:07.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:07.505+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:08.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:08.086+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:08.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:08.383+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:08.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:08.410+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:08.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:08.468+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:09.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:09.051+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:09.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:09.375+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:09.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:09.414+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:09.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:09.455+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:10.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:10.027+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:10.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:10.338+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:10.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:10.398+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:10.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:10.423+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:11.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:11.005+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:11.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:11.361+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:11.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:11.384+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:11.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:11.433+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:12.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:12.017+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:12.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:12.386+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:12.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:12.402+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:12.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:12.476+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:13.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:13.009+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:13.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:13.384+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:13.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:13.390+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:13.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:13.443+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:14.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:14.040+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:14.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:14.347+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:14.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:14.378+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:14.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:14.429+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:15.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:15.052+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:15.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:15.353+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:15.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:15.371+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:15.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:15.409+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:16.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:16.065+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:16.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:16.316+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:16.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:16.336+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:16.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:16.400+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:17.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:17.054+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:17.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:17.364+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:17.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:17.365+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:17.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:17.385+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:18.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:18.055+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:18.145 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:32:18.144+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:32:18.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:18.347+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:18.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:18.369+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:18.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:18.402+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:19.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:19.048+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:19.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:19.357+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:19.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:19.367+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:19.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:19.377+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:20.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:20.074+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:20.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:20.363+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:20.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:20.372+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:20.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:20.401+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:21.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:21.031+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:21.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:21.352+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:21.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:21.353+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:21.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:21.406+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:22.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:22.048+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:22.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:22.363+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:22.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:22.390+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:22.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:22.401+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:23.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:23.000+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:23.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:23.373+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:23.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:23.386+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:23.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:23.398+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:23.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:23.996+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:24.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:24.331+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:24.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:24.375+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:24.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:24.401+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:24.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:24.959+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:25.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:25.319+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:25.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:25.371+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:25.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:25.421+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:25.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:25.948+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:26.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:26.332+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:26.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:26.360+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:26.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:26.458+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:26.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:26.980+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:27.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:27.311+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:27.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:27.379+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:27.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:27.482+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:27.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:27.937+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:28.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:28.329+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:28.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:28.370+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:28.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:28.493+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:28.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:28.940+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:29.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:29.309+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:29.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:29.333+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:29.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:29.534+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:29.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:29.944+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:30.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:30.291+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:30.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:30.366+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:30.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:30.552+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:30.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:30.957+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:31.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:31.250+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:31.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:31.331+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:31.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:31.532+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:31.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:31.993+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:32.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:32.246+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:32.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:32.317+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:32.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:32.551+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:32.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:32.972+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:33.160 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:32:33.158+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:32:33.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:33.277+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:33.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:33.345+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:33.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:33.595+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:33.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:33.978+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:34.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:34.244+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:34.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:34.385+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:34.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:34.565+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:34.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:34.957+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:35.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:32:35.149 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:32:35.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:35.279+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:35.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:35.352+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:35.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:35.598+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:35.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:35.937+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:36.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:36.311+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:36.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:36.342+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:36.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:36.596+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:36.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:36.949+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:37.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:37.297+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:37.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:37.349+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:37.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:37.566+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:37.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:37.963+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:38.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:38.267+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:38.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:38.396+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:38.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:38.546+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:39.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:39.000+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:39.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:39.226+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:39.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:39.423+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:39.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:39.589+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:40.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:40.050+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:40.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:40.263+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:40.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:40.415+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:40.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:40.555+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:41.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:41.018+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:41.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:41.220+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:41.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:41.463+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:41.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:41.518+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:42.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:42.053+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:42.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:42.176+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:42.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:42.484+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:42.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:42.521+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:43.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:43.092+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:43.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:43.206+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:43.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:43.520+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:43.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:43.520+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:44.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:44.086+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:44.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:44.256+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:44.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:44.481+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:44.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:44.557+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:45.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:45.100+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:45.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:45.228+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:45.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:45.473+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:45.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:45.591+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:46.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:46.074+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:46.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:46.195+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:46.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:46.491+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:46.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:46.554+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:47.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:47.110+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:47.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:47.151+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:47.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:47.465+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:47.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:47.586+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:48.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:48.134+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:48.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:48.158+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:48.171 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:32:48.170+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:32:48.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:48.472+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:48.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:48.613+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:49.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:49.152+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:49.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:49.169+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:49.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:49.509+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:49.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:49.661+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:50.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:50.142+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:50.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:50.194+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:50.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:50.478+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:50.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:50.663+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:51.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:51.118+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:51.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:51.169+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:51.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:51.528+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:51.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:51.711+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:52.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:52.093+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:52.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:52.203+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:52.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:52.578+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:52.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:52.748+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:53.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:53.046+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:53.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:53.226+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:53.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:53.567+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:53.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:53.789+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:54.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:54.059+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:54.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:54.270+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:54.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:54.584+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:54.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:54.796+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:55.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:55.098+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:55.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:55.285+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:55.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:55.609+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:55.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:55.768+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:56.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:56.055+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:56.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:56.263+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:56.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:56.653+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:56.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:56.813+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:57.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:57.057+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:57.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:57.228+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:57.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:57.696+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:57.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:57.825+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:58.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:58.016+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:58.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:58.202+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:58.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:58.708+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:58.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:58.827+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:58.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:58.968+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:59.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:32:59.159+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:59.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:32:59.658+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:59.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:32:59.788+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:32:59.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:32:59.924+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:00.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:00.128+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:00.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:00.624+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:00.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:00.803+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:00.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:00.964+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:01.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:01.157+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:01.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:01.659+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:01.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:01.801+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:01.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:01.933+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:02.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:02.112+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:02.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:02.631+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:02.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:02.802+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:02.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:02.889+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:03.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:03.072+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:03.183 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:33:03.181+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:33:03.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:03.642+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:03.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:03.833+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:03.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:03.908+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:04.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:04.040+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:04.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:04.642+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:04.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:04.873+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:04.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:04.898+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:05.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:05.069+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:05.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:33:05.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:33:05.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:05.619+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:05.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:05.862+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:05.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:05.869+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:06.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:06.071+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:06.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:06.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:06.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:06.842+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:06.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:06.873+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:07.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:07.109+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:07.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:07.682+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:07.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:07.810+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:07.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:07.842+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:08.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:08.101+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:08.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:08.645+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:08.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:08.824+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:08.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:08.859+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:09.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:09.058+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:09.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:09.684+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:09.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:09.846+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:09.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:09.897+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:10.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:10.050+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:10.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:10.647+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:10.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:10.836+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:10.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:10.862+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:11.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:11.063+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:11.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:11.672+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:11.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:11.866+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:11.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:11.882+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:12.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:12.050+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:12.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:12.675+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:12.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:12.837+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:12.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:12.908+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:13.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:13.080+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:13.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:13.664+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:13.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:13.822+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:13.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:13.933+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:14.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:14.049+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:14.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:14.676+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:14.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:14.789+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:14.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:14.896+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:15.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:15.008+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:15.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:15.725+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:15.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:15.803+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:15.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:15.938+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:16.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:16.012+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:16.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:16.710+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:16.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:16.830+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:16.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:16.961+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:16.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:16.965+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:17.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:17.702+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:17.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:17.835+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:17.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:17.951+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:17.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:17.992+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:18.199 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:33:18.197+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:33:18.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:18.672+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:18.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:18.851+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:19.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:18.998+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:19.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:19.036+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:19.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:19.686+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:19.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:19.818+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:19.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:19.961+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:19.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:19.989+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:20.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:20.674+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:20.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:20.849+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:20.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:20.960+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:21.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:21.008+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:21.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:21.722+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:21.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:21.852+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:21.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:21.967+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:22.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:22.010+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:22.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:22.737+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:22.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:22.832+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:22.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:22.953+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:23.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:23.015+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:23.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:23.712+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:23.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:23.834+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:23.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:23.974+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:24.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:24.053+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:24.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:24.701+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:24.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:24.875+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:24.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:24.973+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:25.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:25.048+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:25.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:25.740+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:25.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:25.866+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:26.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:26.022+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:26.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:26.051+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:26.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:26.737+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:26.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:26.879+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:27.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:27.007+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:27.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:27.030+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:27.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:27.689+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:27.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:27.892+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:28.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:28.007+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:28.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:28.043+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:28.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:28.715+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:28.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:28.864+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:29.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:29.035+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:29.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:29.041+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:29.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:29.720+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:29.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:29.849+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:29.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:29.996+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:30.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:30.090+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:30.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:30.703+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:30.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:30.889+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:31.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:31.043+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:31.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:31.140+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:31.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:31.681+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:31.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:31.929+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:32.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:32.044+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:32.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:32.102+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:32.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:32.661+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:32.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:32.914+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:33.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:33.073+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:33.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:33.125+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:33.205 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:33:33.203+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:33:33.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:33.695+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:33.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:33.911+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:34.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:34.081+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:34.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:34.167+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:34.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:34.744+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:34.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:34.950+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:35.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:35.093+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:35.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:35.192+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:35.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:33:35.313 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:33:35.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:35.730+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:35.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:35.918+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:36.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:36.063+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:36.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:36.200+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:36.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:36.706+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:36.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:36.919+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:37.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:37.047+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:37.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:37.247+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:37.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:37.740+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:37.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:37.956+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:38.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:38.073+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:38.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:38.241+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:38.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:38.728+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:39.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:39.006+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:39.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:39.037+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:39.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:39.220+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:39.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:39.727+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:39.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:39.968+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:40.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:40.013+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:40.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:40.269+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:40.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:40.749+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:40.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:40.921+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:40.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:40.967+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:41.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:41.243+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:41.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:41.706+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:41.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:41.880+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:41.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:41.947+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:42.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:42.216+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:42.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:42.706+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:42.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:42.835+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:42.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:42.924+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:43.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:43.244+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:43.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:43.745+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:43.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:43.799+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:43.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:43.943+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:44.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:44.220+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:44.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:44.787+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:44.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:44.827+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:44.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:44.922+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:45.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:45.244+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:45.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:45.796+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:45.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:45.807+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:45.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:45.894+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:46.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:46.230+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:46.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:46.802+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:46.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:46.823+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:46.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:46.888+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:47.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:47.259+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:47.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:47.813+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:47.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:47.835+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:47.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:47.861+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:48.220 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:33:48.217+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:33:48.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:48.240+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:48.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:48.828+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:48.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:48.843+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:48.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:48.848+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:49.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:49.231+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:49.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:49.781+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:49.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:49.798+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:49.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:49.885+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:50.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:50.271+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:50.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:50.757+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:50.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:50.802+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:50.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:50.875+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:51.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:51.223+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:51.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:51.754+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:51.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:51.816+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:51.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:51.879+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:52.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:52.191+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:52.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:52.746+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:52.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:52.799+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:52.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:52.853+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:53.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:53.188+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:53.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:53.713+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:53.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:53.793+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:53.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:53.872+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:54.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:54.224+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:54.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:54.726+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:54.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:54.841+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:54.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:54.898+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:55.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:55.256+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:55.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:55.696+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:55.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:55.850+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:55.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:55.850+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:56.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:56.297+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:56.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:56.697+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:56.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:56.839+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:56.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:56.852+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:57.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:57.327+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:57.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:57.697+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:57.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:57.818+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:57.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:57.875+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:58.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:58.282+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:58.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:58.668+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:58.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:58.839+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:58.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:58.856+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:59.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:33:59.308+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:59.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:33:59.700+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:59.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:33:59.793+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:33:59.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:33:59.898+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:00.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:00.330+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:00.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:00.703+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:00.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:00.810+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:00.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:00.936+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:01.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:01.327+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:01.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:01.739+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:01.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:01.774+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:01.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:01.933+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:02.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:02.340+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:02.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:02.742+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:02.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:02.764+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:02.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:02.926+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:03.227 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:34:03.226+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:34:03.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:03.358+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:03.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:03.760+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:03.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:03.761+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:03.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:03.930+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:04.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:04.378+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:04.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:04.718+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:04.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:04.802+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:04.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:04.929+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:05.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:05.377+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:05.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:34:05.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:34:05.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:05.706+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:05.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:05.819+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:05.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:05.922+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:06.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:06.380+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:06.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:06.660+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:06.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:06.781+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:06.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:06.944+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:07.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:07.422+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:07.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:07.631+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:07.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:07.734+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:07.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:07.919+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:08.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:08.470+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:08.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:08.669+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:08.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:08.723+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:08.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:08.881+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:09.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:09.453+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:09.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:09.674+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:09.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:09.744+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:09.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:09.872+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:10.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:10.438+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:10.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:10.687+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:10.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:10.769+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:10.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:10.866+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:11.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:11.453+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:11.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:11.694+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:11.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:11.779+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:11.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:11.825+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:12.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:12.422+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:12.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:12.712+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:12.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:12.773+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:12.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:12.858+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:13.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:13.409+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:13.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:13.696+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:13.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:13.736+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:13.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:13.884+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:14.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:14.384+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:14.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:14.669+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:14.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:14.751+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:14.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:14.933+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:15.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:15.418+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:15.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:15.659+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:15.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:15.781+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:15.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:15.927+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:16.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:16.463+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:16.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:16.662+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:16.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:16.821+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:16.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:16.950+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:17.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:17.498+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:17.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:17.621+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:17.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:17.798+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:17.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:17.979+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:18.243 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:34:18.241+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:34:18.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:18.496+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:18.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:18.670+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:18.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:18.835+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:18.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:18.974+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:19.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:19.530+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:19.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:19.622+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:19.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:19.800+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:19.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:19.978+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:20.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:20.560+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:20.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:20.582+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:20.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:20.774+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:21.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:21.008+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:21.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:21.606+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:21.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:21.622+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:21.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:21.798+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:21.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:21.979+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:22.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:22.634+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:22.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:22.647+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:22.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:22.780+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:22.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:22.988+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:23.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:23.617+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:23.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:23.652+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:23.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:23.790+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:23.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:23.943+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:24.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:24.593+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:24.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:24.694+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:24.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:24.819+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:24.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:24.908+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:25.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:25.564+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:25.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:25.650+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:25.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:25.847+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:25.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:25.913+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:26.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:26.533+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:26.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:26.687+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:26.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:26.822+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:26.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:26.952+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:27.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:27.524+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:27.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:27.642+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:27.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:27.838+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:27.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:27.954+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:28.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:28.512+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:28.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:28.627+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:28.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:28.861+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:28.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:28.940+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:29.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:29.495+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:29.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:29.662+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:29.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:29.876+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:29.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:29.898+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:30.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:30.474+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:30.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:30.621+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:30.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:30.827+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:30.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:30.869+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:31.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:31.512+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:31.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:31.663+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:31.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:31.817+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:31.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:31.898+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:32.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:32.512+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:32.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:32.671+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:32.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:32.825+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:32.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:32.937+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:33.255 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:34:33.254+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:34:33.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:33.484+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:33.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:33.647+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:33.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:33.831+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:33.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:33.945+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:34.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:34.530+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:34.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:34.603+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:34.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:34.879+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:34.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:34.970+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:35.466 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:34:35.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:34:35.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:35.563+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:35.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:35.576+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:35.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:35.865+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:36.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:35.998+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:36.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:36.515+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:36.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:36.559+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:36.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:36.816+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:37.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:37.030+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:37.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:37.522+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:37.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:37.591+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:37.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:37.843+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:38.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:38.014+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:38.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:38.559+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:38.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:38.611+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:38.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:38.873+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:39.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:39.021+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:39.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:39.533+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:39.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:39.579+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:39.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:39.867+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:40.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:40.004+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:40.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:40.526+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:40.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:40.588+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:40.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:40.869+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:40.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:40.976+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:41.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:41.491+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:41.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:41.616+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:41.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:41.917+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:42.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:42.013+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:42.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:42.496+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:42.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:42.583+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:42.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:42.933+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:43.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:43.034+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:43.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:43.538+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:43.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:43.582+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:43.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:43.969+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:44.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:44.052+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:44.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:44.492+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:44.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:44.605+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:44.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:44.986+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:45.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:45.054+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:45.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:45.536+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:45.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:45.624+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:46.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:46.036+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:46.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:46.100+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:46.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:46.528+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:46.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:46.656+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:47.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:47.063+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:47.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:47.139+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:47.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:47.506+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:47.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:47.687+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:48.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:48.081+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:48.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:48.102+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:48.271 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:34:48.269+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:34:48.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:48.523+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:48.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:48.712+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:49.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:49.115+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:49.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:49.150+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:49.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:49.544+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:49.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:49.679+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:50.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:50.142+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:50.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:50.181+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:50.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:50.563+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:50.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:50.697+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:51.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:51.143+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:51.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:51.173+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:51.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:51.562+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:51.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:51.653+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:52.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:52.149+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:52.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:52.214+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:52.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:52.517+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:52.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:52.686+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:53.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:53.109+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:53.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:53.179+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:53.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:53.470+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:53.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:53.642+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:54.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:54.145+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:54.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:54.148+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:54.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:54.430+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:54.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:54.602+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:55.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:55.108+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:55.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:55.110+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:55.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:55.451+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:55.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:55.591+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:56.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:56.060+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:56.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:56.101+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:56.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:56.450+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:56.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:56.614+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:57.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:57.047+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:57.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:57.094+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:57.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:57.440+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:57.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:57.653+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:58.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:57.999+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:58.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:58.105+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:58.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:58.471+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:58.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:58.652+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:58.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:58.984+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:59.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:34:59.155+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:59.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:34:59.465+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:59.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:34:59.657+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:34:59.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:34:59.961+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:00.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:00.203+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:00.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:00.488+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:00.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:00.689+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:01.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:01.011+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:01.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:01.229+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:01.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:01.450+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:01.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:01.656+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:02.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:02.043+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:02.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:02.273+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:02.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:02.424+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:02.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:02.652+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:03.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:03.089+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:03.287 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:35:03.285+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:35:03.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:03.305+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:03.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:03.419+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:03.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:03.639+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:04.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:04.108+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:04.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:04.350+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:04.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:04.445+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:04.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:04.611+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:05.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:05.100+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:05.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:05.336+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:05.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:05.492+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:05.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:05.607+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:05.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:35:05.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:35:06.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:06.099+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:06.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:06.287+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:06.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:06.476+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:06.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:06.588+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:07.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:07.055+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:07.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:07.286+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:07.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:07.430+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:07.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:07.632+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:08.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:08.044+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:08.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:08.328+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:08.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:08.416+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:08.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:08.645+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:09.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:09.023+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:09.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:09.318+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:09.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:09.429+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:09.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:09.629+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:10.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:10.068+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:10.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:10.305+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:10.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:10.417+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:10.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:10.670+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:11.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:11.059+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:11.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:11.259+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:11.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:11.398+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:11.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:11.690+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:12.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:12.077+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:12.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:12.232+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:12.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:12.401+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:12.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:12.709+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:13.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:13.092+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:13.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:13.236+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:13.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:13.373+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:13.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:13.698+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:14.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:14.132+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:14.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:14.232+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:14.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:14.377+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:14.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:14.649+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:15.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:15.141+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:15.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:15.219+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:15.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:15.365+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:15.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:15.653+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:16.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:16.092+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:16.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:16.207+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:16.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:16.325+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:16.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:16.647+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:17.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:17.096+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:17.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:17.252+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:17.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:17.367+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:17.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:17.628+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:18.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:18.066+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:18.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:18.218+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:18.303 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:35:18.302+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:35:18.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:18.412+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:18.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:18.639+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:19.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:19.034+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:19.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:19.196+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:19.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:19.370+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:19.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:19.601+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:20.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:20.025+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:20.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:20.206+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:20.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:20.331+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:20.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:20.599+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:21.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:21.020+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:21.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:21.176+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:21.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:21.319+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:21.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:21.554+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:22.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:22.056+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:22.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:22.180+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:22.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:22.294+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:22.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:22.582+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:23.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:23.100+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:23.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:23.203+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:23.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:23.336+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:23.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:23.553+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:24.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:24.144+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:24.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:24.193+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:24.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:24.363+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:24.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:24.510+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:25.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:25.163+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:25.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:25.194+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:25.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:25.354+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:25.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:25.547+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:26.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:26.199+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:26.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:26.222+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:26.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:26.327+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:26.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:26.591+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:27.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:27.182+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:27.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:27.237+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:27.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:27.322+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:27.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:27.555+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:28.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:28.202+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:28.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:28.237+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:28.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:28.360+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:28.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:28.563+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:29.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:29.192+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:29.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:29.259+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:29.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:29.330+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:29.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:29.532+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:30.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:30.192+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:30.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:30.309+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:30.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:30.366+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:30.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:30.575+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:31.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:31.158+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:31.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:31.278+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:31.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:31.322+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:31.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:31.605+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:32.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:32.129+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:32.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:32.265+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:32.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:32.283+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:32.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:32.629+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:33.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:33.162+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:33.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:33.263+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:33.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:33.278+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:33.319 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:35:33.316+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:35:33.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:33.673+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:34.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:34.195+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:34.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:34.265+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:34.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:34.304+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:34.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:34.687+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:35.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:35.233+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:35.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:35.274+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:35.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:35.315+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:35.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:35.642+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:35.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:35:35.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:35:36.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:36.197+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:36.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:36.278+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:36.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:36.365+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:36.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:36.607+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:37.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:37.165+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:37.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:37.324+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:37.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:37.389+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:37.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:37.604+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:38.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:38.121+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:38.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:38.304+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:38.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:38.370+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:38.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:38.598+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:39.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:39.098+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:39.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:39.291+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:39.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:39.398+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:39.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:39.625+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:40.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:40.082+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:40.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:40.339+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:40.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:40.409+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:40.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:40.665+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:41.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:41.112+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:41.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:41.299+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:41.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:41.434+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:41.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:41.623+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:42.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:42.153+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:42.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:42.278+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:42.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:42.439+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:42.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:42.598+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:43.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:43.153+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:43.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:43.263+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:43.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:43.429+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:43.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:43.632+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:44.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:44.158+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:44.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:44.296+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:44.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:44.403+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:44.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:44.592+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:45.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:45.140+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:45.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:45.319+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:45.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:45.420+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:45.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:45.613+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:46.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:46.156+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:46.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:46.308+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:46.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:46.458+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:46.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:46.662+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:47.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:47.201+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:47.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:47.298+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:47.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:47.486+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:47.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:47.702+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:48.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:48.153+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:48.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:48.271+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:48.335 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:35:48.333+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:35:48.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:48.500+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:48.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:48.657+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:49.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:49.186+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:49.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:49.302+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:49.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:49.523+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:49.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:49.657+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:50.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:50.142+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:50.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:50.336+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:50.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:50.478+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:50.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:50.668+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:51.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:51.173+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:51.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:51.364+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:51.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:51.460+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:51.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:51.689+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:52.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:52.153+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:52.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:52.384+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:52.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:52.478+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:52.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:52.720+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:53.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:53.162+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:53.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:53.369+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:53.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:53.468+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:53.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:53.714+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:54.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:54.135+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:54.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:54.322+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:54.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:54.460+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:54.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:54.736+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:55.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:55.098+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:55.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:55.292+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:55.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:55.458+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:55.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:55.752+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:56.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:56.074+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:56.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:56.282+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:56.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:56.503+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:56.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:56.793+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:57.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:57.054+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:57.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:57.312+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:57.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:57.546+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:57.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:57.838+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:58.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:58.101+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:58.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:58.326+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:58.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:58.563+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:58.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:58.810+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:59.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:35:59.142+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:59.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:35:59.339+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:59.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:35:59.573+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:35:59.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:35:59.773+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:00.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:00.169+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:00.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:00.305+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:00.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:00.560+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:00.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:00.790+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:01.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:01.196+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:01.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:01.257+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:01.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:01.538+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:01.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:01.813+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:02.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:02.148+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:02.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:02.279+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:02.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:02.580+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:02.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:02.797+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:03.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:03.106+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:03.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:03.279+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:03.348 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:36:03.346+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:36:03.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:03.583+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:03.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:03.838+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:04.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:04.126+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:04.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:04.274+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:04.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:04.535+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:04.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:04.881+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:05.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:05.126+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:05.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:05.232+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:05.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:05.566+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:05.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:05.844+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:05.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:36:05.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:36:06.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:06.165+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:06.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:06.226+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:06.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:06.544+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:06.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:06.820+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:07.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:07.145+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:07.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:07.207+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:07.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:07.554+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:07.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:07.810+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:08.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:08.192+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:08.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:08.214+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:08.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:08.588+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:08.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:08.793+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:09.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:09.221+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:09.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:09.237+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:09.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:09.638+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:09.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:09.791+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:10.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:10.201+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:10.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:10.224+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:10.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:10.610+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:10.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:10.775+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:11.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:11.185+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:11.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:11.231+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:11.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:11.642+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:11.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:11.734+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:12.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:12.197+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:12.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:12.211+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:12.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:12.630+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:12.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:12.714+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:13.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:13.230+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:13.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:13.231+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:13.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:13.607+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:13.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:13.716+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:14.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:14.211+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:14.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:14.215+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:14.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:14.576+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:14.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:14.695+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:15.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:15.199+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:15.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:15.228+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:15.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:15.562+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:15.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:15.661+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:16.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:16.158+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:16.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:16.207+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:16.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:16.568+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:16.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:16.689+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:17.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:17.173+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:17.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:17.181+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:17.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:17.553+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:17.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:17.643+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:18.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:18.144+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:18.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:18.183+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:18.364 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:36:18.362+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:36:18.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:18.538+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:18.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:18.644+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:19.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:19.137+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:19.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:19.211+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:19.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:19.534+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:19.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:19.639+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:20.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:20.156+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:20.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:20.203+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:20.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:20.501+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:20.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:20.684+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:21.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:21.205+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:21.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:21.241+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:21.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:21.527+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:21.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:21.671+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:22.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:22.173+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:22.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:22.255+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:22.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:22.547+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:22.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:22.694+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:23.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:23.204+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:23.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:23.209+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:23.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:23.540+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:23.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:23.651+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:24.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:24.176+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:24.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:24.248+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:24.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:24.555+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:24.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:24.699+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:25.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:25.209+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:25.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:25.221+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:25.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:25.514+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:25.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:25.689+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:26.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:26.256+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:26.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:26.260+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:26.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:26.563+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:26.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:26.662+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:27.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:27.245+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:27.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:27.258+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:27.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:27.602+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:27.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:27.624+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:28.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:28.233+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:28.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:28.266+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:28.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:28.599+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:28.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:28.609+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:29.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:29.245+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:29.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:29.314+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:29.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:29.592+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:29.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:29.654+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:30.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:30.213+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:30.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:30.345+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:30.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:30.574+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:30.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:30.630+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:31.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:31.249+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:31.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:31.377+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:31.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:31.583+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:31.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:31.613+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:32.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:32.247+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:32.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:32.328+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:32.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:32.536+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:32.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:32.564+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:33.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:33.212+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:33.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:33.286+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:33.379 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:36:33.378+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:36:33.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:33.535+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:33.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:33.572+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:34.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:34.181+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:34.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:34.335+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:34.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:34.564+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:34.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:34.618+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:35.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:35.201+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:35.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:35.360+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:35.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:35.552+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:35.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:35.648+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:36.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:36:36.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:36:36.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:36.242+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:36.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:36.382+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:36.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:36.596+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:36.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:36.626+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:37.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:37.271+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:37.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:37.407+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:37.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:37.600+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:37.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:37.618+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:38.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:38.264+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:38.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:38.372+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:38.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:38.591+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:38.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:38.662+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:39.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:39.314+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:39.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:39.349+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:39.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:39.590+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:39.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:39.697+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:40.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:40.340+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:40.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:40.394+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:40.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:40.637+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:40.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:40.656+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:41.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:41.309+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:41.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:41.418+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:41.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:41.660+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:41.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:41.677+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:42.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:42.285+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:42.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:42.426+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:42.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:42.629+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:42.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:42.710+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:43.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:43.271+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:43.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:43.475+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:43.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:43.679+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:43.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:43.730+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:44.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:44.286+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:44.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:44.486+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:44.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:44.651+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:44.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:44.773+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:45.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:45.259+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:45.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:45.520+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:45.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:45.679+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:45.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:45.749+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:46.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:46.304+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:46.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:46.483+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:46.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:46.688+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:46.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:46.764+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:47.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:47.345+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:47.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:47.522+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:47.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:47.708+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:47.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:47.769+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:48.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:48.356+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:48.395 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:36:48.393+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:36:48.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:48.566+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:48.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:48.711+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:48.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:48.728+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:49.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:49.333+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:49.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:49.594+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:49.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:49.701+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:49.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:49.722+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:50.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:50.354+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:50.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:50.601+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:50.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:50.690+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:50.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:50.703+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:51.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:51.384+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:51.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:51.597+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:51.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:51.662+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:51.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:51.731+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:52.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:52.377+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:52.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:52.599+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:52.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:52.621+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:52.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:52.777+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:53.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:53.359+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:53.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:53.607+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:53.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:53.641+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:53.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:53.783+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:54.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:54.402+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:54.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:54.629+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:54.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:54.636+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:54.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:54.744+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:55.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:55.357+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:55.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:55.601+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:55.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:55.628+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:55.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:55.777+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:56.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:56.375+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:56.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:56.574+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:56.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:56.652+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:56.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:56.773+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:57.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:57.358+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:57.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:57.541+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:57.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:57.664+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:57.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:57.767+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:58.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:58.365+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:58.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:58.587+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:58.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:58.622+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:58.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:58.752+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:59.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:36:59.364+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:59.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:36:59.593+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:59.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:36:59.609+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:36:59.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:36:59.784+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:00.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:00.325+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:00.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:00.605+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:00.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:00.637+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:00.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:00.794+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:01.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:01.336+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:01.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:01.575+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:01.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:01.613+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:01.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:01.788+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:02.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:02.367+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:02.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:02.561+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:02.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:02.602+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:02.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:02.765+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:03.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:03.387+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:03.411 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:37:03.410+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:37:03.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:03.596+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:03.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:03.608+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:03.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:03.786+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:04.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:04.421+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:04.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:04.557+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:04.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:04.579+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:04.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:04.790+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:05.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:05.441+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:05.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:05.534+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:05.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:05.575+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:05.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:05.783+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:06.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:37:06.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:37:06.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:06.397+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:06.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:06.511+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:06.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:06.544+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:06.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:06.755+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:07.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:07.415+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:07.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:07.518+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:07.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:07.536+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:07.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:07.750+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:08.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:08.452+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:08.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:08.497+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:08.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:08.539+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:08.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:08.711+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:09.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:09.403+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:09.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:09.454+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:09.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:09.502+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:09.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:09.664+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:10.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:10.373+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:10.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:10.415+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:10.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:10.459+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:10.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:10.631+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:11.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:11.383+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:11.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:11.465+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:11.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:11.487+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:11.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:11.601+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:12.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:12.347+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:12.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:12.454+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:12.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:12.487+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:12.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:12.594+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:13.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:13.335+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:13.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:13.472+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:13.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:13.511+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:13.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:13.569+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:14.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:14.383+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:14.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:14.510+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:14.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:14.527+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:14.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:14.619+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:15.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:15.345+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:15.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:15.506+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:15.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:15.571+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:15.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:15.571+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:16.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:16.378+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:16.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:16.525+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:16.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:16.546+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:16.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:16.546+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:17.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:17.408+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:17.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:17.498+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:17.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:17.524+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:17.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:17.579+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:18.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:18.374+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:18.427 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:37:18.425+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:37:18.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:18.483+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:18.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:18.515+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:18.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:18.616+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:19.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:19.412+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:19.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:19.462+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:19.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:19.526+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:19.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:19.603+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:20.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:20.416+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:20.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:20.454+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:20.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:20.515+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:20.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:20.622+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:21.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:21.400+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:21.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:21.464+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:21.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:21.508+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:21.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:21.617+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:22.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:22.393+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:22.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:22.423+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:22.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:22.504+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:22.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:22.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:23.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:23.366+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:23.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:23.422+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:23.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:23.494+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:23.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:23.618+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:24.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:24.379+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:24.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:24.468+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:24.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:24.474+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:24.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:24.619+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:25.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:25.334+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:25.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:25.437+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:25.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:25.441+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:25.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:25.598+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:26.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:26.299+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:26.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:26.448+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:26.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:26.469+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:26.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:26.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:27.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:27.314+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:27.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:27.463+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:27.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:27.476+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:27.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:27.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:28.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:28.290+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:28.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:28.438+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:28.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:28.474+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:28.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:28.677+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:29.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:29.266+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:29.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:29.434+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:29.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:29.436+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:29.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:29.646+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:30.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:30.307+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:30.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:30.411+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:30.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:30.475+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:30.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:30.688+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:31.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:31.350+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:31.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:31.454+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:31.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:31.474+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:31.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:31.684+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:32.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:32.329+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:32.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:32.444+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:32.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:32.492+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:32.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:32.668+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:33.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:33.294+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:33.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:33.401+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:33.442 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:37:33.440+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:37:33.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:33.491+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:33.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:33.646+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:34.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:34.284+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:34.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:34.436+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:34.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:34.453+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:34.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:34.620+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:35.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:35.322+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:35.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:35.441+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:35.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:35.442+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:35.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:35.635+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:36.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:37:36.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:37:36.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:36.355+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:36.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:36.429+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:36.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:36.448+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:36.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:36.595+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:37.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:37.312+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:37.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:37.468+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:37.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:37.476+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:37.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:37.593+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:38.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:38.320+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:38.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:38.479+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:38.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:38.479+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:38.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:38.630+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:39.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:39.366+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:39.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:39.436+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:39.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:39.444+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:39.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:39.651+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:40.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:40.318+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:40.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:40.409+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:40.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:40.447+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:40.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:40.638+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:41.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:41.317+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:41.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:41.368+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:41.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:41.480+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:41.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:41.653+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:42.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:42.325+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:42.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:42.409+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:42.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:42.454+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:42.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:42.689+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:43.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:43.373+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:43.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:43.375+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:43.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:43.500+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:43.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:43.701+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:44.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:44.352+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:44.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:44.402+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:44.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:44.539+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:44.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:44.652+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:45.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:45.377+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:45.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:45.380+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:45.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:45.531+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:45.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:45.620+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:46.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:46.389+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:46.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:46.396+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:46.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:46.532+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:46.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:46.576+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:47.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:47.354+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:47.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:47.410+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:47.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:47.502+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:47.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:47.598+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:48.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:48.336+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:48.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:48.447+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:48.459 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:37:48.457+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:37:48.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:48.477+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:48.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:48.569+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:49.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:49.372+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:49.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:49.456+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:49.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:49.480+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:49.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:49.590+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:50.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:50.417+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:50.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:50.485+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:50.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:50.502+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:50.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:50.626+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:51.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:51.436+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:51.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:51.473+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:51.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:51.515+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:51.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:51.608+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:52.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:52.425+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:52.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:52.471+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:52.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:52.506+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:52.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:52.561+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:53.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:53.425+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:53.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:53.462+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:53.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:53.509+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:53.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:53.543+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:54.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:54.380+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:54.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:54.474+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:54.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:54.484+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:54.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:54.575+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:55.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:55.363+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:55.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:55.447+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:55.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:55.486+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:55.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:55.585+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:56.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:56.395+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:56.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:56.419+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:56.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:56.497+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:56.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:56.624+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:57.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:57.434+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:57.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:57.445+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:57.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:57.517+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:57.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:57.664+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:58.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:58.387+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:58.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:58.433+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:58.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:58.523+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:58.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:58.704+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:59.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:37:59.381+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:59.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:37:59.428+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:59.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:37:59.510+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:37:59.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:37:59.669+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:00.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:00.412+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:00.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:00.443+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:00.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:00.521+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:00.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:00.696+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:01.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:01.416+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:01.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:01.420+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:01.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:01.570+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:01.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:01.739+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:02.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:02.395+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:02.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:02.408+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:02.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:02.590+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:02.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:02.707+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:03.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:03.369+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:03.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:03.406+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:03.464 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:38:03.461+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:38:03.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:03.594+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:03.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:03.711+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:04.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:04.373+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:04.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:04.429+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:04.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:04.639+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:04.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:04.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:05.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:05.366+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:05.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:05.463+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:05.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:05.652+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:05.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:05.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:06.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:38:06.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:38:06.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:06.364+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:06.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:06.512+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:06.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:06.642+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:06.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:06.642+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:07.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:07.367+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:07.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:07.481+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:07.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:07.653+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:07.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:07.689+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:08.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:08.413+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:08.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:08.530+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:08.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:08.665+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:08.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:08.705+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:09.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:09.449+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:09.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:09.540+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:09.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:09.667+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:09.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:09.703+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:10.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:10.482+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:10.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:10.509+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:10.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:10.682+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:10.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:10.739+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:11.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:11.502+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:11.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:11.505+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:11.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:11.636+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:11.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:11.731+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:12.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:12.491+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:12.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:12.492+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:12.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:12.618+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:12.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:12.713+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:13.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:13.506+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:13.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:13.517+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:13.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:13.623+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:13.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:13.713+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:14.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:14.477+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:14.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:14.550+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:14.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:14.649+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:14.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:14.736+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:15.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:15.484+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:15.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:15.545+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:15.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:15.650+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:15.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:15.738+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:16.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:16.468+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:16.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:16.550+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:16.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:16.640+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:16.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:16.709+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:17.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:17.490+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:17.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:17.542+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:17.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:17.638+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:17.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:17.684+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:18.480 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:38:18.478+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:38:18.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:18.489+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:18.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:18.554+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:18.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:18.634+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:18.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:18.703+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:19.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:19.469+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:19.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:19.547+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:19.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:19.592+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:19.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:19.717+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:20.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:20.499+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:20.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:20.561+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:20.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:20.623+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:20.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:20.686+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:21.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:21.525+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:21.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:21.549+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:21.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:21.600+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:21.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:21.702+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:22.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:22.530+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:22.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:22.598+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:22.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:22.634+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:22.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:22.660+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:23.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:23.536+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:23.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:23.628+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:23.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:23.633+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:23.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:23.634+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:24.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:24.578+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:24.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:24.606+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:24.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:24.627+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:24.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:24.640+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:25.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:25.578+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:25.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:25.593+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:25.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:25.614+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:25.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:25.628+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:26.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:26.577+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:26.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:26.601+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:26.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:26.622+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:26.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:26.641+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:27.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:27.606+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:27.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:27.612+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:27.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:27.620+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:27.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:27.639+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:28.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:28.587+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:28.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:28.602+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:28.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:28.610+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:28.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:28.650+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:29.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:29.581+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:29.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:29.631+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:29.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:29.637+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:29.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:29.678+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:30.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:30.567+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:30.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:30.653+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:30.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:30.676+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:30.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:30.700+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:31.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:31.598+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:31.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:31.656+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:31.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:31.658+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:31.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:31.671+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:32.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:32.616+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:32.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:32.623+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:32.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:32.680+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:32.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:32.693+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:33.496 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:38:33.493+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:38:33.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:33.582+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:33.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:33.619+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:33.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:33.644+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:33.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:33.655+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:34.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:34.554+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:34.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:34.604+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:34.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:34.650+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:34.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:34.661+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:35.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:35.526+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:35.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:35.590+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:35.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:35.603+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:35.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:35.687+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:36.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:38:36.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:38:36.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:36.511+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:36.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:36.580+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:36.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:36.646+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:36.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:36.654+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:37.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:37.543+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:37.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:37.614+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:37.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:37.663+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:37.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:37.671+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:38.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:38.518+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:38.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:38.639+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:38.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:38.660+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:38.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:38.700+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:39.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:39.547+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:39.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:39.631+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:39.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:39.674+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:39.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:39.746+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:40.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:40.568+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:40.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:40.602+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:40.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:40.696+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:40.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:40.712+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:41.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:41.571+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:41.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:41.606+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:41.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:41.735+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:41.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:41.744+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:42.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:42.569+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:42.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:42.607+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:42.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:42.730+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:42.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:42.737+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:43.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:43.524+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:43.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:43.570+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:43.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:43.700+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:43.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:43.712+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:44.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:44.518+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:44.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:44.560+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:44.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:44.661+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:44.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:44.757+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:45.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:45.551+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:45.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:45.600+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:45.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:45.691+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:45.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:45.791+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:46.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:46.594+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:46.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:46.598+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:46.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:46.716+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:46.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:46.748+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:47.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:47.595+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:47.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:47.643+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:47.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:47.714+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:47.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:47.770+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:48.501 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:38:48.499+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:38:48.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:48.587+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:48.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:48.623+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:48.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:48.730+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:48.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:48.803+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:49.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:49.581+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:49.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:49.612+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:49.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:49.731+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:49.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:49.816+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:50.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:50.576+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:50.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:50.633+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:50.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:50.718+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:50.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:50.775+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:51.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:51.560+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:51.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:51.651+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:51.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:51.699+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:51.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:51.783+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:52.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:52.558+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:52.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:52.671+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:52.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:52.729+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:52.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:52.781+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:53.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:53.532+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:53.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:53.695+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:53.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:53.703+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:53.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:53.824+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:54.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:54.516+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:54.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:54.655+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:54.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:54.659+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:54.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:54.803+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:55.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:55.564+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:55.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:55.672+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:55.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:55.685+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:55.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:55.771+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:56.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:56.528+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:56.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:56.674+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:56.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:56.721+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:56.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:56.729+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:57.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:57.543+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:57.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:57.648+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:57.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:57.762+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:57.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:57.762+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:58.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:58.529+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:58.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:58.687+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:58.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:58.751+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:58.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:58.789+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:59.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:38:59.518+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:59.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:38:59.662+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:59.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:38:59.710+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:38:59.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:38:59.791+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:00.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:00.495+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:00.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:00.615+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:00.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:00.744+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:00.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:00.750+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:01.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:01.518+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:01.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:01.606+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:01.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:01.704+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:01.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:01.766+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:02.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:02.501+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:02.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:02.579+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:02.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:02.710+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:02.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:02.776+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:03.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:03.512+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:03.580 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:39:03.514+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:39:03.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:03.614+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:03.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:03.673+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:03.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:03.768+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:04.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:04.479+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:04.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:04.586+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:04.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:04.657+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:04.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:04.796+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:05.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:05.499+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:05.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:05.601+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:05.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:05.676+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:05.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:05.816+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:06.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:06.534+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:06.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:39:06.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:39:06.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:06.598+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:06.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:06.694+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:06.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:06.818+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:07.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:07.523+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:07.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:07.617+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:07.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:07.742+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:07.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:07.829+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:08.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:08.566+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:08.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:08.619+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:08.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:08.756+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:08.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:08.812+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:09.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:09.598+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:09.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:09.659+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:09.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:09.772+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:09.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:09.797+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:10.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:10.574+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:10.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:10.697+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:10.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:10.734+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:10.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:10.818+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:11.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:11.529+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:11.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:11.655+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:11.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:11.725+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:11.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:11.793+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:12.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:12.530+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:12.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:12.660+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:12.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:12.756+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:12.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:12.758+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:13.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:13.561+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:13.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:13.643+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:13.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:13.735+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:13.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:13.798+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:14.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:14.542+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:14.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:14.642+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:14.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:14.732+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:14.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:14.776+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:15.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:15.560+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:15.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:15.601+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:15.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:15.731+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:15.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:15.751+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:16.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:16.610+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:16.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:16.641+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:16.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:16.768+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:16.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:16.782+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:17.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:17.566+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:17.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:17.596+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:17.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:17.805+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:17.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:17.822+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:18.532 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:39:18.530+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:39:18.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:18.570+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:18.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:18.610+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:18.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:18.803+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:18.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:18.821+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:19.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:19.570+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:19.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:19.660+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:19.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:19.778+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:19.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:19.804+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:20.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:20.600+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:20.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:20.650+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:20.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:20.773+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:20.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:20.786+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:21.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:21.644+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:21.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:21.671+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:21.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:21.773+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:21.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:21.805+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:22.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:22.645+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:22.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:22.659+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:22.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:22.795+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:22.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:22.806+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:23.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:23.671+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:23.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:23.708+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:23.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:23.758+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:23.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:23.792+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:24.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:24.672+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:24.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:24.719+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:24.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:24.756+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:24.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:24.796+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:25.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:25.635+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:25.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:25.692+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:25.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:25.750+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:25.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:25.758+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:26.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:26.640+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:26.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:26.713+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:26.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:26.754+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:26.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:26.782+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:27.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:27.661+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:27.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:27.676+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:27.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:27.716+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:27.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:27.760+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:28.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:28.643+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:28.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:28.682+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:28.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:28.708+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:28.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:28.722+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:29.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:29.683+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:29.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:29.693+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:29.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:29.706+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:29.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:29.752+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:30.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:30.665+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:30.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:30.683+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:30.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:30.694+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:30.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:30.763+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:31.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:31.659+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:31.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:31.660+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:31.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:31.731+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:31.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:31.770+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:32.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:32.652+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:32.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:32.707+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:32.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:32.762+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:32.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:32.790+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:33.538 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:39:33.537+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:39:33.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:33.642+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:33.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:33.744+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:33.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:33.747+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:33.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:33.772+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:34.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:34.638+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:34.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:34.737+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:34.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:34.751+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:34.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:34.793+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:35.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:35.628+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:35.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:35.762+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:35.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:35.777+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:35.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:35.836+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:36.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:36.613+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:36.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:39:36.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:39:36.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:36.799+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:36.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:36.815+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:36.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:36.824+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:37.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:37.614+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:37.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:37.770+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:37.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:37.840+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:37.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:37.852+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:38.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:38.568+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:38.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:38.721+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:38.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:38.795+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:38.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:38.855+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:39.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:39.604+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:39.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:39.675+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:39.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:39.760+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:39.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:39.875+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:40.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:40.579+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:40.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:40.634+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:40.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:40.776+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:40.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:40.835+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:41.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:41.558+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:41.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:41.586+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:41.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:41.816+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:41.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:41.820+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:42.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:42.537+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:42.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:42.567+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:42.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:42.802+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:42.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:42.841+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:43.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:43.518+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:43.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:43.529+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:43.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:43.763+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:43.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:43.839+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:44.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:44.531+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:44.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:44.567+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:44.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:44.748+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:44.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:44.864+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:45.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:45.520+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:45.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:45.524+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:45.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:45.784+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:45.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:45.822+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:46.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:46.546+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:46.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:46.549+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:46.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:46.774+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:46.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:46.856+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:47.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:47.517+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:47.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:47.522+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:47.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:47.771+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:47.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:47.832+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:48.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:48.493+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:48.546 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:39:48.544+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:39:48.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:48.548+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:48.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:48.798+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:48.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:48.833+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:49.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:49.537+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:49.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:49.542+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:49.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:49.794+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:49.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:49.858+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:50.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:50.493+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:50.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:50.493+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:50.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:50.781+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:50.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:50.839+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:51.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:51.505+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:51.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:51.513+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:51.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:51.826+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:51.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:51.886+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:52.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:52.480+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:52.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:52.511+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:52.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:52.801+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:52.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:52.926+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:53.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:53.477+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:53.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:53.560+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:53.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:53.772+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:53.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:53.881+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:54.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:54.473+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:54.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:54.603+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:54.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:54.761+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:54.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:54.896+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:55.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:55.512+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:55.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:55.624+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:55.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:55.753+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:55.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:55.944+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:56.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:56.475+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:56.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:56.577+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:56.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:56.781+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:56.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:56.948+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:57.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:57.470+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:57.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:57.553+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:57.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:57.807+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:57.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:57.925+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:58.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:58.462+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:58.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:58.539+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:58.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:58.839+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:58.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:58.972+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:59.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:39:59.414+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:59.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:39:59.496+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:59.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:39:59.804+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:39:59.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:39:59.954+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:00.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:00.407+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:00.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:00.508+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:00.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:00.791+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:00.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:00.944+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:01.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:01.399+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:01.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:01.523+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:01.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:01.816+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:01.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:01.900+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:02.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:02.399+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:02.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:02.512+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:02.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:02.816+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:02.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:02.901+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:03.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:03.392+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:03.548 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:40:03.545+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:40:03.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:03.562+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:03.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:03.795+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:03.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:03.863+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:04.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:04.442+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:04.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:04.537+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:04.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:04.748+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:04.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:04.850+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:05.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:05.433+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:05.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:05.562+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:05.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:05.782+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:05.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:05.819+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:06.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:06.452+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:06.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:06.573+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:06.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:06.763+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:06.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:06.794+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:06.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:40:06.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:40:07.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:07.468+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:07.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:07.577+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:07.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:07.809+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:07.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:07.828+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:08.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:08.440+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:08.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:08.612+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:08.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:08.772+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:08.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:08.824+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:09.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:09.487+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:09.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:09.656+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:09.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:09.762+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:09.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:09.857+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:10.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:10.452+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:10.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:10.623+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:10.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:10.811+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:10.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:10.864+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:11.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:11.466+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:11.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:11.644+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:11.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:11.851+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:11.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:11.853+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:12.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:12.438+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:12.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:12.600+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:12.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:12.813+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:12.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:12.902+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:13.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:13.415+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:13.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:13.635+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:13.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:13.799+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:13.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:13.858+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:14.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:14.386+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:14.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:14.670+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:14.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:14.803+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:14.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:14.818+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:15.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:15.373+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:15.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:15.678+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:15.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:15.811+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:15.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:15.828+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:16.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:16.357+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:16.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:16.643+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:16.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:16.821+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:16.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:16.827+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:17.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:17.358+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:17.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:17.672+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:17.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:17.809+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:17.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:17.813+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:18.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:18.364+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:18.560 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:40:18.558+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:40:18.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:18.665+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:18.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:18.818+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:18.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:18.828+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:19.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:19.318+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:19.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:19.661+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:19.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:19.808+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:19.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:19.842+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:20.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:20.301+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:20.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:20.622+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:20.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:20.787+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:20.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:20.859+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:21.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:21.276+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:21.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:21.626+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:21.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:21.781+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:21.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:21.847+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:22.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:22.276+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:22.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:22.590+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:22.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:22.797+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:22.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:22.799+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:23.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:23.254+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:23.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:23.541+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:23.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:23.791+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:23.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:23.835+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:24.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:24.297+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:24.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:24.519+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:24.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:24.829+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:24.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:24.835+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:25.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:25.295+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:25.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:25.511+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:25.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:25.790+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:25.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:25.829+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:26.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:26.275+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:26.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:26.468+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:26.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:26.788+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:26.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:26.791+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:27.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:27.321+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:27.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:27.491+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:27.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:27.753+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:27.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:27.806+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:28.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:28.327+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:28.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:28.537+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:28.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:28.741+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:28.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:28.809+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:29.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:29.294+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:29.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:29.553+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:29.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:29.700+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:29.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:29.828+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:30.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:30.248+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:30.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:30.577+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:30.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:30.746+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:30.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:30.785+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:31.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:31.235+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:31.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:31.625+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:31.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:31.736+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:31.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:31.785+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:32.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:32.211+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:32.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:32.625+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:32.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:32.774+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:32.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:32.831+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:33.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:33.226+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:33.576 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:40:33.574+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:40:33.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:33.604+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:33.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:33.804+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:33.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:33.817+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:34.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:34.256+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:34.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:34.558+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:34.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:34.775+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:34.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:34.840+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:35.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:35.283+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:35.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:35.582+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:35.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:35.750+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:35.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:35.856+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:36.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:36.240+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:36.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:36.589+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:36.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:36.752+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:36.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:36.827+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:36.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:40:36.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:40:37.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:37.287+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:37.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:37.559+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:37.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:37.741+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:37.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:37.812+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:38.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:38.255+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:38.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:38.561+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:38.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:38.770+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:38.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:38.830+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:39.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:39.277+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:39.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:39.516+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:39.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:39.778+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:39.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:39.878+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:40.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:40.310+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:40.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:40.551+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:40.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:40.749+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:40.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:40.925+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:41.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:41.312+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:41.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:41.542+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:41.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:41.705+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:41.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:41.877+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:42.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:42.295+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:42.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:42.567+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:42.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:42.750+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:42.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:42.846+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:43.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:43.296+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:43.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:43.566+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:43.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:43.790+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:43.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:43.888+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:44.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:44.284+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:44.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:44.609+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:44.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:44.774+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:44.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:44.873+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:45.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:45.235+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:45.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:45.589+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:45.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:45.745+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:45.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:45.824+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:46.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:46.262+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:46.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:46.542+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:46.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:46.741+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:46.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:46.809+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:47.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:47.296+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:47.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:47.580+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:47.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:47.707+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:47.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:47.774+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:48.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:48.261+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:48.592 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:40:48.591+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:40:48.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:48.595+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:48.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:48.683+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:48.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:48.785+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:49.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:49.309+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:49.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:49.591+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:49.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:49.643+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:49.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:49.790+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:50.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:50.271+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:50.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:50.594+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:50.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:50.619+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:50.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:50.761+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:51.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:51.285+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:51.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:51.581+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:51.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:51.624+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:51.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:51.771+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:52.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:52.240+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:52.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:52.542+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:52.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:52.669+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:52.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:52.747+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:53.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:53.260+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:53.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:53.512+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:53.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:53.702+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:53.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:53.711+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:54.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:54.212+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:54.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:54.470+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:54.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:54.653+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:54.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:54.749+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:55.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:55.232+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:55.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:55.481+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:55.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:55.669+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:55.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:55.790+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:56.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:56.249+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:56.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:56.494+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:56.497 INFO:tasks.ceph.mds.a.smithi049.stderr:2022-04-03T22:40:56.495+0000 7f81dd045700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:40:56.515 INFO:tasks.ceph.mds.a.smithi049.stderr: -1> 2022-04-03T22:40:56.495+0000 7f81dd045700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:40:56.516 INFO:tasks.ceph.mds.a.smithi049.stderr:2022-04-03T22:40:56.496+0000 7f81dc844700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-03T22:40:56.545 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2022-04-03T22:40:56.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:56.691+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:56.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:56.810+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:57.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:57.226+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:57.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:57.522+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:57.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:57.722+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:57.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:57.799+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:58.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:58.197+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:58.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:58.526+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:58.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:58.714+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:58.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:58.846+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:59.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:40:59.161+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:59.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:40:59.483+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:59.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:40:59.685+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:40:59.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:40:59.810+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:00.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:00.168+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:00.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:00.467+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:00.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:00.723+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:00.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:00.847+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:01.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:01.132+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:01.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:01.474+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:01.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:01.706+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:01.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:01.882+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:02.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:02.140+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:02.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:02.434+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:02.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:02.690+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:02.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:02.893+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:03.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:03.115+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:03.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:03.474+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:03.608 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:41:03.606+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:41:03.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:03.709+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:03.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:03.904+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:04.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:04.148+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:04.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:04.494+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:04.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:04.747+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:04.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:04.948+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:05.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:05.125+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:05.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:05.535+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:05.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:05.716+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:05.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:05.957+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:06.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:06.153+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:06.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:06.570+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:06.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:06.726+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:07.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:07.005+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:07.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:41:07.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:41:07.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:07.111+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:07.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:07.606+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:07.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:07.691+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:08.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:08.004+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:08.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:08.137+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:08.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:08.595+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:08.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:08.717+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:09.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:09.025+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:09.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:09.147+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:09.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:09.601+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:09.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:09.687+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:10.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:10.003+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:10.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:10.132+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:10.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:10.587+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:10.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:10.681+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:11.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:11.007+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:11.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:11.108+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:11.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:11.585+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:11.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:11.658+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:11.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:11.978+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:12.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:12.099+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:12.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:12.536+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:12.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:12.622+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:13.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:13.027+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:13.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:13.135+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:13.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:13.577+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:13.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:13.670+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:14.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:14.048+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:14.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:14.111+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:14.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:14.554+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:14.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:14.687+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:15.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:15.031+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:15.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:15.090+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:15.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:15.602+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:15.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:15.720+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:16.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:16.077+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:16.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:16.098+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:16.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:16.622+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:16.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:16.767+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:17.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:17.078+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:17.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:17.119+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:17.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:17.623+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:17.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:17.796+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:18.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:18.090+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:18.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:18.135+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:18.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:18.590+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:18.624 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:41:18.622+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:41:18.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:18.784+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:19.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:19.124+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:19.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:19.182+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:19.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:19.577+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:19.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:19.826+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:20.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:20.087+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:20.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:20.141+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:20.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:20.541+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:20.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:20.832+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:21.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:21.090+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:21.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:21.160+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:21.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:21.516+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:21.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:21.856+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:22.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:22.049+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:22.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:22.118+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:22.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:22.552+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:22.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:22.850+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:23.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:23.074+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:23.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:23.097+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:23.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:23.551+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:23.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:23.847+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:24.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:24.098+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:24.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:24.111+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:24.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:24.541+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:24.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:24.810+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:25.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:25.072+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:25.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:25.158+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:25.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:25.578+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:25.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:25.839+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:26.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:26.074+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:26.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:26.136+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:26.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:26.558+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:26.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:26.841+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:27.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:27.079+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:27.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:27.143+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:27.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:27.551+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:27.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:27.856+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:28.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:28.050+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:28.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:28.134+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:28.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:28.555+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:28.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:28.903+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:29.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:29.013+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:29.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:29.112+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:29.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:29.526+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:29.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:29.936+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:29.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:29.968+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:30.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:30.117+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:30.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:30.549+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:30.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:30.915+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:30.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:30.934+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:31.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:31.128+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:31.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:31.502+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:31.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:31.890+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:31.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:31.931+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:32.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:32.138+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:32.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:32.474+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:32.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:32.852+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:32.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:32.943+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:33.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:33.188+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:33.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:33.482+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:33.640 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:41:33.637+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:41:33.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:33.834+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:33.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:33.905+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:34.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:34.182+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:34.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:34.471+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:34.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:34.857+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:34.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:34.880+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:35.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:35.153+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:35.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:35.459+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:35.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:35.854+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:35.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:35.865+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:36.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:36.168+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:36.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:36.472+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:36.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:36.825+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:36.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:36.834+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:37.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:37.137+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:37.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:41:37.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:41:37.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:37.521+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:37.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:37.837+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:37.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:37.873+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:38.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:38.186+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:38.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:38.516+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:38.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:38.820+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:38.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:38.878+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:39.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:39.161+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:39.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:39.539+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:39.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:39.793+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:39.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:39.890+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:40.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:40.201+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:40.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:40.490+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:40.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:40.794+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:40.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:40.861+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:41.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:41.163+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:41.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:41.523+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:41.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:41.760+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:41.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:41.875+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:42.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:42.152+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:42.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:42.501+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:42.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:42.760+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:42.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:42.842+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:43.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:43.156+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:43.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:43.542+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:43.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:43.750+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:43.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:43.835+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:44.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:44.146+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:44.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:44.564+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:44.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:44.721+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:44.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:44.870+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:45.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:45.099+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:45.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:45.518+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:45.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:45.708+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:45.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:45.827+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:46.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:46.060+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:46.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:46.503+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:46.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:46.690+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:46.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:46.836+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:47.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:47.018+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:47.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:47.479+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:47.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:47.671+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:47.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:47.819+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:48.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:48.030+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:48.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:48.437+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:48.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:48.636+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:48.655 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:41:48.653+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:41:48.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:48.771+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:49.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:49.024+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:49.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:49.455+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:49.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:49.639+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:49.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:49.815+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:50.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:50.054+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:50.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:50.450+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:50.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:50.634+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:50.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:50.822+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:51.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:51.100+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:51.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:51.456+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:51.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:51.609+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:51.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:51.862+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:52.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:52.103+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:52.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:52.466+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:52.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:52.634+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:52.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:52.888+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:53.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:53.140+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:53.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:53.450+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:53.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:53.596+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:53.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:53.873+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:54.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:54.178+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:54.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:54.489+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:54.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:54.578+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:54.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:54.845+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:55.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:55.139+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:55.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:55.523+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:55.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:55.620+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:55.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:55.799+0000 7f6e44c9f700 -1 osd.7 98 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:56.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:56.146+0000 7f389e18e700 -1 osd.4 98 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:56.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:56.552+0000 7f72c425d700 -1 osd.5 98 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:56.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:56.596+0000 7f596d92c700 -1 osd.6 98 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:56.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:56.757+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 36 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:57.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:57.142+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:57.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:57.518+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:57.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:57.573+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:57.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:57.781+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:58.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:58.134+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:58.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:58.526+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:58.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:58.602+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:58.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:58.830+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:59.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:41:59.168+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:59.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:41:59.528+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:59.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:41:59.600+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:41:59.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:41:59.813+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:00.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:00.132+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:00.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:00.519+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:00.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:00.635+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:00.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:00.843+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:01.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:01.142+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:01.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:01.513+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:01.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:01.651+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:01.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:01.880+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:02.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:02.134+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:02.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:02.499+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:02.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:02.604+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:02.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:02.916+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:03.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:03.169+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:03.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:03.525+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:03.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:03.580+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:03.671 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:42:03.670+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:42:03.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:03.915+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:04.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:04.157+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:04.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:04.520+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:04.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:04.573+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:04.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:04.884+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:05.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:05.119+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:05.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:05.512+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:05.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:05.565+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:05.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:05.853+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:06.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:06.140+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:06.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:06.476+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:06.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:06.572+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:06.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:06.829+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:07.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:07.172+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:07.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:42:07.252 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:42:07.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:07.431+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:07.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:07.555+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:07.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:07.851+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:08.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:08.172+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:08.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:08.403+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:08.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:08.535+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:08.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:08.813+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:09.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:09.148+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:09.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:09.367+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:09.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:09.497+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:09.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:09.824+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:10.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:10.172+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:10.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:10.374+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:10.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:10.505+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:10.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:10.785+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:11.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:11.210+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:11.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:11.385+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:11.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:11.552+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:11.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:11.785+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:12.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:12.217+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:12.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:12.365+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:12.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:12.577+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:12.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:12.754+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:13.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:13.211+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:13.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:13.364+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:13.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:13.598+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:13.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:13.755+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:14.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:14.174+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:14.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:14.367+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:14.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:14.576+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:14.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:14.757+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:15.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:15.173+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:15.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:15.333+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:15.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:15.604+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:15.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:15.708+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:16.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:16.143+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:16.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:16.308+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:16.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:16.591+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:16.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:16.672+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:17.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:17.099+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:17.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:17.344+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:17.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:17.612+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:17.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:17.646+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:18.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:18.087+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:18.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:18.324+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:18.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:18.612+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:18.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:18.658+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:18.688 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:42:18.686+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:42:19.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:19.045+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:19.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:19.333+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:19.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:19.628+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:19.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:19.698+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:20.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:20.047+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:20.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:20.290+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:20.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:20.620+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:20.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:20.748+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:21.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:21.049+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:21.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:21.242+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:21.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:21.645+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:21.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:21.758+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:22.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:22.075+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:22.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:22.275+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:22.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:22.658+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:22.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:22.768+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:23.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:23.107+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:23.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:23.271+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:23.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:23.665+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:23.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:23.723+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:24.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:24.136+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:24.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:24.268+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:24.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:24.643+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:24.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:24.764+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:25.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:25.100+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:25.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:25.226+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:25.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:25.684+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:25.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:25.784+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:26.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:26.056+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:26.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:26.241+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:26.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:26.685+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:26.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:26.804+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:27.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:27.016+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:27.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:27.236+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:27.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:27.644+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:27.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:27.767+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:28.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:28.053+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:28.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:28.210+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:28.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:28.671+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:28.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:28.731+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:29.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:29.077+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:29.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:29.217+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:29.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:29.648+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:29.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:29.742+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:30.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:30.122+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:30.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:30.181+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:30.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:30.642+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:30.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:30.726+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:31.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:31.100+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:31.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:31.218+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:31.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:31.604+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:31.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:31.725+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:32.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:32.142+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:32.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:32.226+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:32.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:32.610+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:32.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:32.765+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:33.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:33.134+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:33.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:33.215+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:33.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:33.580+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:33.706 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:42:33.694+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:42:33.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:33.732+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:34.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:34.167+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:34.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:34.259+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:34.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:34.623+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:34.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:34.722+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:35.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:35.183+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:35.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:35.221+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:35.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:35.648+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:35.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:35.698+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:36.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:36.145+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:36.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:36.248+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:36.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:36.688+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:36.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:36.744+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:37.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:37.149+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:37.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:37.286+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:37.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:42:37.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:42:37.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:37.713+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:37.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:37.785+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:38.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:38.154+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:38.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:38.281+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:38.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:38.756+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:38.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:38.793+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:39.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:39.162+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:39.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:39.302+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:39.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:39.755+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:39.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:39.800+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:40.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:40.201+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:40.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:40.330+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:40.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:40.750+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:40.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:40.774+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:41.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:41.204+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:41.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:41.303+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:41.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:41.770+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:41.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:41.786+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:42.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:42.206+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:42.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:42.255+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:42.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:42.771+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:42.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:42.799+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:43.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:43.229+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:43.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:43.256+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:43.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:43.729+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:43.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:43.788+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:44.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:44.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:44.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:44.299+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:44.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:44.697+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:44.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:44.798+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:45.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:45.257+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:45.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:45.265+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:45.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:45.701+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:45.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:45.796+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:46.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:46.236+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:46.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:46.268+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:46.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:46.685+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:46.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:46.813+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:47.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:47.225+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:47.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:47.265+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:47.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:47.637+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:47.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:47.824+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:48.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:48.206+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:48.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:48.283+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:48.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:48.636+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:48.711 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:42:48.709+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:42:48.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:48.853+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:49.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:49.200+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:49.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:49.323+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:49.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:49.680+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:49.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:49.831+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:50.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:50.222+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:50.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:50.296+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:50.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:50.710+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:50.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:50.854+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:51.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:51.204+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:51.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:51.265+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:51.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:51.685+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:51.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:51.902+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:52.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:52.167+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:52.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:52.226+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:52.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:52.702+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:52.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:52.865+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:53.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:53.182+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:53.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:53.213+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:53.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:53.663+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:53.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:53.896+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:54.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:54.185+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:54.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:54.201+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:54.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:54.653+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:54.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:54.927+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:55.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:55.140+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:55.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:55.158+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:55.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:55.675+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:55.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:55.948+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:56.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:56.109+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:56.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:56.125+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:56.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:56.641+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:56.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:56.906+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:57.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:57.113+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:57.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:57.114+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:57.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:57.602+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:57.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:57.914+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:58.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:58.073+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:58.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:58.154+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:58.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:58.555+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:58.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:58.939+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:59.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:42:59.105+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:59.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:42:59.190+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:59.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:42:59.515+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:42:59.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:42:59.974+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:00.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:00.067+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:00.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:00.174+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:00.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:00.537+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:01.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:01.005+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:01.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:01.030+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:01.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:01.224+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:01.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:01.554+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:02.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:02.008+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:02.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:02.027+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:02.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:02.256+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:02.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:02.517+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:02.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:02.968+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:03.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:03.008+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:03.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:03.274+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:03.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:03.541+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:03.727 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:43:03.725+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:43:03.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:03.990+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:04.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:04.001+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:04.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:04.237+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:04.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:04.512+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:04.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:04.963+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:05.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:04.998+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:05.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:05.235+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:05.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:05.486+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:05.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:05.922+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:05.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:05.975+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:06.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:06.272+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:06.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:06.486+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:06.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:06.943+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:07.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:07.024+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:07.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:07.315+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:07.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:43:07.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:43:07.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:07.536+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:07.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:07.954+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:08.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:08.035+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:08.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:08.312+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:08.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:08.573+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:08.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:08.997+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:09.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:08.998+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:09.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:09.302+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:09.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:09.607+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:09.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:09.995+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:10.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:10.024+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:10.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:10.277+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:10.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:10.611+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:10.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:10.962+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:11.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:11.009+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:11.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:11.310+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:11.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:11.600+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:11.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:11.949+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:11.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:11.996+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:12.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:12.351+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:12.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:12.634+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:12.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:12.912+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:12.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:12.977+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:13.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:13.370+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:13.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:13.647+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:13.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:13.934+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:14.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:14.024+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:14.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:14.322+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:14.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:14.662+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:14.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:14.964+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:15.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:15.012+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:15.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:15.339+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:15.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:15.694+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:15.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:15.915+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:16.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:16.013+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:16.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:16.346+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:16.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:16.699+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:16.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:16.902+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:17.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:17.053+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:17.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:17.355+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:17.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:17.664+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:17.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:17.946+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:18.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:18.017+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:18.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:18.311+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:18.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:18.650+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:18.743 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:43:18.741+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:43:18.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:18.980+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:19.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:19.059+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:19.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:19.351+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:19.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:19.671+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:19.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:19.985+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:20.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:20.092+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:20.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:20.330+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:20.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:20.681+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:20.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:20.948+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:21.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:21.140+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:21.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:21.335+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:21.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:21.720+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:21.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:21.970+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:22.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:22.108+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:22.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:22.294+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:22.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:22.748+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:22.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:22.957+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:23.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:23.086+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:23.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:23.340+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:23.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:23.794+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:23.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:23.927+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:24.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:24.101+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:24.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:24.351+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:24.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:24.778+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:24.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:24.971+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:25.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:25.129+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:25.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:25.316+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:25.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:25.801+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:26.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:26.003+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:26.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:26.136+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:26.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:26.336+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:26.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:26.848+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:27.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:27.048+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:27.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:27.140+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:27.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:27.306+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:27.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:27.839+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:28.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:28.029+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:28.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:28.131+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:28.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:28.265+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:28.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:28.872+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:29.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:29.008+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:29.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:29.165+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:29.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:29.307+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:29.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:29.873+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:30.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:30.016+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:30.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:30.126+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:30.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:30.273+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:30.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:30.881+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:31.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:31.033+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:31.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:31.109+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:31.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:31.304+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:31.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:31.875+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:32.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:32.025+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:32.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:32.140+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:32.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:32.293+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:32.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:32.829+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:33.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:33.044+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:33.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:33.107+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:33.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:33.312+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:33.759 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:43:33.757+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:43:33.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:33.877+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:34.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:34.008+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:34.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:34.125+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:34.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:34.275+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:34.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:34.918+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:35.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:35.046+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:35.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:35.131+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:35.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:35.244+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:35.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:35.907+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:36.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:36.058+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:36.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:36.175+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:36.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:36.290+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:36.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:36.885+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:37.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:37.053+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:37.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:37.184+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:37.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:37.302+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:37.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:43:37.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:43:37.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:37.841+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:38.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:38.031+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:38.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:38.139+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:38.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:38.350+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:38.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:38.807+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:39.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:39.072+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:39.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:39.114+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:39.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:39.345+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:39.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:39.856+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:40.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:40.068+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:40.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:40.104+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:40.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:40.348+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:40.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:40.833+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:41.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:41.092+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:41.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:41.145+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:41.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:41.309+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:41.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:41.868+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:42.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:42.047+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:42.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:42.179+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:42.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:42.354+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:42.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:42.895+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:43.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:43.019+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:43.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:43.152+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:43.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:43.365+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:43.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:43.877+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:44.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:44.059+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:44.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:44.190+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:44.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:44.366+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:44.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:44.923+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:45.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:45.102+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:45.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:45.194+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:45.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:45.407+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:45.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:45.966+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:46.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:46.144+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:46.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:46.144+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:46.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:46.443+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:46.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:46.924+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:47.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:47.119+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:47.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:47.183+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:47.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:47.427+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:47.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:47.943+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:48.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:48.076+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:48.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:48.169+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:48.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:48.454+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:48.775 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:43:48.774+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:43:48.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:48.907+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:49.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:49.080+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:49.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:49.125+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:49.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:49.412+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:49.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:49.858+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:50.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:50.069+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:50.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:50.139+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:50.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:50.446+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:50.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:50.860+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:51.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:51.100+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:51.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:51.100+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:51.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:51.474+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:51.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:51.903+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:52.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:52.060+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:52.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:52.084+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:52.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:52.432+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:52.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:52.931+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:53.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:53.096+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:53.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:53.097+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:53.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:53.473+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:53.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:53.886+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:54.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:54.052+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:54.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:54.067+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:54.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:54.441+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:54.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:54.896+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:55.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:55.069+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:55.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:55.072+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:55.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:55.410+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:55.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:55.910+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:56.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:56.054+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:56.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:56.094+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:56.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:56.428+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:56.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:56.929+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:57.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:57.076+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:57.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:57.081+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:57.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:57.475+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:57.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:57.951+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:58.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:58.064+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:58.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:58.078+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:58.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:58.485+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:58.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:58.995+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:59.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:43:59.037+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:59.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:43:59.069+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:59.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:43:59.440+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:43:59.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:43:59.994+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:00.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:00.051+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:00.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:00.111+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:00.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:00.396+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:01.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:01.010+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:01.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:01.017+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:01.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:01.114+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:01.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:01.427+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:01.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:01.980+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:02.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:02.022+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:02.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:02.079+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:02.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:02.453+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:03.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:03.002+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:03.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:03.061+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:03.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:03.088+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:03.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:03.481+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:03.791 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:44:03.789+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:44:03.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:03.991+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:04.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:04.045+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:04.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:04.089+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:04.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:04.444+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:04.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:04.989+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:05.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:05.084+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:05.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:05.084+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:05.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:05.466+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:06.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:06.023+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:06.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:06.097+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:06.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:06.117+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:06.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:06.515+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:07.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:07.002+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:07.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:07.073+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:07.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:07.162+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:07.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:07.535+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:07.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:44:07.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:44:07.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:07.976+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:08.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:08.092+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:08.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:08.144+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:08.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:08.495+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:09.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:09.014+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:09.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:09.107+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:09.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:09.127+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:09.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:09.457+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:09.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:09.969+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:10.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:10.111+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:10.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:10.126+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:10.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:10.491+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:10.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:10.923+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:11.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:11.079+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:11.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:11.149+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:11.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:11.454+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:11.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:11.971+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:12.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:12.094+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:12.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:12.140+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:12.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:12.424+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:12.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:12.941+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:13.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:13.070+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:13.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:13.172+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:13.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:13.459+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:13.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:13.986+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:14.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:14.056+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:14.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:14.127+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:14.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:14.424+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:14.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:14.996+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:15.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:15.048+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:15.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:15.161+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:15.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:15.405+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:16.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:16.009+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:16.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:16.053+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:16.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:16.185+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:16.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:16.414+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:17.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:17.007+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:17.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:17.085+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:17.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:17.136+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:17.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:17.399+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:17.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:17.985+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:18.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:18.101+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:18.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:18.149+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:18.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:18.396+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:18.795 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:44:18.793+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:44:19.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:19.005+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:19.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:19.056+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:19.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:19.148+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:19.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:19.385+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:19.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:19.956+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:20.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:20.088+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:20.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:20.189+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:20.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:20.341+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:21.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:21.002+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:21.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:21.091+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:21.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:21.179+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:21.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:21.369+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:22.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:22.039+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:22.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:22.112+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:22.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:22.185+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:22.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:22.368+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:23.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:23.000+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:23.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:23.109+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:23.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:23.169+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:23.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:23.360+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:23.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:23.957+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:24.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:24.060+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:24.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:24.163+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:24.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:24.324+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:25.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:25.001+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:25.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:25.084+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:25.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:25.172+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:25.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:25.328+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:26.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:26.023+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:26.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:26.124+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:26.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:26.220+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:26.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:26.299+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:26.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:26.990+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:27.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:27.135+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:27.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:27.219+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:27.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:27.346+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:28.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:27.999+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:28.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:28.103+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:28.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:28.232+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:28.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:28.306+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:28.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:28.954+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:29.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:29.132+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:29.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:29.241+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:29.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:29.283+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:29.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:29.979+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:30.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:30.159+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:30.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:30.219+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:30.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:30.293+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:30.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:30.975+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:31.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:31.181+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:31.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:31.262+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:31.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:31.326+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:31.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:31.952+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:32.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:32.222+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:32.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:32.306+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:32.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:32.311+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:32.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:32.939+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:33.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:33.260+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:33.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:33.308+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:33.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:33.314+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:33.811 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:44:33.809+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:44:33.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:33.925+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:34.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:34.229+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:34.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:34.284+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:34.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:34.352+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:34.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:34.963+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:35.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:35.251+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:35.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:35.316+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:35.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:35.337+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:35.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:35.975+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:36.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:36.250+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:36.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:36.275+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:36.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:36.366+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:36.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:36.974+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:37.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:37.229+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:37.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:37.298+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:37.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:37.346+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:37.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:44:37.805 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:44:37.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:37.990+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:38.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:38.207+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:38.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:38.289+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:38.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:38.302+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:38.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:38.954+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:39.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:39.188+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:39.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:39.242+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:39.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:39.297+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:39.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:39.915+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:40.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:40.147+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:40.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:40.233+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:40.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:40.280+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:40.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:40.878+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:41.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:41.170+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:41.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:41.232+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:41.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:41.237+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:41.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:41.874+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:42.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:42.122+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:42.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:42.235+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:42.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:42.261+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:42.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:42.853+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:43.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:43.083+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:43.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:43.252+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:43.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:43.301+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:43.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:43.863+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:44.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:44.120+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:44.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:44.256+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:44.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:44.278+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:44.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:44.844+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:45.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:45.124+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:45.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:45.224+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:45.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:45.230+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:45.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:45.884+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:46.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:46.150+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:46.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:46.223+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:46.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:46.267+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:46.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:46.836+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:47.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:47.120+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:47.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:47.273+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:47.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:47.285+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:47.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:47.792+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:48.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:48.123+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:48.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:48.231+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:48.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:48.260+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:48.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:48.785+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:48.827 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:44:48.825+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:44:49.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:49.146+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:49.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:49.213+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:49.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:49.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:49.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:49.740+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:50.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:50.116+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:50.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:50.175+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:50.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:50.249+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:50.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:50.762+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:51.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:51.119+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:51.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:51.195+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:51.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:51.290+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:51.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:51.760+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:52.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:52.144+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:52.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:52.179+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:52.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:52.290+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:52.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:52.762+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:53.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:53.167+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:53.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:53.189+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:53.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:53.319+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:53.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:53.801+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:54.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:54.157+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:54.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:54.164+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:54.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:54.332+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:54.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:54.765+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:55.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:55.172+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:55.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:55.193+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:55.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:55.373+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:55.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:55.739+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:56.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:56.141+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:56.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:56.160+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 33 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:56.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:56.327+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:56.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:56.740+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 4 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:57.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:57.145+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:57.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:57.186+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:57.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:57.308+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:57.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:57.735+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:58.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:58.128+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:58.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:58.150+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:58.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:58.278+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:58.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:58.758+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:59.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:44:59.163+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:59.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:44:59.181+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:59.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:44:59.279+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:44:59.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:44:59.802+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:00.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:00.138+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:00.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:00.199+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:00.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:00.287+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:00.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:00.809+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:01.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:01.164+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:01.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:01.239+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:01.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:01.244+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:01.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:01.827+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:02.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:02.170+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:02.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:02.212+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:02.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:02.280+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:02.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:02.864+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:03.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:03.169+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:03.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:03.229+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:03.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:03.275+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:03.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:03.825+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:03.843 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:45:03.842+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:45:04.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:04.122+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:04.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:04.205+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:04.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:04.237+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:04.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:04.866+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:05.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:05.144+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:05.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:05.234+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:05.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:05.258+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:05.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:05.831+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:06.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:06.136+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:06.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:06.222+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:06.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:06.279+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:06.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:06.858+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:07.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:07.120+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:07.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:07.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:07.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:07.245+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:07.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:07.813+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:07.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:45:07.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:45:08.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:08.110+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:08.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:08.229+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:08.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:08.258+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:08.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:08.806+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:09.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:09.152+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:09.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:09.214+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:09.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:09.268+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:09.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:09.800+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:10.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:10.181+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:10.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:10.235+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:10.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:10.300+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:10.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:10.805+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:11.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:11.179+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:11.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:11.201+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:11.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:11.282+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:11.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:11.831+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:12.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:12.191+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:12.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:12.204+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:12.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:12.321+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:12.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:12.792+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:13.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:13.153+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:13.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:13.233+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:13.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:13.274+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:13.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:13.746+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:14.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:14.201+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:14.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:14.211+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:14.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:14.258+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:14.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:14.765+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:15.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:15.174+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:15.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:15.177+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:15.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:15.221+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:15.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:15.797+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:16.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:16.134+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:16.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:16.188+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:16.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:16.242+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:16.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:16.843+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:17.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:17.150+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:17.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:17.203+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:17.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:17.276+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:17.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:17.794+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:18.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:18.102+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:18.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:18.169+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:18.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:18.315+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:18.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:18.796+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:18.857 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:45:18.855+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:45:19.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:19.118+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:19.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:19.211+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:19.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:19.308+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:19.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:19.827+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:20.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:20.082+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:20.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:20.192+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:20.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:20.286+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:20.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:20.842+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:21.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:21.109+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:21.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:21.225+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:21.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:21.263+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:21.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:21.876+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:22.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:22.127+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:22.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:22.205+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:22.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:22.280+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:22.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:22.905+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:23.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:23.173+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:23.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:23.189+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:23.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:23.246+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:23.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:23.871+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:24.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:24.144+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:24.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:24.153+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:24.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:24.277+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:24.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:24.888+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:25.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:25.131+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:25.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:25.149+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:25.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:25.319+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:25.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:25.936+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:26.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:26.087+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:26.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:26.164+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:26.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:26.311+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:26.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:26.900+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:27.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:27.045+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:27.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:27.156+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:27.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:27.299+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:27.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:27.881+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:28.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:28.008+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:28.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:28.154+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:28.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:28.265+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:28.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:28.913+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:29.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:29.018+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:29.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:29.151+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:29.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:29.258+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:29.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:29.900+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:30.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:30.046+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:30.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:30.161+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:30.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:30.283+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:30.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:30.938+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:31.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:30.999+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:31.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:31.122+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:31.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:31.269+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:31.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:31.932+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:31.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:31.950+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:32.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:32.131+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:32.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:32.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:32.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:32.908+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:32.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:32.930+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:33.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:33.172+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:33.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:33.214+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:33.867 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:45:33.866+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:45:33.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:33.902+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:33.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:33.959+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:34.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:34.205+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:34.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:34.234+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:34.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:34.942+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:34.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:34.973+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:35.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:35.208+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:35.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:35.264+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:35.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:35.905+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:36.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:36.016+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:36.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:36.187+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:36.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:36.285+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:36.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:36.886+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:37.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:37.004+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:37.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:37.229+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:37.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:37.283+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:37.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:37.858+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:37.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:37.985+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:38.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:45:38.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:45:38.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:38.182+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:38.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:38.298+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:38.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:38.866+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:39.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:39.023+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:39.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:39.172+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:39.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:39.268+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:39.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:39.869+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:40.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:40.051+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:40.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:40.198+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:40.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:40.310+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:40.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:40.879+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:41.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:41.051+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:41.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:41.159+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:41.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:41.302+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:41.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:41.883+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:42.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:42.003+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:42.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:42.175+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:42.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:42.257+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:42.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:42.848+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:43.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:43.040+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:43.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:43.130+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:43.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:43.249+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:43.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:43.881+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:44.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:44.042+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:44.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:44.144+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:44.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:44.241+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:44.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:44.909+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:45.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:45.007+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:45.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:45.126+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:45.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:45.248+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:45.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:45.925+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:45.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:45.959+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:46.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:46.081+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:46.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:46.219+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:46.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:46.924+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:46.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:46.941+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:47.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:47.118+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:47.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:47.268+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:47.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:47.882+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:47.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:47.975+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:48.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:48.094+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:48.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:48.243+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:48.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:48.843+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:48.883 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:45:48.881+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:45:48.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:48.993+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:49.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:49.076+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:49.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:49.269+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:49.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:49.889+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:49.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:49.987+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:50.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:50.102+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:50.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:50.275+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:50.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:50.873+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:51.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:51.026+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:51.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:51.085+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:51.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:51.233+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:51.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:51.894+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:52.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:52.009+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:52.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:52.043+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:52.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:52.208+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:52.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:52.869+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:53.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:53.033+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:53.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:53.057+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:53.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:53.241+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:53.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:53.852+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:54.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:54.034+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:54.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:54.063+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:54.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:54.201+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:54.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:54.878+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:55.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:55.025+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:55.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:55.056+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:55.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:55.185+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:55.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:55.849+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:56.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:56.067+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:56.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:56.075+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:56.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:56.193+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:56.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:56.837+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:57.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:57.103+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:57.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:57.122+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:57.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:57.179+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:57.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:57.829+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:58.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:58.065+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:58.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:58.094+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:58.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:58.197+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:58.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:58.796+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:59.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:45:59.090+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:59.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:45:59.114+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:59.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:45:59.157+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:45:59.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:45:59.768+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:00.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:00.076+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:00.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:00.155+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:00.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:00.182+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:00.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:00.768+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:01.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:01.041+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:01.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:01.114+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:01.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:01.215+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:01.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:01.811+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:02.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:02.009+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:02.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:02.155+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:02.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:02.251+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:02.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:02.762+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:02.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:02.973+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:03.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:03.125+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:03.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:03.230+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:03.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:03.746+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:03.899 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:46:03.897+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:46:04.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:04.018+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:04.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:04.137+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:04.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:04.214+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:04.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:04.698+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:05.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:05.036+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:05.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:05.139+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:05.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:05.249+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:05.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:05.686+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:06.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:06.063+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:06.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:06.176+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:06.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:06.297+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:06.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:06.711+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:07.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:07.087+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:07.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:07.225+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:07.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:07.255+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:07.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:07.664+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:08.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:08.126+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:08.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:46:08.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:46:08.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:08.190+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:08.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:08.231+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:08.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:08.617+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:09.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:09.120+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:09.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:09.142+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:09.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:09.184+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:09.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:09.612+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:10.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:10.143+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:10.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:10.148+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:10.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:10.155+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:10.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:10.589+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:11.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:11.168+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:11.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:11.168+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:11.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:11.184+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:11.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:11.632+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:12.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:12.145+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:12.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:12.154+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:12.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:12.179+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:12.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:12.648+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:13.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:13.116+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:13.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:13.142+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:13.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:13.168+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:13.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:13.623+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:14.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:14.143+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:14.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:14.145+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:14.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:14.178+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:14.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:14.610+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:15.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:15.127+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:15.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:15.180+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:15.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:15.225+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:15.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:15.588+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:16.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:16.079+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:16.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:16.214+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:16.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:16.225+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:16.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:16.562+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:17.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:17.074+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:17.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:17.193+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:17.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:17.253+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:17.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:17.551+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:18.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:18.064+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:18.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:18.213+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:18.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:18.215+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:18.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:18.566+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:18.915 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:46:18.914+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:46:19.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:19.047+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:19.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:19.175+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:19.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:19.263+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:19.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:19.606+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:20.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:20.001+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:20.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:20.203+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:20.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:20.226+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:20.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:20.641+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:20.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:20.975+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:21.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:21.162+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:21.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:21.255+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:21.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:21.663+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:21.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:21.967+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:22.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:22.182+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:22.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:22.299+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:22.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:22.671+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:22.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:22.958+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:23.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:23.137+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:23.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:23.286+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:23.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:23.685+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:23.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:23.921+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:24.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:24.155+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:24.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:24.289+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:24.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:24.723+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:24.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:24.930+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:25.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:25.162+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:25.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:25.255+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:25.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:25.764+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:25.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:25.928+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:26.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:26.145+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:26.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:26.269+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:26.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:26.743+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:26.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:26.881+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:27.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:27.107+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:27.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:27.243+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:27.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:27.791+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:27.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:27.851+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:28.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:28.062+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:28.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:28.262+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:28.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:28.784+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:28.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:28.848+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:29.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:29.049+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:29.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:29.260+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:29.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:29.788+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:29.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:29.877+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:30.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:30.010+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:30.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:30.242+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:30.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:30.779+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:30.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:30.837+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:31.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:31.019+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:31.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:31.224+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:31.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:31.810+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:31.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:31.844+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:32.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:32.009+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:32.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:32.271+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:32.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:32.818+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:32.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:32.820+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:33.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:32.999+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:33.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:33.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:33.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:33.828+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:33.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:33.847+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:33.931 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:46:33.929+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:46:33.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:33.972+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:34.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:34.196+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:34.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:34.806+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:34.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:34.817+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:35.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:35.022+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:35.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:35.215+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:35.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:35.777+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:35.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:35.797+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:36.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:36.014+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:36.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:36.170+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:36.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:36.771+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:36.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:36.815+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:37.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:37.062+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:37.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:37.140+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:37.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:37.729+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:37.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:37.801+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:38.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:38.059+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:38.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:38.161+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:38.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:46:38.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:46:38.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:38.724+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:38.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:38.822+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:39.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:39.060+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:39.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:39.128+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:39.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:39.714+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:39.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:39.797+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:40.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:40.015+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:40.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:40.108+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:40.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:40.665+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:40.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:40.803+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:41.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:41.030+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:41.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:41.140+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:41.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:41.625+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:41.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:41.817+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:41.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:41.988+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:42.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:42.099+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:42.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:42.607+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:42.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:42.771+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:43.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:43.004+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:43.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:43.116+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:43.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:43.614+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:43.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:43.730+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:44.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:44.017+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:44.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:44.134+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:44.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:44.570+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:44.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:44.740+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:45.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:45.016+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:45.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:45.184+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:45.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:45.546+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:45.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:45.730+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:46.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:46.043+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:46.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:46.143+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:46.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:46.511+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:46.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:46.750+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:47.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:47.016+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:47.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:47.188+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:47.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:47.546+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:47.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:47.707+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:48.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:48.060+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:48.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:48.166+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:48.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:48.505+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:48.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:48.664+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:48.942 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:46:48.941+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:46:49.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:49.039+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:49.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:49.179+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:49.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:49.539+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:49.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:49.681+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:50.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:50.085+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:50.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:50.135+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:50.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:50.565+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:50.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:50.637+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:51.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:51.104+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:51.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:51.140+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:51.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:51.578+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:51.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:51.589+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:52.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:52.131+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:52.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:52.149+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:52.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:52.561+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:52.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:52.602+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:53.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:53.148+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:53.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:53.169+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:53.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:53.536+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:53.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:53.639+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:54.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:54.136+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:54.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:54.217+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:54.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:54.528+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:54.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:54.593+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:55.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:55.120+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:55.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:55.230+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:55.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:55.498+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:55.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:55.592+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:56.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:56.132+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:56.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:56.231+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:56.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:56.465+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:56.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:56.549+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:57.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:57.094+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:57.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:57.199+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:57.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:57.454+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:57.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:57.513+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:58.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:58.140+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:58.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:58.176+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:58.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:58.487+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:58.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:58.497+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:59.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:46:59.120+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:59.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:46:59.135+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:59.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:46:59.478+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:46:59.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:46:59.510+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:00.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:00.107+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:00.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:00.128+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:00.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:00.472+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:00.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:00.502+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:01.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:01.087+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:01.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:01.121+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:01.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:01.446+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:01.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:01.538+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:02.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:02.087+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:02.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:02.090+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:02.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:02.441+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:02.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:02.489+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:03.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:03.091+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:03.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:03.116+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:03.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:03.470+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:03.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:03.520+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:03.958 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:47:03.955+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:47:04.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:04.097+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:04.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:04.103+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:04.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:04.505+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:04.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:04.553+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:05.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:05.100+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:05.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:05.143+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:05.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:05.466+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:05.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:05.541+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:06.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:06.118+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:06.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:06.118+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:06.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:06.439+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:06.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:06.529+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:07.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:07.089+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:07.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:07.122+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:07.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:07.416+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:07.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:07.535+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:08.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:08.116+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:08.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:08.126+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:08.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:47:08.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:47:08.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:08.401+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:08.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:08.513+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:09.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:09.104+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:09.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:09.131+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:09.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:09.357+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:09.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:09.516+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:10.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:10.120+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:10.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:10.143+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:10.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:10.331+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:10.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:10.526+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:11.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:11.093+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:11.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:11.116+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:11.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:11.328+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:11.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:11.514+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:12.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:12.075+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:12.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:12.116+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:12.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:12.294+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:12.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:12.555+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:13.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:13.079+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:13.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:13.082+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:13.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:13.307+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:13.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:13.540+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:14.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:14.100+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:14.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:14.114+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:14.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:14.345+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:14.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:14.584+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:15.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:15.083+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:15.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:15.102+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:15.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:15.388+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:15.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:15.575+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:16.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:16.078+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:16.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:16.126+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:16.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:16.384+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:16.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:16.531+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:17.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:17.030+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:17.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:17.092+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:17.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:17.351+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:17.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:17.534+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:18.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:18.043+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:18.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:18.133+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:18.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:18.399+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:18.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:18.564+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:18.974 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:47:18.971+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:47:19.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:19.085+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:19.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:19.116+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:19.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:19.386+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:19.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:19.558+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:20.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:20.068+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:20.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:20.094+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:20.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:20.399+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:20.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:20.578+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:21.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:21.101+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:21.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:21.129+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:21.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:21.362+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:21.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:21.552+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:22.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:22.149+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:22.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:22.162+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:22.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:22.337+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:22.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:22.543+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:23.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:23.105+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:23.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:23.208+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:23.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:23.364+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:23.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:23.583+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:24.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:24.131+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:24.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:24.162+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:24.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:24.398+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:24.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:24.598+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:25.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:25.124+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:25.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:25.133+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:25.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:25.418+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:25.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:25.586+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:26.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:26.138+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:26.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:26.154+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:26.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:26.441+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:26.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:26.553+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:27.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:27.153+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:27.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:27.202+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:27.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:27.428+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:27.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:27.563+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:28.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:28.103+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:28.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:28.220+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:28.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:28.473+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:28.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:28.536+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:29.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:29.137+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:29.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:29.244+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:29.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:29.467+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:29.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:29.551+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:30.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:30.118+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:30.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:30.255+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:30.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:30.439+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:30.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:30.564+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:31.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:31.151+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:31.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:31.278+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:31.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:31.393+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:31.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:31.538+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:32.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:32.110+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:32.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:32.231+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:32.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:32.440+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:32.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:32.578+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:33.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:33.067+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:33.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:33.214+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:33.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:33.452+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:33.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:33.606+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:33.990 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:47:33.988+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:47:34.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:34.112+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:34.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:34.171+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:34.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:34.418+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:34.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:34.652+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:35.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:35.128+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:35.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:35.162+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:35.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:35.426+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:35.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:35.628+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:36.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:36.082+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:36.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:36.120+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:36.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:36.389+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:36.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:36.649+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:37.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:37.070+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:37.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:37.079+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:37.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:37.361+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:37.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:37.699+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:38.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:38.068+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:38.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:38.081+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:38.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:38.351+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:38.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:47:38.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:47:38.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:38.740+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:39.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:39.063+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:39.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:39.103+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:39.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:39.303+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:39.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:39.759+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:40.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:40.036+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:40.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:40.082+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:40.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:40.342+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:40.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:40.728+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:41.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:41.045+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:41.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:41.083+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:41.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:41.357+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:41.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:41.711+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:42.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:42.057+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:42.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:42.090+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:42.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:42.384+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:42.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:42.687+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:43.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:43.064+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:43.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:43.131+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:43.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:43.372+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:43.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:43.661+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:44.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:44.070+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:44.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:44.173+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:44.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:44.347+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:44.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:44.685+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:45.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:45.024+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:45.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:45.155+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:45.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:45.317+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:45.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:45.669+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:46.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:46.061+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:46.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:46.119+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:46.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:46.317+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:46.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:46.620+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:47.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:47.078+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:47.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:47.091+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:47.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:47.300+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:47.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:47.571+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:48.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:48.038+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:48.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:48.067+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:48.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:48.312+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:48.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:48.614+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:49.006 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:47:49.003+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:47:49.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:49.053+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:49.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:49.067+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:49.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:49.269+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:49.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:49.604+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:50.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:50.062+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:50.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:50.079+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:50.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:50.238+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:50.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:50.556+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:51.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:51.045+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:51.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:51.068+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:51.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:51.203+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:51.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:51.605+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:52.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:52.026+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:52.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:52.095+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:52.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:52.228+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:52.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:52.594+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:53.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:53.030+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:53.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:53.131+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:53.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:53.204+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:53.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:53.629+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:54.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:54.045+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:54.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:54.100+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:54.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:54.223+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:54.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:54.614+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:55.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:55.092+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:55.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:55.146+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:55.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:55.231+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:55.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:55.631+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:56.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:56.068+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:56.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:56.152+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:56.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:56.239+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:56.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:56.616+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:57.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:57.104+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:57.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:57.200+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:57.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:57.227+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:57.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:57.643+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:58.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:58.139+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:58.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:58.224+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:58.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:58.253+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:58.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:58.612+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:59.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:47:59.187+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:59.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:47:59.204+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:59.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:47:59.240+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:47:59.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:47:59.582+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:00.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:00.157+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:00.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:00.243+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:00.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:00.281+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:00.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:00.559+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:01.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:01.155+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:01.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:01.271+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:01.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:01.273+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:01.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:01.599+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:02.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:02.129+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:02.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:02.236+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:02.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:02.314+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:02.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:02.613+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:03.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:03.166+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:03.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:03.267+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:03.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:03.333+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:03.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:03.589+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:04.021 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:48:04.020+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:48:04.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:04.206+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:04.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:04.233+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:04.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:04.366+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:04.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:04.640+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:05.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:05.216+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:05.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:05.256+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:05.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:05.408+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:05.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:05.648+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:06.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:06.186+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:06.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:06.229+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:06.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:06.430+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:06.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:06.635+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:07.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:07.213+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:07.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:07.228+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:07.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:07.470+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:07.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:07.627+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:08.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:08.212+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:08.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:08.252+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:08.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:08.492+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:08.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:48:08.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:48:08.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:08.628+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:09.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:09.174+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:09.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:09.218+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:09.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:09.479+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:09.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:09.666+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:10.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:10.152+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:10.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:10.178+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:10.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:10.502+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:10.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:10.622+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:11.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:11.136+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:11.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:11.173+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:11.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:11.482+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:11.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:11.636+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:12.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:12.145+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:12.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:12.192+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:12.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:12.530+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:12.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:12.670+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:13.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:13.113+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:13.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:13.201+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:13.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:13.549+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:13.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:13.719+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:14.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:14.097+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:14.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:14.183+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:14.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:14.586+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:14.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:14.716+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:15.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:15.131+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:15.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:15.210+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:15.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:15.629+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:15.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:15.761+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:16.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:16.123+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:16.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:16.213+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:16.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:16.632+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:16.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:16.787+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:17.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:17.171+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:17.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:17.224+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:17.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:17.606+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:17.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:17.739+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:18.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:18.129+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:18.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:18.270+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:18.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:18.654+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:18.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:18.780+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:19.037 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:48:19.035+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:48:19.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:19.127+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:19.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:19.304+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:19.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:19.684+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:19.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:19.823+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:20.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:20.090+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:20.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:20.264+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:20.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:20.704+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:20.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:20.836+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:21.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:21.070+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:21.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:21.233+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:21.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:21.685+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:21.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:21.798+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:22.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:22.086+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:22.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:22.241+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:22.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:22.684+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:22.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:22.819+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:23.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:23.056+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:23.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:23.224+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:23.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:23.644+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:23.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:23.802+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:24.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:24.068+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:24.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:24.247+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:24.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:24.675+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:24.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:24.781+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:25.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:25.110+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:25.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:25.211+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:25.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:25.691+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:25.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:25.752+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:26.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:26.158+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:26.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:26.250+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:26.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:26.662+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:26.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:26.723+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:27.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:27.161+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:27.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:27.253+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:27.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:27.707+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:27.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:27.736+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:28.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:28.153+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:28.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:28.208+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:28.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:28.688+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:28.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:28.693+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:29.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:29.120+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:29.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:29.187+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:29.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:29.694+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:29.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:29.738+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:30.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:30.157+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:30.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:30.174+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:30.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:30.739+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:30.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:30.786+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:31.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:31.142+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:31.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:31.201+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:31.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:31.742+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:31.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:31.812+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:32.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:32.145+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:32.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:32.208+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:32.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:32.709+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:32.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:32.833+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:33.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:33.139+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:33.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:33.191+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:33.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:33.683+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:33.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:33.786+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:34.053 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:48:34.051+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:48:34.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:34.109+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:34.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:34.183+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:34.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:34.707+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:34.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:34.740+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:35.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:35.110+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:35.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:35.151+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:35.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:35.740+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:35.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:35.755+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:36.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:36.136+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:36.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:36.153+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:36.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:36.745+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:36.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:36.798+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:37.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:37.109+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:37.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:37.115+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:37.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:37.702+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:37.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:37.806+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:38.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:38.101+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:38.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:38.149+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:38.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:48:38.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:48:38.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:38.732+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:38.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:38.804+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:39.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:39.085+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:39.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:39.121+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:39.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:39.739+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:39.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:39.763+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:40.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:40.082+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:40.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:40.105+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:40.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:40.728+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:40.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:40.764+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:41.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:41.068+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:41.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:41.077+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:41.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:41.717+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:41.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:41.729+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:42.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:42.085+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:42.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:42.122+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:42.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:42.707+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:42.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:42.758+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:43.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:43.105+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:43.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:43.136+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:43.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:43.710+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:43.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:43.720+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:44.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:44.094+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:44.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:44.128+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:44.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:44.716+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:44.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:44.762+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:45.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:45.062+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:45.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:45.079+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:45.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:45.728+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:45.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:45.759+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:46.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:46.109+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:46.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:46.123+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:46.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:46.687+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:46.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:46.735+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:47.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:47.064+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:47.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:47.091+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:47.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:47.719+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:47.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:47.744+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:48.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:48.071+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:48.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:48.114+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:48.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:48.749+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:48.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:48.759+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:49.069 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:48:49.067+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:48:49.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:49.080+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:49.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:49.162+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:49.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:49.752+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:49.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:49.791+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:50.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:50.034+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:50.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:50.206+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:50.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:50.781+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:50.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:50.839+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:51.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:51.070+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:51.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:51.157+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:51.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:51.828+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:51.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:51.847+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:52.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:52.080+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:52.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:52.141+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:52.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:52.791+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:52.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:52.883+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:53.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:53.052+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:53.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:53.142+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:53.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:53.839+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:53.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:53.886+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:54.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:54.010+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:54.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:54.187+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:54.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:54.805+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:54.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:54.882+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:55.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:55.021+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:55.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:55.210+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:55.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:55.792+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:55.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:55.850+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:56.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:56.047+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:56.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:56.164+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:56.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:56.791+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:56.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:56.828+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:57.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:57.048+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:57.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:57.126+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:57.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:57.810+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:57.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:57.873+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:58.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:58.027+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:58.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:58.115+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:58.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:58.780+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:58.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:58.836+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:59.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:48:59.013+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:59.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:48:59.130+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:59.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:48:59.759+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:48:59.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:48:59.876+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:00.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:00.043+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:00.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:00.140+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:00.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:00.797+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:00.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:00.883+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:01.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:01.027+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:01.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:01.126+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:01.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:01.790+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:01.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:01.860+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:01.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:01.997+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:02.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:02.105+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:02.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:02.768+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:02.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:02.833+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:03.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:03.001+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:03.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:03.149+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:03.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:03.742+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:03.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:03.869+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:04.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:04.038+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:04.085 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:49:04.083+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:49:04.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:04.198+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:04.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:04.792+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:04.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:04.917+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:05.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:05.005+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:05.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:05.222+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:05.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:05.811+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:05.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:05.942+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:05.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:05.967+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:06.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:06.215+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:06.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:06.779+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:06.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:06.916+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:06.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:06.922+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:07.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:07.178+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:07.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:07.821+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:07.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:07.956+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:07.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:07.972+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:08.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:08.206+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:08.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:49:08.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:49:08.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:08.845+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:08.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:08.977+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:09.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:08.999+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:09.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:09.209+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:09.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:09.891+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:10.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:10.002+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:10.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:10.032+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:10.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:10.171+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:10.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:10.933+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:10.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:10.972+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:11.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:11.042+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:11.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:11.168+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:11.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:11.926+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:11.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:11.976+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:12.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:12.054+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:12.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:12.171+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:12.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:12.940+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:12.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:12.982+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:13.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:13.041+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:13.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:13.122+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:13.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:13.942+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:13.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:13.997+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:14.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:14.055+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:14.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:14.077+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:14.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:14.932+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:14.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:14.990+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:15.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:15.074+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:15.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:15.078+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:15.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:15.927+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:15.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:15.986+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:16.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:16.080+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:16.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:16.118+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:16.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:16.931+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:17.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:17.000+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:17.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:17.031+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:17.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:17.144+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:17.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:17.924+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:17.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:17.990+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:18.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:18.026+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:18.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:18.114+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:18.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:18.886+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:18.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:18.983+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:19.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:19.002+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:19.096 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:49:19.095+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:49:19.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:19.108+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:19.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:19.929+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:19.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:19.959+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:19.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:19.986+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:20.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:20.139+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:20.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:20.946+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:20.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:20.992+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:21.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:21.017+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:21.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:21.136+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:21.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:21.898+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:21.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:21.956+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:22.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:22.019+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:22.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:22.117+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:22.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:22.924+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:22.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:22.924+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:23.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:23.024+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:23.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:23.117+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:23.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:23.909+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:23.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:23.939+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:23.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:23.989+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:24.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:24.132+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:24.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:24.939+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:24.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:24.949+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:24.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:24.985+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:25.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:25.172+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:25.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:25.924+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:25.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:25.934+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:25.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:25.948+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:26.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:26.191+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:26.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:26.894+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:26.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:26.920+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:26.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:26.955+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:27.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:27.178+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:27.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:27.897+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:27.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:27.933+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:27.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:27.985+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:28.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:28.129+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:28.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:28.898+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:28.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:28.942+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:28.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:28.968+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:29.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:29.127+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:29.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:29.938+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:29.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:29.942+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:29.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:29.952+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:30.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:30.093+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:30.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:30.899+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:30.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:30.928+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:30.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:30.934+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:31.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:31.077+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:31.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:31.854+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:31.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:31.901+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:31.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:31.956+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:32.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:32.076+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:32.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:32.886+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:32.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:32.919+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:32.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:32.922+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:33.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:33.111+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:33.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:33.874+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:33.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:33.899+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:33.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:33.939+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:34.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:34.063+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:34.112 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:49:34.110+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:49:34.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:34.827+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:34.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:34.893+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:34.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:34.946+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:35.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:35.081+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:35.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:35.778+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:35.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:35.885+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:35.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:35.931+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:36.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:36.066+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:36.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:36.827+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:36.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:36.887+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:36.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:36.981+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:37.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:37.095+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:37.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:37.833+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:37.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:37.929+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:37.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:37.962+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:38.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:38.082+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:38.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:38.858+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:38.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:49:38.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:49:38.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:38.948+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:38.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:38.953+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:39.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:39.108+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:39.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:39.836+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:39.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:39.904+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:39.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:39.914+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:40.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:40.144+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:40.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:40.877+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:40.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:40.878+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:40.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:40.960+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:41.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:41.135+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:41.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:41.867+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:41.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:41.871+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:41.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:41.996+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:42.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:42.118+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:42.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:42.896+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:42.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:42.916+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:43.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:43.010+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:43.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:43.129+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:43.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:43.938+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:43.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:43.944+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:44.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:44.000+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:44.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:44.109+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:44.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:44.924+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:44.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:44.974+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:45.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:45.043+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:45.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:45.096+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:45.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:45.936+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:45.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:45.954+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:46.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:46.012+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:46.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:46.109+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:46.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:46.925+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:46.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:46.974+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:46.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:46.986+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:47.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:47.064+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:47.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:47.878+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:47.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:47.943+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:48.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:48.005+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:48.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:48.078+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:48.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:48.857+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:48.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:48.937+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:49.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:49.022+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:49.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:49.049+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:49.128 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:49:49.127+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:49:49.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:49.841+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:49.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:49.981+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:50.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:50.049+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:50.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:50.051+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:50.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:50.835+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:51.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:51.000+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:51.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:51.040+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:51.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:51.046+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:51.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:51.873+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:51.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:51.986+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:52.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:52.015+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:52.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:52.076+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:52.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:52.879+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:53.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:53.018+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:53.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:53.029+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:53.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:53.037+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:53.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:53.913+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:54.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:54.032+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:54.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:54.062+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:54.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:54.079+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:54.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:54.941+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:55.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:55.028+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:55.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:55.099+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:55.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:55.115+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:55.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:55.952+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:55.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:55.994+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:56.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:56.091+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:56.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:56.102+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:56.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:56.955+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:56.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:56.983+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:57.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:57.114+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:57.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:57.118+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:57.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:57.949+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:57.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:57.967+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:58.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:58.083+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:58.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:58.131+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:58.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:58.942+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:58.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:58.960+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:59.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:49:59.086+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:59.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:49:59.128+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:59.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:49:59.971+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:49:59.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:49:59.985+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:00.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:00.086+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:00.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:00.125+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:00.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:00.955+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:00.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:00.996+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:01.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:01.067+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:01.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:01.149+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:01.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:01.925+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:02.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:02.036+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:02.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:02.054+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:02.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:02.184+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:02.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:02.891+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:03.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:03.028+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:03.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:03.083+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:03.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:03.195+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:03.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:03.875+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:04.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:04.063+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:04.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:04.065+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:04.144 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:50:04.142+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:50:04.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:04.149+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:04.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:04.914+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:05.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:05.041+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:05.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:05.046+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:05.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:05.138+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:05.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:05.909+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:05.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:05.993+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:06.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:06.053+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:06.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:06.180+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:06.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:06.869+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:06.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:06.995+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:07.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:07.097+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:07.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:07.200+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:07.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:07.894+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:08.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:08.032+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:08.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:08.083+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:08.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:08.246+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:08.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:08.942+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:09.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:09.035+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:09.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:50:09.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:50:09.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:09.049+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:09.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:09.204+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:09.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:09.892+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:10.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:10.016+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:10.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:10.093+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:10.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:10.242+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:10.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:10.860+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:10.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:10.996+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:11.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:11.045+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:11.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:11.195+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:11.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:11.870+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:12.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:12.003+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:12.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:12.016+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:12.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:12.237+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:12.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:12.880+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:13.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:13.025+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:13.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:13.034+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:13.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:13.189+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:13.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:13.906+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:14.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:14.001+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:14.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:14.083+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:14.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:14.203+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:14.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:14.929+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:15.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:15.046+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:15.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:15.113+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:15.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:15.195+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:15.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:15.928+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:16.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:16.028+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:16.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:16.129+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:16.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:16.210+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:16.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:16.879+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:17.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:17.020+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:17.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:17.106+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:17.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:17.212+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:17.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:17.871+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:17.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:17.975+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:18.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:18.138+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:18.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:18.235+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:18.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:18.868+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:18.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:18.977+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:19.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:19.143+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:19.160 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:50:19.158+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:50:19.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:19.205+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:19.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:19.870+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:20.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:20.001+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:20.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:20.160+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:20.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:20.223+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:20.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:20.849+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:20.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:20.980+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:21.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:21.197+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:21.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:21.261+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:21.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:21.836+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:22.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:22.025+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:22.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:22.191+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:22.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:22.297+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:22.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:22.835+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:23.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:23.011+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:23.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:23.213+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:23.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:23.256+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:23.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:23.878+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:23.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:23.995+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:24.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:24.207+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:24.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:24.262+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:24.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:24.851+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:24.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:24.946+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:25.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:25.223+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:25.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:25.241+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:25.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:25.886+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:25.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:25.963+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:26.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:26.236+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:26.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:26.266+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:26.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:26.922+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:26.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:26.950+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:27.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:27.229+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:27.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:27.250+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:27.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:27.883+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:27.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:27.992+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:28.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:28.234+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:28.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:28.282+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:28.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:28.934+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:29.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:29.011+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:29.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:29.207+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:29.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:29.251+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:29.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:29.904+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:30.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:30.001+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:30.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:30.204+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:30.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:30.264+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:30.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:30.939+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:31.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:31.050+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:31.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:31.196+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:31.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:31.264+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:31.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:31.914+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:32.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:32.035+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:32.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:32.196+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:32.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:32.229+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:32.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:32.921+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:33.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:33.070+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:33.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:33.180+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:33.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:33.253+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:33.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:33.931+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:34.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:34.072+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:34.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:34.153+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:34.163 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:50:34.163+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:50:34.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:34.298+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:34.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:34.929+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:35.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:35.052+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:35.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:35.152+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:35.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:35.258+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:35.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:35.913+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:36.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:36.082+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:36.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:36.195+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:36.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:36.244+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:36.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:36.912+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:37.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:37.088+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:37.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:37.213+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:37.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:37.284+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:37.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:37.915+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:38.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:38.089+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:38.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:38.191+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:38.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:38.283+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:38.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:38.927+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:39.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:39.102+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:39.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:39.152+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:39.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:50:39.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:50:39.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:39.273+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:39.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:39.964+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:40.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:40.129+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:40.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:40.153+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:40.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:40.298+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:40.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:40.922+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:41.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:41.114+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:41.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:41.152+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:41.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:41.329+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:41.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:41.954+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:42.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:42.120+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:42.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:42.126+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:42.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:42.320+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:42.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:42.917+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:43.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:43.105+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:43.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:43.141+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:43.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:43.356+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:43.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:43.946+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:44.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:44.079+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:44.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:44.144+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:44.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:44.342+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:44.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:44.960+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:45.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:45.091+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:45.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:45.189+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:45.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:45.387+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:45.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:45.916+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:46.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:46.096+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:46.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:46.183+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:46.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:46.437+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:46.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:46.906+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:47.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:47.109+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:47.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:47.233+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:47.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:47.481+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:47.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:47.883+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:48.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:48.077+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:48.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:48.276+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:48.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:48.477+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:48.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:48.851+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:49.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:49.113+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:49.180 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:50:49.177+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:50:49.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:49.233+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:49.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:49.437+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:49.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:49.865+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:50.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:50.074+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:50.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:50.283+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:50.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:50.422+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:50.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:50.913+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:51.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:51.100+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:51.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:51.327+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:51.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:51.373+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:51.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:51.922+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:52.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:52.145+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:52.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:52.350+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:52.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:52.375+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:52.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:52.943+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:53.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:53.130+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:53.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:53.368+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:53.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:53.389+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:53.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:53.937+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:54.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:54.105+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:54.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:54.377+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:54.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:54.405+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:54.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:54.922+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:55.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:55.135+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:55.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:55.346+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:55.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:55.394+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:55.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:55.964+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:56.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:56.093+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:56.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:56.301+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:56.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:56.433+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:56.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:56.974+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:57.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:57.057+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:57.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:57.335+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:57.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:57.408+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:57.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:57.985+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:58.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:58.101+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:58.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:58.358+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:58.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:58.430+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:59.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:50:59.033+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:59.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:50:59.108+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:59.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:50:59.352+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:50:59.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:50:59.479+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:00.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:00.065+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:00.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:00.127+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:00.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:00.307+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:00.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:00.517+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:01.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:01.094+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:01.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:01.097+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:01.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:01.310+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:01.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:01.557+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:02.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:02.068+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:02.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:02.069+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:02.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:02.263+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:02.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:02.606+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:03.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:03.020+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:03.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:03.077+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:03.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:03.241+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:03.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:03.606+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:03.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:03.998+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:04.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:04.043+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:04.195 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:51:04.194+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:51:04.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:04.258+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:04.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:04.648+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:05.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:05.038+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:05.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:05.069+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:05.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:05.258+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:05.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:05.682+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:06.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:06.014+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:06.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:06.036+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:06.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:06.243+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:06.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:06.701+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:06.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:06.992+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:07.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:07.026+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:07.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:07.239+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:07.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:07.699+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:07.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:07.982+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:07.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:07.985+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:08.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:08.190+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:08.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:08.724+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:08.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:08.944+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:09.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:09.021+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:09.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:09.190+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:09.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:51:09.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:51:09.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:09.773+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:09.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:09.910+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:10.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:10.007+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:10.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:10.193+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:10.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:10.801+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:10.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:10.912+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:11.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:11.024+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:11.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:11.191+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:11.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:11.759+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:11.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:11.873+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:12.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:12.030+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:12.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:12.178+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:12.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:12.761+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:12.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:12.882+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:13.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:13.018+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:13.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:13.228+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:13.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:13.740+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:13.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:13.851+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:13.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:13.986+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:14.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:14.275+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:14.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:14.719+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:14.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:14.830+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:14.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:14.983+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:15.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:15.238+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:15.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:15.676+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:15.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:15.871+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:16.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:15.998+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:16.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:16.215+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:16.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:16.718+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:16.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:16.876+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:17.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:17.037+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:17.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:17.170+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:17.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:17.684+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:17.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:17.873+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:18.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:18.087+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:18.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:18.174+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:18.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:18.646+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:18.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:18.889+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:19.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:19.111+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:19.197 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:51:19.195+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:51:19.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:19.203+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:19.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:19.634+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:19.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:19.903+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:20.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:20.161+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:20.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:20.205+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:20.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:20.609+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:20.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:20.893+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:21.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:21.194+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:21.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:21.213+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:21.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:21.592+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:21.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:21.942+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:22.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:22.181+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:22.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:22.214+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:22.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:22.617+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:22.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:22.946+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:23.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:23.190+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:23.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:23.193+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:23.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:23.579+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:23.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:23.901+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:24.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:24.189+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:24.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:24.222+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:24.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:24.608+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:24.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:24.885+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:25.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:25.196+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:25.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:25.210+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:25.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:25.585+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:25.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:25.927+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:26.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:26.164+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:26.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:26.187+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:26.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:26.574+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:26.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:26.941+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:27.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:27.150+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:27.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:27.223+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:27.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:27.605+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:27.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:27.959+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:28.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:28.195+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:28.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:28.245+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:28.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:28.585+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:28.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:28.938+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:29.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:29.213+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:29.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:29.285+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:29.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:29.578+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:29.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:29.964+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:30.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:30.250+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:30.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:30.308+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:30.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:30.618+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:30.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:30.930+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:31.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:31.271+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:31.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:31.272+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:31.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:31.619+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:31.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:31.936+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:32.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:32.248+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:32.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:32.251+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:32.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:32.588+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:32.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:32.978+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:33.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:33.233+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:33.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:33.272+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:33.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:33.558+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:33.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:33.983+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:34.213 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:51:34.211+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:51:34.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:34.233+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:34.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:34.236+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:34.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:34.538+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:34.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:34.937+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:35.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:35.213+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:35.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:35.240+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:35.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:35.498+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:35.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:35.919+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:36.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:36.186+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:36.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:36.226+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:36.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:36.512+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:36.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:36.895+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:37.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:37.203+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:37.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:37.237+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:37.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:37.505+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:37.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:37.937+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:38.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:38.241+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:38.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:38.269+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:38.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:38.501+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:38.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:38.963+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:39.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:39.222+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:39.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:39.226+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:39.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:51:39.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:51:39.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:39.490+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:39.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:39.970+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:40.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:40.269+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:40.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:40.270+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:40.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:40.521+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:41.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:41.001+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:41.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:41.263+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:41.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:41.320+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:41.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:41.545+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:42.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:42.019+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:42.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:42.232+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:42.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:42.293+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:42.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:42.587+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:43.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:43.018+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:43.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:43.274+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:43.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:43.308+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:43.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:43.581+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:44.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:44.067+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:44.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:44.236+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:44.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:44.345+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:44.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:44.587+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:45.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:45.076+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:45.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:45.228+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:45.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:45.372+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:45.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:45.632+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:46.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:46.058+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:46.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:46.262+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:46.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:46.375+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:46.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:46.596+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:47.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:47.018+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:47.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:47.261+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:47.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:47.395+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:47.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:47.577+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:48.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:48.014+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:48.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:48.277+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:48.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:48.362+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:48.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:48.580+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:48.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:48.975+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:49.229 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:51:49.227+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:51:49.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:49.279+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:49.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:49.325+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:49.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:49.558+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:49.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:49.979+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:50.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:50.288+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:50.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:50.320+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:50.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:50.544+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:50.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:50.988+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:51.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:51.335+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:51.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:51.337+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:51.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:51.557+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:51.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:51.966+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:52.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:52.329+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:52.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:52.334+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:52.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:52.535+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:52.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:52.932+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:53.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:53.339+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:53.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:53.360+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:53.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:53.562+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:53.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:53.927+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:54.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:54.348+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:54.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:54.351+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:54.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:54.537+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:54.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:54.893+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:55.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:55.357+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:55.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:55.364+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:55.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:55.587+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:55.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:55.845+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:56.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:56.367+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:56.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:56.372+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:56.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:56.557+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:56.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:56.856+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:57.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:57.353+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:57.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:57.353+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:57.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:57.566+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:57.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:57.900+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:58.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:58.317+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:58.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:58.325+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:58.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:58.534+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:58.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:58.934+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:59.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:51:59.322+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:59.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:51:59.338+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:59.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:51:59.505+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:51:59.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:51:59.973+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:00.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:00.312+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:00.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:00.370+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:00.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:00.485+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:00.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:00.997+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:01.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:01.275+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:01.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:01.416+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:01.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:01.435+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:01.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:01.949+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:02.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:02.227+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:02.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:02.378+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:02.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:02.450+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:02.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:02.997+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:03.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:03.249+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:03.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:03.374+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:03.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:03.419+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:03.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:03.984+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:04.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:04.224+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:04.245 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:52:04.243+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:52:04.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:04.335+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:04.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:04.404+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:05.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:05.011+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:05.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:05.265+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:05.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:05.337+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:05.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:05.440+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:05.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:05.997+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:06.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:06.306+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:06.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:06.386+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:06.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:06.435+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:07.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:07.022+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:07.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:07.297+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:07.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:07.376+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:07.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:07.455+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:07.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:07.986+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:08.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:08.325+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:08.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:08.413+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:08.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:08.451+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:08.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:08.973+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:09.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:09.326+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:09.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:09.380+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:09.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:09.482+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:09.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:52:09.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:52:09.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:09.961+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:10.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:10.318+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:10.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:10.382+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:10.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:10.493+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:10.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:10.972+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:11.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:11.340+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:11.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:11.428+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:11.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:11.506+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:11.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:11.983+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:12.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:12.381+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:12.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:12.385+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:12.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:12.515+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:12.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:12.979+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:13.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:13.340+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:13.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:13.430+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:13.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:13.478+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:14.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:14.010+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:14.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:14.345+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:14.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:14.386+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:14.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:14.489+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:15.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:15.029+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:15.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:15.345+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:15.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:15.383+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:15.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:15.504+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:16.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:16.019+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:16.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:16.377+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:16.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:16.388+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:16.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:16.467+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:17.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:17.067+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:17.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:17.360+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:17.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:17.370+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:17.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:17.512+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:18.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:18.060+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:18.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:18.408+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:18.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:18.418+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:18.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:18.479+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:19.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:19.035+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:19.261 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:52:19.260+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:52:19.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:19.442+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:19.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:19.452+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:19.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:19.472+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:20.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:20.002+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:20.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:20.467+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:20.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:20.474+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:20.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:20.498+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:21.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:21.023+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:21.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:21.429+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:21.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:21.487+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:21.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:21.487+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:22.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:22.013+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:22.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:22.389+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:22.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:22.447+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:22.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:22.480+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:23.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:23.019+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:23.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:23.407+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:23.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:23.423+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:23.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:23.496+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:23.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:23.976+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:24.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:24.400+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:24.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:24.424+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:24.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:24.478+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:25.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:25.016+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:25.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:25.420+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:25.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:25.444+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:25.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:25.481+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:26.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:26.040+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:26.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:26.456+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:26.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:26.493+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:26.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:26.522+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:27.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:27.083+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:27.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:27.412+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:27.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:27.479+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:27.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:27.555+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:28.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:28.037+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:28.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:28.416+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:28.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:28.497+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:28.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:28.587+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:29.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:29.017+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:29.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:29.390+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:29.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:29.497+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:29.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:29.629+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:30.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:30.007+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:30.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:30.360+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:30.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:30.474+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:30.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:30.652+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:31.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:31.051+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:31.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:31.398+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:31.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:31.502+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:31.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:31.623+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:32.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:32.019+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:32.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:32.369+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:32.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:32.511+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:32.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:32.671+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:33.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:33.046+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:33.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:33.348+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:33.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:33.487+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:33.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:33.622+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:34.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:34.093+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:34.277 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:52:34.275+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:52:34.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:34.336+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:34.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:34.534+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:34.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:34.589+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:35.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:35.133+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:35.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:35.305+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:35.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:35.520+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:35.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:35.639+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:36.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:36.120+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:36.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:36.312+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:36.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:36.516+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:36.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:36.689+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:37.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:37.150+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:37.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:37.301+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:37.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:37.487+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:37.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:37.724+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:38.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:38.191+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:38.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:38.290+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:38.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:38.508+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:38.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:38.741+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:39.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:39.227+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:39.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:39.256+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:39.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:39.529+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:39.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:52:39.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:52:39.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:39.693+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:40.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:40.275+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:40.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:40.285+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:40.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:40.514+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:40.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:40.726+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:41.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:41.276+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:41.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:41.282+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:41.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:41.517+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:41.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:41.713+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:42.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:42.276+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:42.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:42.287+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:42.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:42.553+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:42.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:42.735+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:43.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:43.281+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:43.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:43.293+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:43.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:43.536+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:43.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:43.753+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:44.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:44.287+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:44.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:44.295+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:44.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:44.541+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:44.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:44.756+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:45.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:45.302+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:45.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:45.343+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:45.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:45.529+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:45.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:45.791+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:46.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:46.289+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:46.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:46.353+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:46.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:46.514+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:46.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:46.826+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:47.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:47.318+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:47.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:47.329+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:47.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:47.557+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:47.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:47.868+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:48.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:48.296+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:48.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:48.324+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:48.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:48.600+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:48.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:48.913+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:49.293 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:52:49.291+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:52:49.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:49.305+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:49.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:49.321+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:49.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:49.647+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:49.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:49.883+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:50.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:50.288+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:50.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:50.371+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:50.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:50.666+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:50.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:50.885+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:51.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:51.272+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:51.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:51.378+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:51.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:51.711+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:51.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:51.838+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:52.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:52.268+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:52.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:52.345+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:52.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:52.673+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:52.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:52.794+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:53.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:53.314+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:53.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:53.317+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:53.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:53.638+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:53.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:53.790+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:54.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:54.269+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:54.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:54.313+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:54.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:54.606+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:54.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:54.830+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:55.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:55.250+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:55.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:55.308+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:55.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:55.634+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:55.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:55.821+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:56.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:56.204+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:56.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:56.301+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:56.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:56.585+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:56.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:56.775+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:57.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:57.182+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:57.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:57.277+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:57.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:57.576+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:57.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:57.743+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:58.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:58.165+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:58.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:58.291+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:58.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:58.581+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:58.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:58.780+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:59.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:52:59.137+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:59.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:52:59.325+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:59.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:52:59.537+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:52:59.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:52:59.808+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:00.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:00.161+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:00.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:00.352+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:00.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:00.511+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:00.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:00.760+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:01.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:01.132+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:01.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:01.344+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:01.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:01.513+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:01.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:01.777+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:02.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:02.115+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:02.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:02.386+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:02.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:02.524+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:02.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:02.820+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:03.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:03.096+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:03.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:03.399+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:03.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:03.557+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:03.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:03.793+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:04.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:04.139+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:04.308 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:53:04.306+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:53:04.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:04.388+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:04.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:04.523+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:04.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:04.837+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:05.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:05.101+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:05.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:05.350+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:05.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:05.562+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:05.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:05.860+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:06.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:06.138+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:06.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:06.333+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:06.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:06.535+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:06.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:06.826+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:07.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:07.174+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:07.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:07.284+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:07.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:07.576+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:07.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:07.783+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:08.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:08.157+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:08.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:08.323+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:08.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:08.574+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:08.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:08.774+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:09.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:09.143+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:09.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:09.283+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:09.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:09.549+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:09.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:53:09.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:53:09.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:09.800+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:10.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:10.154+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:10.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:10.283+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:10.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:10.549+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:10.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:10.794+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:11.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:11.115+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:11.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:11.282+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:11.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:11.545+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:11.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:11.801+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:12.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:12.096+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:12.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:12.300+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:12.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:12.591+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:12.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:12.840+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:13.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:13.121+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:13.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:13.254+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:13.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:13.578+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:13.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:13.813+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:14.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:14.141+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:14.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:14.232+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:14.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:14.562+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:14.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:14.774+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:15.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:15.170+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:15.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:15.276+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:15.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:15.610+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:15.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:15.746+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:16.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:16.182+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:16.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:16.283+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:16.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:16.660+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:16.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:16.705+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:17.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:17.182+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:17.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:17.326+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:17.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:17.629+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:17.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:17.696+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:18.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:18.166+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:18.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:18.375+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:18.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:18.648+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:18.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:18.653+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:19.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:19.151+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:19.324 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:53:19.322+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:53:19.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:19.379+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:19.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:19.617+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:19.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:19.678+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:20.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:20.135+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:20.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:20.341+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:20.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:20.586+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:20.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:20.652+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:21.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:21.184+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:21.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:21.308+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:21.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:21.624+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:21.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:21.683+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:22.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:22.212+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:22.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:22.301+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:22.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:22.608+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:22.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:22.715+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:23.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:23.246+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:23.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:23.298+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:23.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:23.639+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:23.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:23.671+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:24.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:24.239+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:24.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:24.315+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:24.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:24.678+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:24.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:24.711+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:25.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:25.218+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:25.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:25.339+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:25.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:25.728+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:25.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:25.729+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:26.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:26.189+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:26.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:26.374+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:26.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:26.696+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:26.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:26.736+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:27.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:27.173+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:27.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:27.396+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:27.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:27.734+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:27.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:27.785+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:28.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:28.171+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:28.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:28.374+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:28.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:28.686+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:28.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:28.819+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:29.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:29.184+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:29.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:29.397+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:29.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:29.689+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:29.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:29.867+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:30.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:30.143+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:30.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:30.354+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:30.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:30.662+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:30.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:30.895+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:31.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:31.164+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:31.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:31.341+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:31.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:31.674+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:31.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:31.852+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:32.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:32.153+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:32.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:32.372+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:32.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:32.656+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:32.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:32.826+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:33.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:33.198+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:33.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:33.352+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:33.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:33.628+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:33.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:33.801+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:34.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:34.194+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:34.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:34.332+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:34.341 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:53:34.339+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:53:34.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:34.654+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:34.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:34.806+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:35.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:35.175+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:35.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:35.300+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:35.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:35.633+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:35.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:35.767+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:36.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:36.129+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:36.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:36.265+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:36.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:36.617+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:36.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:36.769+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:37.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:37.092+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:37.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:37.228+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:37.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:37.587+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:37.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:37.806+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:38.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:38.139+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:38.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:38.200+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:38.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:38.594+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:38.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:38.784+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:39.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:39.129+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:39.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:39.162+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:39.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:39.545+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:39.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:39.750+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:39.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:53:39.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:53:40.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:40.173+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:40.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:40.173+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:40.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:40.565+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:40.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:40.721+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:41.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:41.161+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:41.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:41.180+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:41.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:41.582+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:41.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:41.708+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:42.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:42.166+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:42.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:42.174+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:42.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:42.603+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:42.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:42.668+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:43.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:43.165+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:43.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:43.199+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:43.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:43.649+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:43.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:43.685+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:44.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:44.147+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:44.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:44.202+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:44.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:44.662+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:44.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:44.716+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:45.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:45.115+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:45.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:45.243+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:45.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:45.692+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:45.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:45.710+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:46.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:46.141+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:46.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:46.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:46.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:46.676+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:46.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:46.710+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:47.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:47.158+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:47.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:47.236+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:47.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:47.683+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:47.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:47.711+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:48.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:48.174+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:48.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:48.201+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:48.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:48.670+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:48.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:48.690+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:49.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:49.133+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:49.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:49.162+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:49.357 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:53:49.355+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:53:49.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:49.649+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:49.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:49.690+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:50.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:50.111+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:50.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:50.133+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:50.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:50.691+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:50.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:50.696+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:51.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:51.095+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:51.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:51.140+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:51.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:51.691+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:51.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:51.744+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:52.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:52.093+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:52.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:52.139+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:52.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:52.649+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:52.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:52.766+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:53.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:53.044+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:53.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:53.124+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:53.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:53.664+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:53.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:53.738+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:54.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:54.034+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:54.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:54.075+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:54.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:54.641+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:54.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:54.788+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:55.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:55.071+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:55.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:55.113+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:55.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:55.679+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:55.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:55.785+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:56.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:56.081+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:56.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:56.155+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:56.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:56.668+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:56.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:56.769+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:57.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:57.063+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:57.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:57.160+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:57.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:57.633+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:57.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:57.731+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:58.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:58.061+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:58.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:58.200+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:58.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:58.617+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:58.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:58.712+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:59.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:53:59.050+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:59.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:53:59.200+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:59.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:53:59.665+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:53:59.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:53:59.697+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:00.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:00.061+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:00.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:00.224+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:00.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:00.682+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:00.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:00.698+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:01.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:01.063+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:01.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:01.223+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:01.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:01.668+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:01.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:01.670+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:02.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:02.112+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:02.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:02.245+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:02.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:02.633+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:02.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:02.680+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:03.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:03.148+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:03.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:03.212+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:03.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:03.594+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:03.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:03.679+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:04.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:04.154+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:04.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:04.238+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:04.372 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:54:04.371+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:54:04.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:04.614+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:04.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:04.657+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:05.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:05.203+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:05.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:05.236+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:05.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:05.613+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:05.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:05.630+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:06.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:06.161+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:06.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:06.199+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:06.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:06.619+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:06.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:06.636+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:07.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:07.143+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:07.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:07.161+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:07.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:07.576+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:07.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:07.609+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:08.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:08.121+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:08.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:08.129+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:08.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:08.561+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:08.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:08.573+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:09.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:09.144+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:09.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:09.157+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:09.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:09.563+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:09.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:09.567+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:10.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:54:10.052 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:54:10.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:10.144+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:10.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:10.157+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:10.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:10.581+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:10.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:10.594+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:11.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:11.111+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:11.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:11.173+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:11.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:11.623+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:11.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:11.631+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:12.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:12.096+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:12.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:12.168+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:12.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:12.590+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:12.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:12.619+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:13.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:13.069+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:13.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:13.119+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:13.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:13.625+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:13.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:13.628+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:14.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:14.075+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:14.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:14.166+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:14.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:14.615+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:14.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:14.638+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:15.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:15.041+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:15.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:15.173+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:15.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:15.587+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:15.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:15.651+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:16.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:16.010+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:16.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:16.148+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:16.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:16.606+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:16.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:16.632+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:16.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:16.976+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:17.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:17.125+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:17.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:17.575+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:17.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:17.584+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:18.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:18.014+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:18.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:18.097+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:18.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:18.562+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:18.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:18.617+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:19.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:19.040+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:19.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:19.102+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:19.384 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:54:19.382+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:54:19.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:19.572+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:19.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:19.596+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:20.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:20.062+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:20.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:20.065+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:20.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:20.559+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:20.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:20.637+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:21.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:21.064+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:21.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:21.071+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:21.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:21.552+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:21.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:21.639+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:22.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:22.038+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:22.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:22.072+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:22.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:22.602+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:22.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:22.611+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:22.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:22.990+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:23.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:23.047+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:23.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:23.578+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:23.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:23.613+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:23.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:23.960+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:24.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:24.027+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:24.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:24.596+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:24.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:24.606+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:24.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:24.948+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:25.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:25.001+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:25.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:25.613+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:25.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:25.648+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:25.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:25.935+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:25.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:25.973+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:26.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:26.614+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:26.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:26.681+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:26.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:26.906+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:26.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:26.949+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:27.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:27.636+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:27.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:27.731+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:27.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:27.921+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:27.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:27.950+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:28.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:28.684+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:28.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:28.775+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:28.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:28.928+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:28.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:28.941+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:29.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:29.690+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:29.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:29.748+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:29.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:29.914+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:29.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:29.930+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:30.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:30.654+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:30.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:30.700+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:30.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:30.874+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:30.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:30.933+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:31.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:31.659+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:31.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:31.702+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:31.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:31.890+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:31.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:31.955+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:32.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:32.691+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:32.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:32.749+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:32.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:32.871+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:32.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:32.917+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:33.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:33.699+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:33.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:33.761+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:33.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:33.842+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:33.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:33.930+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:34.400 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:54:34.398+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:54:34.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:34.705+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:34.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:34.763+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:34.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:34.804+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:34.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:34.938+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:35.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:35.730+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:35.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:35.741+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:35.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:35.769+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:35.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:35.964+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:36.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:36.748+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:36.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:36.785+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:36.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:36.818+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:36.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:36.967+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:37.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:37.751+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:37.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:37.752+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:37.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:37.818+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:37.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:37.972+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:38.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:38.730+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:38.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:38.760+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:38.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:38.845+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:38.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:38.948+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:39.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:39.743+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:39.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:39.756+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:39.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:39.886+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:39.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:39.972+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:40.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:54:40.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:54:40.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:40.726+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:40.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:40.756+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:40.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:40.884+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:40.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:40.951+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:41.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:41.689+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:41.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:41.709+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:41.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:41.933+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:41.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:41.968+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:42.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:42.664+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:42.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:42.666+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:42.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:42.887+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:42.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:42.968+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:43.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:43.670+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:43.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:43.715+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:43.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:43.896+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:43.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:43.930+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:44.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:44.700+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:44.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:44.750+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:44.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:44.868+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:44.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:44.927+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:45.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:45.750+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:45.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:45.768+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:45.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:45.910+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:45.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:45.952+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:46.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:46.729+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:46.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:46.767+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:46.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:46.902+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:46.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:46.965+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:47.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:47.759+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:47.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:47.783+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:47.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:47.900+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:47.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:47.990+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:48.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:48.743+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:48.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:48.806+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:48.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:48.887+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:48.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:48.980+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:49.416 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:54:49.415+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:54:49.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:49.727+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:49.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:49.848+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:49.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:49.886+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:50.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:50.012+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:50.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:50.727+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:50.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:50.880+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:50.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:50.880+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:51.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:51.049+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:51.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:51.744+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:51.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:51.858+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:51.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:51.879+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:52.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:52.090+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:52.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:52.717+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:52.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:52.811+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:52.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:52.869+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:53.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:53.072+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:53.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:53.715+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:53.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:53.810+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:53.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:53.904+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:54.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:54.069+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:54.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:54.725+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:54.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:54.764+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:54.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:54.879+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:55.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:55.049+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:55.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:55.722+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:55.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:55.773+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:55.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:55.840+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:56.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:56.001+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:56.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:56.743+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:56.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:56.782+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:56.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:56.855+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:57.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:57.038+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:57.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:57.768+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:57.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:57.821+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:57.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:57.879+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:58.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:58.008+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:58.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:58.771+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:58.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:58.798+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:58.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:58.887+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:59.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:59.007+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:59.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:54:59.802+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:59.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:54:59.804+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:59.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:54:59.881+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:54:59.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:54:59.974+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:00.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:00.757+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:00.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:00.822+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:00.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:00.863+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:00.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:00.969+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:01.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:01.768+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:01.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:01.784+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:01.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:01.815+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:01.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:01.936+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:02.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:02.722+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:02.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:02.766+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:02.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:02.766+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:02.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:02.958+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:03.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:03.716+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:03.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:03.726+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:03.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:03.804+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:03.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:03.964+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:04.419 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:55:04.416+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:55:04.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:04.700+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:04.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:04.751+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:04.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:04.820+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:04.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:04.946+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:05.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:05.661+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:05.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:05.757+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:05.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:05.833+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:05.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:05.978+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:06.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:06.616+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:06.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:06.723+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:06.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:06.880+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:06.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:06.966+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:07.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:07.658+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:07.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:07.684+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:07.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:07.908+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:07.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:07.989+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:08.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:08.615+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:08.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:08.727+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:08.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:08.895+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:08.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:08.949+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:09.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:09.599+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:09.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:09.722+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:09.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:09.849+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:09.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:09.940+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:10.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:55:10.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:55:10.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:10.549+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:10.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:10.709+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:10.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:10.859+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:10.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:10.973+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:11.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:11.597+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:11.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:11.695+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:11.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:11.824+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:11.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:11.975+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:12.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:12.608+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:12.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:12.692+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:12.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:12.861+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:13.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:13.004+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:13.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:13.632+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:13.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:13.662+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:13.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:13.820+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:13.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:13.992+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:14.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:14.609+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:14.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:14.672+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:14.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:14.829+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:15.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:15.012+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:15.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:15.562+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:15.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:15.714+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:15.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:15.793+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:15.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:15.970+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:16.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:16.608+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:16.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:16.751+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:16.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:16.798+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:16.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:16.965+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:17.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:17.616+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:17.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:17.771+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:17.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:17.809+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:18.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:18.007+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:18.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:18.663+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:18.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:18.783+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:18.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:18.855+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:19.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:19.035+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:19.434 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:55:19.433+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:55:19.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:19.702+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:19.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:19.754+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:19.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:19.808+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:20.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:20.061+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:20.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:20.693+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:20.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:20.733+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:20.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:20.835+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:21.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:21.057+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:21.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:21.689+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:21.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:21.731+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:21.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:21.803+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:22.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:22.013+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:22.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:22.730+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:22.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:22.743+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:22.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:22.792+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:22.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:22.968+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:23.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:23.727+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:23.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:23.759+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:23.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:23.776+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:23.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:23.933+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:24.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:24.732+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:24.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:24.769+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:24.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:24.784+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:24.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:24.952+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:25.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:25.732+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:25.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:25.743+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:25.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:25.775+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:25.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:25.990+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:26.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:26.713+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:26.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:26.766+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:26.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:26.774+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:26.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:26.963+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:27.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:27.684+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:27.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:27.766+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:27.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:27.777+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:27.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:27.949+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:28.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:28.685+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:28.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:28.734+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:28.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:28.784+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:28.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:28.979+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:29.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:29.687+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:29.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:29.727+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:29.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:29.778+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:30.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:30.008+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:30.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:30.713+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:30.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:30.735+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:30.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:30.756+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:30.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:30.962+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:31.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:31.714+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:31.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:31.749+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:31.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:31.784+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:31.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:31.944+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:32.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:32.670+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:32.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:32.771+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:32.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:32.773+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:32.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:32.958+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:33.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:33.711+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:33.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:33.789+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:33.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:33.792+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:33.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:33.928+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:34.450 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:55:34.448+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:55:34.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:34.725+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:34.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:34.787+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:34.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:34.818+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:34.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:34.892+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:35.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:35.699+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:35.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:35.753+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:35.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:35.792+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:35.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:35.901+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:36.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:36.743+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:36.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:36.750+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:36.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:36.814+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:36.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:36.886+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:37.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:37.731+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:37.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:37.767+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:37.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:37.784+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:37.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:37.922+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:38.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:38.714+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:38.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:38.733+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:38.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:38.828+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:38.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:38.883+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:39.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:39.669+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:39.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:39.743+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:39.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:39.792+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:39.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:39.835+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:40.492 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:55:40.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:55:40.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:40.713+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:40.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:40.780+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:40.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:40.782+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:40.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:40.856+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:41.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:41.710+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:41.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:41.739+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:41.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:41.806+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:41.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:41.894+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:42.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:42.705+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:42.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:42.762+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:42.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:42.787+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:42.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:42.888+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:43.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:43.713+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:43.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:43.790+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:43.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:43.825+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:43.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:43.921+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:44.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:44.668+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:44.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:44.757+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:44.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:44.865+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:44.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:44.951+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:45.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:45.642+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:45.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:45.712+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:45.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:45.901+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:45.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:45.941+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:46.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:46.675+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:46.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:46.746+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:46.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:46.911+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:46.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:46.944+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:47.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:47.639+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:47.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:47.719+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:47.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:47.936+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:47.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:47.938+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:48.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:48.655+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:48.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:48.690+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:48.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:48.905+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:48.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:48.976+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:49.451 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:55:49.449+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:55:49.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:49.667+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:49.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:49.740+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:49.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:49.900+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:49.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:49.943+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:50.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:50.626+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:50.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:50.699+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:50.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:50.862+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:50.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:50.983+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:51.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:51.586+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:51.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:51.707+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:51.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:51.882+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:51.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:51.976+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:52.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:52.578+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:52.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:52.735+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:52.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:52.877+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:53.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:53.026+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:53.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:53.596+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:53.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:53.744+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:53.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:53.920+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:54.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:54.012+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:54.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:54.555+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:54.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:54.784+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:54.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:54.929+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:55.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:55.018+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:55.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:55.518+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:55.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:55.745+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:55.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:55.904+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:56.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:56.026+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:56.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:56.535+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:56.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:56.709+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:56.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:56.943+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:57.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:57.042+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:57.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:57.537+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:57.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:57.699+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:57.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:57.952+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:58.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:58.030+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:58.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:58.541+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:58.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:58.653+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:58.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:58.937+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:59.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:55:59.078+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:59.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:55:59.580+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:59.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:55:59.607+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:55:59.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:55:59.979+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:00.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:00.107+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:00.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:00.569+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:00.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:00.597+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:00.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:00.992+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:01.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:01.063+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:01.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:01.549+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:01.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:01.592+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:01.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:01.989+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:02.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:02.108+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:02.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:02.501+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:02.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:02.618+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:02.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:02.958+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:03.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:03.105+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:03.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:03.494+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:03.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:03.619+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:03.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:03.955+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:04.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:04.136+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:04.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:04.463+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:04.467 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:56:04.465+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:56:04.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:04.598+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:04.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:04.918+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:05.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:05.162+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:05.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:05.513+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:05.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:05.594+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:05.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:05.911+0000 7f389e18e700 -1 osd.4 99 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:06.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:06.138+0000 7f72c425d700 -1 osd.5 99 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:06.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:06.546+0000 7f6e44c9f700 -1 osd.7 99 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:06.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:06.586+0000 7f596d92c700 -1 osd.6 99 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:06.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:06.976+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:07.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:07.158+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:07.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:07.508+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:07.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:07.593+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:07.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:07.948+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:08.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:08.163+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:08.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:08.503+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:08.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:08.563+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:08.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:08.992+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:09.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:09.134+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:09.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:09.496+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:09.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:09.521+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:10.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:10.034+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:10.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:10.165+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:10.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:10.490+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:10.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:10.527+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:10.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:56:10.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:56:11.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:11.057+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:11.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:11.200+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:11.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:11.474+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:11.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:11.562+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:12.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:12.104+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:12.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:12.249+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:12.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:12.450+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:12.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:12.559+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:13.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:13.080+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:13.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:13.291+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:13.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:13.473+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:13.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:13.522+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:14.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:14.080+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:14.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:14.270+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:14.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:14.496+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:14.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:14.523+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:15.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:15.037+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:15.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:15.257+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:15.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:15.475+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:15.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:15.484+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:16.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:16.066+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:16.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:16.286+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:16.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:16.447+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:16.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:16.498+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:17.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:17.035+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:17.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:17.321+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:17.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:17.437+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:17.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:17.542+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:18.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:18.065+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:18.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:18.277+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:18.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:18.430+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:18.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:18.583+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:19.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:19.096+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:19.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:19.305+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:19.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:19.414+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:19.483 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:56:19.481+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:56:19.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:19.565+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:20.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:20.133+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:20.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:20.347+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:20.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:20.445+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:20.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:20.582+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:21.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:21.142+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:21.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:21.350+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:21.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:21.432+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:21.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:21.552+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:22.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:22.095+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:22.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:22.350+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:22.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:22.415+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:22.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:22.546+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:23.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:23.098+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:23.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:23.316+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:23.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:23.450+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:23.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:23.514+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:24.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:24.123+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:24.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:24.360+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:24.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:24.434+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:24.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:24.487+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:25.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:25.169+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:25.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:25.391+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:25.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:25.440+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:25.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:25.460+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:26.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:26.216+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:26.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:26.424+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:26.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:26.436+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:26.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:26.456+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:27.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:27.244+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:27.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:27.389+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:27.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:27.397+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:27.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:27.469+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:28.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:28.268+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:28.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:28.353+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:28.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:28.418+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:28.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:28.473+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:29.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:29.267+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:29.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:29.330+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:29.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:29.385+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:29.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:29.469+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:30.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:30.305+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:30.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:30.327+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:30.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:30.388+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:30.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:30.422+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:31.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:31.278+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:31.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:31.311+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:31.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:31.347+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:31.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:31.467+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:32.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:32.308+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:32.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:32.356+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:32.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:32.359+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:32.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:32.428+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:33.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:33.329+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:33.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:33.350+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:33.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:33.390+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:33.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:33.456+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:34.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:34.315+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:34.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:34.336+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:34.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:34.372+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:34.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:34.434+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:34.499 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:56:34.498+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:56:35.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:35.299+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:35.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:35.349+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:35.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:35.418+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:35.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:35.457+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:36.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:36.253+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:36.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:36.329+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:36.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:36.404+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:36.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:36.432+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:37.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:37.206+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:37.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:37.347+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:37.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:37.451+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:37.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:37.467+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:38.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:38.160+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:38.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:38.384+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:38.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:38.423+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:38.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:38.437+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:39.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:39.160+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:39.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:39.390+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:39.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:39.394+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:39.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:39.460+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:40.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:40.128+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:40.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:40.437+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:40.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:40.437+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:40.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:40.443+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:40.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:56:40.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:56:41.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:41.162+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:41.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:41.460+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:41.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:41.469+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:41.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:41.484+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:42.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:42.136+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:42.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:42.465+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:42.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:42.466+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:42.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:42.467+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:43.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:43.160+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:43.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:43.450+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:43.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:43.507+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:43.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:43.513+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:44.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:44.127+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:44.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:44.454+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:44.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:44.503+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:44.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:44.563+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:45.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:45.096+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:45.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:45.415+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:45.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:45.456+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:45.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:45.599+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:46.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:46.131+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:46.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:46.431+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:46.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:46.502+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:46.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:46.577+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:47.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:47.152+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:47.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:47.470+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:47.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:47.472+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:47.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:47.604+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:48.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:48.160+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:48.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:48.457+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:48.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:48.489+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:48.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:48.641+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:49.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:49.121+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:49.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:49.488+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:49.514 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:56:49.513+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:56:49.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:49.522+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:49.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:49.650+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:50.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:50.138+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:50.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:50.493+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:50.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:50.532+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:50.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:50.616+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:51.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:51.166+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:51.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:51.501+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:51.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:51.511+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:51.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:51.623+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:52.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:52.159+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:52.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:52.481+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:52.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:52.492+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:52.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:52.674+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:53.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:53.170+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:53.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:53.452+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:53.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:53.473+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:53.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:53.651+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:54.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:54.127+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:54.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:54.457+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:54.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:54.478+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:54.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:54.650+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:55.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:55.092+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:55.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:55.438+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:55.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:55.455+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:55.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:55.628+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:56.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:56.061+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:56.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:56.389+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:56.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:56.422+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:56.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:56.640+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:56.790 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:56:56.788+0000 7f403ca4a700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:56:56.808 INFO:tasks.ceph.mds.c.smithi049.stderr: -1> 2022-04-03T22:56:56.788+0000 7f403ca4a700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T22:56:56.809 INFO:tasks.ceph.mds.c.smithi049.stderr:2022-04-03T22:56:56.789+0000 7f403c249700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-03T22:56:56.837 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2022-04-03T22:56:57.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:57.058+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:57.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:57.404+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:57.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:57.443+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:57.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:57.680+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:58.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:58.060+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:58.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:58.410+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:58.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:58.413+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:58.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:58.698+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:59.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:56:59.071+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:59.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:56:59.367+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:59.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:56:59.421+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:56:59.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:56:59.686+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:00.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:00.075+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:00.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:00.360+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:00.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:00.423+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:00.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:00.710+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:01.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:01.038+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:01.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:01.386+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:01.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:01.409+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:01.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:01.732+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:02.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:02.087+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:02.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:02.398+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:02.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:02.399+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:02.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:02.763+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:03.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:03.098+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:03.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:03.361+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:03.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:03.407+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:03.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:03.734+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:04.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:04.146+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:04.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:04.325+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:04.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:04.381+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:04.523 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:57:04.521+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:57:04.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:04.771+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:05.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:05.194+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:05.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:05.281+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:05.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:05.334+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:05.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:05.802+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:06.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:06.196+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:06.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:06.275+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:06.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:06.349+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:06.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:06.852+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:07.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:07.162+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:07.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:07.323+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:07.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:07.384+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:07.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:07.805+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:08.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:08.178+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:08.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:08.286+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:08.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:08.417+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:08.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:08.794+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:09.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:09.207+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:09.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:09.298+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:09.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:09.424+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:09.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:09.756+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:10.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:10.255+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:10.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:10.257+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:10.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:10.402+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:10.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:10.711+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:10.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:57:10.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:57:11.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:11.221+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:11.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:11.277+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:11.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:11.376+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:11.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:11.668+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:12.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:12.205+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:12.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:12.250+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:12.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:12.425+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:12.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:12.633+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:13.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:13.231+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:13.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:13.254+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:13.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:13.466+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:13.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:13.648+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:14.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:14.225+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:14.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:14.254+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:14.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:14.486+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:14.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:14.692+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:15.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:15.235+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:15.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:15.240+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:15.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:15.449+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:15.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:15.685+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:16.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:16.209+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:16.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:16.223+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:16.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:16.417+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:16.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:16.733+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:17.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:17.216+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:17.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:17.257+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:17.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:17.369+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:17.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:17.711+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:18.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:18.264+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:18.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:18.271+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:18.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:18.341+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:18.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:18.704+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:19.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:19.242+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:19.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:19.301+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:19.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:19.358+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:19.539 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:57:19.537+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:57:19.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:19.744+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:20.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:20.289+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:20.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:20.328+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:20.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:20.382+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:20.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:20.780+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:21.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:21.290+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:21.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:21.335+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:21.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:21.336+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:21.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:21.805+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:22.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:22.295+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:22.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:22.309+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:22.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:22.335+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:22.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:22.785+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:23.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:23.288+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:23.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:23.293+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:23.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:23.376+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:23.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:23.794+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:24.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:24.263+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:24.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:24.277+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:24.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:24.373+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:24.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:24.813+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:25.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:25.281+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:25.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:25.307+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:25.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:25.369+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:25.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:25.830+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:26.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:26.237+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:26.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:26.324+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:26.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:26.346+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:26.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:26.835+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:27.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:27.240+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:27.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:27.361+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:27.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:27.372+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:27.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:27.877+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:28.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:28.263+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:28.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:28.375+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:28.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:28.403+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:28.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:28.852+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:29.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:29.299+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:29.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:29.328+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:29.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:29.373+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:29.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:29.836+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:30.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:30.298+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:30.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:30.303+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:30.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:30.332+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:30.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:30.818+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:31.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:31.278+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:31.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:31.323+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:31.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:31.328+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:31.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:31.777+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:32.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:32.239+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:32.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:32.349+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:32.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:32.370+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:32.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:32.785+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:33.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:33.233+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:33.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:33.343+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:33.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:33.398+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:33.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:33.743+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:34.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:34.209+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:34.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:34.322+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:34.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:34.360+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:34.555 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:57:34.553+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:57:34.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:34.735+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:35.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:35.167+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:35.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:35.340+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:35.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:35.393+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:35.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:35.752+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:36.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:36.142+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:36.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:36.382+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:36.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:36.404+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:36.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:36.761+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:37.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:37.154+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:37.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:37.428+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:37.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:37.448+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:37.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:37.752+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:38.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:38.165+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:38.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:38.426+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:38.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:38.449+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:38.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:38.709+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:39.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:39.131+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:39.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:39.384+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:39.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:39.453+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:39.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:39.749+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:40.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:40.124+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:40.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:40.392+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:40.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:40.457+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:40.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:40.774+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:40.920 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:57:40.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:57:41.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:41.145+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:41.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:41.420+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:41.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:41.424+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:41.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:41.803+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:42.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:42.098+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:42.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:42.379+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:42.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:42.395+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:42.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:42.811+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:43.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:43.064+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:43.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:43.420+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:43.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:43.430+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:43.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:43.800+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:44.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:44.091+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:44.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:44.388+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:44.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:44.409+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:44.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:44.818+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:45.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:45.134+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:45.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:45.385+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:45.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:45.448+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:45.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:45.802+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:46.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:46.158+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:46.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:46.349+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:46.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:46.448+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:46.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:46.827+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:47.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:47.113+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:47.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:47.341+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:47.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:47.404+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:47.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:47.855+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:48.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:48.092+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:48.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:48.362+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:48.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:48.431+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:48.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:48.870+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:49.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:49.048+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:49.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:49.363+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:49.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:49.469+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:49.569 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:57:49.568+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:57:49.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:49.862+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:50.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:50.030+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:50.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:50.376+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:50.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:50.459+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:50.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:50.864+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:50.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:50.983+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:51.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:51.369+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:51.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:51.464+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:51.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:51.830+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:51.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:51.972+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:52.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:52.341+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:52.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:52.435+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:52.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:52.863+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:52.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:52.970+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:53.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:53.341+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:53.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:53.390+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:53.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:53.827+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:53.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:53.956+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:54.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:54.388+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:54.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:54.388+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:54.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:54.846+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:54.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:54.946+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:55.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:55.345+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:55.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:55.353+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:55.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:55.802+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:55.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:55.986+0000 7f389e18e700 -1 osd.4 100 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:56.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:56.328+0000 7f72c425d700 -1 osd.5 100 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:56.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:56.353+0000 7f596d92c700 -1 osd.6 100 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:56.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:56.848+0000 7f6e44c9f700 -1 osd.7 100 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:57.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:56.974+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:57.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:57.317+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:57.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:57.361+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:57.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:57.857+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:57.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:57.950+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:58.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:58.289+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:58.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:58.356+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:58.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:58.887+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:58.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:57:58.995+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:59.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:57:59.291+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:59.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:57:59.373+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:57:59.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:57:59.843+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:00.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:00.032+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:00.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:00.244+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:00.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:00.359+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:00.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:00.886+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:01.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:01.034+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:01.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:01.262+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:01.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:01.387+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:01.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:01.889+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:02.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:02.011+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:02.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:02.279+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:02.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:02.344+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:02.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:02.928+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:02.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:02.982+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:03.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:03.248+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:03.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:03.325+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:03.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:03.971+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:03.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:03.993+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:04.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:04.253+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:04.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:04.346+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:04.585 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:58:04.583+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:58:04.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:04.979+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:05.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:05.005+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:05.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:05.269+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:05.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:05.374+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:05.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:05.988+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:06.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:06.045+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:06.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:06.287+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:06.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:06.358+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:06.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:06.940+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:07.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:07.050+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:07.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:07.325+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:07.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:07.356+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:07.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:07.913+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:08.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:08.030+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:08.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:08.320+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:08.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:08.338+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:08.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:08.912+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:09.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:09.064+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:09.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:09.347+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:09.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:09.372+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:09.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:09.920+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:10.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:10.042+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:10.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:10.328+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:10.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:10.413+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:10.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:10.896+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:11.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:11.032+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:11.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:58:11.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:58:11.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:11.287+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:11.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:11.388+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:11.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:11.848+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:11.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:11.988+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:12.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:12.264+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:12.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:12.349+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:12.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:12.887+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:13.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:13.022+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:13.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:13.297+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:13.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:13.314+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:13.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:13.869+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:14.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:14.007+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:14.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:14.334+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:14.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:14.342+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:14.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:14.834+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:14.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:14.985+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:15.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:15.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:15.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:15.335+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:15.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:15.817+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:16.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:16.015+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:16.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:16.275+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:16.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:16.329+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:16.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:16.778+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:17.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:17.062+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:17.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:17.271+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:17.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:17.290+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:17.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:17.826+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:18.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:18.040+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:18.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:18.244+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:18.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:18.319+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:18.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:18.858+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:19.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:19.036+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:19.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:19.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:19.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:19.322+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:19.601 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:58:19.599+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:58:19.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:19.882+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:20.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:20.006+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:20.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:20.296+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:20.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:20.334+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:20.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:20.867+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:21.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:21.004+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:21.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:21.288+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:21.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:21.311+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:21.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:21.891+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:21.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:21.959+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:22.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:22.253+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:22.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:22.267+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:22.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:22.932+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:23.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:22.967+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:23.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:23.220+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:23.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:23.251+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:23.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:23.921+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:23.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:23.960+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:24.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:24.244+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:24.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:24.265+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:24.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:24.955+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:24.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:24.971+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:25.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:25.244+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:25.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:25.287+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:25.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:25.957+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:25.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:25.972+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:26.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:26.284+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:26.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:26.292+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:26.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:26.924+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:26.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:26.992+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:27.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:27.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:27.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:27.332+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:27.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:27.950+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:28.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:28.024+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:28.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:28.287+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:28.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:28.287+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:28.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:28.962+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:28.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:28.985+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:29.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:29.274+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:29.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:29.310+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:29.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:29.946+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:29.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:29.947+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:30.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:30.295+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:30.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:30.348+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:30.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:30.923+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:30.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:30.996+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:31.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:31.323+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:31.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:31.359+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:31.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:31.962+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:31.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:31.974+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:32.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:32.361+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:32.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:32.361+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:32.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:32.993+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:33.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:33.011+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:33.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:33.316+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:33.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:33.405+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:33.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:33.962+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:33.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:33.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:34.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:34.365+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:34.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:34.422+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:34.616 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:58:34.615+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:58:34.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:34.975+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:34.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:34.979+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:35.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:35.357+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:35.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:35.471+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:36.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:36.006+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:36.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:36.022+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:36.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:36.320+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:36.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:36.450+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:37.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:37.010+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:37.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:37.011+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:37.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:37.296+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:37.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:37.496+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:38.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:37.999+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:38.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:38.004+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:38.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:38.281+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:38.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:38.456+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:38.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:38.968+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:38.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:38.990+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:39.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:39.247+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:39.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:39.429+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:39.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:39.974+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:40.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:40.020+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:40.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:40.256+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:40.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:40.382+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:41.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:41.014+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:41.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:41.024+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:41.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:58:41.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:58:41.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:41.219+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:41.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:41.422+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:42.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:42.009+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:42.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:42.028+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:42.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:42.190+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:42.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:42.433+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:42.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:42.995+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:43.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:43.006+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:43.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:43.210+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:43.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:43.402+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:44.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:44.039+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:44.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:44.044+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:44.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:44.212+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:44.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:44.432+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:45.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:45.013+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:45.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:45.044+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:45.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:45.193+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:45.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:45.390+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:45.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:45.982+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:46.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:46.091+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:46.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:46.158+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:46.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:46.429+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:46.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:46.967+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:47.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:47.132+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:47.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:47.143+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:47.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:47.465+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:47.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:47.963+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:48.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:48.120+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:48.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:48.142+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:48.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:48.506+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:48.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:48.961+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:49.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:49.164+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:49.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:49.171+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:49.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:49.534+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:49.632 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:58:49.631+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:58:50.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:49.998+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:50.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:50.151+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:50.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:50.216+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:50.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:50.532+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:50.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:50.964+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:51.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:51.179+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:51.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:51.241+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:51.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:51.483+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:52.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:52.001+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:52.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:52.157+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:52.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:52.221+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:52.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:52.482+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:53.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:53.013+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:53.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:53.207+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:53.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:53.248+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:53.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:53.459+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:54.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:54.042+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:54.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:54.165+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:54.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:54.273+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:54.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:54.451+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:55.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:55.056+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:55.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:55.204+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:55.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:55.267+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:55.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:55.426+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:56.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:56.009+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:56.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:56.173+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:56.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:56.303+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:56.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:56.432+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:56.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:56.976+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:57.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:57.207+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:57.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:57.327+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:57.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:57.389+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:57.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:57.970+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:58.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:58.184+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:58.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:58.349+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:58.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:58.362+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:58.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:58.931+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:59.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:58:59.165+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:59.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:58:59.392+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:59.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:58:59.400+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:58:59.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:58:59.922+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:00.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:00.123+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:00.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:00.360+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:00.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:00.397+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:00.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:00.921+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:01.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:01.077+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:01.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:01.333+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:01.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:01.440+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:01.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:01.882+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:02.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:02.040+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:02.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:02.330+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:02.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:02.480+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:02.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:02.914+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:03.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:03.085+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:03.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:03.353+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:03.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:03.525+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:03.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:03.921+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:04.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:04.039+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:04.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:04.306+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:04.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:04.514+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:04.648 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:59:04.647+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:59:04.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:04.934+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:05.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:05.054+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:05.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:05.279+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:05.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:05.494+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:05.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:05.909+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:06.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:06.051+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:06.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:06.255+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:06.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:06.505+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:06.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:06.938+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:07.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:07.065+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:07.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:07.299+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:07.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:07.484+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:07.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:07.933+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:08.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:08.052+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:08.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:08.277+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:08.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:08.472+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:08.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:08.956+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:09.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:09.040+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:09.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:09.285+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:09.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:09.442+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:09.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:09.952+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:09.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:09.997+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:10.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:10.312+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:10.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:10.491+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:10.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:10.989+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:11.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:11.022+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:11.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:59:11.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:59:11.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:11.304+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:11.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:11.471+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:12.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:12.004+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:12.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:12.035+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:12.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:12.313+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:12.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:12.509+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:13.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:13.027+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:13.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:13.060+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:13.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:13.302+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:13.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:13.460+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:14.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:14.016+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:14.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:14.098+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:14.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:14.351+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:14.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:14.422+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:15.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:15.062+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:15.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:15.109+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:15.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:15.400+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:15.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:15.431+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:16.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:16.054+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:16.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:16.123+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:16.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:16.416+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:16.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:16.441+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:17.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:17.046+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:17.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:17.150+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:17.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:17.398+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:17.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:17.441+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:18.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:18.042+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:18.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:18.144+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:18.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:18.434+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:18.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:18.443+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:19.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:19.066+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:19.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:19.100+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:19.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:19.423+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:19.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:19.443+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:19.653 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:59:19.651+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:59:20.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:20.032+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:20.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:20.100+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:20.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:20.424+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:20.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:20.443+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:21.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:21.031+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:21.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:21.098+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:21.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:21.462+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:21.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:21.465+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:22.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:22.043+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:22.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:22.107+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:22.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:22.427+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:22.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:22.444+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:23.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:23.004+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:23.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:23.133+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:23.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:23.377+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:23.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:23.492+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:23.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:23.963+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:24.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:24.114+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:24.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:24.347+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:24.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:24.470+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:24.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:24.997+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:25.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:25.143+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:25.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:25.336+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:25.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:25.492+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:25.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:25.969+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:26.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:26.185+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:26.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:26.356+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:26.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:26.481+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:26.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:26.924+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:27.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:27.142+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:27.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:27.394+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:27.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:27.459+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:27.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:27.933+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:28.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:28.096+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:28.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:28.382+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:28.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:28.446+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:28.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:28.973+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:29.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:29.085+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:29.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:29.344+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:29.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:29.493+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:30.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:29.999+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:30.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:30.123+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:30.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:30.387+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:30.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:30.464+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:31.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:31.037+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:31.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:31.075+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:31.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:31.350+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:31.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:31.433+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:32.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:31.999+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:32.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:32.097+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:32.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:32.399+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:32.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:32.415+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:33.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:33.035+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:33.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:33.110+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:33.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:33.358+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:33.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:33.382+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:34.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:34.014+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:34.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:34.094+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:34.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:34.335+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:34.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:34.370+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:34.669 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:59:34.668+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:59:35.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:35.035+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:35.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:35.094+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:35.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:35.349+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:35.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:35.357+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:36.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:36.042+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:36.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:36.114+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:36.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:36.304+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:36.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:36.346+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:37.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:37.012+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:37.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:37.120+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:37.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:37.277+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:37.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:37.396+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:38.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:38.041+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:38.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:38.169+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:38.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:38.323+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:38.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:38.350+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:39.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:39.065+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:39.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:39.129+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:39.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:39.318+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:39.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:39.329+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:40.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:40.072+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:40.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:40.133+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:40.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:40.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:40.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:40.326+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:41.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:41.051+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:41.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:41.178+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:41.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:41.327+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:41.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:41.333+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:41.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:59:41.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T22:59:42.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:42.030+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:42.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:42.190+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:42.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:42.344+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:42.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:42.353+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:42.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:42.993+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:43.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:43.155+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:43.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:43.320+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:43.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:43.382+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:43.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:43.983+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:44.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:44.113+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:44.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:44.294+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:44.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:44.380+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:44.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:44.961+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:45.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:45.075+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:45.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:45.329+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:45.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:45.343+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:45.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:45.951+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:46.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:46.096+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:46.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:46.377+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:46.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:46.381+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:46.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:46.906+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:47.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:47.074+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:47.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:47.334+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:47.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:47.419+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:47.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:47.862+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:48.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:48.121+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:48.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:48.366+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:48.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:48.438+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:48.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:48.831+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:49.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:49.105+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:49.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:49.329+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:49.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:49.434+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:49.685 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T22:59:49.683+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T22:59:49.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:49.860+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:50.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:50.149+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:50.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:50.352+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:50.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:50.462+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:50.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:50.871+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:51.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:51.170+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:51.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:51.329+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:51.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:51.437+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:51.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:51.890+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:52.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:52.139+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:52.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:52.325+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:52.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:52.471+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:52.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:52.877+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:53.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:53.157+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:53.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:53.345+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:53.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:53.453+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:53.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:53.859+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:54.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:54.140+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:54.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:54.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:54.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:54.452+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:54.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:54.899+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:55.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:55.144+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:55.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:55.345+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:55.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:55.436+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:55.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:55.853+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:56.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:56.119+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:56.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:56.328+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:56.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:56.439+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:56.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:56.836+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:57.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:57.152+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:57.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:57.295+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:57.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:57.411+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:57.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:57.866+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:58.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:58.144+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:58.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:58.330+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:58.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:58.374+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:58.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:58.822+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:59.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T22:59:59.162+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:59.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T22:59:59.299+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:59.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T22:59:59.361+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T22:59:59.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T22:59:59.860+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:00.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:00.200+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:00.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:00.272+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:00.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:00.322+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:00.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:00.812+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:01.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:01.159+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:01.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:01.229+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:01.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:01.372+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:01.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:01.786+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:02.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:02.190+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:02.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:02.242+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:02.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:02.359+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:02.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:02.792+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:03.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:03.194+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:03.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:03.219+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:03.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:03.372+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:03.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:03.786+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:04.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:04.187+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:04.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:04.219+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:04.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:04.369+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:04.701 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:00:04.699+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:00:04.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:04.791+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:05.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:05.167+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:05.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:05.225+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:05.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:05.383+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:05.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:05.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:06.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:06.134+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:06.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:06.226+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:06.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:06.408+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:06.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:06.794+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:07.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:07.101+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:07.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:07.275+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:07.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:07.446+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:07.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:07.806+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:08.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:08.057+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:08.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:08.297+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:08.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:08.441+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:08.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:08.785+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:09.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:09.019+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:09.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:09.302+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:09.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:09.394+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:09.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:09.807+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:10.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:10.040+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:10.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:10.265+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:10.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:10.362+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:10.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:10.850+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:11.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:11.087+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:11.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:11.308+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:11.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:11.407+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:11.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:00:11.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:00:11.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:11.880+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:12.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:12.067+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:12.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:12.330+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:12.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:12.454+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:12.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:12.864+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:13.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:13.026+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:13.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:13.368+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:13.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:13.480+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:13.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:13.835+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:14.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:14.043+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:14.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:14.394+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:14.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:14.504+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:14.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:14.826+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:15.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:15.063+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:15.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:15.372+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:15.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:15.527+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:15.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:15.868+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:16.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:16.047+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:16.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:16.413+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:16.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:16.531+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:16.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:16.860+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:17.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:17.041+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:17.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:17.397+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:17.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:17.490+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:17.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:17.866+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:18.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:18.051+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:18.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:18.385+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:18.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:18.510+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:18.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:18.844+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:19.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:19.025+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:19.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:19.412+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:19.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:19.472+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:19.707 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:00:19.705+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:00:19.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:19.862+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:20.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:20.067+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:20.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:20.367+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:20.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:20.475+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:20.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:20.865+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:21.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:21.028+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:21.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:21.349+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:21.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:21.524+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:21.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:21.898+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:21.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:21.984+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:22.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:22.377+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:22.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:22.519+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:22.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:22.872+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:22.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:22.961+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:23.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:23.336+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:23.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:23.564+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:23.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:23.896+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:23.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:23.934+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:24.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:24.375+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:24.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:24.556+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:24.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:24.908+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:24.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:24.977+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:25.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:25.344+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:25.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:25.541+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:25.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:25.915+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:26.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:26.002+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:26.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:26.298+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:26.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:26.582+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:26.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:26.902+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:26.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:26.986+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:27.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:27.315+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:27.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:27.630+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:27.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:27.859+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:27.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:27.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:28.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:28.270+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:28.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:28.680+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:28.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:28.822+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:28.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:28.971+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:29.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:29.247+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:29.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:29.718+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:29.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:29.852+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:29.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:29.981+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:30.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:30.239+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:30.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:30.722+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:30.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:30.825+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:31.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:31.022+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:31.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:31.269+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:31.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:31.681+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:31.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:31.787+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:32.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:32.051+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:32.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:32.295+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:32.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:32.730+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:32.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:32.780+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:33.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:33.015+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:33.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:33.305+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:33.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:33.691+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:33.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:33.764+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:34.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:34.040+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:34.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:34.256+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:34.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:34.701+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:34.723 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:00:34.721+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:00:34.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:34.799+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:35.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:35.039+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:35.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:35.250+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:35.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:35.663+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:35.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:35.832+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:36.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:36.041+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:36.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:36.280+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:36.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:36.690+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:36.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:36.832+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:37.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:37.030+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:37.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:37.256+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:37.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:37.679+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:37.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:37.853+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:38.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:38.050+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:38.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:38.250+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:38.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:38.647+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:38.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:38.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:39.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:39.074+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:39.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:39.266+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:39.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:39.660+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:39.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:39.832+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:40.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:40.048+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:40.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:40.225+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:40.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:40.683+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:40.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:40.788+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:41.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:41.002+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:41.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:41.207+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:41.672 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:00:41.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:00:41.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:41.707+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:41.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:41.741+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:41.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:41.962+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:42.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:42.255+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:42.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:42.693+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:42.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:42.710+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:42.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:42.933+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:43.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:43.264+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:43.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:43.708+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:43.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:43.720+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:43.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:43.973+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:44.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:44.298+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:44.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:44.675+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:44.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:44.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:44.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:44.961+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:45.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:45.266+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:45.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:45.670+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:45.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:45.730+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:45.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:45.946+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:46.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:46.297+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:46.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:46.625+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:46.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:46.738+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:46.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:46.932+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:47.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:47.259+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:47.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:47.654+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:47.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:47.740+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:47.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:47.975+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:48.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:48.288+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:48.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:48.704+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:48.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:48.787+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:48.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:48.939+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:49.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:49.313+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:49.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:49.667+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:49.739 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:00:49.738+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:00:49.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:49.789+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:49.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:49.977+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:50.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:50.331+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:50.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:50.681+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:50.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:50.821+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:50.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:50.970+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:51.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:51.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:51.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:51.689+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:51.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:51.772+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:51.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:51.932+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:52.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:52.267+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:52.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:52.676+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:52.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:52.793+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:52.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:52.965+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:53.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:53.241+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:53.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:53.702+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:53.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:53.798+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:53.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:53.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:54.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:54.216+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:54.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:54.712+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:54.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:54.781+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:55.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:55.004+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:55.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:55.179+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:55.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:55.672+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:55.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:55.823+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:56.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:56.019+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:56.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:56.162+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:56.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:56.719+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:56.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:56.854+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:57.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:57.000+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 13 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:57.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:57.202+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:57.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:57.757+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:57.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:57.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:58.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:58.027+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:58.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:58.182+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:58.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:58.709+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:58.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:58.917+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:59.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:00:59.043+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:59.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:00:59.216+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:59.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:00:59.700+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:00:59.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:00:59.882+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:00.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:00.086+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:00.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:00.179+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:00.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:00.665+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:00.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:00.844+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:01.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:01.061+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:01.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:01.229+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:01.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:01.692+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:01.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:01.864+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:02.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:02.025+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:02.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:02.241+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:02.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:02.702+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:02.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:02.841+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:02.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:02.996+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:03.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:03.219+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:03.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:03.689+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:03.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:03.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:03.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:03.982+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:04.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:04.209+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:04.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:04.699+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:04.745 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:01:04.743+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:01:04.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:04.911+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:04.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:04.935+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:05.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:05.213+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:05.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:05.746+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:05.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:05.864+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:05.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:05.949+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:06.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:06.250+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:06.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:06.751+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:06.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:06.823+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:06.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:06.940+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:07.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:07.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:07.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:07.747+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:07.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:07.847+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:07.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:07.973+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:08.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:08.307+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:08.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:08.773+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:08.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:08.809+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:08.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:08.930+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:09.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:09.318+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:09.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:09.775+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:09.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:09.814+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:09.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:09.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:10.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:10.319+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:10.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:10.727+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:10.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:10.785+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:10.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:10.926+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:11.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:11.338+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:11.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:11.686+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:11.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:11.754+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:11.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:01:11.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:01:11.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:11.936+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:12.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:12.340+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:12.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:12.679+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:12.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:12.745+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:12.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:12.953+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:13.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:13.306+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:13.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:13.728+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:13.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:13.729+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:13.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:13.976+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:14.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:14.323+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:14.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:14.689+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:14.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:14.775+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:14.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:14.964+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:15.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:15.371+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:15.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:15.698+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:15.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:15.823+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:15.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:15.997+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:16.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:16.366+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:16.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:16.663+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:16.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:16.794+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:16.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:16.975+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:17.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:17.332+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:17.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:17.672+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:17.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:17.844+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:17.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:17.940+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:18.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:18.315+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:18.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:18.695+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:18.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:18.883+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:18.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:18.915+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:19.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:19.343+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:19.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:19.703+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:19.761 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:01:19.759+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:01:19.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:19.851+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:19.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:19.881+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:20.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:20.339+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:20.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:20.708+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:20.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:20.809+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:20.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:20.923+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:21.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:21.336+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:21.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:21.721+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:21.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:21.822+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:21.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:21.962+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:22.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:22.385+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:22.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:22.682+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:22.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:22.851+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:22.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:22.926+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:23.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:23.339+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:23.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:23.664+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:23.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:23.891+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:23.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:23.948+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:24.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:24.355+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:24.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:24.671+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:24.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:24.916+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:24.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:24.965+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:25.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:25.327+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:25.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:25.635+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:25.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:25.922+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:25.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:25.990+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:26.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:26.358+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:26.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:26.589+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:26.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:26.904+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:27.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:27.014+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:27.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:27.376+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:27.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:27.595+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:27.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:27.866+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:28.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:28.059+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:28.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:28.376+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:28.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:28.625+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:28.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:28.821+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:29.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:29.092+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:29.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:29.384+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:29.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:29.605+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:29.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:29.791+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:30.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:30.045+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:30.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:30.342+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:30.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:30.565+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:30.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:30.781+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:31.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:31.052+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:31.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:31.351+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:31.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:31.538+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:31.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:31.737+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:32.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:32.038+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:32.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:32.322+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:32.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:32.531+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:32.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:32.747+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:33.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:33.001+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:33.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:33.310+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:33.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:33.518+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:33.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:33.750+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:33.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:33.975+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:34.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:34.309+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:34.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:34.535+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:34.777 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:01:34.775+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:01:34.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:34.783+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:35.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:35.011+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:35.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:35.347+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:35.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:35.524+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:35.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:35.739+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:36.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:36.000+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:36.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:36.352+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:36.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:36.572+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:36.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:36.694+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:36.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:36.995+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:37.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:37.388+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:37.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:37.526+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:37.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:37.687+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:37.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:37.968+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:38.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:38.416+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:38.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:38.557+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:38.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:38.694+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:38.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:38.940+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:39.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:39.395+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:39.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:39.589+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:39.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:39.673+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:39.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:39.920+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:40.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:40.431+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:40.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:40.590+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:40.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:40.703+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:40.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:40.915+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:41.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:41.480+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:41.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:41.631+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:41.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:41.736+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:41.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:41.893+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:41.895 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:01:41.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:01:42.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:42.431+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:42.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:42.616+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:42.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:42.746+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:42.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:42.912+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:43.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:43.410+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:43.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:43.655+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:43.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:43.746+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:43.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:43.922+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:44.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:44.366+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:44.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:44.649+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:44.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:44.709+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:44.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:44.913+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:45.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:45.327+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:45.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:45.672+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:45.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:45.741+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:45.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:45.869+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:46.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:46.370+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:46.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:46.717+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:46.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:46.788+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:46.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:46.916+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:47.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:47.343+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:47.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:47.723+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:47.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:47.746+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:47.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:47.878+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:48.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:48.349+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:48.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:48.716+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:48.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:48.765+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:48.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:48.893+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:49.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:49.315+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:49.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:49.756+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:49.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:49.771+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:49.779 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:01:49.777+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:01:49.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:49.870+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:50.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:50.343+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:50.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:50.725+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:50.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:50.785+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:50.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:50.832+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:51.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:51.310+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:51.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:51.683+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:51.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:51.780+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:51.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:51.878+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:52.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:52.289+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:52.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:52.697+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:52.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:52.747+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:52.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:52.898+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:53.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:53.306+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:53.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:53.676+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:53.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:53.781+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:53.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:53.915+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:54.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:54.311+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:54.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:54.627+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:54.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:54.809+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:54.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:54.916+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:55.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:55.304+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:55.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:55.638+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:55.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:55.851+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:55.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:55.893+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:56.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:56.286+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:56.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:56.685+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:56.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:56.851+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:56.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:56.895+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:57.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:57.250+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:57.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:57.645+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:57.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:57.812+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:57.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:57.909+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:58.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:58.264+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:58.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:58.614+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:58.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:58.781+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:58.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:58.958+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:59.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:01:59.251+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:59.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:01:59.578+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:59.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:01:59.823+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:01:59.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:01:59.969+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:00.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:00.206+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:00.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:00.551+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:00.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:00.779+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:01.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:01.013+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:01.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:01.247+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:01.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:01.518+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:01.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:01.731+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:02.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:02.049+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:02.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:02.219+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:02.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:02.537+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:02.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:02.750+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:03.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:03.084+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:03.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:03.266+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:03.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:03.565+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:03.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:03.788+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:04.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:04.095+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:04.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:04.299+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:04.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:04.580+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:04.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:04.739+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:04.795 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:02:04.794+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:02:05.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:05.105+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:05.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:05.331+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:05.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:05.616+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:05.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:05.724+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:06.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:06.081+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:06.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:06.341+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:06.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:06.636+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:06.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:06.728+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:07.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:07.074+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:07.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:07.389+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:07.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:07.611+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:07.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:07.735+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:08.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:08.123+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:08.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:08.435+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:08.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:08.629+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:08.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:08.695+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:09.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:09.086+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:09.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:09.474+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:09.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:09.646+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:09.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:09.657+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:10.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:10.103+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:10.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:10.493+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:10.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:10.646+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:10.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:10.676+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:11.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:11.102+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:11.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:11.512+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:11.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:11.657+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:11.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:11.674+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:12.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:02:12.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:02:12.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:12.139+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:12.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:12.527+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:12.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:12.650+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:12.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:12.697+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:13.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:13.098+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:13.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:13.523+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:13.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:13.648+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:13.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:13.670+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:14.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:14.096+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:14.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:14.551+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:14.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:14.643+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:14.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:14.671+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:15.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:15.138+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:15.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:15.585+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:15.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:15.598+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:15.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:15.628+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:16.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:16.171+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:16.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:16.580+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:16.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:16.629+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:16.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:16.630+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:17.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:17.147+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:17.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:17.594+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:17.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:17.595+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:17.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:17.671+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:18.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:18.141+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:18.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:18.573+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:18.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:18.637+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:18.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:18.714+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:19.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:19.148+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:19.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:19.526+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:19.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:19.615+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:19.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:19.738+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:19.811 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:02:19.809+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:02:20.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:20.170+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:20.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:20.505+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:20.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:20.658+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:20.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:20.690+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:21.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:21.145+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:21.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:21.504+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:21.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:21.658+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:21.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:21.699+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:22.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:22.190+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:22.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:22.469+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:22.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:22.637+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:22.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:22.652+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:23.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:23.224+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:23.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:23.450+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:23.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:23.625+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:23.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:23.655+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:24.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:24.273+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:24.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:24.436+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:24.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:24.586+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:24.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:24.617+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:25.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:25.281+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:25.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:25.477+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:25.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:25.551+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:25.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:25.636+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:26.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:26.313+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:26.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:26.471+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:26.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:26.568+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:26.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:26.598+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:27.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:27.336+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:27.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:27.500+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:27.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:27.578+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:27.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:27.613+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:28.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:28.302+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:28.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:28.530+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:28.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:28.537+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:28.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:28.570+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:29.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:29.255+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:29.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:29.505+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:29.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:29.560+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:29.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:29.575+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:30.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:30.230+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:30.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:30.498+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:30.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:30.550+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:30.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:30.564+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:31.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:31.222+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:31.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:31.525+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:31.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:31.535+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:31.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:31.553+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:32.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:32.266+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:32.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:32.551+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:32.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:32.566+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:32.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:32.570+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:33.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:33.311+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:33.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:33.520+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:33.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:33.552+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:33.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:33.583+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:34.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:34.333+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:34.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:34.498+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:34.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:34.544+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:34.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:34.563+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:34.824 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:02:34.822+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:02:35.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:35.361+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:35.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:35.515+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:35.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:35.548+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:35.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:35.578+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:36.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:36.339+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:36.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:36.488+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:36.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:36.560+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:36.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:36.583+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:37.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:37.315+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:37.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:37.517+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:37.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:37.590+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:37.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:37.624+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:38.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:38.356+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:38.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:38.514+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:38.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:38.630+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:38.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:38.637+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:39.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:39.343+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:39.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:39.496+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:39.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:39.615+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:39.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:39.619+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:40.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:40.330+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:40.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:40.474+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:40.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:40.585+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:40.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:40.636+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:41.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:41.352+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:41.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:41.488+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:41.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:41.590+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:41.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:41.666+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:42.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:02:42.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:02:42.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:42.328+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:42.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:42.499+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:42.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:42.620+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:42.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:42.638+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:43.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:43.292+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:43.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:43.451+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:43.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:43.623+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:43.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:43.660+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:44.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:44.275+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:44.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:44.489+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:44.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:44.664+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:44.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:44.678+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:45.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:45.259+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:45.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:45.510+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:45.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:45.632+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:45.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:45.656+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:46.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:46.279+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:46.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:46.464+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:46.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:46.638+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:46.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:46.673+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:47.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:47.284+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:47.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:47.420+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:47.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:47.649+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:47.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:47.682+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:48.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:48.262+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:48.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:48.442+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:48.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:48.636+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:48.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:48.656+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:49.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:49.277+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:49.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:49.452+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:49.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:49.614+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:49.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:49.706+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:49.826 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:02:49.824+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:02:50.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:50.238+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:50.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:50.497+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:50.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:50.623+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:50.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:50.726+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:51.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:51.208+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:51.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:51.500+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:51.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:51.582+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:51.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:51.712+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:52.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:52.176+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:52.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:52.470+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:52.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:52.623+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:52.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:52.742+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:53.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:53.150+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:53.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:53.465+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:53.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:53.652+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:53.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:53.764+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:54.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:54.154+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:54.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:54.441+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:54.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:54.666+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:54.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:54.808+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:55.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:55.150+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:55.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:55.406+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:55.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:55.708+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:55.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:55.850+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:56.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:56.199+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:56.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:56.372+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:56.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:56.756+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:56.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:56.804+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:57.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:57.239+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:57.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:57.328+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:57.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:57.755+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:57.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:57.835+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:58.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:58.259+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:58.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:58.364+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:58.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:58.712+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:58.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:58.806+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:59.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:02:59.281+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:59.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:02:59.414+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:59.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:02:59.743+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:02:59.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:02:59.856+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:00.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:00.297+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:00.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:00.394+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:00.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:00.705+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:00.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:00.867+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:01.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:01.331+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:01.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:01.425+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:01.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:01.684+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:01.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:01.893+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:02.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:02.291+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:02.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:02.434+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:02.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:02.673+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:02.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:02.923+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:03.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:03.311+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:03.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:03.437+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:03.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:03.657+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:03.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:03.877+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:04.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:04.279+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:04.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:04.428+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:04.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:04.660+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:04.842 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:03:04.840+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:03:04.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:04.841+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:05.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:05.246+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:05.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:05.447+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:05.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:05.690+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:05.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:05.842+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:06.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:06.287+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:06.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:06.453+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:06.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:06.685+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:06.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:06.821+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:07.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:07.253+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:07.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:07.482+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:07.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:07.712+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:07.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:07.815+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:08.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:08.232+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:08.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:08.501+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:08.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:08.696+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:08.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:08.855+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:09.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:09.277+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:09.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:09.476+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:09.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:09.684+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:09.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:09.848+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:10.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:10.252+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:10.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:10.460+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:10.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:10.693+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:10.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:10.824+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:11.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:11.203+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:11.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:11.467+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:11.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:11.703+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:11.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:11.828+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:12.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:03:12.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:03:12.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:12.230+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:12.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:12.485+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:12.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:12.724+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:12.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:12.820+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:13.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:13.212+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:13.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:13.495+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:13.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:13.745+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:13.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:13.775+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:14.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:14.221+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:14.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:14.492+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:14.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:14.714+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:14.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:14.795+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:15.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:15.186+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:15.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:15.489+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:15.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:15.719+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:15.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:15.811+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:16.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:16.172+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:16.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:16.445+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:16.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:16.737+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:16.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:16.812+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:17.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:17.133+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:17.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:17.481+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:17.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:17.731+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:17.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:17.782+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:18.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:18.087+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:18.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:18.510+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:18.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:18.759+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:18.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:18.786+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:19.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:19.077+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:19.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:19.494+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:19.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:19.717+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:19.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:19.798+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:19.863 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:03:19.843+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:03:20.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:20.069+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:20.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:20.471+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:20.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:20.758+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:20.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:20.839+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:21.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:21.113+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:21.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:21.497+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:21.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:21.751+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:21.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:21.800+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:22.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:22.077+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:22.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:22.463+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:22.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:22.777+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:22.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:22.788+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:23.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:23.115+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:23.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:23.485+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:23.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:23.734+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:23.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:23.784+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:24.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:24.144+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:24.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:24.458+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:24.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:24.735+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:24.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:24.743+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:25.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:25.181+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:25.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:25.474+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:25.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:25.726+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:25.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:25.739+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:26.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:26.195+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:26.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:26.481+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:26.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:26.751+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:26.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:26.754+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:27.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:27.214+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:27.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:27.530+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:27.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:27.710+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:27.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:27.794+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:28.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:28.216+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:28.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:28.506+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:28.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:28.753+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:28.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:28.763+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:29.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:29.199+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:29.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:29.517+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:29.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:29.744+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:29.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:29.797+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:30.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:30.230+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:30.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:30.540+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:30.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:30.736+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:30.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:30.846+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:31.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:31.240+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:31.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:31.532+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:31.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:31.783+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:31.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:31.860+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:32.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:32.229+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:32.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:32.548+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:32.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:32.764+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:32.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:32.841+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:33.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:33.260+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:33.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:33.563+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:33.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:33.800+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:33.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:33.816+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:34.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:34.261+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:34.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:34.602+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:34.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:34.786+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:34.860 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:03:34.858+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:03:34.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:34.865+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:35.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:35.262+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:35.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:35.595+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:35.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:35.786+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:35.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:35.882+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:36.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:36.223+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:36.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:36.614+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:36.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:36.799+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:36.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:36.917+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:37.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:37.245+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:37.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:37.618+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:37.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:37.759+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:37.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:37.905+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:38.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:38.293+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:38.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:38.608+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:38.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:38.717+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:38.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:38.915+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:39.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:39.309+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:39.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:39.559+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:39.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:39.679+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:39.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:39.881+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:40.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:40.341+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:40.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:40.535+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:40.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:40.709+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:40.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:40.889+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:41.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:41.371+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:41.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:41.547+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:41.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:41.689+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:41.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:41.844+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:42.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:03:42.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:03:42.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:42.337+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:42.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:42.510+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:42.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:42.697+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:42.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:42.805+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:43.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:43.325+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:43.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:43.504+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:43.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:43.680+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:43.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:43.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:44.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:44.374+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:44.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:44.515+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:44.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:44.703+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:44.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:44.849+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:45.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:45.400+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:45.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:45.512+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:45.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:45.720+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:45.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:45.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:46.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:46.369+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:46.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:46.476+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:46.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:46.693+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:46.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:46.821+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:47.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:47.323+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:47.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:47.464+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:47.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:47.683+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:47.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:47.773+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:48.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:48.351+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:48.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:48.416+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:48.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:48.688+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:48.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:48.797+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:49.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:49.357+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:49.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:49.426+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:49.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:49.647+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:49.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:49.832+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:49.876 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:03:49.875+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:03:50.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:50.405+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:50.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:50.459+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:50.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:50.645+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:50.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:50.817+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:51.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:51.431+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:51.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:51.470+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:51.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:51.660+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:51.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:51.827+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:52.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:52.414+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:52.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:52.475+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:52.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:52.638+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:52.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:52.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:53.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:53.368+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:53.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:53.459+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:53.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:53.623+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:53.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:53.861+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:54.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:54.368+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:54.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:54.442+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:54.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:54.592+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:54.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:54.896+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:55.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:55.392+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:55.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:55.489+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:55.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:55.623+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:55.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:55.919+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:56.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:56.394+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:56.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:56.466+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:56.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:56.652+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:56.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:56.952+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:57.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:57.355+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:57.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:57.423+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:57.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:57.700+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:57.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:57.914+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:58.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:58.306+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:58.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:58.406+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:58.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:58.729+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:58.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:58.951+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:59.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:03:59.299+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:59.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:03:59.390+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:59.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:03:59.772+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:03:59.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:03:59.997+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:00.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:00.261+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:00.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:00.348+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:00.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:00.787+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:00.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:00.971+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:01.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:01.286+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:01.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:01.326+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:01.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:01.742+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:01.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:01.941+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:02.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:02.307+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:02.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:02.326+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:02.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:02.766+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:02.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:02.953+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:03.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:03.263+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:03.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:03.301+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:03.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:03.790+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:03.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:03.925+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:04.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:04.269+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:04.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:04.288+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:04.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:04.832+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:04.892 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:04:04.890+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:04:04.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:04.932+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:05.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:05.246+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:05.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:05.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:05.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:05.833+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:05.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:05.891+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:06.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:06.257+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:06.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:06.333+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:06.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:06.808+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:06.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:06.919+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:07.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:07.223+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:07.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:07.379+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:07.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:07.797+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:07.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:07.932+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:08.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:08.254+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:08.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:08.361+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:08.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:08.758+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:08.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:08.953+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:09.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:09.251+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:09.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:09.383+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:09.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:09.794+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:09.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:09.915+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:10.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:10.295+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:10.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:10.381+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:10.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:10.794+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:10.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:10.933+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:11.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:11.323+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:11.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:11.397+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:11.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:11.775+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:11.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:11.933+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:12.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:12.347+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:12.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:12.367+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:12.402 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:04:12.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:04:12.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:12.813+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:12.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:12.982+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:13.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:13.344+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:13.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:13.397+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:13.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:13.862+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:13.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:13.972+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:14.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:14.366+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:14.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:14.389+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:14.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:14.867+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:14.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:14.939+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:15.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:15.363+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:15.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:15.426+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:15.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:15.890+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:15.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:15.959+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:16.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:16.349+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:16.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:16.400+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:16.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:16.865+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:16.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:16.919+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:17.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:17.346+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:17.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:17.394+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:17.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:17.847+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:17.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:17.968+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:18.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:18.374+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:18.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:18.415+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:18.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:18.804+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:18.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:18.982+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:19.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:19.331+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:19.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:19.464+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:19.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:19.790+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:19.908 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:04:19.906+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:04:19.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:19.963+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:20.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:20.293+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:20.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:20.439+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:20.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:20.803+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:20.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:20.994+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:21.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:21.256+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:21.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:21.461+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:21.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:21.782+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:21.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:21.963+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:22.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:22.235+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:22.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:22.435+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:22.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:22.821+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:22.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:22.946+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:23.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:23.276+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:23.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:23.462+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:23.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:23.846+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:23.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:23.925+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:24.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:24.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:24.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:24.504+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:24.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:24.885+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:24.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:24.964+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:25.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:25.285+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:25.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:25.480+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:25.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:25.889+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:26.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:26.006+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:26.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:26.253+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:26.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:26.444+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:26.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:26.870+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:27.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:27.018+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:27.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:27.219+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:27.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:27.415+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:27.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:27.894+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:27.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:27.978+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:28.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:28.195+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:28.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:28.402+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:28.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:28.855+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:28.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:28.969+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:29.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:29.174+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:29.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:29.370+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:29.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:29.902+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:29.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:29.922+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:30.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:30.206+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:30.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:30.342+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:30.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:30.885+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:30.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:30.918+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:31.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:31.219+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:31.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:31.356+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:31.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:31.856+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:31.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:31.883+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:32.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:32.242+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:32.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:32.319+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:32.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:32.822+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:32.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:32.877+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:33.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:33.263+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:33.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:33.333+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:33.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:33.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:33.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:33.895+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:34.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:34.283+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:34.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:34.340+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:34.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:34.756+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:34.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:34.880+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:34.916 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:04:34.915+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:04:35.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:35.304+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:35.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:35.388+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:35.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:35.761+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:35.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:35.861+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:36.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:36.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:36.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:36.389+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:36.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:36.732+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:36.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:36.890+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:37.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:37.312+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:37.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:37.359+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:37.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:37.739+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:37.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:37.905+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:38.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:38.301+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:38.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:38.404+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:38.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:38.745+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:38.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:38.951+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:39.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:39.284+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:39.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:39.429+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:39.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:39.729+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:39.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:39.920+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:40.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:40.264+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:40.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:40.390+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:40.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:40.744+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:40.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:40.927+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:41.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:41.248+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:41.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:41.424+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:41.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:41.710+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:41.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:41.918+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:42.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:42.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:42.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:42.454+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:42.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:04:42.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:04:42.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:42.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:42.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:42.916+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:43.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:43.245+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:43.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:43.450+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:43.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:43.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:43.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:43.955+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:44.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:44.217+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:44.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:44.430+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:44.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:44.707+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:45.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:44.999+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:45.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:45.266+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:45.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:45.389+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:45.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:45.662+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:46.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:46.033+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:46.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:46.287+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:46.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:46.354+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:46.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:46.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:47.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:47.015+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:47.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:47.283+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:47.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:47.361+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:47.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:47.650+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:47.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:47.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:48.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:48.262+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:48.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:48.394+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:48.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:48.647+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:49.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:49.008+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:49.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:49.229+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:49.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:49.347+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:49.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:49.666+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:49.932 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:04:49.930+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:04:49.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:49.968+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:50.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:50.229+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:50.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:50.299+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:50.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:50.638+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:50.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:50.983+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:51.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:51.240+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:51.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:51.251+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:51.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:51.660+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:51.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:51.949+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:52.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:52.254+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:52.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:52.265+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:52.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:52.659+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:52.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:52.987+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:53.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:53.286+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:53.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:53.307+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:53.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:53.640+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:54.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:54.025+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:54.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:54.299+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:54.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:54.347+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:54.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:54.651+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:55.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:55.052+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:55.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:55.334+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:55.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:55.341+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:55.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:55.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:56.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:56.020+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:56.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:56.361+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:56.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:56.369+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:56.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:56.704+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:56.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:56.989+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:57.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:57.340+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:57.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:57.368+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:57.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:57.726+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:57.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:57.963+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:58.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:58.319+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:58.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:58.322+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:58.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:58.720+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:58.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:58.942+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:59.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:04:59.327+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:59.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:04:59.351+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:59.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:04:59.684+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:04:59.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:04:59.936+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:00.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:00.355+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:00.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:00.371+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:00.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:00.642+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:00.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:00.916+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:01.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:01.340+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:01.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:01.348+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:01.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:01.689+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:01.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:01.901+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:02.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:02.344+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:02.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:02.367+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:02.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:02.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:02.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:02.896+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:03.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:03.359+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:03.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:03.407+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:03.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:03.678+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:03.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:03.912+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:04.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:04.346+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:04.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:04.397+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:04.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:04.656+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:04.948 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:05:04.947+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:05:04.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:04.952+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:05.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:05.373+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:05.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:05.390+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:05.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:05.640+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:05.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:05.917+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:06.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:06.367+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:06.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:06.375+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:06.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:06.597+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:06.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:06.942+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:07.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:07.379+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:07.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:07.390+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:07.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:07.570+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:07.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:07.923+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:08.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:08.360+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:08.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:08.375+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:08.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:08.535+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:08.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:08.942+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:09.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:09.341+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:09.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:09.365+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:09.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:09.553+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:09.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:09.977+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:10.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:10.333+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:10.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:10.354+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:10.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:10.575+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:10.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:10.976+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:11.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:11.331+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:11.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:11.398+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:11.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:11.538+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:11.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:11.946+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:12.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:12.347+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:12.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:12.348+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:12.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:05:12.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:12.556+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:12.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:05:12.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:12.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:13.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:13.325+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:13.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:13.334+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:13.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:13.606+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:13.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:13.920+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:14.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:14.345+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:14.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:14.356+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:14.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:14.564+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:14.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:14.945+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:15.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:15.325+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:15.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:15.371+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:15.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:15.555+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:15.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:15.963+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:16.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:16.343+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:16.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:16.349+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:16.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:16.599+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:16.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:16.940+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:17.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:17.302+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:17.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:17.308+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:17.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:17.646+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:17.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:17.948+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:18.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:18.265+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:18.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:18.283+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:18.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:18.694+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:18.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:18.917+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:19.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:19.296+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:19.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:19.303+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:19.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:19.690+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:19.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:19.902+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:19.964 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:05:19.962+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:05:20.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:20.312+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:20.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:20.325+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:20.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:20.704+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:20.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:20.873+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:21.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:21.278+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:21.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:21.360+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:21.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:21.721+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:21.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:21.917+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:22.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:22.251+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:22.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:22.330+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:22.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:22.717+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:22.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:22.966+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:23.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:23.205+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:23.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:23.328+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:23.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:23.691+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:23.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:23.987+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:24.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:24.210+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:24.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:24.295+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:24.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:24.725+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:24.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:24.959+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:25.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:25.248+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:25.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:25.252+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:25.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:25.738+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:25.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:25.954+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:26.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:26.206+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:26.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:26.226+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:26.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:26.704+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:26.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:26.989+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:27.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:27.189+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:27.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:27.207+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:27.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:27.742+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:28.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:28.030+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:28.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:28.186+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:28.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:28.222+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:28.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:28.739+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:29.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:29.049+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:29.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:29.156+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:29.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:29.185+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:29.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:29.748+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:30.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:30.071+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:30.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:30.167+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:30.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:30.199+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:30.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:30.734+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:31.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:31.074+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:31.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:31.160+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:31.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:31.180+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:31.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:31.736+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:32.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:32.094+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:32.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:32.118+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:32.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:32.155+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:32.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:32.775+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:33.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:33.085+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:33.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:33.088+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:33.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:33.182+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:33.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:33.778+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:34.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:34.052+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:34.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:34.082+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:34.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:34.232+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:34.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:34.811+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:34.980 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:05:34.978+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:05:35.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:35.052+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:35.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:35.055+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:35.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:35.184+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:35.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:35.770+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:36.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:36.021+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:36.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:36.038+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:36.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:36.168+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:36.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:36.791+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:37.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:37.002+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:37.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:37.052+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:37.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:37.132+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:37.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:37.754+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:38.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:38.011+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:38.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:38.018+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:38.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:38.085+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:38.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:38.763+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:38.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:38.983+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:39.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:39.057+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:39.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:39.072+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:39.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:39.800+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:39.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:39.983+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:40.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:40.008+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:40.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:40.037+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:40.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:40.827+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:40.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:40.976+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:41.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:41.031+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:41.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:41.051+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:41.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:41.815+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:42.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:42.010+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:42.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:42.021+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:42.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:42.025+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:42.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:05:42.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:05:42.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:42.775+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:42.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:42.976+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:43.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:43.059+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:43.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:43.065+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:43.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:43.787+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:44.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:44.018+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:44.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:44.020+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:44.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:44.101+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:44.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:44.816+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:44.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:44.973+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:44.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:44.992+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:45.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:45.116+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:45.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:45.772+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:45.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:45.942+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:45.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:45.954+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:46.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:46.158+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:46.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:46.727+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:46.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:46.901+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:46.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:46.982+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:47.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:47.135+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:47.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:47.703+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:47.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:47.858+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:47.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:47.982+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:48.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:48.097+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:48.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:48.753+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:48.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:48.882+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:48.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:48.933+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:49.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:49.067+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:49.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:49.743+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:49.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:49.890+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:49.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:49.916+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:49.996 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:05:49.994+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:05:50.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:50.093+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:50.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:50.764+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:50.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:50.881+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:50.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:50.883+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:51.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:51.054+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:51.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:51.730+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:51.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:51.887+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:51.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:51.910+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:52.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:52.010+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:52.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:52.729+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:52.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:52.883+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:52.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:52.936+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:52.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:52.968+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:53.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:53.776+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:53.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:53.865+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:53.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:53.928+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:53.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:53.937+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:54.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:54.767+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:54.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:54.840+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:54.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:54.965+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:54.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:54.969+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:55.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:55.768+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:55.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:55.848+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:55.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:55.962+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:56.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:56.011+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:56.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:56.732+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:56.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:56.852+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:56.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:56.971+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:56.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:56.988+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:57.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:57.699+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:57.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:57.837+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:57.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:57.924+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:57.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:57.946+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:58.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:58.655+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:58.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:58.880+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:58.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:58.933+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:58.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:58.934+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:59.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:05:59.621+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:59.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:05:59.876+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:59.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:05:59.973+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:05:59.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:05:59.981+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:00.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:00.643+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:00.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:00.828+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:00.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:00.924+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:00.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:00.962+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:01.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:01.673+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:01.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:01.849+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:01.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:01.916+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:01.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:01.919+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:02.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:02.716+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:02.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:02.875+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:02.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:02.917+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:02.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:02.930+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:03.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:03.727+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:03.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:03.868+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:03.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:03.871+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:03.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:03.967+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:04.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:04.692+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:04.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:04.863+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:04.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:04.904+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:04.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:04.989+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:05.011 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:06:05.010+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:06:05.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:05.733+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:05.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:05.896+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:05.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:05.915+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:05.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:05.943+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:06.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:06.765+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:06.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:06.894+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:06.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:06.926+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:06.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:06.947+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:07.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:07.780+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:07.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:07.904+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:07.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:07.916+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:07.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:07.924+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:08.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:08.761+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:08.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:08.897+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:08.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:08.918+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:08.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:08.932+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:09.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:09.782+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:09.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:09.889+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:09.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:09.898+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:09.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:09.955+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:10.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:10.815+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:10.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:10.911+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:10.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:10.937+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:10.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:10.972+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:11.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:11.770+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:11.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:11.892+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:11.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:11.947+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:12.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:12.010+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:12.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:12.751+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:12.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:12.858+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:12.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:12.902+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:12.905 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:06:12.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:06:13.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:13.058+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:13.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:13.774+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:13.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:13.850+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:13.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:13.882+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:14.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:14.093+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:14.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:14.752+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:14.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:14.864+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:14.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:14.888+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:15.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:15.120+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:15.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:15.739+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:15.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:15.878+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:15.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:15.888+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:16.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:16.108+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:16.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:16.736+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:16.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:16.845+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:16.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:16.896+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:17.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:17.155+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:17.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:17.754+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:17.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:17.871+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:17.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:17.894+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:18.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:18.114+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:18.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:18.726+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:18.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:18.823+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:18.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:18.912+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:19.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:19.083+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:19.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:19.745+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:19.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:19.777+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:19.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:19.901+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:20.027 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:06:20.027+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:06:20.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:20.083+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:20.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:20.754+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:20.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:20.775+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:20.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:20.883+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:21.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:21.058+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:21.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:21.741+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:21.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:21.798+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:21.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:21.842+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:22.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:22.015+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:22.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:22.712+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:22.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:22.798+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:22.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:22.839+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:23.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:23.034+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:23.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:23.752+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:23.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:23.830+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:23.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:23.842+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:24.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:24.030+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:24.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:24.756+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:24.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:24.838+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:24.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:24.848+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:25.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:25.051+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:25.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:25.792+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:25.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:25.795+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:25.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:25.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:26.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:26.064+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:26.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:26.767+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:26.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:26.771+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:26.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:26.810+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:27.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:27.016+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:27.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:27.729+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:27.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:27.774+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:27.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:27.775+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:28.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:28.039+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:28.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:28.701+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:28.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:28.729+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:28.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:28.751+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:29.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:28.999+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:29.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:29.665+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:29.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:29.715+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:29.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:29.726+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:29.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:29.951+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:30.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:30.667+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:30.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:30.676+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:30.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:30.751+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:30.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:30.987+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:31.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:31.661+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:31.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:31.701+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:31.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:31.786+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:31.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:31.972+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:32.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:32.676+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:32.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:32.719+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:32.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:32.831+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:32.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:32.951+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:33.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:33.674+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:33.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:33.714+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:33.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:33.807+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:33.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:33.955+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:34.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:34.689+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:34.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:34.757+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:34.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:34.777+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:34.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:34.916+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:35.043 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:06:35.041+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:06:35.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:35.730+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:35.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:35.767+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:35.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:35.806+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:35.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:35.954+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:36.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:36.752+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:36.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:36.773+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:36.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:36.783+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:36.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:36.935+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:37.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:37.720+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:37.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:37.751+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:37.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:37.831+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:37.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:37.946+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:38.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:38.685+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:38.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:38.801+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:38.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:38.876+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:38.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:38.992+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:39.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:39.636+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:39.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:39.831+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:39.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:39.909+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:39.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:39.949+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:40.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:40.651+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:40.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:40.872+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:40.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:40.895+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:40.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:40.931+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:41.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:41.617+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:41.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:41.897+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:41.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:41.919+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:41.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:41.951+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:42.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:42.644+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:42.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:42.911+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:42.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:42.913+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:42.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:42.920+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:43.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:06:43.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:06:43.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:43.613+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:43.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:43.864+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:43.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:43.961+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:43.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:43.961+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:44.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:44.632+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:44.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:44.904+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:44.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:44.943+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:44.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:44.972+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:45.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:45.657+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:45.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:45.867+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:45.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:45.970+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:46.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:46.010+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:46.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:46.657+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:46.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:46.876+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:46.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:46.968+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:46.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:46.996+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:47.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:47.617+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:47.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:47.911+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:47.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:47.948+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:47.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:47.998+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:48.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:48.591+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:48.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:48.886+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:48.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:48.935+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:48.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:48.996+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:49.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:49.574+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:49.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:49.922+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:49.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:49.929+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:50.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:50.036+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:50.059 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:06:50.057+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:06:50.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:50.554+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:50.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:50.910+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:50.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:50.968+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:51.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:51.078+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:51.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:51.568+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:51.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:51.918+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:51.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:51.988+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:52.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:52.114+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:52.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:52.551+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:52.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:52.921+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:53.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:53.026+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:53.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:53.142+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:53.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:53.527+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:53.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:53.943+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:54.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:54.072+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:54.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:54.102+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:54.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:54.573+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:54.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:54.905+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:55.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:55.058+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:55.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:55.119+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:55.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:55.530+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:55.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:55.950+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:56.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:56.028+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:56.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:56.147+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:56.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:56.560+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:56.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:56.928+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:57.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:57.030+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:57.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:57.180+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:57.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:57.545+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:57.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:57.913+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:58.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:58.058+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:58.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:58.193+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:58.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:58.588+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:58.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:58.901+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:59.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:59.016+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:59.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:06:59.165+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:59.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:06:59.595+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:06:59.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:06:59.922+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:00.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:06:59.975+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:00.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:00.165+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:00.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:00.559+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:00.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:00.920+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:00.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:00.973+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:01.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:01.212+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:01.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:01.550+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:01.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:01.902+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:02.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:02.010+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:02.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:02.171+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:02.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:02.599+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:02.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:02.918+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:03.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:03.010+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:03.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:03.154+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:03.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:03.601+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:03.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:03.936+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:04.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:04.030+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:04.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:04.162+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:04.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:04.576+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:04.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:04.889+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:05.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:05.070+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:05.075 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:07:05.073+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:07:05.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:05.119+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:05.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:05.574+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:05.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:05.850+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:06.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:06.064+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:06.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:06.112+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:06.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:06.615+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:06.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:06.895+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:07.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:07.085+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:07.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:07.099+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:07.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:07.616+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:07.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:07.890+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:08.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:08.077+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:08.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:08.098+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:08.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:08.666+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:08.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:08.890+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:09.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:09.066+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:09.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:09.114+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:09.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:09.650+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:09.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:09.925+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:10.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:10.069+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:10.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:10.134+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:10.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:10.630+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:10.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:10.896+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:11.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:11.053+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:11.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:11.144+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:11.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:11.611+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:11.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:11.883+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:12.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:12.085+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:12.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:12.101+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:12.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:12.623+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:12.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:12.889+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:13.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:13.061+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:13.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:13.102+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:13.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:07:13.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:07:13.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:13.653+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:13.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:13.930+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:14.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:14.089+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:14.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:14.110+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:14.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:14.691+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:14.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:14.948+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:15.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:15.088+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:15.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:15.136+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:15.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:15.685+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:15.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:15.964+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:16.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:16.130+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:16.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:16.154+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:16.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:16.721+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:16.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:16.938+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:17.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:17.127+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:17.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:17.199+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:17.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:17.759+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:17.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:17.966+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:18.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:18.096+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:18.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:18.158+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:18.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:18.743+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:18.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:18.985+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:19.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:19.111+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:19.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:19.186+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:19.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:19.743+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:19.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:19.957+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:20.080 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:07:20.078+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:07:20.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:20.083+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:20.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:20.192+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:20.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:20.788+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:20.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:20.982+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:21.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:21.097+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:21.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:21.218+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:21.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:21.794+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:21.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:21.951+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:22.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:22.049+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:22.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:22.259+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:22.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:22.827+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:22.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:22.954+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:23.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:23.065+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:23.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:23.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:23.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:23.815+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:23.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:23.917+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:24.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:24.114+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:24.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:24.324+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:24.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:24.780+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:24.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:24.870+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:25.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:25.149+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:25.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:25.327+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:25.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:25.801+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:25.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:25.853+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:26.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:26.169+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:26.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:26.357+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:26.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:26.763+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:26.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:26.809+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:27.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:27.189+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:27.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:27.371+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:27.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:27.717+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:27.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:27.779+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:28.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:28.216+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:28.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:28.344+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:28.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:28.697+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:28.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:28.758+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:29.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:29.207+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:29.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:29.327+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:29.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:29.714+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:29.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:29.759+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:30.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:30.226+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:30.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:30.375+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:30.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:30.684+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:30.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:30.717+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:31.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:31.233+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:31.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:31.350+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:31.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:31.641+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:31.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:31.754+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:32.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:32.233+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:32.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:32.394+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:32.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:32.611+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:32.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:32.793+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:33.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:33.195+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:33.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:33.413+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:33.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:33.624+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:33.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:33.815+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:34.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:34.185+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:34.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:34.400+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:34.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:34.628+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:34.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:34.804+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:35.095 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:07:35.095+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:07:35.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:35.177+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:35.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:35.407+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:35.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:35.665+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:35.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:35.814+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:36.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:36.216+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:36.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:36.368+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:36.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:36.670+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:36.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:36.814+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:37.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:37.225+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:37.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:37.320+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:37.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:37.694+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:37.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:37.829+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:38.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:38.257+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:38.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:38.295+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:38.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:38.737+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:38.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:38.782+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:39.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:39.246+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:39.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:39.324+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:39.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:39.717+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:39.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:39.737+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:40.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:40.285+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:40.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:40.289+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:40.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:40.688+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:40.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:40.708+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:41.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:41.305+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:41.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:41.328+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:41.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:41.642+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:41.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:41.717+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:42.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:42.301+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:42.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:42.362+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:42.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:42.611+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:42.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:42.708+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:43.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:07:43.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:07:43.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:43.303+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:43.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:43.391+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:43.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:43.608+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:43.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:43.731+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:44.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:44.325+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:44.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:44.359+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:44.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:44.591+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:44.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:44.726+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:45.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:45.313+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:45.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:45.381+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:45.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:45.612+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:45.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:45.703+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:46.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:46.303+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:46.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:46.339+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:46.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:46.606+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:46.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:46.722+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:47.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:47.293+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:47.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:47.330+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:47.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:47.623+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:47.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:47.735+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:48.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:48.256+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:48.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:48.370+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:48.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:48.599+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:48.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:48.735+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:49.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:49.262+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:49.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:49.352+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:49.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:49.575+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:49.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:49.688+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:50.111 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:07:50.109+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:07:50.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:50.231+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:50.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:50.393+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:50.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:50.622+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:50.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:50.684+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:51.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:51.277+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:51.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:51.393+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:51.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:51.602+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:51.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:51.718+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:52.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:52.248+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:52.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:52.428+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:52.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:52.612+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:52.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:52.697+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:53.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:53.238+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:53.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:53.456+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:53.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:53.655+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:53.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:53.700+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:54.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:54.212+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:54.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:54.443+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:54.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:54.618+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:54.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:54.719+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:55.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:55.163+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:55.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:55.435+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:55.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:55.653+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:55.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:55.671+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:56.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:56.127+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:56.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:56.441+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:56.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:56.672+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:56.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:56.675+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:57.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:57.080+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:57.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:57.412+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:57.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:57.672+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:57.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:57.720+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:58.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:58.041+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:58.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:58.389+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:58.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:58.637+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:58.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:58.729+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:59.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:07:59.091+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:59.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:07:59.438+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:59.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:07:59.619+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:07:59.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:07:59.716+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:00.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:00.140+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:00.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:00.484+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:00.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:00.571+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:00.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:00.748+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:01.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:01.107+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:01.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:01.445+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:01.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:01.568+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:01.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:01.743+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:02.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:02.153+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:02.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:02.441+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:02.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:02.534+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:02.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:02.751+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:03.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:03.175+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:03.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:03.489+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:03.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:03.548+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:03.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:03.727+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:04.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:04.173+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:04.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:04.467+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:04.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:04.542+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:04.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:04.726+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:05.127 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:08:05.125+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:08:05.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:05.208+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:05.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:05.420+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:05.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:05.552+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:05.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:05.700+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:06.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:06.181+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:06.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:06.413+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:06.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:06.519+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:06.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:06.682+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:07.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:07.160+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:07.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:07.396+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:07.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:07.518+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:07.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:07.632+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:08.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:08.207+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:08.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:08.362+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:08.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:08.511+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:08.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:08.622+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:09.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:09.227+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:09.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:09.327+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:09.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:09.495+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:09.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:09.673+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:10.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:10.258+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:10.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:10.319+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:10.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:10.506+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:10.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:10.698+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:11.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:11.261+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:11.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:11.293+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:11.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:11.533+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:11.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:11.737+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:12.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:12.227+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:12.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:12.310+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:12.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:12.565+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:12.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:12.759+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:13.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:13.259+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:13.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:13.299+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:13.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:08:13.346 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:08:13.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:13.576+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:13.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:13.740+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:14.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:14.249+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:14.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:14.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:14.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:14.585+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:14.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:14.755+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:15.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:15.268+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:15.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:15.281+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:15.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:15.550+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:15.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:15.746+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:16.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:16.299+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:16.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:16.306+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:16.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:16.536+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:16.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:16.763+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:17.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:17.323+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:17.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:17.343+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:17.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:17.523+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:17.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:17.719+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:18.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:18.304+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:18.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:18.336+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:18.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:18.546+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:18.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:18.700+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:19.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:19.309+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:19.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:19.346+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:19.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:19.578+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:19.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:19.663+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:20.143 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:08:20.141+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:08:20.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:20.326+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:20.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:20.384+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:20.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:20.544+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:20.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:20.628+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:21.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:21.373+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:21.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:21.402+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:21.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:21.590+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:21.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:21.616+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:22.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:22.395+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:22.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:22.429+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:22.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:22.576+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:22.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:22.614+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:23.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:23.374+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:23.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:23.389+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:23.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:23.529+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:23.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:23.600+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:24.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:24.372+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:24.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:24.388+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:24.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:24.538+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:24.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:24.565+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:25.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:25.405+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:25.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:25.433+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:25.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:25.523+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:25.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:25.552+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:26.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:26.389+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:26.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:26.412+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:26.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:26.551+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:26.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:26.555+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:27.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:27.392+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:27.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:27.400+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:27.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:27.518+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:27.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:27.579+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:28.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:28.418+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:28.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:28.418+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:28.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:28.478+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:28.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:28.570+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:29.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:29.401+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:29.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:29.441+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:29.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:29.470+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:29.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:29.592+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:30.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:30.409+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:30.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:30.437+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:30.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:30.442+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:30.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:30.580+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:31.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:31.392+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:31.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:31.399+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:31.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:31.449+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:31.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:31.563+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:32.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:32.407+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:32.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:32.425+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:32.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:32.440+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:32.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:32.600+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:33.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:33.386+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:33.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:33.443+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:33.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:33.451+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:33.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:33.620+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:34.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:34.427+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:34.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:34.444+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:34.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:34.449+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:34.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:34.646+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:35.159 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:08:35.157+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:08:35.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:35.402+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:35.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:35.419+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:35.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:35.440+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:35.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:35.665+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:36.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:36.385+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:36.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:36.439+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:36.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:36.443+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:36.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:36.656+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:37.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:37.360+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:37.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:37.435+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:37.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:37.480+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:37.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:37.645+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:38.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:38.354+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:38.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:38.419+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:38.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:38.474+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:38.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:38.633+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:39.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:39.376+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:39.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:39.426+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:39.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:39.442+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:39.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:39.674+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:40.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:40.335+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:40.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:40.447+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:40.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:40.449+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:40.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:40.713+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:41.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:41.343+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:41.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:41.407+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:41.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:41.450+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:41.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:41.757+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:42.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:42.328+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:42.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:42.411+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:42.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:42.451+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:42.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:42.739+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:43.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:43.353+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:43.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:43.423+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:43.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:43.452+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:43.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:08:43.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:08:43.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:43.709+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:44.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:44.381+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:44.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:44.408+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:44.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:44.437+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:44.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:44.681+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:45.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:45.398+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:45.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:45.415+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:45.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:45.463+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:45.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:45.643+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:46.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:46.355+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:46.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:46.420+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:46.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:46.461+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:46.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:46.598+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:47.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:47.370+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:47.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:47.432+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:47.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:47.499+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:47.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:47.603+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:48.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:48.329+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:48.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:48.390+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:48.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:48.471+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:48.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:48.576+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:49.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:49.326+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:49.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:49.347+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:49.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:49.459+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:49.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:49.535+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:50.175 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:08:50.174+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:08:50.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:50.358+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:50.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:50.378+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:50.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:50.421+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:50.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:50.524+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:51.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:51.353+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:51.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:51.378+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:51.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:51.407+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:51.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:51.518+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:52.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:52.346+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:52.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:52.376+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:52.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:52.416+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:52.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:52.486+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:53.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:53.329+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:53.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:53.388+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:53.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:53.405+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:53.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:53.464+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:54.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:54.368+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:54.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:54.404+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:54.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:54.424+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:54.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:54.487+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:55.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:55.357+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:55.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:55.429+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:55.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:55.447+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:55.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:55.521+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:56.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:56.326+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:56.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:56.409+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:56.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:56.485+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:56.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:56.504+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:57.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:57.376+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:57.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:57.390+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:57.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:57.474+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:57.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:57.492+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:58.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:58.341+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:58.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:58.369+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:58.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:58.429+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:58.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:58.490+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:59.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:08:59.337+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:59.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:08:59.345+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:59.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:08:59.408+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:08:59.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:08:59.539+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:00.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:00.311+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:00.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:00.342+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:00.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:00.457+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:00.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:00.517+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:01.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:01.299+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:01.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:01.323+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:01.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:01.426+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:01.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:01.507+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:02.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:02.325+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:02.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:02.337+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:02.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:02.420+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:02.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:02.507+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:03.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:03.289+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:03.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:03.352+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:03.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:03.424+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:03.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:03.464+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:04.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:04.309+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:04.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:04.323+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:04.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:04.424+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:04.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:04.448+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:05.190 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:09:05.189+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:09:05.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:05.302+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:05.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:05.356+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:05.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:05.451+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:05.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:05.452+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:06.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:06.306+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:06.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:06.379+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:06.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:06.406+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:06.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:06.435+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:07.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:07.294+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:07.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:07.360+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:07.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:07.427+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:07.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:07.445+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:08.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:08.323+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:08.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:08.388+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:08.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:08.399+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:08.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:08.437+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:09.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:09.303+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:09.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:09.372+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:09.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:09.386+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:09.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:09.483+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:10.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:10.283+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:10.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:10.374+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:10.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:10.385+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:10.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:10.484+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:11.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:11.304+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:11.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:11.350+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:11.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:11.350+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:11.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:11.469+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:12.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:12.266+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:12.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:12.314+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:12.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:12.364+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:12.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:12.497+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:13.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:13.295+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:13.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:13.312+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:13.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:13.356+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:13.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:13.500+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:13.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:09:13.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:09:14.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:14.247+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:14.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:14.264+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:14.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:14.399+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:14.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:14.459+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:15.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:15.261+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:15.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:15.294+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:15.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:15.372+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:15.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:15.414+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:16.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:16.279+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:16.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:16.281+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:16.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:16.389+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:16.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:16.405+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:17.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:17.252+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:17.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:17.277+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:17.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:17.402+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:17.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:17.409+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:18.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:18.272+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:18.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:18.280+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:18.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:18.379+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:18.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:18.443+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:19.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:19.245+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:19.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:19.282+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:19.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:19.346+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:19.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:19.419+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:20.206 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:09:20.205+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:09:20.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:20.256+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:20.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:20.272+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:20.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:20.371+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:20.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:20.389+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:21.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:21.226+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:21.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:21.228+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:21.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:21.334+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:21.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:21.387+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:22.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:22.179+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:22.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:22.223+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:22.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:22.380+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:22.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:22.394+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:23.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:23.184+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:23.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:23.185+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:23.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:23.393+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:23.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:23.395+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:24.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:24.189+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:24.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:24.234+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:24.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:24.343+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:24.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:24.425+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:25.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:25.167+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:25.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:25.233+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:25.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:25.382+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:25.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:25.387+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:26.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:26.212+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:26.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:26.278+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:26.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:26.395+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:26.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:26.424+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:27.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:27.214+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:27.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:27.286+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:27.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:27.429+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:27.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:27.444+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:28.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:28.224+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:28.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:28.322+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:28.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:28.407+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:28.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:28.481+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:29.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:29.208+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:29.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:29.281+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:29.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:29.383+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:29.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:29.444+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:30.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:30.191+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:30.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:30.277+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:30.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:30.352+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:30.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:30.404+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:31.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:31.159+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:31.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:31.231+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:31.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:31.390+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:31.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:31.444+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:32.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:32.190+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:32.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:32.231+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:32.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:32.387+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:32.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:32.455+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:33.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:33.198+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:33.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:33.223+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:33.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:33.425+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:33.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:33.496+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:34.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:34.203+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:34.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:34.218+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:34.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:34.415+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:34.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:34.458+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:35.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:35.166+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:35.222 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:09:35.220+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:09:35.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:35.250+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:35.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:35.427+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:35.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:35.506+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:36.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:36.126+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:36.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:36.224+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:36.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:36.439+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:36.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:36.545+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:37.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:37.093+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:37.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:37.181+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:37.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:37.418+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:37.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:37.586+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:38.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:38.065+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:38.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:38.204+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:38.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:38.431+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:38.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:38.613+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:39.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:39.017+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:39.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:39.158+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:39.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:39.386+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:39.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:39.632+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:40.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:40.065+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:40.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:40.191+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:40.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:40.401+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:40.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:40.619+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:41.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:41.113+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:41.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:41.215+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:41.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:41.414+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:41.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:41.651+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:42.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:42.138+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:42.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:42.226+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:42.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:42.403+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:42.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:42.612+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:43.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:43.114+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:43.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:43.219+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:43.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:43.435+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:43.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:43.653+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:43.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:09:43.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:09:44.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:44.106+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:44.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:44.267+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:44.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:44.415+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:44.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:44.610+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:45.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:45.111+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:45.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:45.293+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:45.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:45.377+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:45.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:45.616+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:46.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:46.097+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:46.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:46.324+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:46.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:46.343+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:46.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:46.605+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:47.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:47.069+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:47.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:47.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:47.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:47.392+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:47.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:47.635+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:48.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:48.029+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:48.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:48.310+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:48.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:48.352+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:48.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:48.589+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:49.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:49.042+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:49.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:49.312+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:49.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:49.334+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:49.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:49.625+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:50.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:50.000+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:50.238 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:09:50.236+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:09:50.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:50.297+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:50.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:50.339+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:50.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:50.655+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:51.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:51.003+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:51.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:51.300+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:51.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:51.321+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:51.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:51.679+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:51.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:51.967+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:52.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:52.255+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:52.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:52.343+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:52.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:52.686+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:52.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:52.931+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:53.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:53.278+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:53.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:53.362+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:53.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:53.670+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:53.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:53.889+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:54.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:54.311+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:54.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:54.401+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:54.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:54.654+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:54.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:54.853+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:55.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:55.342+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:55.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:55.407+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:55.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:55.684+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:55.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:55.833+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:56.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:56.339+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:56.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:56.423+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:56.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:56.642+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:56.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:56.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:57.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:57.328+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:57.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:57.398+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:57.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:57.669+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:57.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:57.757+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:58.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:58.315+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:58.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:58.352+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:58.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:58.688+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:58.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:58.751+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:59.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:09:59.322+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:59.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:09:59.326+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:59.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:09:59.676+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:09:59.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:09:59.781+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:00.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:00.281+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:00.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:00.290+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:00.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:00.704+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:00.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:00.804+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:01.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:01.305+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:01.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:01.339+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:01.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:01.662+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:01.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:01.852+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:02.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:02.277+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:02.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:02.348+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:02.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:02.622+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:02.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:02.887+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:03.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:03.300+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:03.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:03.348+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:03.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:03.672+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:03.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:03.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:04.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:04.287+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:04.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:04.396+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:04.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:04.666+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:04.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:04.879+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:05.254 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:10:05.252+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:10:05.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:05.325+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:05.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:05.418+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:05.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:05.707+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:05.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:05.851+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:06.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:06.276+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:06.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:06.397+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:06.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:06.716+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:06.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:06.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:07.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:07.265+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:07.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:07.399+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:07.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:07.692+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:07.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:07.842+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:08.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:08.307+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:08.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:08.400+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:08.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:08.654+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:08.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:08.856+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:09.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:09.336+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:09.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:09.391+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:09.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:09.608+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:09.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:09.895+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:10.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:10.295+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:10.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:10.412+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:10.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:10.571+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:10.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:10.933+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:11.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:11.252+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:11.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:11.429+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:11.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:11.582+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:11.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:11.933+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:12.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:12.258+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:12.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:12.409+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:12.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:12.533+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:12.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:12.922+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:13.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:13.259+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:13.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:13.437+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:13.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:13.522+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:13.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:10:13.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:10:13.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:13.954+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:14.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:14.211+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:14.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:14.388+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:14.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:14.569+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:14.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:14.989+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:15.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:15.204+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:15.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:15.382+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:15.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:15.552+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:16.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:16.001+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:16.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:16.168+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:16.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:16.424+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:16.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:16.573+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:17.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:17.003+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:17.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:17.144+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:17.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:17.458+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:17.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:17.560+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:18.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:18.026+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:18.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:18.178+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:18.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:18.428+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:18.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:18.601+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:18.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:18.983+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:19.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:19.202+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:19.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:19.458+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:19.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:19.615+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:20.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:20.022+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:20.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:20.207+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:20.270 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:10:20.268+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:10:20.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:20.434+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:20.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:20.625+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:21.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:21.031+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:21.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:21.211+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:21.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:21.454+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:21.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:21.581+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:22.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:22.048+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:22.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:22.228+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:22.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:22.417+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:22.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:22.582+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:23.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:23.050+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:23.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:23.207+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:23.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:23.460+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:23.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:23.632+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:24.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:24.017+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:24.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:24.218+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:24.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:24.508+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:24.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:24.618+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:25.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:25.005+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:25.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:25.230+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:25.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:25.470+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:25.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:25.661+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:26.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:26.016+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:26.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:26.252+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:26.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:26.474+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:26.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:26.683+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:27.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:26.999+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:27.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:27.216+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:27.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:27.523+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:27.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:27.693+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:28.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:28.036+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:28.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:28.247+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:28.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:28.537+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:28.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:28.678+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:29.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:29.070+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:29.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:29.202+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:29.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:29.489+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:29.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:29.671+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:30.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:30.076+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:30.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:30.209+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:30.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:30.511+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:30.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:30.630+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:31.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:31.072+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:31.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:31.234+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:31.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:31.483+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:31.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:31.586+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:32.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:32.090+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:32.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:32.244+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:32.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:32.450+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:32.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:32.567+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:33.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:33.049+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:33.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:33.231+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:33.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:33.477+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:33.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:33.576+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:34.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:34.077+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:34.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:34.194+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:34.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:34.490+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:34.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:34.536+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:35.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:35.042+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:35.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:35.219+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:35.286 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:10:35.285+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:10:35.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:35.511+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:35.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:35.558+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:36.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:36.033+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:36.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:36.230+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:36.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:36.505+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:36.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:36.550+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:37.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:37.043+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:37.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:37.257+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:37.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:37.544+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:37.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:37.546+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:38.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:38.021+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:38.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:38.299+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:38.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:38.526+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:38.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:38.547+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:39.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:39.018+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:39.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:39.310+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:39.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:39.542+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:39.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:39.559+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:40.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:40.059+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:40.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:40.328+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:40.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:40.507+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:40.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:40.561+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:41.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:41.029+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:41.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:41.369+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:41.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:41.523+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:41.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:41.535+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:42.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:42.038+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:42.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:42.393+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:42.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:42.483+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:42.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:42.556+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:43.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:43.017+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:43.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:43.384+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:43.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:43.500+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:43.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:43.606+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:43.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:10:43.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:10:44.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:44.002+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:44.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:44.387+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:44.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:44.510+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:44.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:44.593+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:45.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:45.005+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:45.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:45.427+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:45.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:45.541+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:45.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:45.563+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:46.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:46.019+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:46.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:46.472+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:46.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:46.569+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:46.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:46.607+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:47.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:47.047+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:47.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:47.438+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:47.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:47.537+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:47.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:47.649+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:48.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:48.018+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:48.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:48.452+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:48.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:48.492+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:48.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:48.600+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:49.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:48.998+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:49.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:49.460+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:49.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:49.495+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:49.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:49.601+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:50.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:50.027+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:50.302 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:10:50.299+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:10:50.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:50.480+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:50.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:50.500+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:50.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:50.620+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:50.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:50.984+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:51.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:51.513+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:51.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:51.535+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:51.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:51.580+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:51.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:51.950+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:52.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:52.496+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:52.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:52.548+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:52.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:52.581+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:52.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:52.977+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:53.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:53.535+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:53.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:53.550+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:53.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:53.609+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:53.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:53.933+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:54.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:54.584+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:54.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:54.599+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:54.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:54.608+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:54.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:54.981+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:55.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:55.597+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:55.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:55.601+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:55.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:55.612+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:56.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:56.018+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:56.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:56.563+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:56.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:56.592+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:56.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:56.628+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:57.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:57.021+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:57.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:57.552+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:57.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:57.584+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:57.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:57.588+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:58.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:58.029+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:58.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:58.572+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:58.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:58.579+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:58.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:58.616+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:59.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:59.031+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:59.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:10:59.560+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:59.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:10:59.612+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:59.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:10:59.627+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:10:59.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:10:59.981+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:00.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:00.542+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:00.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:00.576+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:00.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:00.615+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:00.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:00.943+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:01.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:01.569+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:01.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:01.575+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:01.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:01.625+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:01.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:01.906+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:02.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:02.549+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:02.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:02.555+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:02.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:02.582+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:02.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:02.881+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:03.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:03.543+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:03.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:03.548+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:03.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:03.575+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:03.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:03.872+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:04.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:04.558+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:04.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:04.566+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:04.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:04.570+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:04.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:04.851+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:05.308 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:11:05.307+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:11:05.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:05.539+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:05.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:05.553+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:05.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:05.594+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:05.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:05.845+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:06.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:06.510+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:06.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:06.561+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:06.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:06.613+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:06.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:06.810+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:07.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:07.503+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:07.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:07.540+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:07.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:07.575+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:07.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:07.771+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:08.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:08.454+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:08.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:08.587+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:08.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:08.587+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:08.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:08.779+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:09.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:09.465+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:09.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:09.595+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:09.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:09.606+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:09.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:09.810+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:10.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:10.499+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:10.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:10.621+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:10.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:10.650+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:10.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:10.848+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:11.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:11.546+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:11.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:11.611+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:11.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:11.615+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:11.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:11.869+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:12.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:12.569+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:12.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:12.598+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:12.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:12.663+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:12.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:12.855+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:13.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:13.555+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:13.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:13.565+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:13.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:13.703+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:13.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:13.847+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:14.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:11:14.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:11:14.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:14.570+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:14.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:14.595+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:14.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:14.749+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:14.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:14.888+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:15.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:15.584+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:15.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:15.605+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:15.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:15.766+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:15.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:15.850+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:16.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:16.543+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:16.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:16.593+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:16.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:16.733+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:16.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:16.888+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:17.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:17.545+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:17.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:17.587+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:17.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:17.732+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:17.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:17.913+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:18.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:18.518+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:18.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:18.617+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:18.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:18.711+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:18.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:18.934+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:19.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:19.556+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:19.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:19.596+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:19.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:19.681+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:19.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:19.973+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:20.324 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:11:20.322+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:11:20.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:20.554+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:20.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:20.563+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:20.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:20.711+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:21.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:21.008+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:21.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:21.568+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:21.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:21.592+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:21.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:21.706+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:21.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:21.968+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:22.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:22.615+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:22.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:22.618+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:22.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:22.738+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:22.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:22.926+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:23.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:23.596+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:23.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:23.665+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:23.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:23.691+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:23.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:23.920+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:24.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:24.636+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:24.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:24.646+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:24.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:24.738+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:24.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:24.940+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:25.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:25.646+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:25.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:25.651+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:25.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:25.705+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:25.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:25.889+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:26.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:26.650+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:26.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:26.664+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:26.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:26.687+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:26.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:26.936+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:27.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:27.623+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:27.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:27.685+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:27.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:27.701+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:27.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:27.913+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:28.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:28.604+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:28.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:28.638+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:28.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:28.741+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:28.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:28.919+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:29.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:29.599+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:29.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:29.631+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:29.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:29.751+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:29.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:29.891+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:30.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:30.600+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:30.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:30.637+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:30.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:30.727+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:30.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:30.848+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:31.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:31.582+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:31.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:31.657+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:31.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:31.767+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:31.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:31.834+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:32.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:32.572+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:32.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:32.659+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:32.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:32.741+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:32.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:32.843+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:33.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:33.600+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:33.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:33.631+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:33.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:33.714+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:33.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:33.847+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:34.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:34.602+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:34.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:34.642+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:34.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:34.705+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:34.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:34.836+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:35.340 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:11:35.338+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:11:35.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:35.614+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:35.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:35.626+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:35.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:35.722+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:35.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:35.851+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:36.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:36.603+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:36.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:36.654+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:36.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:36.731+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:36.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:36.862+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:37.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:37.594+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:37.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:37.650+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:37.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:37.727+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:37.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:37.821+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:38.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:38.562+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:38.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:38.665+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:38.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:38.754+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:38.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:38.846+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:39.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:39.563+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:39.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:39.684+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:39.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:39.743+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:39.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:39.879+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:40.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:40.563+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:40.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:40.706+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:40.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:40.719+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:40.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:40.848+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:41.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:41.605+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:41.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:41.686+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:41.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:41.717+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:41.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:41.878+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:42.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:42.580+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:42.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:42.689+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:42.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:42.725+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:42.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:42.898+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:43.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:43.577+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:43.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:43.655+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:43.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:43.756+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:43.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:43.926+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:44.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:11:44.242 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:11:44.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:44.551+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:44.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:44.681+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:44.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:44.762+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:44.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:44.885+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:45.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:45.511+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:45.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:45.659+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:45.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:45.807+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:45.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:45.861+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:46.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:46.464+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:46.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:46.647+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:46.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:46.842+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:46.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:46.886+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:47.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:47.492+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:47.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:47.680+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:47.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:47.797+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:47.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:47.871+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:48.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:48.542+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:48.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:48.723+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:48.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:48.767+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:48.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:48.854+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:49.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:49.578+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:49.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:49.721+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:49.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:49.746+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:49.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:49.881+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:50.355 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:11:50.354+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:11:50.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:50.550+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:50.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:50.733+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:50.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:50.767+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:50.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:50.880+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:51.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:51.592+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:51.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:51.698+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:51.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:51.742+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:51.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:51.895+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:52.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:52.560+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:52.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:52.705+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:52.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:52.786+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:52.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:52.847+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:53.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:53.562+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:53.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:53.670+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:53.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:53.748+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:53.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:53.881+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:54.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:54.584+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:54.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:54.627+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:54.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:54.776+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:54.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:54.867+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:55.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:55.565+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:55.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:55.583+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:55.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:55.738+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:55.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:55.819+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:56.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:56.588+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:56.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:56.602+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:56.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:56.703+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:56.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:56.858+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:57.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:57.574+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:57.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:57.622+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:57.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:57.657+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:57.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:57.872+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:58.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:58.565+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:58.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:58.653+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:58.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:58.661+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:58.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:58.861+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:59.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:11:59.576+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:59.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:11:59.626+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:59.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:11:59.641+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:11:59.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:11:59.864+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:00.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:00.593+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:00.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:00.605+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:00.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:00.626+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:00.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:00.903+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:01.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:01.615+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:01.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:01.638+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:01.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:01.660+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:01.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:01.904+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:02.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:02.629+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:02.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:02.643+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:02.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:02.666+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:02.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:02.894+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:03.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:03.598+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:03.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:03.636+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:03.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:03.673+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:03.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:03.850+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:04.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:04.621+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:04.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:04.655+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:04.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:04.690+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:04.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:04.880+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:05.371 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:12:05.369+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:12:05.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:05.585+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:05.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:05.657+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:05.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:05.735+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:05.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:05.919+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:06.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:06.555+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:06.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:06.625+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:06.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:06.778+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:06.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:06.897+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:07.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:07.554+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:07.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:07.612+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:07.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:07.781+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:07.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:07.913+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:08.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:08.564+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:08.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:08.654+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:08.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:08.827+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:08.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:08.875+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:09.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:09.516+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:09.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:09.656+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:09.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:09.795+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:09.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:09.882+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:10.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:10.549+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:10.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:10.618+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:10.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:10.781+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:10.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:10.925+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:11.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:11.577+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:11.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:11.582+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:11.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:11.796+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:11.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:11.895+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:12.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:12.555+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:12.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:12.616+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:12.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:12.762+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:12.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:12.939+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:13.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:13.539+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:13.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:13.567+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:13.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:13.807+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:13.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:13.913+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:14.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:12:14.437 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:12:14.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:14.514+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:14.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:14.599+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:14.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:14.759+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:14.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:14.937+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:15.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:15.466+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:15.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:15.561+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:15.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:15.767+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:15.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:15.894+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:16.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:16.514+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:16.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:16.514+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:16.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:16.773+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:16.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:16.918+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:17.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:17.486+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:17.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:17.550+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:17.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:17.809+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:17.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:17.956+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:18.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:18.486+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:18.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:18.509+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:18.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:18.771+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:18.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:18.935+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:19.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:19.445+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:19.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:19.553+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:19.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:19.814+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:19.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:19.929+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:20.387 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:12:20.385+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:12:20.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:20.451+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:20.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:20.566+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:20.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:20.798+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:20.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:20.900+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:21.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:21.432+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:21.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:21.530+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:21.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:21.785+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:21.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:21.918+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:22.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:22.438+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:22.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:22.515+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:22.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:22.833+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:22.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:22.883+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:23.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:23.455+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:23.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:23.542+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:23.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:23.815+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:23.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:23.890+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:24.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:24.489+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:24.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:24.556+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:24.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:24.864+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:24.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:24.889+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:25.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:25.464+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:25.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:25.580+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:25.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:25.892+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:25.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:25.938+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:26.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:26.479+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:26.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:26.568+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:26.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:26.930+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:26.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:26.942+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:27.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:27.470+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:27.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:27.544+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:27.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:27.976+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:27.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:27.987+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:28.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:28.443+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:28.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:28.504+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:28.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:28.947+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:28.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:28.962+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:29.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:29.395+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:29.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:29.553+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:29.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:29.920+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:29.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:29.945+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:30.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:30.414+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:30.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:30.577+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:30.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:30.886+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:30.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:30.960+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:31.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:31.404+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:31.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:31.609+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:31.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:31.919+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:31.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:31.952+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:32.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:32.444+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:32.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:32.636+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:32.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:32.876+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:33.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:33.001+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:33.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:33.469+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:33.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:33.651+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:33.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:33.899+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:33.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:33.994+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:34.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:34.501+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:34.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:34.683+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:34.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:34.934+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:34.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:34.955+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:35.403 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:12:35.401+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:12:35.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:35.472+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:35.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:35.678+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:35.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:35.929+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:35.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:35.936+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:36.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:36.466+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:36.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:36.717+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:36.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:36.923+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:36.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:36.970+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:37.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:37.432+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:37.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:37.680+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:37.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:37.944+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:37.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:37.981+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:38.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:38.435+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:38.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:38.685+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:38.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:38.947+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:38.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:38.956+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:39.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:39.430+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:39.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:39.645+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:39.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:39.969+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:39.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:39.979+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:40.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:40.398+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:40.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:40.682+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:40.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:40.948+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:40.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:40.968+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:41.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:41.438+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:41.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:41.688+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:41.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:41.929+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:42.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:42.015+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:42.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:42.474+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:42.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:42.718+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:42.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:42.890+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:42.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:42.993+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:43.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:43.514+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:43.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:43.728+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:43.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:43.931+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:43.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:43.957+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:44.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:44.498+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:44.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:12:44.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:12:44.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:44.682+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:44.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:44.932+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:44.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:44.959+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:45.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:45.543+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:45.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:45.698+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:45.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:45.931+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:45.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:45.948+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:46.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:46.511+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:46.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:46.656+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:46.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:46.970+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:46.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:46.989+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:47.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:47.508+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:47.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:47.633+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:47.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:47.958+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:48.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:48.036+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:48.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:48.497+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:48.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:48.632+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:48.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:48.927+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:49.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:49.020+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:49.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:49.467+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:49.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:49.655+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:49.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:49.935+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:50.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:50.006+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:50.411 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:12:50.409+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:12:50.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:50.496+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:50.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:50.630+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:50.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:50.907+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:51.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:51.019+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:51.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:51.523+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:51.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:51.616+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:51.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:51.914+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:51.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:51.978+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:52.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:52.573+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:52.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:52.608+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:52.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:52.880+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:53.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:53.005+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:53.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:53.597+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:53.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:53.623+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:53.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:53.840+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:54.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:54.008+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:54.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:54.554+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:54.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:54.595+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:54.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:54.805+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:55.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:55.009+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:55.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:55.524+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:55.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:55.616+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:55.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:55.775+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:56.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:56.047+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:56.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:56.490+0000 7f72c425d700 -1 osd.5 101 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:56.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:56.663+0000 7f389e18e700 -1 osd.4 101 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:56.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:56.741+0000 7f6e44c9f700 -1 osd.7 101 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:57.015 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-03T23:12:57.013+0000 7f7a4ab49700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:12:57.030 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-03T23:12:57.013+0000 7f7a4ab49700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:12:57.031 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-03T23:12:57.027+0000 7f7a4a348700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-03T23:12:57.052 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-03T23:12:57.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:57.069+0000 7f596d92c700 -1 osd.6 101 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:57.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:57.463+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:57.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:57.701+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:57.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:57.708+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:58.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:58.058+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:58.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:58.453+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:58.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:58.695+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:58.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:58.710+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:59.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:12:59.093+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:59.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:12:59.472+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:59.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:12:59.687+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:12:59.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:12:59.720+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:00.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:00.059+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:00.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:00.480+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:00.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:00.711+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:00.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:00.758+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:01.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:01.043+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:01.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:01.489+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:01.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:01.674+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:01.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:01.729+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:02.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:02.009+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:02.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:02.513+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:02.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:02.649+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:02.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:02.680+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:02.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:02.968+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:03.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:03.506+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:03.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:03.620+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:03.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:03.649+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:03.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:03.940+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:04.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:04.466+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:04.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:04.585+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:04.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:04.606+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:04.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:04.899+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:05.419 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:13:05.418+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:13:05.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:05.472+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:05.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:05.606+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:05.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:05.630+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:05.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:05.923+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:06.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:06.519+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:06.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:06.635+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:06.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:06.639+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:06.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:06.921+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:07.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:07.552+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:07.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:07.599+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:07.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:07.642+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:07.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:07.934+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:08.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:08.519+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:08.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:08.558+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:08.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:08.676+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:08.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:08.909+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:09.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:09.525+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:09.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:09.607+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:09.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:09.646+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:09.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:09.925+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:10.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:10.540+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:10.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:10.634+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:10.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:10.681+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:10.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:10.957+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:11.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:11.589+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:11.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:11.632+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:11.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:11.659+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:11.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:11.979+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:12.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:12.563+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:12.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:12.598+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:12.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:12.612+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:13.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:13.016+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:13.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:13.533+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:13.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:13.570+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:13.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:13.596+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:13.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:13.980+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:14.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:14.527+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:14.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:14.533+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:14.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:14.621+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:14.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:13:14.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:13:14.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:14.996+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:15.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:15.490+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:15.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:15.552+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:15.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:15.653+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:15.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:15.991+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:16.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:16.535+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:16.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:16.558+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:16.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:16.698+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:16.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:16.946+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:17.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:17.498+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:17.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:17.577+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:17.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:17.709+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:17.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:17.917+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:18.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:18.477+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:18.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:18.534+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:18.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:18.739+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:18.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:18.957+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:19.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:19.492+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:19.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:19.521+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:19.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:19.769+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:19.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:19.911+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:20.421 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:13:20.419+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:13:20.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:20.523+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:20.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:20.537+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:20.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:20.805+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:20.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:20.951+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:21.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:21.536+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:21.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:21.585+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:21.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:21.756+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:21.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:21.930+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:22.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:22.537+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:22.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:22.543+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:22.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:22.760+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:22.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:22.949+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:23.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:23.558+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:23.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:23.562+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:23.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:23.789+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:23.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:23.918+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:24.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:24.555+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:24.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:24.565+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:24.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:24.770+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:24.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:24.965+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:25.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:25.597+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:25.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:25.597+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:25.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:25.753+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:26.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:26.002+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:26.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:26.632+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:26.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:26.646+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:26.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:26.717+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:26.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:26.994+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:27.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:27.673+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:27.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:27.675+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:27.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:27.752+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:27.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:27.963+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:28.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:28.701+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:28.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:28.713+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:28.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:28.767+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:28.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:28.933+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:29.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:29.723+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:29.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:29.733+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:29.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:29.758+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:29.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:29.884+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:30.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:30.703+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:30.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:30.772+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:30.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:30.782+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:30.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:30.838+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:31.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:31.697+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:31.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:31.729+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:31.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:31.741+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:31.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:31.862+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:32.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:32.692+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:32.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:32.707+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:32.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:32.743+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:32.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:32.863+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:33.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:33.703+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:33.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:33.722+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:33.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:33.724+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:33.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:33.902+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:34.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:34.710+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:34.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:34.738+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:34.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:34.761+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:34.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:34.877+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:35.437 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:13:35.436+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:13:35.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:35.696+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:35.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:35.774+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:35.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:35.788+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:35.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:35.870+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:36.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:36.699+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:36.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:36.767+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:36.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:36.775+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:36.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:36.896+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:37.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:37.681+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:37.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:37.775+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:37.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:37.776+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:37.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:37.900+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:38.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:38.632+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:38.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:38.747+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:38.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:38.769+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:38.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:38.889+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:39.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:39.668+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:39.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:39.707+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:39.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:39.733+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:39.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:39.898+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:40.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:40.675+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:40.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:40.717+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:40.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:40.754+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:40.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:40.875+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:41.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:41.649+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:41.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:41.729+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:41.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:41.781+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:41.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:41.833+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:42.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:42.697+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:42.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:42.734+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:42.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:42.770+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:42.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:42.857+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:43.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:43.710+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:43.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:43.764+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:43.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:43.777+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:43.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:43.853+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:44.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:44.741+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:44.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:13:44.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:13:44.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:44.758+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:44.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:44.796+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:44.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:44.891+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:45.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:45.732+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:45.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:45.785+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:45.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:45.795+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:45.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:45.874+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:46.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:46.687+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:46.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:46.780+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:46.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:46.807+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:46.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:46.893+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:47.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:47.653+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:47.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:47.778+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:47.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:47.825+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:47.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:47.914+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:48.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:48.657+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:48.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:48.780+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:48.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:48.824+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:48.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:48.946+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:49.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:49.633+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:49.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:49.783+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:49.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:49.826+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:49.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:49.953+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:50.444 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:13:50.441+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:13:50.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:50.682+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:50.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:50.826+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:50.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:50.855+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:50.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:50.990+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:51.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:51.679+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:51.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:51.789+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:51.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:51.813+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:52.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:52.033+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:52.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:52.659+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:52.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:52.789+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:52.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:52.831+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:53.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:53.074+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:53.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:53.628+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:53.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:53.775+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:53.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:53.820+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:54.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:54.036+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:54.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:54.625+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:54.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:54.791+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:54.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:54.798+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:55.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:55.059+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:55.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:55.657+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:55.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:55.752+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:55.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:55.823+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:56.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:56.066+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:56.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:56.686+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:56.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:56.743+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:56.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:56.864+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:57.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:57.067+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:57.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:57.702+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:57.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:57.778+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:57.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:57.894+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:58.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:58.046+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:58.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:58.669+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:58.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:58.811+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:58.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:58.886+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:59.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:13:59.090+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:59.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:13:59.716+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:59.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:13:59.786+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:13:59.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:13:59.862+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:00.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:00.120+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:00.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:00.748+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:00.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:00.817+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:00.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:00.820+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:01.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:01.130+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:01.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:01.792+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:01.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:01.795+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:01.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:01.829+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:02.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:02.180+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:02.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:02.770+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:02.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:02.791+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:02.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:02.821+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:03.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:03.207+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:03.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:03.779+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:03.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:03.798+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:03.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:03.814+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:04.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:04.178+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:04.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:04.749+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:04.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:04.795+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:04.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:04.829+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:05.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:05.180+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:05.459 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:14:05.457+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:14:05.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:05.702+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:05.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:05.823+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:05.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:05.874+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:06.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:06.213+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:06.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:06.692+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:06.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:06.857+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:06.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:06.869+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:07.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:07.216+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:07.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:07.732+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:07.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:07.837+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:07.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:07.877+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:08.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:08.232+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:08.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:08.705+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:08.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:08.857+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:08.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:08.884+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:09.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:09.239+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:09.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:09.674+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:09.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:09.814+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:09.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:09.843+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:10.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:10.209+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:10.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:10.712+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:10.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:10.766+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:10.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:10.888+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:11.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:11.195+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:11.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:11.719+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:11.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:11.809+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:11.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:11.903+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:12.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:12.200+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:12.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:12.769+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:12.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:12.828+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:12.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:12.870+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:13.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:13.191+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:13.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:13.750+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:13.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:13.862+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:13.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:13.863+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:14.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:14.237+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:14.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:14.734+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:14.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:14:14.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:14:14.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:14.879+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:14.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:14.879+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:15.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:15.258+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:15.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:15.756+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:15.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:15.861+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:15.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:15.881+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:16.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:16.280+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:16.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:16.733+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:16.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:16.848+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:16.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:16.869+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:17.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:17.319+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:17.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:17.710+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:17.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:17.815+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:17.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:17.913+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:18.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:18.303+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:18.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:18.676+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:18.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:18.803+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:18.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:18.929+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:19.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:19.324+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:19.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:19.632+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:19.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:19.759+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:19.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:19.936+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:20.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:20.306+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:20.475 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:14:20.473+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:14:20.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:20.664+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:20.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:20.799+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:20.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:20.952+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:21.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:21.279+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:21.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:21.704+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:21.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:21.839+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:21.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:21.985+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:22.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:22.272+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:22.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:22.701+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:22.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:22.874+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:22.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:22.985+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:23.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:23.269+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:23.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:23.674+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:23.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:23.863+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:23.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:23.997+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:24.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:24.278+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:24.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:24.642+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:24.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:24.824+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:25.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:25.032+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:25.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:25.275+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:25.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:25.646+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:25.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:25.806+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:26.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:26.034+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:26.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:26.229+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:26.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:26.619+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:26.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:26.797+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:27.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:27.015+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:27.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:27.199+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:27.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:27.594+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:27.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:27.788+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:28.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:28.000+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:28.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:28.210+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:28.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:28.596+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:28.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:28.798+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:29.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:29.042+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:29.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:29.178+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:29.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:29.589+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:29.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:29.793+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:30.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:30.030+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:30.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:30.177+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:30.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:30.562+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:30.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:30.752+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:31.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:31.006+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:31.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:31.131+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:31.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:31.593+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:31.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:31.802+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:32.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:32.003+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:32.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:32.117+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:32.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:32.604+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:32.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:32.778+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:33.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:33.025+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:33.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:33.144+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:33.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:33.586+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:33.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:33.788+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:34.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:34.048+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:34.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:34.175+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:34.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:34.556+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:34.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:34.760+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:35.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:35.071+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:35.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:35.164+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:35.477 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:14:35.475+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:14:35.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:35.601+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:35.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:35.780+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:36.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:36.114+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:36.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:36.202+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:36.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:36.605+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:36.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:36.777+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:37.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:37.128+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:37.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:37.162+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:37.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:37.570+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:37.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:37.742+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:38.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:38.094+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:38.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:38.179+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:38.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:38.598+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:38.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:38.748+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:39.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:39.063+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:39.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:39.141+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:39.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:39.597+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:39.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:39.702+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:40.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:40.027+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:40.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:40.104+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:40.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:40.612+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:40.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:40.742+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:40.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:40.995+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:41.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:41.086+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:41.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:41.617+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:41.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:41.752+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:41.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:41.973+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:42.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:42.069+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:42.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:42.615+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:42.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:42.784+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:42.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:42.948+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:43.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:43.055+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:43.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:43.600+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:43.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:43.804+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:43.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:43.956+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:44.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:44.057+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:44.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:44.554+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:44.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:44.853+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:44.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:14:44.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:14:44.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:44.988+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:45.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:45.084+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:45.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:45.564+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:45.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:45.872+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:45.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:45.976+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:46.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:46.133+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:46.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:46.527+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:46.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:46.893+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:47.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:47.021+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:47.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:47.103+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:47.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:47.529+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:47.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:47.909+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:48.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:48.000+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:48.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:48.068+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:48.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:48.506+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:48.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:48.897+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:48.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:48.969+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:49.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:49.049+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:49.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:49.486+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:49.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:49.946+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:49.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:49.961+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:50.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:50.020+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:50.493 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:14:50.492+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:14:50.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:50.526+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:50.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:50.916+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:50.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:50.977+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:51.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:51.061+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:51.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:51.542+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:51.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:51.884+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:51.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:51.982+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:52.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:52.044+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:52.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:52.505+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:52.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:52.897+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:53.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:52.999+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:53.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:53.090+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:53.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:53.531+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:53.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:53.864+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:54.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:54.039+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:54.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:54.136+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:54.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:54.565+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:54.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:54.909+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:55.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:55.026+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:55.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:55.148+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:55.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:55.600+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:55.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:55.891+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:56.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:56.020+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:56.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:56.139+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:56.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:56.612+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:56.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:56.928+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:57.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:57.012+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:57.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:57.183+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:57.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:57.652+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:57.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:57.940+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:57.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:57.987+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:58.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:58.180+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:58.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:58.702+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:58.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:58.939+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:58.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:58.954+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:59.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:14:59.227+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:59.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:14:59.736+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:59.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:14:59.908+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:14:59.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:14:59.975+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:00.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:00.261+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:00.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:00.749+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:00.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:00.925+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:01.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:01.014+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:01.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:01.275+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:01.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:01.701+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:01.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:01.913+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:02.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:02.029+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:02.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:02.252+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:02.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:02.734+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:02.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:02.899+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:03.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:03.033+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:03.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:03.284+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:03.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:03.764+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:03.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:03.857+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:04.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:04.017+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:04.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:04.256+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:04.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:04.716+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:04.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:04.896+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:05.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:05.057+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:05.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:05.215+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:05.509 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:15:05.507+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:15:05.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:05.681+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:05.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:05.858+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:06.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:06.107+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:06.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:06.174+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:06.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:06.647+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:06.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:06.873+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:07.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:07.088+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:07.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:07.155+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:07.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:07.691+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:07.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:07.840+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:08.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:08.067+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:08.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:08.121+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:08.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:08.643+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:08.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:08.856+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:09.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:09.081+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:09.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:09.105+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:09.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:09.627+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:09.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:09.874+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:10.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:10.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:10.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:10.138+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:10.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:10.643+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:10.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:10.900+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:11.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:11.111+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:11.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:11.124+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:11.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:11.668+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:11.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:11.913+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:12.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:12.109+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:12.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:12.150+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:12.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:12.619+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:12.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:12.899+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:13.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:13.111+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:13.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:13.150+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:13.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:13.595+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:13.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:13.854+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:14.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:14.063+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:14.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:14.185+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:14.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:14.579+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:14.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:14.850+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:15.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:15.042+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:15.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:15:15.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:15:15.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:15.224+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:15.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:15.616+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:15.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:15.857+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:16.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:16.023+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:16.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:16.236+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:16.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:16.637+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:16.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:16.880+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:16.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:16.979+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:17.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:17.223+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:17.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:17.642+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:17.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:17.878+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:18.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:18.003+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:18.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:18.269+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:18.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:18.624+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:18.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:18.919+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:19.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:19.029+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:19.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:19.298+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:19.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:19.580+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:19.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:19.872+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:20.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:20.045+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:20.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:20.274+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:20.516 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:15:20.513+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:15:20.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:20.621+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:20.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:20.911+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:21.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:21.024+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:21.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:21.231+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:21.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:21.632+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:21.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:21.924+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:22.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:22.022+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:22.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:22.261+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:22.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:22.588+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:22.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:22.927+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:22.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:22.977+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:23.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:23.295+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:23.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:23.639+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:23.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:23.950+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:23.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:23.984+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:24.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:24.336+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:24.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:24.604+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:24.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:24.987+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:24.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:24.991+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:25.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:25.369+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:25.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:25.617+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:25.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:25.962+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:25.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:25.975+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:26.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:26.400+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:26.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:26.641+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:26.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:26.970+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:27.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:27.020+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:27.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:27.403+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:27.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:27.683+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:27.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:27.977+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:27.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:27.991+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:28.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:28.406+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:28.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:28.658+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:28.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:28.991+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:29.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:29.014+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:29.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:29.439+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:29.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:29.620+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:29.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:29.972+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:29.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:29.987+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:30.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:30.483+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:30.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:30.658+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:30.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:30.943+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:31.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:31.032+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:31.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:31.523+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:31.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:31.706+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:31.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:31.897+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:32.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:32.024+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:32.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:32.499+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:32.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:32.664+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:32.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:32.933+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:33.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:33.050+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:33.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:33.468+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:33.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:33.647+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:33.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:33.938+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:34.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:34.031+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:34.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:34.431+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:34.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:34.646+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:34.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:34.981+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:35.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:35.030+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:35.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:35.481+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:35.531 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:15:35.529+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:15:35.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:35.649+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:36.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:36.015+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:36.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:36.047+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:36.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:36.459+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:36.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:36.662+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:36.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:36.991+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:37.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:37.077+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:37.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:37.411+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:37.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:37.650+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:37.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:37.962+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:38.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:38.109+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:38.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:38.406+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:38.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:38.633+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:38.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:38.977+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:39.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:39.076+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:39.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:39.364+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:39.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:39.677+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:39.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:39.997+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:40.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:40.038+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:40.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:40.347+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:40.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:40.710+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:40.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:40.988+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:41.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:41.019+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:41.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:41.382+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:41.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:41.661+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:41.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:41.950+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:42.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:42.023+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:42.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:42.369+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:42.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:42.699+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:42.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:42.981+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:43.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:43.041+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:43.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:43.360+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:43.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:43.693+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:43.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:43.945+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:44.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:44.031+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:44.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:44.361+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:44.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:44.655+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:44.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:44.969+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:45.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:45.025+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:45.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:15:45.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:15:45.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:45.350+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:45.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:45.630+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:45.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:45.961+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:46.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:46.036+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:46.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:46.339+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:46.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:46.628+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:46.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:46.982+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:47.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:47.019+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:47.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:47.354+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:47.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:47.618+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:48.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:48.021+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:48.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:48.044+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:48.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:48.377+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:48.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:48.637+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:49.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:49.018+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:49.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:49.081+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:49.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:49.370+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:49.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:49.613+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:50.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:50.042+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:50.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:50.044+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:50.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:50.398+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:50.543 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:15:50.541+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:15:50.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:50.614+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:51.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:51.046+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:51.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:51.075+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:51.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:51.377+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:51.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:51.594+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:52.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:52.037+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:52.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:52.083+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:52.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:52.383+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:52.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:52.640+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:53.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:53.067+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:53.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:53.096+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:53.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:53.413+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:53.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:53.647+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:54.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:54.036+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:54.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:54.072+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:54.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:54.396+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:54.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:54.694+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:55.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:55.043+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:55.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:55.061+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:55.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:55.390+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:55.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:55.705+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:56.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:56.022+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:56.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:56.056+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:56.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:56.427+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:56.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:56.733+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:57.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:57.001+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 37 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:57.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:57.065+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:57.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:57.438+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:57.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:57.764+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:58.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:58.027+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:58.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:58.070+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:58.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:58.419+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:58.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:58.780+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:59.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:15:59.053+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:59.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:15:59.088+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:59.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:15:59.421+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:15:59.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:15:59.786+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:00.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:00.039+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:00.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:00.123+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:00.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:00.397+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:00.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:00.791+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:01.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:01.025+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:01.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:01.154+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:01.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:01.386+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:01.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:01.813+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:02.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:02.025+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:02.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:02.202+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:02.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:02.435+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:02.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:02.849+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:03.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:03.017+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:03.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:03.220+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:03.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:03.451+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:03.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:03.887+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:03.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:03.975+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:04.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:04.193+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:04.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:04.458+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:04.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:04.868+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:04.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:04.981+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:05.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:05.178+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:05.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:05.420+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:05.559 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:16:05.558+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:16:05.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:05.848+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:05.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:05.992+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:06.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:06.206+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:06.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:06.427+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:06.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:06.811+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:07.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:07.013+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:07.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:07.176+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:07.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:07.422+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:07.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:07.772+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:07.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:07.983+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:08.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:08.205+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:08.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:08.389+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:08.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:08.782+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:08.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:08.966+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:09.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:09.245+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:09.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:09.360+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:09.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:09.746+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:09.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:09.934+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:10.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:10.242+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:10.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:10.370+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:10.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:10.754+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:10.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:10.929+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:11.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:11.226+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:11.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:11.393+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:11.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:11.743+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:11.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:11.912+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:12.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:12.210+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:12.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:12.418+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:12.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:12.754+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:12.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:12.944+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:13.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:13.189+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:13.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:13.397+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:13.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:13.727+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:13.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:13.984+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:14.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:14.188+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:14.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:14.431+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:14.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:14.711+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:14.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:14.959+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:15.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:15.161+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:15.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:16:15.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:16:15.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:15.447+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:15.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:15.692+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:15.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:15.924+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:16.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:16.194+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:16.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:16.401+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:16.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:16.676+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:16.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:16.936+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:17.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:17.243+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:17.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:17.420+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:17.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:17.651+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:17.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:17.925+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:18.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:18.271+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:18.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:18.374+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:18.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:18.675+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:18.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:18.882+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:19.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:19.265+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:19.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:19.392+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:19.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:19.715+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:19.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:19.860+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:20.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:20.257+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:20.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:20.371+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:20.575 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:16:20.573+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:16:20.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:20.672+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:20.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:20.844+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:21.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:21.258+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:21.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:21.326+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:21.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:21.721+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:21.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:21.818+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:22.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:22.260+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:22.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:22.349+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:22.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:22.751+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:22.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:22.828+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:23.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:23.220+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:23.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:23.354+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:23.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:23.754+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:23.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:23.850+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:24.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:24.242+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:24.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:24.399+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:24.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:24.762+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:24.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:24.813+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:25.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:25.222+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:25.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:25.425+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:25.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:25.747+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:25.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:25.810+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:26.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:26.173+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:26.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:26.395+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:26.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:26.702+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:26.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:26.833+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:27.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:27.141+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:27.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:27.349+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:27.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:27.669+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:27.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:27.859+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:28.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:28.095+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:28.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:28.364+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:28.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:28.704+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:28.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:28.857+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:29.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:29.139+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:29.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:29.384+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:29.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:29.666+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:29.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:29.876+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:30.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:30.116+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:30.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:30.347+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:30.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:30.694+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:30.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:30.827+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:31.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:31.142+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:31.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:31.332+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:31.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:31.697+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:31.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:31.811+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:32.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:32.189+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:32.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:32.296+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:32.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:32.680+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:32.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:32.861+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:33.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:33.183+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:33.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:33.283+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:33.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:33.641+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:33.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:33.901+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:34.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:34.140+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:34.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:34.282+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:34.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:34.627+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:34.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:34.862+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:35.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:35.148+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:35.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:35.271+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:35.591 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:16:35.590+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:16:35.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:35.657+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:35.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:35.832+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:36.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:36.101+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:36.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:36.308+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:36.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:36.679+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:36.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:36.831+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:37.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:37.076+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:37.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:37.350+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:37.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:37.635+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:37.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:37.879+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:38.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:38.117+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:38.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:38.340+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:38.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:38.665+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:38.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:38.832+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:39.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:39.153+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:39.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:39.355+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:39.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:39.624+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:39.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:39.795+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:40.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:40.145+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:40.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:40.308+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:40.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:40.674+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:40.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:40.841+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:41.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:41.138+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:41.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:41.353+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:41.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:41.628+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:41.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:41.845+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:42.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:42.161+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:42.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:42.387+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:42.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:42.620+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:42.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:42.872+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:43.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:43.183+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:43.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:43.363+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:43.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:43.621+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:43.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:43.836+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:44.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:44.178+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:44.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:44.332+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:44.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:44.585+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:44.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:44.813+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:45.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:45.189+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:45.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:16:45.306 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:16:45.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:45.350+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:45.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:45.628+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:45.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:45.767+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:46.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:46.199+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:46.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:46.343+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:46.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:46.587+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:46.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:46.782+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:47.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:47.244+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:47.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:47.379+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:47.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:47.581+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:47.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:47.813+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:48.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:48.259+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:48.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:48.351+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:48.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:48.583+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:48.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:48.794+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:49.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:49.301+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:49.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:49.378+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:49.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:49.632+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:49.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:49.784+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:50.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:50.333+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:50.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:50.337+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:50.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:50.584+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:50.607 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:16:50.605+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:16:50.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:50.778+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:51.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:51.287+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:51.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:51.381+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:51.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:51.598+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:51.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:51.807+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:52.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:52.320+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:52.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:52.426+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:52.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:52.625+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:52.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:52.802+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:53.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:53.315+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:53.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:53.443+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:53.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:53.643+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:53.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:53.799+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:54.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:54.330+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:54.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:54.450+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:54.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:54.598+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:54.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:54.759+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:55.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:55.378+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:55.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:55.422+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:55.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:55.622+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:55.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:55.792+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:56.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:56.353+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:56.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:56.413+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:56.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:56.641+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:56.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:56.775+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:57.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:57.380+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:57.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:57.433+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:57.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:57.678+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:57.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:57.735+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:58.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:58.333+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:58.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:58.403+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:58.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:58.641+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:58.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:58.701+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:59.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:16:59.366+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:59.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:16:59.395+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:59.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:16:59.612+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:16:59.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:16:59.726+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:00.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:00.395+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:00.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:00.401+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:00.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:00.599+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:00.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:00.677+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:01.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:01.410+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:01.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:01.421+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:01.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:01.634+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:01.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:01.690+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:02.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:02.385+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:02.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:02.460+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:02.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:02.591+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:02.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:02.649+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:03.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:03.392+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:03.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:03.441+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:03.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:03.606+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:03.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:03.682+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:04.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:04.435+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:04.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:04.442+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:04.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:04.621+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:04.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:04.662+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:05.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:05.446+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:05.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:05.478+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:05.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:05.586+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:05.623 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:17:05.621+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:17:05.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:05.649+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:06.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:06.445+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:06.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:06.463+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:06.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:06.554+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:06.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:06.619+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:07.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:07.445+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:07.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:07.501+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:07.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:07.581+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:07.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:07.586+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:08.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:08.466+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:08.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:08.505+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:08.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:08.557+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:08.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:08.562+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:09.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:09.455+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:09.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:09.498+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:09.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:09.557+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:09.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:09.562+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:10.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:10.487+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:10.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:10.529+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:10.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:10.535+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:10.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:10.579+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:11.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:11.507+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:11.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:11.525+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:11.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:11.554+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:11.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:11.566+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:12.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:12.530+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:12.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:12.533+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:12.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:12.552+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:12.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:12.604+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:13.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:13.557+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:13.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:13.575+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:13.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:13.586+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:13.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:13.629+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:14.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:14.538+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:14.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:14.584+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:14.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:14.589+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:14.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:14.596+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:15.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:17:15.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:17:15.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:15.587+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:15.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:15.622+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:15.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:15.631+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:15.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:15.644+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:16.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:16.615+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:16.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:16.659+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:16.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:16.672+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:16.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:16.679+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:17.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:17.572+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:17.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:17.643+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:17.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:17.680+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:17.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:17.712+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:18.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:18.594+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:18.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:18.600+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:18.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:18.656+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:18.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:18.703+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:19.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:19.594+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:19.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:19.611+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:19.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:19.648+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:19.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:19.658+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:20.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:20.600+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:20.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:20.608+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:20.639 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:17:20.638+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:17:20.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:20.661+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:20.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:20.682+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:21.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:21.572+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:21.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:21.610+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:21.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:21.681+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:21.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:21.704+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:22.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:22.532+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:22.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:22.642+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:22.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:22.667+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:22.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:22.701+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:23.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:23.553+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:23.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:23.647+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:23.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:23.665+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:23.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:23.667+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:24.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:24.519+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:24.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:24.618+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:24.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:24.630+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:24.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:24.691+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:25.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:25.540+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:25.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:25.601+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:25.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:25.632+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:25.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:25.678+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:26.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:26.529+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:26.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:26.611+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:26.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:26.630+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:26.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:26.649+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:27.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:27.565+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:27.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:27.566+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:27.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:27.595+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:27.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:27.605+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:28.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:28.539+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:28.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:28.580+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:28.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:28.583+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:28.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:28.584+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:29.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:29.544+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:29.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:29.550+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:29.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:29.561+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:29.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:29.562+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:30.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:30.511+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:30.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:30.533+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:30.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:30.539+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:30.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:30.575+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:31.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:31.508+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:31.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:31.546+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:31.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:31.576+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:31.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:31.601+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:32.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:32.464+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:32.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:32.538+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:32.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:32.542+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:32.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:32.581+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:33.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:33.479+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:33.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:33.506+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:33.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:33.548+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:33.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:33.562+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:34.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:34.466+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:34.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:34.533+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:34.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:34.544+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:34.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:34.555+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:35.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:35.448+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:35.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:35.524+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:35.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:35.575+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:35.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:35.605+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:35.654 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:17:35.651+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:17:36.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:36.410+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:36.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:36.508+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:36.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:36.617+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:36.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:36.624+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:37.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:37.393+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:37.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:37.544+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:37.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:37.619+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:37.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:37.651+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:38.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:38.442+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:38.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:38.498+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:38.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:38.618+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:38.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:38.645+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:39.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:39.456+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:39.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:39.475+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:39.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:39.581+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:39.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:39.597+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:40.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:40.462+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:40.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:40.475+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:40.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:40.565+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:40.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:40.624+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:41.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:41.452+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:41.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:41.483+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:41.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:41.547+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:41.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:41.639+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:42.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:42.461+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:42.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:42.512+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:42.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:42.584+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:42.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:42.610+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:43.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:43.495+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:43.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:43.525+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:43.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:43.570+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:43.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:43.611+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:44.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:44.451+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:44.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:44.516+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:44.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:44.569+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:44.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:44.577+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:45.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:45.469+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:45.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:45.556+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:45.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:45.581+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:45.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:45.591+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:45.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:17:45.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:17:46.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:46.447+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:46.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:46.549+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:46.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:46.590+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:46.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:46.599+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:47.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:47.416+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:47.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:47.570+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:47.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:47.576+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:47.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:47.619+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:48.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:48.443+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:48.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:48.535+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:48.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:48.560+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:48.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:48.603+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:49.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:49.432+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:49.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:49.568+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:49.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:49.576+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:49.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:49.588+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:50.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:50.475+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:50.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:50.536+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:50.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:50.556+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:50.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:50.638+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:50.665 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:17:50.663+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:17:51.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:51.474+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:51.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:51.537+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:51.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:51.578+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:51.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:51.641+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:52.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:52.487+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:52.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:52.539+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:52.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:52.590+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:52.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:52.665+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:53.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:53.494+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:53.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:53.536+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:53.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:53.617+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:53.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:53.632+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:54.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:54.470+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:54.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:54.487+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:54.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:54.572+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:54.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:54.609+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:55.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:55.424+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:55.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:55.442+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:55.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:55.533+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:55.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:55.591+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:56.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:56.432+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:56.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:56.456+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:56.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:56.486+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:56.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:56.568+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:57.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:57.388+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:57.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:57.415+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:57.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:57.458+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:57.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:57.549+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:58.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:58.343+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:58.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:58.456+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:58.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:58.477+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:58.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:58.587+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:59.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:17:59.356+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:59.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:17:59.421+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:59.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:17:59.447+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:17:59.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:17:59.593+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:00.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:00.307+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:00.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:00.419+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:00.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:00.455+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:00.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:00.574+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:01.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:01.357+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:01.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:01.376+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:01.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:01.442+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:01.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:01.591+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:02.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:02.351+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:02.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:02.361+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:02.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:02.450+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:02.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:02.605+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:03.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:03.348+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:03.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:03.392+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:03.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:03.407+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:03.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:03.582+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:04.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:04.339+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:04.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:04.389+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:04.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:04.428+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:04.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:04.567+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:05.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:05.363+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:05.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:05.382+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:05.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:05.459+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:05.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:05.535+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:05.681 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:18:05.679+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:18:06.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:06.392+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:06.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:06.392+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:06.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:06.492+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:06.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:06.567+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:07.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:07.368+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:07.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:07.441+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:07.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:07.460+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:07.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:07.520+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:08.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:08.375+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:08.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:08.420+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:08.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:08.499+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:08.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:08.532+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:09.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:09.371+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:09.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:09.374+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:09.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:09.486+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:09.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:09.516+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:10.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:10.351+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:10.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:10.420+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:10.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:10.457+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:10.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:10.506+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:11.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:11.310+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:11.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:11.382+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:11.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:11.475+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:11.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:11.518+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:12.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:12.354+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:12.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:12.389+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:12.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:12.497+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:12.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:12.566+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:13.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:13.328+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:13.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:13.414+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:13.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:13.472+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:13.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:13.602+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:14.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:14.301+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:14.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:14.424+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:14.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:14.455+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:14.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:14.580+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:15.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:15.284+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:15.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:15.431+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:15.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:15.441+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:15.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:15.596+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:15.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:18:15.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:18:16.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:16.272+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:16.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:16.394+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:16.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:16.468+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:16.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:16.619+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:17.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:17.227+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:17.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:17.417+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:17.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:17.468+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:17.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:17.605+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:18.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:18.196+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:18.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:18.378+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:18.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:18.502+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:18.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:18.585+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:19.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:19.243+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:19.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:19.369+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:19.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:19.469+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:19.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:19.586+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:20.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:20.242+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:20.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:20.340+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:20.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:20.464+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:20.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:20.586+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:20.697 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:18:20.695+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:18:21.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:21.280+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:21.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:21.382+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:21.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:21.429+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:21.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:21.538+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:22.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:22.231+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:22.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:22.381+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:22.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:22.411+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:22.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:22.501+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:23.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:23.188+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:23.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:23.358+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:23.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:23.370+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:23.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:23.544+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:24.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:24.219+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:24.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:24.330+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:24.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:24.375+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:24.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:24.497+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:25.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:25.245+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:25.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:25.358+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:25.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:25.421+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:25.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:25.480+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:26.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:26.206+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:26.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:26.383+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:26.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:26.398+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:26.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:26.512+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:27.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:27.167+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:27.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:27.345+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:27.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:27.392+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:27.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:27.550+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:28.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:28.174+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:28.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:28.305+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:28.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:28.423+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:28.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:28.549+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:29.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:29.211+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:29.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:29.266+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:29.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:29.434+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:29.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:29.510+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:30.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:30.174+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:30.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:30.256+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:30.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:30.422+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:30.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:30.503+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:31.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:31.202+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:31.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:31.292+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:31.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:31.415+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:31.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:31.522+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:32.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:32.194+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:32.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:32.267+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:32.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:32.410+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:32.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:32.482+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:33.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:33.193+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:33.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:33.307+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:33.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:33.433+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:33.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:33.436+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:34.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:34.214+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:34.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:34.287+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:34.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:34.413+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:34.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:34.452+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:35.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:35.252+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:35.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:35.269+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:35.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:35.401+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:35.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:35.483+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:35.713 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:18:35.711+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:18:36.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:36.211+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:36.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:36.310+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:36.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:36.370+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:36.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:36.457+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:37.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:37.179+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:37.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:37.288+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:37.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:37.386+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:37.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:37.485+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:38.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:38.142+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:38.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:38.241+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:38.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:38.355+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:38.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:38.440+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:39.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:39.122+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:39.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:39.274+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:39.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:39.352+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:39.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:39.445+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:40.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:40.133+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:40.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:40.314+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:40.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:40.389+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:40.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:40.490+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:41.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:41.139+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:41.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:41.321+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:41.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:41.364+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:41.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:41.487+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:42.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:42.095+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:42.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:42.298+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:42.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:42.364+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:42.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:42.535+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:43.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:43.119+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:43.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:43.266+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:43.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:43.400+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:43.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:43.497+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:44.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:44.135+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:44.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:44.225+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:44.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:44.384+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:44.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:44.456+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:45.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:45.185+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:45.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:45.235+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:45.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:45.343+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:45.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:45.461+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:45.905 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:18:45.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:18:46.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:46.169+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:46.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:46.206+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:46.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:46.328+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:46.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:46.510+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:47.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:47.185+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:47.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:47.222+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:47.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:47.344+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:47.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:47.532+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:48.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:48.186+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:48.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:48.262+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:48.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:48.301+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:48.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:48.568+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:49.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:49.174+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:49.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:49.216+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:49.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:49.331+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:49.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:49.564+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:50.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:50.204+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:50.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:50.261+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:50.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:50.368+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:50.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:50.604+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:50.729 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:18:50.726+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:18:51.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:51.253+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:51.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:51.258+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:51.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:51.361+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:51.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:51.566+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:52.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:52.292+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:52.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:52.300+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:52.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:52.405+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:52.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:52.542+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:53.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:53.276+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:53.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:53.309+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:53.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:53.374+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:53.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:53.524+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:54.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:54.298+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:54.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:54.304+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:54.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:54.422+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:54.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:54.505+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:55.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:55.322+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:55.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:55.349+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:55.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:55.392+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:55.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:55.481+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:56.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:56.307+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:56.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:56.327+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:56.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:56.438+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:56.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:56.497+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:57.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:57.288+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:57.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:57.349+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:57.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:57.431+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:57.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:57.484+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:58.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:58.309+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:58.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:58.372+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:58.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:58.415+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:58.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:58.491+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:59.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:18:59.265+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:59.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:18:59.381+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:59.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:18:59.396+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:18:59.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:18:59.482+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:00.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:00.224+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:00.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:00.373+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:00.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:00.388+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:00.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:00.458+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:01.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:01.270+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:01.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:01.365+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:01.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:01.396+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:01.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:01.493+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:02.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:02.268+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:02.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:02.366+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:02.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:02.386+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:02.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:02.454+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:03.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:03.254+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:03.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:03.375+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:03.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:03.402+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:03.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:03.416+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:04.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:04.236+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:04.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:04.373+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:04.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:04.377+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:04.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:04.404+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:05.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:05.251+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:05.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:05.325+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:05.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:05.329+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:05.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:05.394+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:05.744 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:19:05.743+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:19:06.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:06.294+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:06.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:06.310+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:06.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:06.332+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:06.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:06.384+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:07.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:07.259+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:07.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:07.321+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:07.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:07.344+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:07.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:07.345+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:08.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:08.225+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:08.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:08.282+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:08.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:08.337+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:08.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:08.349+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:09.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:09.195+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:09.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:09.314+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:09.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:09.363+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:09.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:09.370+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:10.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:10.171+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:10.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:10.309+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:10.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:10.371+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:10.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:10.401+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:11.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:11.203+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:11.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:11.261+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:11.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:11.329+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:11.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:11.431+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:12.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:12.222+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:12.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:12.300+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:12.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:12.351+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:12.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:12.455+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:13.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:13.272+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:13.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:13.329+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:13.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:13.378+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:13.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:13.415+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:14.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:14.229+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:14.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:14.339+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:14.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:14.370+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:14.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:14.375+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:15.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:15.187+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:15.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:15.340+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:15.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:15.358+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:15.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:15.414+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:16.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:19:16.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:19:16.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:16.203+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:16.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:16.312+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:16.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:16.375+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:16.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:16.430+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:17.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:17.211+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:17.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:17.337+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:17.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:17.403+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:17.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:17.438+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:18.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:18.203+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:18.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:18.347+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:18.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:18.397+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:18.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:18.403+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:19.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:19.154+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:19.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:19.379+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:19.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:19.395+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:19.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:19.411+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:20.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:20.130+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:20.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:20.407+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:20.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:20.417+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:20.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:20.425+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:20.760 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:19:20.758+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:19:21.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:21.089+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:21.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:21.371+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:21.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:21.379+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:21.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:21.455+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:22.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:22.067+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:22.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:22.341+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:22.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:22.388+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:22.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:22.463+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:23.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:23.099+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:23.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:23.355+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:23.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:23.382+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:23.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:23.509+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:24.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:24.126+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:24.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:24.341+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:24.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:24.421+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:24.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:24.507+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:25.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:25.136+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:25.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:25.371+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:25.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:25.372+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:25.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:25.535+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:26.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:26.148+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:26.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:26.363+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:26.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:26.394+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:26.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:26.504+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:27.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:27.104+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:27.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:27.367+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:27.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:27.441+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:27.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:27.517+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:28.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:28.120+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:28.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:28.330+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:28.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:28.492+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:28.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:28.509+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:29.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:29.093+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:29.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:29.355+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:29.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:29.476+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:29.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:29.476+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:30.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:30.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:30.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:30.351+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:30.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:30.434+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:30.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:30.505+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:31.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:31.070+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:31.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:31.312+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:31.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:31.426+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:31.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:31.477+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:32.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:32.112+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:32.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:32.276+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:32.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:32.463+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:32.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:32.518+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:33.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:33.156+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:33.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:33.256+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:33.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:33.441+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:33.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:33.550+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:34.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:34.188+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:34.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:34.284+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:34.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:34.437+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:34.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:34.543+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:35.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:35.144+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:35.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:35.236+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:35.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:35.444+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:35.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:35.588+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:35.776 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:19:35.774+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:19:36.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:36.098+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:36.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:36.224+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:36.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:36.460+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:36.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:36.628+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:37.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:37.074+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:37.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:37.236+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:37.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:37.505+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:37.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:37.616+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:38.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:38.096+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:38.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:38.191+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:38.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:38.481+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:38.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:38.665+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:39.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:39.080+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:39.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:39.184+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:39.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:39.464+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:39.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:39.680+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:40.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:40.040+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:40.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:40.187+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:40.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:40.470+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:40.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:40.683+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:41.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:41.089+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:41.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:41.197+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:41.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:41.509+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:41.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:41.708+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:42.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:42.100+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:42.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:42.168+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:42.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:42.557+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:42.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:42.711+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:43.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:43.099+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:43.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:43.144+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:43.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:43.536+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:43.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:43.732+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:44.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:44.116+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:44.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:44.182+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:44.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:44.534+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:44.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:44.748+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:45.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:45.123+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:45.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:45.156+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:45.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:45.577+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:45.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:45.714+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:46.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:46.135+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:46.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:46.184+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:46.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:19:46.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:19:46.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:46.564+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:46.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:46.741+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:47.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:47.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:47.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:47.175+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:47.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:47.584+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:47.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:47.722+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:48.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:48.118+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:48.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:48.147+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:48.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:48.535+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:48.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:48.699+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:49.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:49.159+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:49.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:49.183+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:49.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:49.541+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:49.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:49.721+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:50.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:50.137+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:50.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:50.200+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:50.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:50.491+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:50.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:50.708+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:50.792 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:19:50.790+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:19:51.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:51.124+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:51.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:51.169+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:51.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:51.502+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:51.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:51.746+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:52.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:52.100+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:52.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:52.155+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:52.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:52.516+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:52.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:52.776+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:53.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:53.089+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:53.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:53.121+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:53.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:53.482+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:53.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:53.762+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:54.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:54.138+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:54.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:54.143+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:54.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:54.532+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:54.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:54.752+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:55.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:55.131+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:55.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:55.176+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:55.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:55.519+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:55.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:55.712+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:56.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:56.092+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:56.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:56.200+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:56.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:56.519+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:56.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:56.758+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:57.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:57.092+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:57.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:57.184+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:57.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:57.481+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:57.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:57.793+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:58.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:58.067+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:58.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:58.216+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:58.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:58.503+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:58.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:58.779+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:59.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:19:59.090+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:59.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:19:59.232+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:59.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:19:59.514+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:19:59.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:19:59.739+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:00.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:00.107+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:00.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:00.224+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:00.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:00.521+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:00.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:00.693+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:01.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:01.148+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:01.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:01.257+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:01.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:01.536+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:01.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:01.694+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:02.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:02.140+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:02.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:02.246+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:02.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:02.565+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:02.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:02.706+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:03.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:03.130+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:03.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:03.270+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:03.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:03.566+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:03.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:03.658+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:04.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:04.163+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:04.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:04.235+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:04.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:04.543+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:04.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:04.647+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:05.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:05.173+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:05.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:05.270+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:05.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:05.545+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:05.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:05.642+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:05.808 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:20:05.806+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:20:06.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:06.133+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:06.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:06.255+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:06.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:06.511+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:06.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:06.605+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:07.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:07.116+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:07.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:07.210+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:07.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:07.466+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:07.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:07.578+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:08.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:08.076+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:08.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:08.248+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:08.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:08.499+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:08.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:08.535+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:09.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:09.054+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:09.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:09.224+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:09.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:09.514+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:09.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:09.539+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:10.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:10.074+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:10.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:10.185+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:10.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:10.479+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:10.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:10.492+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:11.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:11.118+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:11.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:11.218+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:11.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:11.463+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:11.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:11.487+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:12.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:12.115+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:12.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:12.174+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:12.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:12.484+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:12.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:12.502+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:13.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:13.086+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:13.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:13.140+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:13.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:13.474+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:13.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:13.529+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:14.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:14.067+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:14.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:14.135+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:14.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:14.491+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:14.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:14.525+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:15.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:15.104+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:15.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:15.181+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:15.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:15.455+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:15.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:15.529+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:16.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:16.087+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:16.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:16.165+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:16.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:20:16.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:20:16.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:16.442+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:16.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:16.491+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:17.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:17.049+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:17.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:17.134+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:17.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:17.409+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:17.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:17.539+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:18.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:18.061+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:18.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:18.149+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:18.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:18.449+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:18.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:18.556+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:19.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:19.015+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:19.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:19.182+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:19.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:19.419+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:19.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:19.531+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:19.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:19.986+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:20.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:20.213+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:20.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:20.396+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:20.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:20.573+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:20.824 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:20:20.822+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:20:20.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:20.954+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:21.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:21.242+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:21.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:21.367+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:21.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:21.571+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:21.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:21.907+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:22.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:22.228+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:22.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:22.340+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:22.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:22.603+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:22.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:22.882+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:23.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:23.212+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:23.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:23.354+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:23.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:23.653+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:23.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:23.910+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:24.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:24.240+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:24.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:24.324+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:24.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:24.651+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:24.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:24.873+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:25.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:25.255+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:25.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:25.359+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:25.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:25.677+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:25.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:25.913+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:26.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:26.292+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:26.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:26.360+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:26.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:26.638+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:26.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:26.880+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:27.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:27.271+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:27.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:27.362+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:27.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:27.633+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:27.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:27.865+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:28.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:28.234+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:28.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:28.355+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:28.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:28.618+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:28.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:28.862+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:29.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:29.252+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:29.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:29.319+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:29.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:29.596+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:29.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:29.825+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:30.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:30.232+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:30.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:30.305+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:30.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:30.621+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:30.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:30.801+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:31.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:31.232+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:31.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:31.257+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:31.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:31.658+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:31.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:31.762+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:32.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:32.185+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:32.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:32.237+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:32.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:32.656+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:32.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:32.735+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:33.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:33.171+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:33.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:33.218+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:33.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:33.636+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:33.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:33.693+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:34.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:34.131+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:34.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:34.236+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:34.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:34.623+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:34.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:34.702+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:35.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:35.122+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:35.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:35.281+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:35.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:35.647+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:35.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:35.677+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:35.840 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:20:35.837+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:20:36.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:36.099+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:36.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:36.282+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:36.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:36.617+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:36.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:36.711+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:37.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:37.078+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:37.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:37.246+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:37.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:37.593+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:37.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:37.761+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:38.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:38.071+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:38.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:38.286+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:38.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:38.584+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:38.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:38.731+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:39.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:39.100+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:39.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:39.318+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:39.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:39.565+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:39.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:39.765+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:40.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:40.058+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:40.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:40.315+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:40.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:40.598+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:40.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:40.728+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:41.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:41.060+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:41.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:41.333+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:41.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:41.608+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:41.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:41.720+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:42.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:42.078+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:42.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:42.335+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:42.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:42.575+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:42.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:42.686+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:43.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:43.120+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:43.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:43.342+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:43.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:43.537+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:43.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:43.679+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:44.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:44.116+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:44.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:44.331+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:44.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:44.533+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:44.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:44.704+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:45.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:45.090+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:45.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:45.361+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:45.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:45.564+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:45.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:45.736+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:46.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:46.099+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:46.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:46.330+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:46.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:20:46.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:20:46.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:46.573+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:46.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:46.767+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:47.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:47.108+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:47.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:47.302+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:47.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:47.620+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:47.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:47.786+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:48.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:48.087+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:48.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:48.333+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:48.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:48.646+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:48.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:48.801+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:49.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:49.065+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:49.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:49.348+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:49.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:49.675+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:49.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:49.824+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:50.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:50.058+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:50.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:50.330+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:50.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:50.646+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:50.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:50.796+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:50.855 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:20:50.853+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:20:51.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:51.055+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:51.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:51.318+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:51.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:51.645+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:51.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:51.782+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:52.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:52.078+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:52.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:52.270+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:52.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:52.648+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:52.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:52.813+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:53.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:53.078+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:53.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:53.290+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:53.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:53.698+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:53.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:53.845+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:54.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:54.095+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:54.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:54.303+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:54.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:54.736+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:54.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:54.894+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:55.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:55.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:55.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:55.278+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:55.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:55.691+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:55.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:55.936+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:56.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:56.164+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:56.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:56.282+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:56.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:56.660+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:56.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:56.983+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:57.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:57.195+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:57.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:57.264+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:57.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:57.611+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:57.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:57.994+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:58.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:58.163+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:58.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:58.252+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:58.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:58.632+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:59.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:58.999+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:59.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:20:59.162+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:59.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:20:59.251+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:20:59.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:20:59.672+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:00.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:20:59.998+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:00.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:00.114+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:00.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:00.207+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:00.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:00.712+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:00.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:00.956+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:01.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:01.163+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:01.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:01.232+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:01.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:01.667+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:01.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:01.922+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:02.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:02.128+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:02.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:02.207+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:02.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:02.692+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:02.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:02.964+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:03.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:03.101+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:03.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:03.225+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:03.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:03.661+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:03.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:03.997+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:04.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:04.052+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:04.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:04.177+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:04.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:04.668+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:04.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:04.995+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:05.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:05.070+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:05.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:05.153+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:05.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:05.671+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:05.871 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:21:05.869+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:21:05.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:05.967+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:06.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:06.105+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:06.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:06.167+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:06.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:06.653+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:06.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:06.937+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:07.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:07.081+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:07.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:07.130+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:07.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:07.694+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:07.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:07.984+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:08.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:08.091+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:08.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:08.109+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:08.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:08.672+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:08.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:08.952+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:09.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:09.070+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:09.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:09.158+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:09.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:09.651+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:09.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:09.987+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:10.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:10.083+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:10.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:10.138+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:10.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:10.639+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:10.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:10.952+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:11.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:11.122+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:11.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:11.124+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:11.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:11.634+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:11.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:11.966+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:12.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:12.080+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:12.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:12.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:12.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:12.654+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:12.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:12.921+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:13.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:13.093+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:13.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:13.162+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:13.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:13.626+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:13.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:13.968+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:14.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:14.108+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:14.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:14.131+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:14.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:14.651+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:14.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:14.937+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:15.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:15.065+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:15.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:15.092+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:15.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:15.686+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:15.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:15.979+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:16.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:16.063+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:16.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:16.087+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:16.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:21:16.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:21:16.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:16.691+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:16.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:16.993+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:17.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:17.026+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:17.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:17.106+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:17.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:17.706+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:17.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:17.978+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:17.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:17.990+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:18.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:18.101+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:18.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:18.754+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:19.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:19.026+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:19.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:19.028+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:19.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:19.126+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:19.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:19.717+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:20.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:20.006+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:20.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:20.028+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:20.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:20.097+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:20.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:20.679+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:20.887 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:21:20.885+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:21:20.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:20.956+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:20.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:20.982+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:21.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:21.142+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:21.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:21.681+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:21.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:21.963+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:21.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:21.979+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:22.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:22.136+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:22.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:22.713+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:22.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:22.952+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:22.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:22.987+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:23.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:23.089+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:23.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:23.684+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:23.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:23.970+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:24.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:24.015+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:24.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:24.116+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:24.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:24.675+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:24.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:24.972+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:25.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:25.014+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:25.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:25.115+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:25.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:25.641+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:25.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:25.929+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:26.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:26.010+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:26.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:26.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:26.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:26.655+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:26.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:26.933+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:26.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:26.965+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:27.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:27.077+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:27.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:27.626+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:27.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:27.926+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:27.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:27.970+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:28.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:28.110+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:28.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:28.597+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:28.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:28.957+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:28.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:28.968+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:29.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:29.063+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:29.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:29.568+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:29.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:29.952+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:29.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:29.971+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:30.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:30.091+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:30.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:30.566+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:30.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:30.953+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:31.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:31.014+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:31.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:31.136+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:31.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:31.524+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:31.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:31.966+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:31.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:31.966+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:32.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:32.176+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:32.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:32.523+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:32.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:32.936+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:32.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:32.955+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:33.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:33.170+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:33.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:33.508+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:33.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:33.912+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:33.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:33.962+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:34.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:34.178+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:34.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:34.501+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:34.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:34.955+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:35.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:35.006+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:35.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:35.186+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:35.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:35.470+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:35.903 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:21:35.902+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:21:35.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:35.969+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:35.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:35.971+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:36.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:36.203+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:36.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:36.451+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:36.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:36.996+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:37.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:37.005+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:37.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:37.184+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:37.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:37.417+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:38.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:38.027+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:38.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:38.042+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:38.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:38.188+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:38.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:38.394+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:39.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:39.016+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:39.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:39.046+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:39.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:39.230+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:39.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:39.353+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:40.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:40.004+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:40.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:40.013+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:40.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:40.258+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:40.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:40.304+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:41.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:41.019+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:41.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:41.033+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:41.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:41.268+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:41.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:41.295+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:42.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:42.008+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:42.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:42.023+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:42.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:42.312+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:42.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:42.312+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:42.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:42.987+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:43.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:43.050+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:43.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:43.312+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:43.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:43.342+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:43.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:43.960+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:44.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:44.035+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:44.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:44.306+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:44.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:44.331+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:44.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:44.978+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:45.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:45.033+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:45.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:45.310+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:45.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:45.326+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:45.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:45.965+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:46.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:46.027+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:46.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:46.325+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:46.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:46.346+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:46.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:21:46.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:21:46.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:46.967+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:46.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:46.996+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:47.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:47.304+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:47.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:47.363+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:47.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:47.931+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:47.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:47.981+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:48.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:48.315+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:48.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:48.323+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:48.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:48.889+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:49.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:48.999+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:49.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:49.290+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:49.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:49.316+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:49.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:49.915+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:49.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:49.992+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:50.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:50.299+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:50.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:50.306+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:50.905 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:21:50.902+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:21:50.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:50.925+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:51.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:51.038+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:51.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:51.273+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:51.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:51.357+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:51.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:51.898+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:52.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:52.062+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:52.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:52.243+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:52.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:52.360+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:52.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:52.902+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:53.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:53.054+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:53.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:53.281+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:53.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:53.404+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:53.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:53.928+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:54.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:54.042+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:54.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:54.331+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:54.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:54.393+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:54.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:54.896+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:55.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:55.019+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:55.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:55.348+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:55.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:55.379+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:55.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:55.897+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:55.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:55.979+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:56.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:56.356+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:56.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:56.416+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:56.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:56.933+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:57.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:57.027+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:57.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:57.318+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:57.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:57.415+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:57.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:57.937+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:58.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:58.010+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:58.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:58.284+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:58.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:58.405+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:58.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:58.906+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:58.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:21:58.978+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:59.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:21:59.289+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:59.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:21:59.418+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:21:59.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:21:59.913+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:00.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:00.027+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:00.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:00.300+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:00.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:00.418+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:00.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:00.933+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:01.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:01.031+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:01.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:01.300+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:01.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:01.464+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:01.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:01.929+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:02.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:02.067+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:02.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:02.339+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:02.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:02.491+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:02.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:02.892+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:03.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:03.103+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:03.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:03.330+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:03.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:03.464+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:03.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:03.863+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:04.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:04.128+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:04.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:04.293+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:04.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:04.414+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:04.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:04.888+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:05.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:05.145+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:05.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:05.294+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:05.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:05.459+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:05.914 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:22:05.912+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:22:05.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:05.920+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:06.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:06.130+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:06.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:06.293+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:06.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:06.487+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:06.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:06.920+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:07.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:07.131+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:07.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:07.342+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:07.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:07.483+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:07.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:07.881+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:08.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:08.130+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:08.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:08.357+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:08.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:08.469+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:08.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:08.878+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:09.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:09.126+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:09.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:09.387+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:09.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:09.440+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:09.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:09.882+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:10.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:10.137+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:10.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:10.361+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:10.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:10.477+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:10.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:10.860+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:11.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:11.150+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:11.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:11.410+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:11.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:11.470+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:11.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:11.883+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:12.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:12.164+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:12.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:12.413+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:12.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:12.457+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:12.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:12.846+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:13.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:13.118+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:13.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:13.414+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:13.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:13.446+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:13.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:13.826+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:14.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:14.100+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:14.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:14.374+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:14.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:14.433+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:14.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:14.857+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:15.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:15.096+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:15.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:15.359+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:15.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:15.429+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:15.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:15.821+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:16.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:16.121+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:16.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:16.389+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:16.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:16.427+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:16.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:22:16.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:22:16.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:16.866+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:17.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:17.169+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:17.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:17.370+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:17.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:17.426+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:17.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:17.898+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:18.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:18.205+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:18.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:18.365+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:18.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:18.393+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:18.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:18.886+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:19.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:19.201+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:19.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:19.387+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:19.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:19.408+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:19.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:19.849+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:20.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:20.186+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:20.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:20.372+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:20.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:20.386+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:20.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:20.809+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:20.930 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:22:20.927+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:22:21.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:21.137+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:21.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:21.345+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:21.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:21.405+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:21.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:21.780+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:22.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:22.155+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:22.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:22.359+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:22.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:22.428+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:22.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:22.762+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:23.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:23.204+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:23.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:23.375+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:23.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:23.399+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:23.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:23.728+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:24.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:24.241+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:24.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:24.370+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:24.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:24.405+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:24.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:24.681+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:25.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:25.210+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:25.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:25.346+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:25.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:25.400+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:25.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:25.710+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:26.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:26.231+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:26.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:26.379+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:26.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:26.384+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:26.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:26.710+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:27.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:27.189+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:27.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:27.370+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:27.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:27.387+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:27.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:27.679+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:28.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:28.188+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:28.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:28.358+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:28.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:28.383+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:28.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:28.704+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:29.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:29.200+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:29.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:29.333+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:29.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:29.373+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:29.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:29.743+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:30.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:30.167+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:30.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:30.354+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:30.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:30.407+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:30.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:30.728+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:31.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:31.212+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:31.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:31.376+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:31.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:31.421+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:31.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:31.701+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:32.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:32.208+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:32.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:32.359+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:32.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:32.427+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:32.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:32.710+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:33.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:33.160+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:33.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:33.313+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:33.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:33.407+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:33.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:33.747+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:34.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:34.200+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:34.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:34.265+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:34.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:34.400+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:34.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:34.727+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:35.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:35.151+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:35.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:35.301+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:35.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:35.397+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:35.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:35.707+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:35.936 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:22:35.933+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:22:36.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:36.142+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:36.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:36.311+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:36.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:36.389+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:36.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:36.685+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:37.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:37.148+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:37.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:37.309+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:37.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:37.364+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:37.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:37.656+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:38.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:38.160+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:38.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:38.351+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:38.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:38.353+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:38.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:38.638+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:39.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:39.158+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:39.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:39.332+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:39.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:39.346+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:39.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:39.637+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:40.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:40.112+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:40.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:40.322+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:40.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:40.331+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:40.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:40.620+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:41.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:41.082+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:41.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:41.333+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:41.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:41.347+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:41.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:41.632+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:42.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:42.113+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:42.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:42.303+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:42.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:42.350+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:42.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:42.599+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:43.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:43.080+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:43.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:43.287+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:43.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:43.324+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:43.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:43.574+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:44.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:44.086+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:44.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:44.242+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:44.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:44.349+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:44.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:44.597+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:45.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:45.092+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:45.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:45.230+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:45.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:45.304+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:45.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:45.623+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:46.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:46.104+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:46.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:46.193+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:46.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:46.257+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:46.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:46.636+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:46.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:22:46.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:22:47.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:47.083+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:47.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:47.228+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:47.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:47.230+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:47.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:47.628+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:48.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:48.094+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:48.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:48.198+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:48.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:48.249+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:48.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:48.579+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:49.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:49.047+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:49.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:49.189+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:49.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:49.274+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:49.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:49.619+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:50.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:50.003+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:50.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:50.200+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:50.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:50.259+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:50.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:50.570+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:50.947 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:22:50.944+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:22:51.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:51.037+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:51.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:51.163+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:51.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:51.214+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:51.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:51.580+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:52.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:52.016+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:52.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:52.147+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:52.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:52.244+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:52.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:52.629+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:53.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:53.029+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:53.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:53.193+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:53.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:53.216+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:53.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:53.601+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:54.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:54.033+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:54.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:54.212+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:54.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:54.218+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:54.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:54.644+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:55.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:55.074+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:55.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:55.224+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:55.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:55.249+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:55.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:55.597+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:56.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:56.036+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:56.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:56.201+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:56.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:56.298+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:56.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:56.590+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:57.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:57.078+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:57.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:57.167+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:57.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:57.294+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:57.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:57.545+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:58.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:58.116+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:58.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:58.122+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:58.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:58.285+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:58.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:58.547+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:59.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:22:59.106+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:59.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:22:59.153+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:59.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:22:59.271+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:22:59.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:22:59.564+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:00.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:00.106+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:00.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:00.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:00.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:00.268+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:00.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:00.599+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:01.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:01.134+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:01.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:01.141+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:01.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:01.238+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:01.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:01.554+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:02.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:02.093+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:02.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:02.099+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:02.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:02.241+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:02.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:02.585+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:03.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:03.093+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:03.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:03.119+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:03.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:03.207+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:03.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:03.635+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:04.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:04.120+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:04.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:04.162+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:04.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:04.216+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:04.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:04.609+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:05.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:05.119+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:05.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:05.129+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:05.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:05.237+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:05.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:05.656+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:05.963 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:23:05.960+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:23:06.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:06.110+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:06.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:06.117+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:06.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:06.190+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:06.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:06.612+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:07.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:07.127+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:07.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:07.131+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:07.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:07.229+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:07.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:07.634+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:08.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:08.094+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:08.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:08.148+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:08.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:08.189+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:08.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:08.585+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:09.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:09.091+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:09.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:09.185+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:09.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:09.200+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:09.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:09.613+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:10.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:10.059+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:10.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:10.148+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:10.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:10.213+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:10.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:10.645+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:11.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:11.084+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:11.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:11.167+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:11.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:11.172+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:11.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:11.671+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:12.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:12.093+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:12.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:12.129+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:12.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:12.156+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:12.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:12.695+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:13.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:13.070+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:13.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:13.168+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:13.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:13.176+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:13.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:13.664+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:14.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:14.094+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:14.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:14.122+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:14.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:14.180+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:14.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:14.634+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:15.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:15.084+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:15.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:15.154+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:15.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:15.229+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:15.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:15.628+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:16.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:16.085+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:16.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:16.129+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:16.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:16.270+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:16.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:16.675+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:16.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:23:16.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:23:17.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:17.107+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:17.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:17.134+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:17.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:17.317+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:17.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:17.690+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:18.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:18.068+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:18.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:18.179+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:18.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:18.364+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:18.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:18.684+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:19.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:19.025+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:19.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:19.179+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:19.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:19.327+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:19.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:19.673+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:20.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:20.064+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:20.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:20.152+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:20.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:20.295+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:20.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:20.709+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:20.979 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:23:20.977+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:23:21.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:21.080+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:21.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:21.198+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:21.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:21.282+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:21.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:21.746+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:22.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:22.096+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:22.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:22.160+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:22.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:22.282+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:22.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:22.785+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:23.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:23.101+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:23.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:23.172+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:23.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:23.320+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:23.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:23.816+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:24.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:24.069+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:24.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:24.181+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:24.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:24.273+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:24.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:24.793+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:25.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:25.021+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:25.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:25.203+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:25.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:25.291+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:25.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:25.796+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:26.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:25.998+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:26.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:26.245+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:26.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:26.262+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:26.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:26.790+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:27.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:27.015+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:27.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:27.254+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:27.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:27.263+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:27.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:27.824+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:27.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:27.976+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:28.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:28.224+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:28.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:28.302+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:28.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:28.859+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:28.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:28.955+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:29.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:29.180+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:29.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:29.288+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:29.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:29.889+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:29.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:29.952+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:30.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:30.209+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:30.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:30.306+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:30.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:30.885+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:30.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:30.940+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:31.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:31.232+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:31.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:31.339+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:31.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:31.885+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:31.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:31.976+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:32.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:32.229+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:32.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:32.306+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:32.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:32.919+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:33.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:33.000+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:33.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:33.252+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:33.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:33.277+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:33.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:33.933+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:34.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:34.015+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:34.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:34.212+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:34.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:34.322+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:34.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:34.926+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:34.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:34.987+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:35.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:35.166+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:35.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:35.306+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:35.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:35.952+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:35.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:35.971+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:35.980 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:23:35.977+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:23:36.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:36.135+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:36.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:36.336+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:36.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:36.923+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:37.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:37.003+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:37.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:37.155+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:37.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:37.334+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:37.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:37.889+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:38.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:38.049+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:38.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:38.186+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:38.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:38.287+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:38.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:38.849+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:39.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:39.009+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:39.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:39.164+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:39.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:39.323+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:39.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:39.849+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:40.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:40.005+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:40.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:40.191+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:40.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:40.332+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:40.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:40.827+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:40.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:40.972+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:41.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:41.225+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:41.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:41.329+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:41.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:41.793+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:41.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:41.931+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:42.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:42.239+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:42.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:42.374+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:42.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:42.780+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:42.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:42.964+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:43.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:43.257+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:43.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:43.399+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:43.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:43.822+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:43.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:43.986+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:44.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:44.213+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:44.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:44.409+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:44.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:44.804+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:45.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:45.029+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:45.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:45.240+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:45.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:45.382+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:45.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:45.815+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:46.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:46.002+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:46.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:46.221+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:46.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:46.424+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:46.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:46.837+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:47.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:47.042+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:47.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:23:47.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:23:47.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:47.200+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:47.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:47.392+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:47.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:47.824+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:48.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:47.999+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:48.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:48.243+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:48.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:48.396+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:48.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:48.843+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:49.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:49.011+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:49.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:49.264+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:49.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:49.354+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:49.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:49.866+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:50.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:50.004+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:50.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:50.245+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:50.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:50.318+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:50.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:50.905+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:50.996 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:23:50.993+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:23:51.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:51.027+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:51.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:51.247+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:51.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:51.331+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:51.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:51.857+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:52.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:52.001+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:52.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:52.251+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:52.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:52.352+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:52.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:52.847+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:53.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:53.003+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:53.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:53.295+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:53.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:53.308+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:53.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:53.819+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:54.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:54.017+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:54.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:54.256+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:54.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:54.274+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:54.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:54.782+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:54.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:54.995+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:55.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:55.264+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:55.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:55.315+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:55.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:55.771+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:55.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:55.994+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:56.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:56.225+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:56.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:56.280+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:56.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:56.756+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:56.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:56.983+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:57.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:57.183+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:57.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:57.282+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:57.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:57.802+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:58.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:58.010+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:58.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:58.155+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:58.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:58.296+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:58.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:58.781+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:59.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:23:59.035+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:59.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:23:59.176+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:59.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:23:59.329+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:23:59.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:23:59.733+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:00.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:00.000+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:00.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:00.141+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:00.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:00.355+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:00.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:00.709+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:01.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:01.006+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:01.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:01.137+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:01.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:01.308+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:01.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:01.755+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:02.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:02.007+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:02.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:02.151+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:02.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:02.270+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:02.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:02.735+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:02.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:02.976+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:03.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:03.148+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:03.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:03.309+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:03.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:03.778+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:03.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:03.966+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:04.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:04.118+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:04.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:04.296+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:04.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:04.731+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:04.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:04.972+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:05.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:05.091+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:05.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:05.257+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:05.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:05.721+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:05.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:05.982+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:06.003 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:24:06.000+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:24:06.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:06.138+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:06.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:06.278+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:06.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:06.745+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:07.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:07.013+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:07.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:07.098+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:07.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:07.261+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:07.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:07.714+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:07.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:07.982+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:08.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:08.107+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:08.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:08.219+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:08.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:08.678+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:08.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:08.942+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:09.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:09.132+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:09.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:09.259+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:09.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:09.644+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:09.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:09.936+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:10.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:10.142+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:10.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:10.236+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:10.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:10.605+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:10.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:10.950+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:11.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:11.168+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:11.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:11.236+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:11.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:11.606+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:11.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:11.988+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:12.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:12.155+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:12.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:12.239+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:12.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:12.558+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:12.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:12.974+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:13.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:13.146+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:13.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:13.258+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:13.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:13.597+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:13.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:13.988+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:14.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:14.177+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:14.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:14.272+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:14.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:14.558+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:14.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:14.966+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:15.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:15.195+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:15.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:15.242+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:15.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:15.540+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:15.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:15.954+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:16.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:16.208+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:16.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:16.289+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:16.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:16.505+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:16.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:16.959+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:17.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:24:17.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:24:17.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:17.189+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:17.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:17.316+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:17.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:17.551+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:17.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:17.952+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:18.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:18.159+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:18.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:18.354+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:18.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:18.562+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:18.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:18.987+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:19.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:19.144+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:19.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:19.343+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:19.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:19.562+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:19.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:19.968+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:20.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:20.104+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:20.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:20.384+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:20.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:20.578+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:20.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:20.979+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:21.013 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:24:21.010+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:24:21.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:21.092+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:21.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:21.432+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:21.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:21.590+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:21.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:21.966+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:22.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:22.074+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:22.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:22.438+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:22.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:22.560+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:22.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:22.991+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:23.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:23.032+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:23.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:23.404+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:23.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:23.555+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:23.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:23.962+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:24.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:24.001+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:24.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:24.356+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:24.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:24.581+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:24.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:24.992+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:25.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:25.000+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:25.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:25.388+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:25.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:25.600+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:25.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:25.970+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:26.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:26.014+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:26.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:26.406+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:26.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:26.560+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:26.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:26.984+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:27.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:27.011+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:27.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:27.433+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:27.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:27.560+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:28.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:28.021+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:28.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:28.051+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:28.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:28.469+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:28.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:28.528+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:28.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:28.993+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:29.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:29.046+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:29.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:29.423+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:29.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:29.499+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:29.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:29.963+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:30.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:30.080+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:30.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:30.403+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:30.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:30.458+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:30.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:30.985+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:31.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:31.096+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:31.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:31.443+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:31.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:31.500+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:31.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:31.993+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:32.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:32.145+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:32.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:32.442+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:32.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:32.496+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:33.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:33.034+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:33.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:33.141+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:33.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:33.393+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:33.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:33.510+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:34.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:34.071+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:34.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:34.164+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:34.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:34.428+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:34.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:34.475+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:35.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:35.031+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:35.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:35.140+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:35.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:35.401+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:35.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:35.453+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:36.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:36.007+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:36.025 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:24:36.023+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:24:36.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:36.154+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:36.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:36.391+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:36.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:36.424+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:37.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:37.023+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:37.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:37.112+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:37.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:37.421+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:37.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:37.460+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:38.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:38.019+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:38.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:38.120+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:38.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:38.413+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:38.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:38.475+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:39.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:39.033+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:39.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:39.152+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:39.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:39.372+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:39.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:39.516+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:40.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:40.071+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:40.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:40.200+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:40.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:40.348+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:40.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:40.471+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:41.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:41.059+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:41.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:41.168+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:41.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:41.381+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:41.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:41.497+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:42.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:42.094+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:42.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:42.196+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:42.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:42.405+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:42.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:42.456+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:43.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:43.047+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:43.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:43.155+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:43.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:43.416+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:43.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:43.461+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:44.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:44.036+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:44.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:44.168+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:44.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:44.369+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:44.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:44.482+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:45.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:45.056+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:45.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:45.192+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:45.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:45.341+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:45.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:45.521+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:46.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:46.100+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:46.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:46.149+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:46.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:46.318+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:46.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:46.474+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:47.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:47.110+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:47.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:47.126+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:47.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:24:47.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:24:47.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:47.300+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:47.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:47.499+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:48.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:48.103+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:48.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:48.103+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:48.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:48.278+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:48.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:48.451+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:49.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:49.088+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:49.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:49.142+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:49.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:49.277+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:49.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:49.412+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:50.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:50.117+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:50.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:50.143+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:50.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:50.295+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:50.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:50.423+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:51.041 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:24:51.038+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:24:51.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:51.118+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:51.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:51.162+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:51.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:51.269+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:51.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:51.423+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:52.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:52.072+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:52.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:52.135+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:52.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:52.261+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:52.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:52.430+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:53.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:53.064+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:53.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:53.122+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:53.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:53.277+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:53.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:53.474+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:54.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:54.082+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:54.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:54.097+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:54.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:54.314+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:54.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:54.438+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:55.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:55.100+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:55.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:55.111+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:55.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:55.329+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:55.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:55.473+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:56.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:56.104+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:56.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:56.126+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:56.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:56.368+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:56.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:56.500+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:57.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:57.065+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:57.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:57.167+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:57.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:57.406+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:57.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:57.506+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:58.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:58.099+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:58.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:58.164+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:58.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:58.362+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:58.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:58.505+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:59.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:24:59.096+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:59.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:24:59.167+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:59.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:24:59.373+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:24:59.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:24:59.490+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:00.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:00.133+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:00.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:00.176+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:00.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:00.331+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:00.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:00.451+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:01.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:01.121+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:01.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:01.201+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:01.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:01.311+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:01.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:01.411+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:02.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:02.083+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:02.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:02.225+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:02.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:02.348+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:02.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:02.395+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:03.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:03.106+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:03.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:03.272+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:03.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:03.373+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:03.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:03.388+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:04.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:04.092+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:04.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:04.232+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:04.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:04.350+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:04.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:04.372+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:05.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:05.112+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:05.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:05.183+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:05.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:05.328+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:05.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:05.335+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:06.056 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:25:06.054+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:25:06.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:06.120+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:06.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:06.205+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:06.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:06.321+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:06.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:06.323+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:07.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:07.071+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:07.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:07.174+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:07.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:07.301+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:07.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:07.366+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:08.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:08.048+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:08.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:08.142+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:08.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:08.339+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:08.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:08.372+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:09.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:09.048+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:09.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:09.166+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:09.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:09.336+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:09.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:09.397+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:10.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:10.027+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:10.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:10.191+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:10.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:10.294+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:10.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:10.362+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:11.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:11.007+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:11.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:11.209+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:11.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:11.255+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:11.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:11.323+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:11.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:11.964+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:12.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:12.190+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:12.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:12.299+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:12.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:12.355+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:12.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:12.918+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:13.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:13.167+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:13.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:13.278+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:13.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:13.391+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:13.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:13.930+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:14.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:14.184+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:14.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:14.238+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:14.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:14.376+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:14.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:14.919+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:15.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:15.217+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:15.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:15.289+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:15.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:15.340+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:15.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:15.942+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:16.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:16.220+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:16.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:16.240+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:16.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:16.309+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:16.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:16.963+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:17.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:17.197+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:17.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:17.225+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:17.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:17.314+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:17.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:25:17.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:25:18.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:18.012+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:18.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:18.170+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:18.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:18.207+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:18.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:18.270+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:18.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:18.968+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:19.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:19.138+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:19.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:19.176+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:19.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:19.313+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:19.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:19.963+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:20.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:20.140+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:20.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:20.215+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:20.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:20.279+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:20.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:20.964+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:21.072 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:25:21.070+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:25:21.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:21.118+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:21.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:21.214+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:21.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:21.268+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:21.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:21.921+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:22.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:22.100+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:22.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:22.200+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:22.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:22.256+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:22.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:22.890+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:23.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:23.114+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:23.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:23.159+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:23.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:23.233+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:23.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:23.926+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:24.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:24.150+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:24.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:24.155+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:24.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:24.252+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:24.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:24.911+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:25.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:25.173+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:25.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:25.190+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:25.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:25.218+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:25.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:25.898+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:26.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:26.144+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:26.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:26.188+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:26.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:26.237+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:26.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:26.928+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:27.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:27.105+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:27.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:27.235+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:27.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:27.277+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:27.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:27.966+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:28.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:28.115+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:28.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:28.240+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:28.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:28.286+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:28.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:28.954+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:29.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:29.087+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:29.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:29.218+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:29.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:29.280+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:29.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:29.929+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:30.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:30.115+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:30.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:30.236+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:30.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:30.246+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:30.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:30.910+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:31.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:31.161+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:31.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:31.272+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:31.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:31.282+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:31.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:31.933+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:32.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:32.177+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:32.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:32.262+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:32.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:32.319+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:32.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:32.948+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:33.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:33.226+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:33.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:33.231+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:33.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:33.338+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:33.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:33.989+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:34.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:34.248+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:34.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:34.253+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:34.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:34.305+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:35.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:35.017+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:35.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:35.257+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:35.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:35.286+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:35.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:35.294+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:36.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:36.025+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:36.088 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:25:36.086+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:25:36.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:36.262+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:36.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:36.276+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:36.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:36.307+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:37.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:37.007+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:37.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:37.213+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:37.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:37.266+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:37.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:37.271+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:37.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:37.973+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:38.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:38.235+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:38.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:38.261+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:38.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:38.311+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:39.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:39.019+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:39.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:39.268+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:39.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:39.280+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:39.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:39.356+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:40.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:40.001+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:40.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:40.261+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:40.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:40.296+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:40.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:40.394+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:41.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:41.049+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:41.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:41.247+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:41.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:41.325+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:41.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:41.404+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:42.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:42.018+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:42.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:42.280+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:42.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:42.281+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:42.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:42.391+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:43.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:43.049+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:43.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:43.233+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:43.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:43.308+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:43.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:43.342+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:44.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:44.021+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:44.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:44.185+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:44.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:44.351+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:44.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:44.358+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:44.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:44.994+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:45.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:45.175+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:45.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:45.354+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:45.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:45.367+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:45.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:45.960+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:46.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:46.196+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:46.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:46.315+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:46.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:46.326+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:46.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:46.933+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:47.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:47.185+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:47.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:47.317+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:47.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:47.362+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:47.499 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:25:47.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:25:47.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:47.915+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:48.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:48.219+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:48.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:48.320+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:48.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:48.337+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:48.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:48.892+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:49.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:49.219+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:49.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:49.303+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:49.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:49.330+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:49.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:49.913+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:50.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:50.242+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:50.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:50.269+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:50.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:50.315+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:50.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:50.901+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:51.104 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:25:51.102+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:25:51.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:51.231+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:51.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:51.278+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:51.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:51.303+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:51.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:51.938+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:52.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:52.182+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:52.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:52.236+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:52.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:52.324+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:52.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:52.890+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:53.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:53.156+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:53.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:53.280+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:53.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:53.308+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:53.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:53.846+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:54.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:54.187+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:54.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:54.303+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:54.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:54.341+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:54.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:54.811+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:55.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:55.188+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:55.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:55.269+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:55.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:55.312+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:55.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:55.826+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:56.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:56.181+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:56.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:56.260+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:56.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:56.278+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:56.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:56.808+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:57.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:57.186+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:57.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:57.254+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:57.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:57.284+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:57.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:57.802+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:58.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:58.159+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:58.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:58.257+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:58.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:58.274+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:58.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:58.755+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:59.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:25:59.207+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:59.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:25:59.276+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:59.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:25:59.303+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:25:59.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:25:59.783+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:00.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:00.202+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:00.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:00.238+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:00.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:00.338+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:00.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:00.781+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:01.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:01.176+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:01.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:01.258+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:01.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:01.305+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:01.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:01.735+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:02.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:02.213+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:02.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:02.231+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:02.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:02.294+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:02.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:02.754+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:03.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:03.208+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:03.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:03.215+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:03.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:03.298+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:03.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:03.739+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:04.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:04.161+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:04.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:04.262+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:04.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:04.341+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:04.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:04.773+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:05.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:05.176+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:05.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:05.229+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:05.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:05.350+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:05.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:05.797+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:06.120 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:26:06.117+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:26:06.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:06.147+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:06.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:06.226+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:06.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:06.383+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:06.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:06.779+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:07.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:07.115+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:07.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:07.255+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:07.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:07.384+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:07.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:07.784+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:08.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:08.153+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:08.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:08.206+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:08.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:08.416+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:08.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:08.748+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:09.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:09.139+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:09.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:09.215+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:09.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:09.417+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:09.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:09.757+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:10.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:10.140+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:10.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:10.262+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:10.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:10.437+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:10.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:10.747+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:11.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:11.171+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:11.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:11.285+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:11.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:11.456+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:11.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:11.750+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:12.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:12.167+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:12.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:12.334+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:12.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:12.459+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:12.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:12.731+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:13.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:13.208+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:13.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:13.365+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:13.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:13.418+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:13.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:13.703+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:14.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:14.194+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:14.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:14.370+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:14.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:14.407+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:14.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:14.690+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:15.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:15.212+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:15.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:15.378+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:15.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:15.403+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:15.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:15.672+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:16.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:16.178+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:16.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:16.371+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:16.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:16.405+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:16.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:16.708+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:17.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:17.129+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:17.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:17.323+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:17.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:17.401+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:17.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:26:17.656 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:26:17.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:17.686+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:18.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:18.172+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:18.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:18.315+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:18.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:18.432+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:18.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:18.682+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:19.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:19.143+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:19.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:19.330+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:19.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:19.413+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:19.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:19.687+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:20.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:20.179+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:20.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:20.284+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:20.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:20.367+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:20.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:20.661+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:21.136 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:26:21.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:26:21.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:21.142+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:21.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:21.313+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:21.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:21.410+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:21.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:21.633+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:22.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:22.108+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:22.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:22.319+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:22.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:22.447+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:22.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:22.679+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:23.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:23.089+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:23.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:23.318+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:23.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:23.449+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:23.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:23.702+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:24.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:24.139+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:24.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:24.311+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:24.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:24.498+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:24.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:24.718+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:25.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:25.129+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:25.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:25.287+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:25.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:25.510+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:25.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:25.718+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:26.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:26.113+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:26.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:26.331+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:26.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:26.488+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:26.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:26.707+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:27.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:27.144+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:27.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:27.350+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:27.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:27.538+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:27.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:27.696+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:28.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:28.185+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:28.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:28.398+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:28.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:28.504+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:28.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:28.706+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:29.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:29.198+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:29.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:29.433+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:29.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:29.502+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:29.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:29.742+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:30.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:30.208+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:30.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:30.483+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:30.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:30.496+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:30.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:30.695+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:31.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:31.198+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:31.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:31.486+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:31.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:31.496+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:31.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:31.699+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:32.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:32.213+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:32.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:32.453+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:32.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:32.477+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:32.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:32.661+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:33.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:33.246+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:33.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:33.449+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:33.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:33.487+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:33.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:33.655+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:34.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:34.229+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:34.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:34.449+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:34.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:34.455+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:34.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:34.689+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:35.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:35.184+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:35.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:35.415+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:35.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:35.501+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:35.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:35.652+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:36.151 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:26:36.149+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:26:36.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:36.165+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:36.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:36.381+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:36.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:36.456+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:36.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:36.647+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:37.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:37.150+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:37.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:37.335+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:37.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:37.462+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:37.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:37.620+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:38.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:38.174+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:38.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:38.327+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:38.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:38.461+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:38.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:38.655+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:39.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:39.209+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:39.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:39.316+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:39.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:39.495+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:39.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:39.606+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:40.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:40.193+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:40.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:40.305+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:40.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:40.499+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:40.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:40.646+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:41.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:41.195+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:41.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:41.337+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:41.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:41.472+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:41.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:41.640+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:42.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:42.226+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:42.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:42.374+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:42.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:42.488+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:42.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:42.595+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:43.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:43.177+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:43.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:43.345+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:43.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:43.502+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:43.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:43.608+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:44.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:44.171+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:44.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:44.346+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:44.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:44.512+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:44.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:44.599+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:45.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:45.136+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:45.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:45.329+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:45.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:45.486+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:45.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:45.605+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:46.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:46.173+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:46.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:46.320+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:46.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:46.500+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:46.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:46.571+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:47.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:47.152+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:47.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:47.343+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:47.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:47.512+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:47.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:47.583+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:47.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:26:47.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:26:48.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:48.120+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:48.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:48.298+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:48.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:48.493+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:48.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:48.584+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:49.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:49.097+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:49.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:49.270+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:49.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:49.474+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:49.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:49.562+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:50.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:50.094+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:50.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:50.279+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:50.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:50.511+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:50.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:50.556+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:51.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:51.044+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:51.167 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:26:51.165+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:26:51.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:51.315+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:51.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:51.479+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:51.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:51.522+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:52.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:52.033+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:52.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:52.279+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:52.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:52.439+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:52.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:52.495+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:53.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:53.022+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:53.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:53.318+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:53.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:53.429+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:53.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:53.498+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:54.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:54.019+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:54.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:54.287+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:54.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:54.399+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:54.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:54.510+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:55.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:55.013+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:55.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:55.320+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:55.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:55.401+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:55.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:55.462+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:56.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:56.034+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:56.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:56.341+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:56.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:56.402+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:56.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:56.475+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:57.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:57.084+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:57.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:57.378+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:57.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:57.417+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:57.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:57.427+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:58.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:58.067+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:58.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:58.376+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:58.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:58.400+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:58.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:58.404+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:59.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:26:59.020+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:59.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:26:59.410+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:59.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:26:59.426+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:26:59.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:26:59.451+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:00.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:00.059+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:00.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:00.432+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:00.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:00.448+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:00.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:00.477+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:01.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:01.093+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:01.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:01.469+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:01.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:01.495+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:01.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:01.513+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:02.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:02.125+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:02.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:02.486+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:02.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:02.514+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:02.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:02.523+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:03.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:03.149+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:03.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:03.454+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:03.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:03.506+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:03.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:03.573+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:04.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:04.186+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:04.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:04.435+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:04.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:04.472+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:04.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:04.608+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:05.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:05.173+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:05.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:05.392+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:05.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:05.461+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:05.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:05.572+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:06.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:06.137+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:06.183 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:27:06.181+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:27:06.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:06.425+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:06.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:06.462+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:06.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:06.585+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:07.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:07.143+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:07.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:07.468+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:07.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:07.499+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:07.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:07.557+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:08.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:08.142+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:08.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:08.463+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:08.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:08.464+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:08.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:08.508+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:09.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:09.110+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:09.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:09.440+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:09.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:09.445+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:09.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:09.551+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:10.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:10.131+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:10.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:10.400+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:10.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:10.428+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:10.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:10.534+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:11.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:11.153+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:11.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:11.359+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:11.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:11.400+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:11.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:11.522+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:12.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:12.139+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:12.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:12.397+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:12.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:12.422+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:12.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:12.481+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:13.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:13.183+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:13.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:13.376+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:13.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:13.385+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:13.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:13.454+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:14.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:14.163+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:14.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:14.355+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:14.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:14.407+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:14.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:14.450+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:15.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:15.146+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:15.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:15.353+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:15.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:15.452+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:15.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:15.456+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:16.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:16.115+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:16.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:16.333+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:16.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:16.413+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:16.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:16.498+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:17.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:17.104+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:17.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:17.307+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:17.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:17.368+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:17.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:17.522+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:17.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:27:17.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:27:18.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:18.136+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:18.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:18.330+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:18.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:18.331+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:18.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:18.508+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:19.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:19.125+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:19.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:19.300+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:19.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:19.327+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:19.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:19.470+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:20.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:20.161+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:20.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:20.329+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:20.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:20.349+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:20.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:20.465+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:21.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:21.124+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:21.199 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:27:21.196+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:27:21.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:21.299+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:21.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:21.330+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:21.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:21.456+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:22.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:22.128+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:22.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:22.285+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:22.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:22.339+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:22.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:22.419+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:23.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:23.152+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:23.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:23.321+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:23.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:23.365+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:23.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:23.427+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:24.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:24.113+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:24.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:24.282+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:24.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:24.319+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:24.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:24.434+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:25.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:25.071+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:25.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:25.237+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:25.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:25.280+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:25.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:25.425+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:26.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:26.120+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:26.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:26.273+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:26.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:26.276+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:26.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:26.388+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:27.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:27.106+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:27.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:27.281+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:27.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:27.303+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:27.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:27.356+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:28.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:28.081+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:28.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:28.270+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:28.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:28.291+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:28.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:28.333+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:29.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:29.060+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:29.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:29.282+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:29.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:29.322+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:29.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:29.382+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:30.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:30.025+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:30.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:30.320+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:30.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:30.338+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:30.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:30.361+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:31.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:31.071+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:31.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:31.296+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:31.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:31.314+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:31.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:31.344+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:32.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:32.111+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:32.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:32.284+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:32.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:32.299+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:32.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:32.309+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:33.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:33.069+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:33.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:33.264+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:33.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:33.280+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:33.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:33.301+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:34.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:34.032+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:34.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:34.254+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:34.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:34.257+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:34.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:34.275+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:35.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:35.052+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:35.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:35.226+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:35.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:35.282+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:35.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:35.294+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:36.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:36.067+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:36.215 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:27:36.213+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:27:36.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:36.219+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:36.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:36.326+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:36.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:36.340+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:37.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:37.099+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:37.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:37.223+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:37.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:37.335+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:37.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:37.342+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:38.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:38.140+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:38.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:38.229+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:38.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:38.302+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:38.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:38.353+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:39.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:39.149+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:39.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:39.224+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:39.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:39.326+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:39.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:39.329+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:40.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:40.141+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:40.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:40.186+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:40.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:40.283+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:40.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:40.308+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:41.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:41.153+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:41.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:41.214+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:41.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:41.274+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:41.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:41.290+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:42.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:42.169+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:42.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:42.218+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:42.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:42.267+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:42.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:42.332+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:43.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:43.163+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:43.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:43.176+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:43.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:43.241+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:43.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:43.365+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:44.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:44.151+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:44.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:44.208+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:44.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:44.246+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:44.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:44.408+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:45.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:45.138+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:45.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:45.220+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:45.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:45.254+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:45.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:45.398+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:46.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:46.167+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:46.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:46.200+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:46.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:46.230+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:46.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:46.439+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:47.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:47.143+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:47.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:47.175+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:47.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:47.249+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:47.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:47.431+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:47.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:27:47.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:27:48.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:48.180+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:48.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:48.180+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:48.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:48.265+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:48.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:48.436+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:49.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:49.134+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:49.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:49.174+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:49.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:49.295+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:49.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:49.405+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:50.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:50.158+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:50.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:50.160+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:50.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:50.296+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:50.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:50.446+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:51.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:51.111+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:51.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:51.141+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:51.231 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:27:51.228+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:27:51.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:51.319+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:51.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:51.442+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:52.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:52.080+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:52.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:52.170+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:52.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:52.360+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:52.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:52.443+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:53.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:53.112+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:53.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:53.124+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:53.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:53.343+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:53.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:53.431+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:54.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:54.101+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:54.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:54.103+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:54.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:54.298+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:54.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:54.455+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:55.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:55.121+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:55.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:55.152+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:55.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:55.295+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:55.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:55.502+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:56.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:56.129+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:56.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:56.178+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:56.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:56.318+0000 7f6e44c9f700 -1 osd.7 102 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:56.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:56.474+0000 7f72c425d700 -1 osd.5 102 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:57.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:57.150+0000 7f596d92c700 -1 osd.6 102 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:57.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:57.228+0000 7f389e18e700 -1 osd.4 102 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:57.239 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-03T23:27:57.236+0000 7f7cc107d700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:27:57.253 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-03T23:27:57.236+0000 7f7cc107d700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:27:57.275 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-03T23:27:57.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:57.363+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:57.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:57.502+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:58.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:58.148+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:58.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:58.245+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:58.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:58.318+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:58.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:58.520+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:59.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:27:59.105+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:59.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:27:59.248+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:59.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:27:59.336+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:27:59.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:27:59.512+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:00.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:00.057+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:00.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:00.231+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:00.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:00.359+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:00.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:00.501+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:01.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:01.106+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:01.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:01.214+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:01.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:01.405+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:01.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:01.457+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:02.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:02.058+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:02.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:02.167+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:02.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:02.451+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:02.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:02.461+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:03.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:03.067+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:03.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:03.129+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:03.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:03.414+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:03.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:03.482+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:04.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:04.048+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:04.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:04.107+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:04.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:04.396+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:04.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:04.433+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:05.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:05.002+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:05.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:05.123+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:05.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:05.394+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:05.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:05.426+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:05.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:05.975+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:06.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:06.091+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:06.236 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:28:06.233+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:28:06.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:06.372+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:06.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:06.386+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:06.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:06.960+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:07.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:07.120+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:07.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:07.362+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:07.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:07.362+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:07.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:07.918+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:08.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:08.147+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:08.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:08.324+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:08.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:08.352+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:08.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:08.885+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:09.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:09.185+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:09.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:09.280+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:09.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:09.321+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:09.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:09.923+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:10.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:10.210+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:10.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:10.265+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:10.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:10.301+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:10.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:10.895+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:11.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:11.221+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:11.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:11.279+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:11.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:11.305+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:11.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:11.875+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:12.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:12.267+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:12.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:12.278+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:12.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:12.297+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:12.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:12.890+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:13.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:13.223+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:13.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:13.276+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:13.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:13.327+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:13.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:13.928+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:14.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:14.217+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:14.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:14.319+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:14.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:14.321+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:14.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:14.934+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:15.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:15.241+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:15.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:15.320+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:15.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:15.341+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:15.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:15.953+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:16.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:16.234+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:16.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:16.307+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:16.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:16.312+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:16.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:16.907+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:17.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:17.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:17.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:17.316+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:17.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:17.360+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:17.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:17.889+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:18.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:28:18.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:28:18.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:18.277+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:18.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:18.277+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:18.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:18.400+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:18.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:18.891+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:19.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:19.266+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:19.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:19.289+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:19.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:19.373+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:19.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:19.857+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:20.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:20.250+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:20.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:20.262+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:20.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:20.339+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:20.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:20.807+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:21.245 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:28:21.243+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:28:21.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:21.249+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:21.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:21.296+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:21.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:21.316+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:21.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:21.780+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:22.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:22.241+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:22.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:22.264+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:22.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:22.298+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:22.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:22.747+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:23.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:23.231+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:23.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:23.264+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:23.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:23.277+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:23.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:23.752+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:24.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:24.233+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:24.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:24.252+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:24.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:24.255+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:24.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:24.754+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:25.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:25.193+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:25.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:25.213+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:25.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:25.232+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:25.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:25.710+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:26.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:26.193+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:26.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:26.204+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:26.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:26.209+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:26.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:26.662+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:27.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:27.195+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:27.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:27.239+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:27.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:27.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:27.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:27.710+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:28.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:28.191+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:28.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:28.245+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:28.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:28.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:28.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:28.668+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:29.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:29.222+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:29.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:29.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:29.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:29.285+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:29.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:29.676+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:30.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:30.200+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:30.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:30.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:30.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:30.278+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:30.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:30.653+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:31.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:31.201+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:31.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:31.221+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:31.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:31.283+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:31.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:31.615+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:32.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:32.193+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:32.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:32.240+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:32.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:32.261+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:32.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:32.638+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:33.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:33.187+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:33.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:33.255+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:33.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:33.288+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:33.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:33.631+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:34.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:34.193+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:34.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:34.257+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:34.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:34.290+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:34.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:34.657+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:35.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:35.193+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:35.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:35.243+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:35.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:35.292+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:35.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:35.648+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:36.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:36.218+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:36.261 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:28:36.258+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:28:36.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:36.276+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:36.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:36.332+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:36.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:36.674+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:37.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:37.198+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:37.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:37.260+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:37.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:37.354+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:37.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:37.707+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:38.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:38.214+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:38.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:38.221+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:38.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:38.328+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:38.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:38.717+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:39.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:39.181+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:39.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:39.240+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:39.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:39.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:39.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:39.717+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:40.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:40.204+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:40.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:40.204+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:40.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:40.291+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:40.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:40.691+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:41.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:41.175+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:41.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:41.225+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:41.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:41.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:41.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:41.688+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:42.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:42.209+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:42.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:42.215+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:42.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:42.223+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:42.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:42.654+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:43.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:43.168+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:43.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:43.242+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:43.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:43.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:43.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:43.636+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:44.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:44.123+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:44.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:44.203+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:44.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:44.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:44.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:44.682+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:45.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:45.086+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:45.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:45.234+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:45.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:45.323+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:45.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:45.706+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:46.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:46.065+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:46.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:46.212+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:46.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:46.351+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:46.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:46.661+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:47.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:47.033+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:47.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:47.207+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:47.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:47.336+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:47.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:47.648+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:48.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:48.082+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:48.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:28:48.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:28:48.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:48.217+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:48.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:48.374+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:48.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:48.680+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:49.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:49.043+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:49.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:49.190+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:49.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:49.399+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:49.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:49.631+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:50.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:50.018+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:50.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:50.208+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:50.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:50.399+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:50.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:50.631+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:50.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:50.982+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:51.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:51.243+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:51.274 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:28:51.273+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:28:51.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:51.417+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:51.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:51.665+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:51.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:51.952+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:52.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:52.209+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:52.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:52.399+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:52.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:52.629+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:52.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:52.966+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:53.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:53.186+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:53.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:53.349+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:53.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:53.609+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:53.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:53.937+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:54.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:54.164+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:54.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:54.347+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:54.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:54.648+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:54.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:54.956+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:55.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:55.182+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:55.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:55.304+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:55.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:55.653+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:55.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:55.924+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:56.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:56.206+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:56.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:56.308+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:56.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:56.676+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:56.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:56.916+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:57.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:57.228+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:57.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:57.291+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:57.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:57.723+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:57.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:57.907+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:58.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:58.214+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:58.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:58.283+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:58.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:58.701+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:58.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:58.873+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:59.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:28:59.216+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:59.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:28:59.317+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:59.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:28:59.721+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:28:59.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:28:59.871+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:00.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:00.264+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:00.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:00.275+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:00.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:00.673+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:00.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:00.857+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:01.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:01.243+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:01.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:01.309+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:01.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:01.640+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:01.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:01.872+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:02.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:02.256+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:02.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:02.307+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:02.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:02.599+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:02.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:02.862+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:03.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:03.263+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:03.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:03.279+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:03.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:03.610+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:03.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:03.815+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:04.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:04.261+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:04.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:04.329+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:04.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:04.566+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:04.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:04.860+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:05.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:05.261+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:05.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:05.350+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:05.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:05.569+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:05.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:05.828+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:06.282 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:29:06.280+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:29:06.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:06.288+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:06.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:06.353+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:06.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:06.553+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:06.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:06.804+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:07.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:07.270+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:07.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:07.361+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:07.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:07.604+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:07.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:07.824+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:08.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:08.231+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:08.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:08.331+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:08.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:08.602+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:08.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:08.842+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:09.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:09.257+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:09.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:09.338+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:09.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:09.570+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:09.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:09.842+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:10.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:10.240+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:10.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:10.314+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:10.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:10.536+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:10.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:10.834+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:11.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:11.249+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:11.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:11.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:11.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:11.568+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:11.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:11.803+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:12.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:12.292+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:12.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:12.331+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:12.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:12.601+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:12.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:12.807+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:13.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:13.325+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:13.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:13.342+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:13.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:13.601+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:13.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:13.802+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:14.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:14.305+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:14.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:14.353+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:14.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:14.643+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:14.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:14.839+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:15.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:15.298+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:15.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:15.341+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:15.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:15.618+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:15.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:15.843+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:16.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:16.299+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:16.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:16.301+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:16.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:16.603+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:16.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:16.853+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:17.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:17.309+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:17.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:17.346+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:17.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:17.562+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:17.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:17.828+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:18.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:29:18.274 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:29:18.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:18.323+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:18.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:18.326+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:18.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:18.535+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:18.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:18.869+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:19.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:19.336+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:19.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:19.373+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:19.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:19.551+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:19.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:19.833+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:20.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:20.319+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:20.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:20.419+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:20.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:20.570+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:20.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:20.853+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:21.298 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:29:21.296+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:29:21.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:21.313+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:21.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:21.437+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:21.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:21.565+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:21.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:21.843+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:22.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:22.331+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:22.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:22.435+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:22.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:22.540+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:22.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:22.871+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:23.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:23.306+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:23.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:23.483+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:23.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:23.550+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:23.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:23.887+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:24.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:24.301+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:24.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:24.440+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:24.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:24.533+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:24.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:24.920+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:25.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:25.262+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:25.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:25.487+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:25.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:25.565+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:25.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:25.883+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:26.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:26.286+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:26.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:26.438+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:26.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:26.583+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:26.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:26.883+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:27.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:27.264+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:27.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:27.483+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:27.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:27.601+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:27.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:27.889+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:28.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:28.264+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:28.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:28.498+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:28.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:28.614+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:28.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:28.859+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:29.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:29.302+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:29.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:29.500+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:29.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:29.659+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:29.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:29.889+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:30.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:30.253+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:30.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:30.485+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:30.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:30.621+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:30.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:30.842+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:31.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:31.220+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:31.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:31.459+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:31.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:31.586+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:31.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:31.808+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:32.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:32.262+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:32.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:32.495+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:32.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:32.566+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:32.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:32.808+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:33.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:33.248+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:33.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:33.491+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:33.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:33.549+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:33.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:33.803+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:34.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:34.296+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:34.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:34.464+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:34.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:34.573+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:34.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:34.811+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:35.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:35.268+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:35.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:35.438+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:35.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:35.575+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:35.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:35.810+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:36.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:36.274+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:36.313 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:29:36.311+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:29:36.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:36.483+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:36.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:36.611+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:36.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:36.810+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:37.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:37.261+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:37.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:37.496+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:37.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:37.631+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:37.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:37.858+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:38.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:38.237+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:38.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:38.469+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:38.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:38.593+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:38.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:38.853+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:39.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:39.250+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:39.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:39.470+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:39.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:39.621+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:39.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:39.901+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:40.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:40.289+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:40.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:40.510+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:40.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:40.667+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:40.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:40.868+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:41.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:41.277+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:41.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:41.464+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:41.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:41.671+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:41.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:41.847+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:42.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:42.248+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:42.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:42.510+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:42.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:42.646+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:42.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:42.878+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:43.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:43.235+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:43.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:43.476+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:43.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:43.646+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:43.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:43.852+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:44.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:44.253+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:44.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:44.458+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:44.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:44.683+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:44.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:44.840+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:45.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:45.236+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:45.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:45.444+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:45.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:45.658+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:45.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:45.800+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:46.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:46.197+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:46.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:46.492+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:46.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:46.688+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:46.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:46.841+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:47.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:47.189+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:47.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:47.533+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:47.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:47.714+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:47.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:47.812+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:48.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:48.188+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:48.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:29:48.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:29:48.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:48.512+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:48.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:48.703+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:48.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:48.825+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:49.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:49.204+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:49.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:49.472+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:49.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:49.720+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:49.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:49.819+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:50.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:50.225+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:50.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:50.510+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:50.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:50.761+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:50.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:50.780+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:51.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:51.219+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:51.329 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:29:51.327+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:29:51.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:51.554+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:51.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:51.747+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:51.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:51.796+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:52.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:52.205+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:52.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:52.527+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:52.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:52.793+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:52.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:52.842+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:53.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:53.204+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:53.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:53.538+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:53.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:53.838+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:53.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:53.847+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:54.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:54.203+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:54.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:54.535+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:54.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:54.828+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:54.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:54.880+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:55.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:55.213+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:55.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:55.542+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:55.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:55.823+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:55.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:55.894+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:56.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:56.185+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:56.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:56.582+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:56.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:56.852+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:56.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:56.866+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:57.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:57.179+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:57.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:57.589+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:57.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:57.857+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:57.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:57.864+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:58.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:58.187+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:58.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:58.622+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:58.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:58.846+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:58.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:58.866+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:59.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:29:59.183+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:59.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:29:59.578+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:59.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:29:59.827+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:29:59.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:29:59.829+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:00.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:00.167+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:00.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:00.607+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:00.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:00.839+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:00.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:00.805+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:01.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:01.136+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:01.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:01.635+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:01.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:01.845+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:01.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:01.857+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:02.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:02.107+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:02.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:02.595+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:02.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:02.820+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:02.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:02.875+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:03.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:03.154+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:03.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:03.550+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:03.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:03.798+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:03.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:03.849+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:04.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:04.123+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:04.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:04.560+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:04.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:04.767+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:04.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:04.881+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:05.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:05.127+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:05.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:05.533+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:05.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:05.784+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:05.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:05.883+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:06.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:06.109+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:06.345 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:30:06.344+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:30:06.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:06.490+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:06.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:06.808+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:06.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:06.878+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:07.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:07.060+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:07.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:07.477+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:07.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:07.821+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:07.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:07.861+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:08.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:08.077+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:08.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:08.475+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:08.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:08.819+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:08.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:08.902+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:09.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:09.113+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:09.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:09.437+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:09.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:09.814+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:09.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:09.902+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:10.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:10.161+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:10.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:10.438+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:10.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:10.859+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:10.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:10.892+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:11.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:11.190+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:11.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:11.466+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:11.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:11.902+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:11.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:11.914+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:12.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:12.226+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:12.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:12.491+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:12.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:12.888+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:12.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:12.935+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:13.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:13.180+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:13.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:13.532+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:13.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:13.846+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:13.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:13.958+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:14.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:14.172+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:14.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:14.566+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:14.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:14.826+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:14.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:14.972+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:15.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:15.204+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:15.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:15.549+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:15.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:15.826+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:15.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:15.947+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:16.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:16.158+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:16.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:16.594+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:16.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:16.810+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:16.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:16.976+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:17.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:17.185+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:17.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:17.600+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:17.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:17.835+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:17.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:17.933+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:18.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:18.235+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:18.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:30:18.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:30:18.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:18.584+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:18.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:18.872+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:18.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:18.961+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:19.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:19.283+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:19.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:19.625+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:19.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:19.886+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:19.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:19.968+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:20.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:20.249+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:20.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:20.607+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:20.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:20.901+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:20.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:20.972+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:21.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:21.235+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:21.361 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:30:21.359+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:30:21.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:21.626+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:21.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:21.854+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:21.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:21.935+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:22.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:22.203+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:22.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:22.658+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:22.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:22.820+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:22.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:22.902+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:23.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:23.234+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:23.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:23.689+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:23.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:23.802+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:23.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:23.931+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:24.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:24.186+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:24.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:24.705+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:24.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:24.820+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:24.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:24.973+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:25.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:25.235+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:25.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:25.705+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:25.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:25.856+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:26.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:26.001+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:26.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:26.251+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:26.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:26.672+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:26.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:26.842+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:26.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:26.978+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:27.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:27.217+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:27.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:27.670+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:27.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:27.867+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:28.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:28.000+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:28.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:28.244+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:28.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:28.664+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:28.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:28.893+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:28.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:28.974+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:29.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:29.222+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:29.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:29.712+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:29.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:29.912+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:30.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:30.007+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:30.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:30.248+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:30.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:30.692+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:30.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:30.917+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:31.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:31.035+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:31.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:31.270+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:31.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:31.674+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:31.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:31.954+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:32.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:32.063+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:32.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:32.253+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:32.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:32.674+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:32.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:32.904+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:33.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:33.074+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:33.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:33.223+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:33.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:33.631+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:33.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:33.944+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:34.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:34.124+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:34.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:34.244+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:34.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:34.640+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:34.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:34.953+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:35.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:35.134+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:35.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:35.281+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:35.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:35.622+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:35.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:35.927+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:36.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:36.114+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:36.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:36.269+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:36.377 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:30:36.375+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:30:36.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:36.607+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:36.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:36.930+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:37.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:37.067+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:37.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:37.254+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:37.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:37.574+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:37.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:37.908+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:38.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:38.043+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:38.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:38.216+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:38.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:38.611+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:38.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:38.958+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:39.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:39.054+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:39.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:39.195+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:39.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:39.624+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:39.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:39.941+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:40.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:40.088+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:40.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:40.210+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:40.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:40.618+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:40.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:40.951+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:41.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:41.039+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:41.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:41.214+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:41.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:41.620+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:41.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:41.932+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:41.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:41.993+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:42.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:42.165+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:42.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:42.641+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:42.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:42.905+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:42.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:42.957+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:43.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:43.184+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:43.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:43.617+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:43.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:43.919+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:43.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:43.923+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:44.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:44.190+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:44.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:44.635+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:44.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:44.890+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:44.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:44.903+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:45.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:45.195+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:45.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:45.618+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:45.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:45.861+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:45.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:45.871+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:46.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:46.176+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:46.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:46.665+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:46.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:46.854+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:46.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:46.906+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:47.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:47.179+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:47.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:47.661+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:47.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:47.825+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:47.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:47.883+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:48.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:48.183+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:48.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:30:48.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:30:48.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:48.651+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:48.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:48.819+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:48.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:48.873+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:49.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:49.202+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:49.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:49.635+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:49.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:49.857+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:49.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:49.895+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:50.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:50.212+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:50.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:50.683+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:50.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:50.813+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:50.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:50.886+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:51.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:51.215+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:51.393 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:30:51.390+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:30:51.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:51.698+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:51.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:51.783+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:51.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:51.869+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:52.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:52.181+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:52.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:52.669+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:52.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:52.826+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:52.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:52.907+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:53.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:53.169+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:53.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:53.676+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:53.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:53.804+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:53.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:53.949+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:54.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:54.191+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:54.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:54.662+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:54.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:54.811+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:54.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:54.967+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:55.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:55.235+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:55.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:55.703+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:55.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:55.788+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:55.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:55.937+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:56.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:56.271+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:56.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:56.663+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 21 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:56.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:56.834+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:56.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:56.931+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:57.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:57.241+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:57.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:57.660+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:57.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:57.795+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:57.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:57.976+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:58.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:58.275+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:58.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:58.670+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:58.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:58.793+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:58.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:30:58.996+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:59.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:30:59.275+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:59.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:30:59.706+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:30:59.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:30:59.766+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:00.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:00.033+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:00.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:00.305+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:00.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:00.751+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:00.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:00.754+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:01.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:01.031+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:01.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:01.312+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:01.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:01.757+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:01.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:01.763+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:01.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:01.984+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:02.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:02.357+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:02.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:02.773+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:02.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:02.799+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:03.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:03.005+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:03.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:03.368+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:03.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:03.770+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:03.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:03.809+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:03.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:03.989+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:04.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:04.368+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:04.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:04.761+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:04.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:04.859+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:04.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:04.957+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:05.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:05.341+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:05.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:05.744+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:05.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:05.837+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:05.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:05.945+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:06.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:06.368+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:06.408 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:31:06.406+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:31:06.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:06.713+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:06.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:06.821+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:06.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:06.934+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:07.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:07.355+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:07.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:07.675+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:07.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:07.868+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:07.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:07.942+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:08.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:08.366+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:08.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:08.718+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:08.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:08.821+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:08.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:08.986+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:09.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:09.380+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:09.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:09.702+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:09.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:09.784+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:10.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:09.999+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:10.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:10.400+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:10.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:10.711+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:10.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:10.783+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:11.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:11.030+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:11.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:11.407+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:11.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:11.721+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:11.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:11.765+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:12.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:12.072+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:12.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:12.407+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:12.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:12.711+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:12.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:12.806+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:13.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:13.081+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:13.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:13.389+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:13.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:13.669+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:13.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:13.849+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:14.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:14.094+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:14.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:14.375+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:14.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:14.702+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:14.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:14.854+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:15.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:15.074+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:15.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:15.338+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:15.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:15.685+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:15.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:15.864+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:16.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:16.063+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:16.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:16.330+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:16.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:16.686+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:16.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:16.864+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:17.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:17.039+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:17.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:17.354+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:17.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:17.700+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:17.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:17.874+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:18.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:18.035+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:18.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:18.336+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:18.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:31:18.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:31:18.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:18.743+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:18.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:18.889+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:19.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:19.041+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:19.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:19.375+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:19.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:19.711+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:19.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:19.904+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:20.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:20.046+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:20.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:20.331+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:20.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:20.712+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:20.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:20.941+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:21.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:21.079+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:21.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:21.316+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:21.414 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:31:21.411+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:31:21.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:21.676+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:21.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:21.942+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:22.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:22.066+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:22.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:22.348+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:22.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:22.690+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:22.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:22.978+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:23.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:23.059+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:23.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:23.346+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:23.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:23.734+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:23.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:23.984+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:24.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:24.082+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:24.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:24.371+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:24.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:24.712+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:25.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:25.023+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:25.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:25.131+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:25.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:25.351+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:25.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:25.686+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:25.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:25.994+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:26.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:26.177+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:26.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:26.398+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:26.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:26.666+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:27.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:27.002+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:27.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:27.135+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:27.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:27.386+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:27.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:27.686+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:28.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:28.043+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:28.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:28.115+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:28.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:28.399+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:28.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:28.654+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:29.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:29.054+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:29.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:29.135+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:29.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:29.355+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:29.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:29.695+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:30.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:30.088+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:30.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:30.110+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:30.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:30.311+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:30.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:30.676+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:31.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:31.101+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:31.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:31.125+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:31.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:31.350+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:31.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:31.669+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:32.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:32.063+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:32.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:32.152+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:32.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:32.306+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:32.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:32.632+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:33.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:33.034+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:33.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:33.173+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:33.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:33.342+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:33.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:33.658+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:34.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:34.026+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:34.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:34.192+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:34.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:34.352+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:34.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:34.660+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:34.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:34.984+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:35.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:35.242+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:35.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:35.386+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:35.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:35.617+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:35.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:35.938+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:36.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:36.213+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:36.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:36.352+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:36.430 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:31:36.427+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:31:36.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:36.609+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:36.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:36.893+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:37.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:37.236+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:37.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:37.335+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:37.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:37.627+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:37.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:37.916+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:38.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:38.258+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:38.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:38.317+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:38.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:38.653+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:38.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:38.902+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:39.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:39.297+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:39.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:39.347+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:39.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:39.684+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:39.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:39.943+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:40.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:40.336+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:40.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:40.397+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:40.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:40.728+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:40.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:40.939+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:41.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:41.304+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:41.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:41.399+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:41.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:41.728+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:41.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:41.931+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:42.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:42.259+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:42.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:42.436+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:42.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:42.752+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:42.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:42.951+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:43.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:43.233+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:43.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:43.402+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:43.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:43.767+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:43.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:43.962+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:44.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:44.227+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:44.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:44.414+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:44.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:44.744+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:44.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:44.990+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:45.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:45.181+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:45.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:45.393+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:45.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:45.695+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:45.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:45.949+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:46.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:46.225+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:46.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:46.413+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:46.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:46.734+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:46.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:46.933+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:47.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:47.237+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:47.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:47.463+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:47.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:47.761+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:47.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:47.909+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:48.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:48.233+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:48.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:48.473+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:48.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:48.723+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:48.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:31:48.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:31:48.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:48.892+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:49.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:49.239+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:49.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:49.471+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:49.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:49.761+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:49.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:49.883+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:50.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:50.238+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:50.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:50.440+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:50.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:50.762+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:50.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:50.910+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:51.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:51.220+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:51.433 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:31:51.431+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:31:51.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:51.451+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:51.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:51.780+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:51.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:51.948+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:52.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:52.216+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:52.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:52.467+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:52.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:52.763+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:52.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:52.932+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:53.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:53.242+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:53.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:53.430+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:53.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:53.799+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:53.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:53.908+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:54.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:54.211+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:54.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:54.434+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:54.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:54.791+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:54.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:54.891+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:55.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:55.235+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:55.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:55.426+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:55.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:55.776+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:55.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:55.877+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:56.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:56.258+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:56.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:56.434+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:56.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:56.775+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:56.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:56.902+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:57.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:57.282+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:57.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:57.416+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:57.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:57.809+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:57.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:57.853+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:58.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:58.254+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:58.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:58.376+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:58.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:58.803+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:58.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:58.902+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:59.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:31:59.301+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:59.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:31:59.426+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:59.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:31:59.810+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:31:59.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:31:59.941+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:00.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:00.253+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:00.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:00.475+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:00.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:00.819+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:00.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:00.979+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:01.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:01.264+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:01.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:01.483+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:01.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:01.852+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:02.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:02.005+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:02.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:02.270+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:02.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:02.434+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:02.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:02.885+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:03.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:03.029+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:03.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:03.282+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:03.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:03.424+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:03.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:03.885+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:03.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:03.984+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:04.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:04.260+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:04.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:04.377+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:04.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:04.861+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:04.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:04.972+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:05.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:05.212+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:05.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:05.415+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:05.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:05.872+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:05.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:05.978+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:06.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:06.193+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:06.449 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:32:06.446+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:32:06.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:06.459+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:06.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:06.842+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:07.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:07.021+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:07.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:07.144+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:07.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:07.415+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:07.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:07.863+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:08.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:08.011+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:08.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:08.171+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:08.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:08.426+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:08.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:08.840+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:09.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:09.056+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:09.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:09.195+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:09.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:09.416+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:09.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:09.790+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:10.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:10.071+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:10.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:10.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:10.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:10.429+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:10.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:10.814+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:11.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:11.045+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:11.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:11.272+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:11.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:11.383+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:11.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:11.787+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:12.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:12.051+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:12.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:12.297+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:12.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:12.417+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:12.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:12.806+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:13.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:13.040+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:13.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:13.344+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:13.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:13.408+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:13.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:13.805+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:14.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:14.078+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:14.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:14.322+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:14.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:14.403+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:14.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:14.809+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:15.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:15.088+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:15.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:15.336+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:15.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:15.431+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:15.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:15.786+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:16.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:16.074+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:16.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:16.372+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:16.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:16.404+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:16.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:16.786+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:17.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:17.033+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:17.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:17.407+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:17.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:17.439+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:17.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:17.826+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:18.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:18.052+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:18.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:18.404+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:18.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:18.428+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:18.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:18.790+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:18.895 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:32:18.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:32:19.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:19.017+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:19.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:19.387+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:19.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:19.468+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:19.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:19.780+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:19.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:19.984+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:20.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:20.337+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:20.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:20.467+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:20.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:20.748+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:20.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:20.995+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:21.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:21.384+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:21.465 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:32:21.462+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:32:21.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:21.496+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:21.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:21.790+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:22.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:22.009+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:22.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:22.401+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:22.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:22.543+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:22.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:22.785+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:23.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:23.040+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:23.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:23.411+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:23.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:23.582+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:23.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:23.757+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:24.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:24.082+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:24.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:24.411+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:24.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:24.542+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:24.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:24.727+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:25.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:25.078+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:25.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:25.370+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:25.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:25.541+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:25.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:25.753+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:26.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:26.108+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:26.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:26.384+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:26.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:26.517+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:26.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:26.772+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:27.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:27.158+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:27.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:27.363+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:27.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:27.493+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:27.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:27.782+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:28.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:28.149+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:28.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:28.396+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:28.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:28.497+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:28.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:28.750+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:29.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:29.104+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:29.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:29.445+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:29.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:29.472+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:29.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:29.783+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:30.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:30.116+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:30.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:30.428+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:30.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:30.480+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:30.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:30.775+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:31.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:31.125+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:31.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:31.433+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:31.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:31.514+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:31.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:31.756+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:32.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:32.176+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:32.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:32.391+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:32.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:32.526+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:32.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:32.758+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:33.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:33.208+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:33.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:33.349+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:33.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:33.536+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:33.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:33.785+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:34.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:34.186+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:34.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:34.350+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:34.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:34.532+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:34.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:34.830+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:35.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:35.162+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:35.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:35.335+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:35.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:35.570+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:35.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:35.796+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:36.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:36.134+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:36.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:36.292+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:36.481 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:32:36.478+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:32:36.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:36.528+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:36.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:36.756+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:37.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:37.159+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:37.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:37.292+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:37.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:37.548+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:37.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:37.712+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:38.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:38.192+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:38.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:38.267+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:38.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:38.588+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:38.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:38.713+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:39.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:39.181+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:39.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:39.247+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:39.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:39.542+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:39.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:39.665+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:40.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:40.156+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:40.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:40.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:40.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:40.541+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:40.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:40.644+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:41.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:41.206+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:41.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:41.255+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:41.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:41.564+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:41.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:41.626+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:42.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:42.191+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:42.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:42.260+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:42.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:42.605+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:42.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:42.645+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:43.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:43.163+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:43.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:43.241+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:43.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:43.639+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:43.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:43.644+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:44.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:44.136+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:44.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:44.287+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:44.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:44.635+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:44.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:44.663+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:45.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:45.117+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:45.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:45.289+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:45.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:45.643+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:45.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:45.676+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:46.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:46.136+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:46.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:46.321+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:46.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:46.693+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:46.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:46.725+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:47.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:47.166+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:47.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:47.301+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:47.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:47.670+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:47.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:47.753+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:48.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:48.203+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:48.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:48.270+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:48.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:48.658+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:48.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:48.782+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:49.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:32:49.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:32:49.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:49.175+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:49.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:49.302+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:49.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:49.690+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:49.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:49.758+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:50.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:50.175+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:50.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:50.311+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:50.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:50.716+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:50.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:50.729+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:51.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:51.171+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:51.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:51.290+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:51.497 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:32:51.494+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:32:51.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:51.723+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:51.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:51.757+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:52.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:52.186+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:52.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:52.301+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:52.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:52.702+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:52.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:52.746+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:53.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:53.205+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:53.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:53.347+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:53.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:53.709+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:53.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:53.765+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:54.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:54.156+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:54.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:54.325+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:54.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:54.717+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:54.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:54.811+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:55.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:55.183+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:55.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:55.338+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:55.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:55.675+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:55.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:55.828+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:56.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:56.194+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:56.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:56.332+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:56.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:56.699+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:56.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:56.853+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:57.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:57.166+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:57.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:57.375+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:57.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:57.666+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:57.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:57.876+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:58.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:58.183+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:58.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:58.397+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:58.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:58.681+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:58.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:58.921+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:59.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:32:59.201+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:59.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:32:59.375+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:59.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:32:59.720+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:32:59.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:32:59.958+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:00.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:00.202+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:00.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:00.378+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:00.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:00.708+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:00.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:00.950+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:01.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:01.202+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:01.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:01.414+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:01.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:01.750+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:01.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:01.915+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:02.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:02.191+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:02.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:02.404+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:02.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:02.786+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:02.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:02.874+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:03.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:03.193+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:03.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:03.419+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:03.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:03.789+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:03.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:03.873+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:04.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:04.153+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:04.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:04.413+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:04.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:04.826+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:04.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:04.908+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:05.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:05.111+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:05.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:05.438+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:05.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:05.850+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:05.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:05.925+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:06.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:06.160+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:06.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:06.420+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:06.512 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:33:06.511+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:33:06.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:06.844+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:06.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:06.903+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:07.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:07.142+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:07.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:07.380+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:07.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:07.878+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:07.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:07.899+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:08.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:08.112+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:08.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:08.391+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:08.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:08.869+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:08.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:08.927+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:09.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:09.078+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:09.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:09.432+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:09.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:09.895+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:09.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:09.973+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:10.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:10.035+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:10.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:10.408+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:10.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:10.886+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:10.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:10.955+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:11.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:11.045+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:11.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:11.438+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:11.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:11.861+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:11.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:11.937+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:12.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:12.049+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:12.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:12.479+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:12.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:12.899+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:12.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:12.952+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:13.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:13.083+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:13.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:13.487+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:13.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:13.875+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:13.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:13.960+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:14.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:14.103+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:14.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:14.509+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:14.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:14.836+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:14.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:14.961+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:15.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:15.136+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:15.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:15.462+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:15.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:15.854+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:15.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:15.980+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:16.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:16.106+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:16.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:16.426+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:16.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:16.814+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:16.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:16.961+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:17.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:17.066+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:17.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:17.383+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:17.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:17.838+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:17.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:17.947+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:18.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:18.072+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:18.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:18.343+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:18.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:18.789+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:18.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:18.961+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:19.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:19.042+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:19.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:33:19.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:33:19.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:19.312+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:19.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:19.794+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:19.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:19.970+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:20.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:20.083+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:20.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:20.319+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:20.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:20.821+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:20.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:20.933+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:21.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:21.083+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:21.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:21.344+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:21.528 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:33:21.526+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:33:21.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:21.813+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:21.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:21.975+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:22.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:22.101+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:22.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:22.384+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:22.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:22.800+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:22.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:22.951+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:23.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:23.132+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:23.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:23.358+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:23.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:23.789+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:23.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:23.971+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:24.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:24.161+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:24.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:24.379+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:24.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:24.753+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:24.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:24.959+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:25.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:25.200+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:25.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:25.369+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:25.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:25.754+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:25.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:25.957+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:26.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:26.160+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:26.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:26.342+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:26.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:26.707+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:26.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:26.957+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:27.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:27.142+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:27.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:27.316+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:27.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:27.673+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:27.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:27.995+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:28.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:28.156+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:28.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:28.339+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:28.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:28.661+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:29.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:29.025+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:29.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:29.205+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:29.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:29.331+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:29.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:29.617+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:30.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:30.042+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:30.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:30.200+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:30.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:30.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:30.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:30.654+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:31.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:31.034+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:31.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:31.233+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:31.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:31.332+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:31.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:31.703+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:31.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:31.989+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:32.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:32.279+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:32.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:32.292+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:32.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:32.685+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:33.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:33.015+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:33.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:33.293+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:33.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:33.323+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:33.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:33.658+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:34.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:34.008+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:34.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:34.247+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:34.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:34.275+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:34.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:34.690+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:35.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:35.020+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:35.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:35.231+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:35.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:35.319+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:35.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:35.692+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:36.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:36.057+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:36.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:36.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:36.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:36.369+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:36.544 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:33:36.542+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:33:36.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:36.691+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:37.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:37.011+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:37.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:37.256+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:37.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:37.399+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:37.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:37.720+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:38.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:38.060+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:38.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:38.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:38.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:38.385+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:38.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:38.673+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:39.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:39.042+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:39.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:39.294+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:39.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:39.393+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:39.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:39.677+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:40.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:40.000+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:40.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:40.309+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:40.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:40.362+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:40.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:40.689+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:40.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:40.976+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:41.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:41.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:41.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:41.362+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:41.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:41.664+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:41.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:41.948+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:42.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:42.272+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:42.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:42.409+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:42.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:42.654+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:42.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:42.930+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:43.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:43.250+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:43.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:43.362+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:43.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:43.647+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:43.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:43.895+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:44.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:44.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:44.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:44.356+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:44.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:44.686+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:44.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:44.914+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:45.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:45.220+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:45.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:45.306+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:45.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:45.724+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:45.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:45.913+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:46.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:46.270+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:46.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:46.345+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:46.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:46.696+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:46.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:46.921+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:47.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:47.267+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:47.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:47.322+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:47.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:47.657+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:47.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:47.953+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:48.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:48.232+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:48.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:48.276+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:48.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:48.665+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:48.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:48.946+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:49.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:49.189+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:49.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:33:49.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:33:49.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:49.289+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:49.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:49.658+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:49.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:49.904+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:50.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:50.149+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:50.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:50.313+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:50.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:50.690+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:50.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:50.902+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:51.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:51.157+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:51.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:51.317+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:51.560 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:33:51.557+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:33:51.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:51.728+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:51.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:51.855+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:52.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:52.150+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:52.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:52.296+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:52.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:52.770+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:52.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:52.891+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:53.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:53.118+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:53.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:53.259+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:53.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:53.806+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:53.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:53.844+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:54.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:54.152+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:54.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:54.251+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:54.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:54.787+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:54.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:54.890+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:55.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:55.163+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:55.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:55.248+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:55.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:55.813+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:55.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:55.888+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:56.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:56.208+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:56.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:56.228+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:56.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:56.805+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:56.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:56.865+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:57.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:57.195+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:57.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:57.220+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:57.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:57.843+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:57.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:57.914+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:58.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:58.190+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:58.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:58.234+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:58.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:58.883+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:58.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:58.956+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:59.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:33:59.141+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:59.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:33:59.219+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:59.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:33:59.839+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:33:59.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:33:59.981+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:00.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:00.141+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:00.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:00.177+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:00.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:00.809+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:01.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:01.023+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:01.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:01.107+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:01.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:01.205+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:01.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:01.851+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:01.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:01.981+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:02.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:02.152+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:02.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:02.238+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:02.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:02.891+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:02.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:02.992+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:03.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:03.163+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:03.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:03.253+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:03.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:03.922+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:03.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:03.959+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:04.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:04.151+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:04.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:04.236+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:04.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:04.955+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:04.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:04.959+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:05.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:05.140+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:05.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:05.259+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:05.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:05.980+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:06.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:05.999+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:06.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:06.160+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:06.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:06.265+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:06.576 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:34:06.574+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:34:06.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:06.964+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:06.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:06.978+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:07.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:07.209+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:07.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:07.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:07.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:07.934+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:07.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:07.952+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:08.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:08.207+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:08.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:08.227+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:08.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:08.909+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:08.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:08.975+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:09.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:09.200+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:09.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:09.242+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:09.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:09.889+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:10.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:10.000+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:10.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:10.214+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:10.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:10.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:10.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:10.866+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:10.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:10.995+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:11.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:11.206+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:11.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:11.219+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:11.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:11.859+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:11.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:11.985+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:12.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:12.176+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:12.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:12.182+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:12.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:12.899+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:13.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:13.021+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:13.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:13.192+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:13.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:13.213+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:13.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:13.928+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:14.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:14.048+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:14.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:14.164+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:14.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:14.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:14.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:14.897+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:15.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:15.084+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:15.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:15.166+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:15.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:15.208+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:15.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:15.904+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:16.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:16.088+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:16.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:16.166+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:16.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:16.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:16.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:16.908+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:17.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:17.087+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:17.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:17.202+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:17.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:17.224+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:17.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:17.898+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:18.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:18.102+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:18.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:18.230+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:18.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:18.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:18.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:18.856+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:19.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:19.059+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:19.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:19.205+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:19.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:19.207+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:19.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:34:19.342 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:34:19.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:19.890+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:20.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:20.025+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:20.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:20.175+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:20.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:20.180+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:20.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:20.888+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:21.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:21.007+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:21.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:21.172+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:21.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:21.213+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:21.592 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:34:21.590+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:34:21.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:21.896+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:22.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:22.037+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:22.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:22.171+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:22.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:22.194+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:22.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:22.863+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:23.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:23.017+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:23.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:23.151+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:23.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:23.234+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:23.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:23.854+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:24.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:24.041+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:24.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:24.149+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:24.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:24.267+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:24.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:24.898+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:25.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:25.008+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:25.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:25.158+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:25.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:25.276+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:25.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:25.940+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:26.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:26.018+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:26.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:26.186+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:26.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:26.325+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:26.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:26.938+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:27.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:27.062+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:27.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:27.150+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:27.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:27.342+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:27.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:27.930+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:28.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:28.068+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:28.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:28.172+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:28.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:28.352+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:28.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:28.891+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:29.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:29.073+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:29.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:29.176+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:29.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:29.322+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:29.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:29.883+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:30.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:30.068+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:30.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:30.202+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:30.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:30.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:30.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:30.834+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:31.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:31.047+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:31.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:31.220+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:31.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:31.281+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:31.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:31.830+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:32.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:32.058+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:32.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:32.209+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:32.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:32.233+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:32.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:32.872+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:33.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:33.056+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:33.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:33.193+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:33.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:33.247+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:33.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:33.893+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:34.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:34.061+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:34.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:34.195+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:34.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:34.269+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:34.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:34.912+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:35.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:35.045+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:35.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:35.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:35.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:35.292+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:35.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:35.926+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:36.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:36.082+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:36.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:36.263+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:36.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:36.272+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:36.608 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:34:36.605+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:34:36.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:36.907+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:37.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:37.092+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:37.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:37.270+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:37.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:37.298+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:37.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:37.944+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:38.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:38.142+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:38.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:38.266+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:38.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:38.278+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:38.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:38.907+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:39.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:39.175+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:39.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:39.259+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:39.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:39.326+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:39.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:39.929+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:40.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:40.212+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:40.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:40.270+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:40.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:40.293+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:40.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:40.963+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:41.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:41.206+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:41.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:41.247+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:41.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:41.247+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:41.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:41.947+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:42.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:42.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:42.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:42.243+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:42.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:42.278+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:42.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:42.966+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:43.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:43.205+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:43.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:43.205+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:43.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:43.316+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:43.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:43.943+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:44.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:44.200+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:44.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:44.221+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:44.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:44.300+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:44.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:44.933+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:45.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:45.200+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:45.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:45.203+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:45.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:45.261+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:45.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:45.933+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:46.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:46.171+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:46.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:46.223+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:46.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:46.246+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:46.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:46.910+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:47.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:47.128+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:47.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:47.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:47.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:47.255+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:47.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:47.953+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:48.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:48.167+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:48.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:48.282+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:48.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:48.291+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:48.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:48.959+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:49.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:49.213+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:49.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:49.253+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:49.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:49.282+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:49.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:34:49.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:34:49.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:49.975+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:50.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:50.228+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:50.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:50.261+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:50.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:50.263+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:50.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:50.966+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:51.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:51.245+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:51.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:51.265+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:51.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:51.283+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:51.624 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:34:51.622+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:34:51.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:51.959+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:52.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:52.240+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:52.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:52.264+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:52.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:52.292+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:52.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:52.924+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:53.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:53.265+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:53.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:53.290+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:53.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:53.327+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:53.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:53.935+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:54.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:54.295+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:54.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:54.303+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:54.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:54.355+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:54.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:54.944+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:55.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:55.286+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:55.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:55.309+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:55.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:55.350+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:55.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:55.936+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:56.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:56.267+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:56.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:56.278+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:56.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:56.382+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:56.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:56.918+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:57.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:57.264+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:57.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:57.268+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:57.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:57.421+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:57.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:57.914+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:58.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:58.238+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:58.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:58.255+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:58.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:58.423+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:58.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:58.865+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:59.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:34:59.203+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:59.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:34:59.219+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:59.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:34:59.373+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:34:59.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:34:59.843+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:00.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:00.200+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:00.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:00.248+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:00.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:00.422+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:00.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:00.800+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:01.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:01.197+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:01.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:01.226+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:01.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:01.401+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:01.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:01.841+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:02.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:02.201+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:02.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:02.214+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:02.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:02.375+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:02.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:02.882+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:03.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:03.162+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:03.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:03.259+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:03.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:03.408+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:03.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:03.874+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:04.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:04.143+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:04.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:04.259+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:04.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:04.411+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:04.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:04.919+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:05.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:05.166+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:05.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:05.223+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:05.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:05.459+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:05.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:05.921+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:06.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:06.204+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:06.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:06.206+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:06.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:06.490+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:06.639 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:35:06.637+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:35:06.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:06.902+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:07.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:07.176+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:07.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:07.250+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:07.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:07.507+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:07.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:07.904+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:08.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:08.135+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:08.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:08.281+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:08.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:08.507+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:08.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:08.952+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:09.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:09.158+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:09.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:09.301+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:09.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:09.550+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:10.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:09.999+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:10.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:10.178+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:10.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:10.267+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:10.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:10.524+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:11.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:11.000+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:11.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:11.177+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:11.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:11.296+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:11.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:11.531+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:12.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:12.000+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:12.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:12.168+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:12.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:12.258+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:12.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:12.528+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:13.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:13.026+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:13.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:13.190+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:13.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:13.305+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:13.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:13.563+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:14.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:14.017+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:14.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:14.165+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:14.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:14.272+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:14.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:14.568+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:14.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:14.972+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:15.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:15.146+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:15.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:15.284+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:15.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:15.575+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:15.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:15.953+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:16.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:16.136+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:16.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:16.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:16.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:16.606+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:16.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:16.981+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:17.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:17.154+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:17.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:17.236+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:17.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:17.594+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:18.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:18.004+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:18.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:18.120+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:18.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:18.245+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:18.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:18.554+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:18.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:18.983+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:19.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:19.146+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:19.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:19.207+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:19.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:19.527+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:19.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:35:19.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:35:19.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:19.939+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:20.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:20.175+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:20.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:20.243+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:20.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:20.555+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:20.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:20.980+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:21.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:21.223+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:21.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:21.260+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:21.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:21.522+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:21.653 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:35:21.651+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:35:21.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:21.964+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:22.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:22.192+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:22.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:22.276+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:22.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:22.545+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:22.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:22.990+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:23.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:23.180+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:23.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:23.283+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:23.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:23.566+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:23.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:23.947+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:24.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:24.146+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:24.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:24.266+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:24.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:24.544+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:24.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:24.912+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:25.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:25.117+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:25.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:25.245+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:25.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:25.557+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:25.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:25.935+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:26.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:26.145+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:26.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:26.221+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:26.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:26.529+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:26.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:26.945+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:27.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:27.185+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:27.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:27.259+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:27.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:27.498+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:27.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:27.969+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:28.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:28.223+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:28.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:28.237+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:28.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:28.449+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:28.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:28.981+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:29.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:29.204+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:29.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:29.236+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:29.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:29.406+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:29.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:29.966+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:30.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:30.167+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:30.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:30.195+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:30.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:30.413+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:30.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:30.974+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:31.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:31.211+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:31.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:31.234+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:31.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:31.425+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:31.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:31.951+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:32.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:32.191+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:32.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:32.216+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:32.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:32.409+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:32.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:32.982+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:33.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:33.201+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:33.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:33.207+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:33.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:33.429+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:33.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:33.940+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:34.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:34.196+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:34.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:34.249+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:34.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:34.381+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:34.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:34.966+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:35.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:35.157+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:35.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:35.246+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:35.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:35.401+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:36.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:36.011+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:36.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:36.116+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:36.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:36.258+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:36.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:36.411+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:36.659 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:35:36.656+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:35:37.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:37.055+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:37.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:37.166+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:37.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:37.290+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:37.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:37.384+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:38.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:38.048+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:38.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:38.164+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:38.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:38.298+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:38.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:38.376+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:39.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:39.049+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:39.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:39.203+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:39.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:39.291+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:39.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:39.349+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:40.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:40.003+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:40.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:40.214+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:40.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:40.257+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:40.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:40.345+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:41.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:41.043+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:41.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:41.194+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:41.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:41.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:41.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:41.371+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:42.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:42.031+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:42.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:42.192+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:42.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:42.278+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:42.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:42.329+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:43.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:43.013+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:43.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:43.188+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:43.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:43.320+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:43.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:43.369+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:44.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:44.034+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:44.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:44.209+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:44.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:44.281+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:44.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:44.350+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:45.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:45.050+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:45.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:45.192+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:45.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:45.302+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:45.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:45.313+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:46.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:46.013+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:46.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:46.223+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:46.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:46.307+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:46.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:46.356+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:47.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:46.999+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:47.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:47.258+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:47.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:47.325+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:47.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:47.333+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:47.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:47.953+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:48.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:48.266+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:48.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:48.315+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:48.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:48.353+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:48.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:48.941+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:49.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:49.223+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:49.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:49.302+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:49.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:49.357+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:49.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:35:49.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:35:49.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:49.928+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:50.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:50.204+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:50.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:50.270+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:50.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:50.346+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:50.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:50.919+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:51.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:51.190+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:51.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:51.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:51.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:51.325+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:51.675 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:35:51.672+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:35:51.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:51.871+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:52.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:52.187+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:52.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:52.313+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:52.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:52.315+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:52.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:52.835+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:53.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:53.154+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:53.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:53.281+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:53.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:53.345+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:53.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:53.852+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:54.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:54.149+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:54.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:54.278+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:54.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:54.319+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:54.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:54.833+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:55.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:55.157+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:55.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:55.284+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:55.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:55.319+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:55.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:55.788+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:56.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:56.122+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:56.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:56.321+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:56.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:56.357+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:56.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:56.743+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:57.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:57.114+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:57.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:57.349+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:57.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:57.382+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:57.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:57.748+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:58.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:58.135+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:58.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:58.331+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:58.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:58.374+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:58.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:58.704+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:59.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:35:59.130+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:59.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:35:59.301+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:59.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:35:59.366+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:35:59.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:35:59.701+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:00.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:00.172+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:00.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:00.261+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:00.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:00.358+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:00.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:00.699+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:01.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:01.124+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:01.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:01.298+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:01.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:01.386+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:01.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:01.660+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:02.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:02.078+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:02.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:02.264+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:02.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:02.371+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:02.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:02.679+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:03.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:03.067+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:03.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:03.297+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:03.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:03.390+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:03.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:03.696+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:04.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:04.029+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:04.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:04.312+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:04.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:04.425+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:04.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:04.670+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:05.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:05.075+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:05.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:05.293+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:05.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:05.414+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:05.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:05.699+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:06.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:06.103+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:06.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:06.286+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:06.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:06.462+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:06.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:06.683+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:06.689 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:36:06.687+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:36:07.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:07.136+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:07.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:07.262+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:07.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:07.478+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:07.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:07.710+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:08.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:08.115+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:08.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:08.307+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:08.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:08.494+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:08.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:08.671+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:09.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:09.119+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:09.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:09.295+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:09.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:09.462+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:09.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:09.639+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:10.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:10.151+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:10.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:10.334+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:10.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:10.457+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:10.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:10.618+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:11.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:11.142+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:11.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:11.312+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:11.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:11.437+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:11.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:11.623+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:12.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:12.104+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:12.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:12.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:12.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:12.405+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:12.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:12.630+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:13.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:13.091+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:13.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:13.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:13.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:13.424+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:13.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:13.599+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:14.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:14.070+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:14.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:14.338+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:14.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:14.412+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:14.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:14.603+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:15.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:15.105+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:15.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:15.302+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:15.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:15.367+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:15.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:15.592+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:16.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:16.077+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:16.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:16.267+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:16.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:16.365+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:16.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:16.593+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:17.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:17.067+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:17.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:17.241+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:17.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:17.351+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:17.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:17.554+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:18.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:18.021+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:18.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:18.210+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:18.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:18.327+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:18.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:18.603+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:19.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:19.016+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:19.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:19.236+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:19.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:19.310+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:19.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:19.595+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:19.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:36:19.742 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:36:19.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:19.990+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:20.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:20.226+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:20.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:20.264+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:20.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:20.581+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:20.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:20.988+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:21.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:21.256+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:21.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:21.269+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:21.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:21.539+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:21.705 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:36:21.702+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:36:22.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:22.036+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:22.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:22.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:22.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:22.304+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:22.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:22.538+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:23.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:23.086+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:23.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:23.203+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:23.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:23.337+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:23.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:23.578+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:24.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:24.053+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:24.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:24.184+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:24.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:24.366+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:24.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:24.606+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:25.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:25.073+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:25.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:25.164+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:25.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:25.334+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:25.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:25.565+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:26.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:26.067+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:26.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:26.166+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:26.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:26.343+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:26.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:26.571+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:27.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:27.114+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:27.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:27.159+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:27.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:27.340+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:27.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:27.575+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:28.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:28.075+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:28.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:28.137+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:28.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:28.306+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:28.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:28.613+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:29.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:29.095+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:29.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:29.153+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:29.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:29.341+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:29.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:29.640+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:30.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:30.057+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:30.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:30.166+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:30.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:30.294+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:30.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:30.680+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:31.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:31.057+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:31.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:31.124+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:31.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:31.340+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:31.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:31.643+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:32.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:32.084+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:32.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:32.161+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:32.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:32.323+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:32.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:32.663+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:33.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:33.134+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:33.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:33.146+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:33.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:33.280+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:33.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:33.687+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:34.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:34.166+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:34.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:34.193+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:34.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:34.269+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:34.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:34.650+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:35.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:35.128+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:35.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:35.213+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:35.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:35.308+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:35.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:35.691+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:36.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:36.124+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:36.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:36.214+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:36.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:36.354+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:36.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:36.664+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:36.720 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:36:36.719+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:36:37.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:37.076+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:37.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:37.239+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:37.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:37.353+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:37.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:37.633+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:38.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:38.091+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:38.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:38.217+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:38.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:38.349+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:38.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:38.655+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:39.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:39.052+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:39.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:39.243+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:39.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:39.380+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:39.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:39.679+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:40.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:40.053+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:40.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:40.204+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:40.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:40.363+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:40.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:40.664+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:41.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:41.018+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:41.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:41.237+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:41.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:41.357+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:41.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:41.692+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:42.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:42.038+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:42.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:42.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:42.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:42.367+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:42.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:42.655+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:43.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:43.027+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:43.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:43.293+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:43.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:43.397+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:43.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:43.692+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:43.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:43.983+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:44.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:44.318+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:44.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:44.411+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:44.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:44.691+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:44.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:44.963+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:45.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:45.327+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:45.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:45.390+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:45.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:45.656+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:46.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:46.005+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:46.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:46.367+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:46.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:46.392+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:46.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:46.677+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:46.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:46.956+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:47.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:47.388+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:47.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:47.411+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:47.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:47.647+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:47.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:47.948+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:48.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:48.343+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:48.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:48.422+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:48.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:48.670+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:48.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:48.904+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:49.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:49.351+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:49.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:49.468+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:49.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:49.632+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:49.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:49.885+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:49.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:36:49.892 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:36:50.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:50.397+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:50.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:50.481+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:50.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:50.623+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:50.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:50.880+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:51.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:51.383+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:51.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:51.468+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:51.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:51.663+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:51.736 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:36:51.734+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:36:51.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:51.834+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:52.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:52.372+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:52.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:52.441+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:52.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:52.640+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:52.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:52.796+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:53.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:53.323+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:53.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:53.411+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:53.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:53.674+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:53.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:53.811+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:54.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:54.308+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:54.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:54.406+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:54.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:54.660+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:54.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:54.772+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:55.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:55.294+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:55.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:55.376+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:55.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:55.689+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:55.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:55.742+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:56.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:56.305+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:56.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:56.413+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:56.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:56.672+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:56.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:56.751+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:57.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:57.327+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:57.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:57.430+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:57.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:57.683+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:57.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:57.784+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:58.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:58.347+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:58.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:58.468+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:58.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:58.660+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:58.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:58.767+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:59.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:36:59.394+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:59.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:36:59.508+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:59.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:36:59.615+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:36:59.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:36:59.759+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:00.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:00.417+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:00.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:00.545+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:00.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:00.608+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:00.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:00.715+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:01.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:01.439+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:01.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:01.520+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:01.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:01.609+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:01.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:01.689+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:02.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:02.418+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:02.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:02.532+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:02.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:02.648+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:02.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:02.654+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:03.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:03.374+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:03.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:03.556+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:03.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:03.607+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:03.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:03.694+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:04.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:04.340+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:04.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:04.541+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:04.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:04.644+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:04.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:04.682+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:05.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:05.352+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:05.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:05.501+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:05.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:05.617+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:05.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:05.701+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:06.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:06.352+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:06.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:06.541+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:06.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:06.657+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:06.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:06.657+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:06.752 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:37:06.750+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:37:07.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:07.303+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:07.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:07.513+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:07.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:07.661+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:07.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:07.673+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:08.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:08.336+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:08.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:08.516+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:08.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:08.620+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:08.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:08.708+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:09.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:09.304+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:09.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:09.539+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:09.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:09.580+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:09.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:09.753+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:10.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:10.319+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:10.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:10.544+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:10.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:10.592+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:10.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:10.777+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:11.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:11.314+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:11.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:11.555+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:11.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:11.596+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:11.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:11.805+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:12.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:12.325+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:12.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:12.527+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:12.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:12.625+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:12.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:12.782+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:13.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:13.310+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:13.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:13.560+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:13.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:13.671+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:13.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:13.748+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:14.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:14.287+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:14.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:14.578+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:14.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:14.652+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:14.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:14.756+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:15.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:15.268+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:15.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:15.566+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:15.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:15.676+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:15.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:15.775+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:16.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:16.258+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:16.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:16.566+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:16.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:16.646+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:16.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:16.751+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:17.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:17.230+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:17.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:17.608+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:17.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:17.622+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:17.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:17.757+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:18.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:18.196+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:18.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:18.589+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:18.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:18.612+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:18.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:18.723+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:19.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:19.183+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:19.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:19.548+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:19.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:19.629+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:19.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:19.728+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:19.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:37:19.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:37:20.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:20.139+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:20.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:20.555+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:20.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:20.637+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:20.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:20.765+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:21.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:21.170+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:21.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:21.515+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:21.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:21.612+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:21.768 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:37:21.766+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:37:21.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:21.768+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:22.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:22.181+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:22.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:22.519+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:22.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:22.653+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:22.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:22.761+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:23.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:23.206+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:23.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:23.558+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:23.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:23.629+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:23.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:23.809+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:24.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:24.195+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:24.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:24.517+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:24.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:24.637+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:24.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:24.820+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:25.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:25.168+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:25.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:25.529+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:25.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:25.621+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:25.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:25.859+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:26.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:26.218+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:26.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:26.558+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:26.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:26.576+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:26.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:26.880+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:27.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:27.267+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:27.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:27.527+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:27.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:27.550+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:27.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:27.926+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:28.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:28.245+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:28.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:28.520+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:28.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:28.580+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:28.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:28.877+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:29.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:29.256+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:29.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:29.555+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:29.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:29.565+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:29.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:29.845+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:30.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:30.228+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:30.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:30.518+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:30.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:30.557+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:30.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:30.861+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:31.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:31.267+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:31.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:31.502+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:31.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:31.570+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:31.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:31.883+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:32.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:32.259+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:32.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:32.493+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:32.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:32.583+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:32.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:32.912+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:33.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:33.230+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:33.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:33.450+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:33.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:33.547+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:33.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:33.962+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:34.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:34.229+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:34.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:34.500+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:34.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:34.517+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:34.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:34.972+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:35.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:35.211+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:35.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:35.470+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:35.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:35.486+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:35.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:35.989+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:36.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:36.174+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:36.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:36.425+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:36.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:36.489+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:36.784 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:37:36.781+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:37:37.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:37.014+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:37.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:37.146+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:37.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:37.384+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:37.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:37.484+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:37.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:37.964+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:38.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:38.124+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:38.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:38.348+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:38.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:38.436+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:38.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:38.990+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:39.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:39.083+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:39.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:39.331+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:39.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:39.449+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:39.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:39.993+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:40.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:40.133+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:40.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:40.302+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:40.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:40.482+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:40.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:40.953+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:41.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:41.173+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:41.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:41.265+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:41.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:41.453+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:41.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:41.927+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:42.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:42.162+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:42.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:42.272+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:42.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:42.495+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:42.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:42.879+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:43.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:43.163+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:43.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:43.308+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:43.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:43.463+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:43.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:43.856+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:44.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:44.142+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:44.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:44.341+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:44.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:44.421+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:44.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:44.839+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:45.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:45.191+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:45.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:45.357+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:45.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:45.461+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:45.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:45.844+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:46.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:46.240+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:46.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:46.347+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:46.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:46.467+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:46.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:46.815+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:47.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:47.234+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:47.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:47.323+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:47.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:47.508+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:47.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:47.825+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:48.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:48.234+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:48.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:48.355+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:48.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:48.556+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:48.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:48.850+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:49.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:49.226+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:49.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:49.347+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:49.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:49.522+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:49.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:49.845+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:50.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:37:50.115 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:37:50.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:50.183+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:50.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:50.312+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:50.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:50.485+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:50.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:50.854+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:51.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:51.141+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:51.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:51.346+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:51.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:51.454+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:51.800 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:37:51.798+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:37:51.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:51.806+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:52.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:52.104+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:52.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:52.371+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:52.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:52.426+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:52.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:52.798+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:53.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:53.106+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:53.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:53.365+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:53.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:53.442+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:53.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:53.763+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:54.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:54.114+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:54.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:54.375+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:54.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:54.394+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:54.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:54.745+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:55.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:55.109+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:55.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:55.353+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:55.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:55.404+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:55.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:55.775+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:56.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:56.105+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:56.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:56.340+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:56.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:56.363+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:56.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:56.775+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:57.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:57.103+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:57.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:57.320+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:57.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:57.340+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:57.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:57.771+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:58.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:58.057+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:58.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:58.316+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:58.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:58.354+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:58.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:58.754+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:59.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:37:59.024+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:59.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:37:59.356+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:59.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:37:59.363+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:37:59.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:37:59.797+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:00.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:00.053+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:00.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:00.371+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:00.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:00.380+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:00.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:00.831+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:01.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:01.028+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:01.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:01.330+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:01.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:01.354+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:01.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:01.880+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:02.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:02.015+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:02.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:02.294+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:02.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:02.372+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:02.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:02.915+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:03.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:03.007+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:03.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:03.304+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:03.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:03.338+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:03.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:03.875+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:04.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:04.014+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:04.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:04.295+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:04.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:04.372+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:04.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:04.832+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:05.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:05.025+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:05.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:05.283+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:05.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:05.383+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:05.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:05.808+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:06.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:06.035+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:06.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:06.273+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:06.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:06.363+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:06.815 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:38:06.813+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:38:06.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:06.855+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:07.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:07.034+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:07.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:07.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:07.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:07.361+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:07.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:07.905+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:08.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:08.062+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:08.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:08.319+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:08.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:08.329+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:08.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:08.888+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:09.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:09.040+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:09.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:09.357+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:09.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:09.361+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:09.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:09.927+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:10.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:10.039+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:10.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:10.332+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:10.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:10.393+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:10.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:10.963+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:11.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:11.089+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:11.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:11.364+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:11.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:11.376+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:11.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:11.990+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:12.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:12.099+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:12.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:12.338+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:12.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:12.339+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:12.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:12.947+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:13.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:13.051+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:13.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:13.357+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:13.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:13.368+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:13.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:13.990+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:14.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:14.076+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:14.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:14.355+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:14.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:14.363+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:15.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:15.032+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:15.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:15.087+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:15.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:15.342+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:15.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:15.386+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:16.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:16.054+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:16.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:16.096+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:16.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:16.306+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:16.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:16.413+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:17.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:17.006+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:17.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:17.071+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:17.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:17.336+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:17.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:17.371+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:17.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:17.962+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:18.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:18.034+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:18.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:18.326+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:18.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:18.354+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:18.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:18.978+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:19.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:19.025+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:19.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:19.349+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:19.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:19.353+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:20.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:20.019+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:20.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:20.035+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:20.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:38:20.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:38:20.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:20.316+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:20.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:20.350+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:21.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:21.006+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:21.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:21.031+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:21.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:21.345+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:21.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:21.359+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:21.832 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:38:21.829+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:38:22.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:22.011+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:22.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:22.044+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:22.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:22.309+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:22.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:22.375+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:23.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:23.027+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:23.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:23.052+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:23.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:23.314+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:23.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:23.344+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:23.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:23.986+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:24.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:24.047+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:24.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:24.333+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:24.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:24.336+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:24.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:24.969+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:25.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:25.015+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:25.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:25.327+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:25.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:25.381+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:25.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:25.988+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:26.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:26.041+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:26.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:26.375+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:26.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:26.379+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:26.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:26.967+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:27.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:27.015+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:27.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:27.395+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:27.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:27.401+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:27.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:27.940+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:27.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:27.984+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:28.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:28.351+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:28.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:28.361+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:28.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:28.953+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:29.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:29.013+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:29.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:29.303+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:29.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:29.323+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:29.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:29.987+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:30.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:30.018+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:30.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:30.292+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:30.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:30.352+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:30.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:30.959+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:31.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:31.007+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:31.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:31.283+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:31.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:31.364+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:31.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:31.965+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:31.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:31.997+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:32.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:32.277+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:32.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:32.346+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:32.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:32.955+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:33.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:33.007+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:33.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:33.302+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:33.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:33.327+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:33.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:33.947+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:34.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:34.006+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:34.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:34.308+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:34.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:34.310+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:34.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:34.964+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:35.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:35.051+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:35.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:35.282+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:35.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:35.339+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:36.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:36.010+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:36.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:36.051+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:36.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:36.262+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:36.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:36.363+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:36.847 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:38:36.845+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:38:37.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:37.029+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:37.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:37.034+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:37.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:37.271+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:37.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:37.353+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:38.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:38.040+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:38.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:38.078+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:38.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:38.277+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:38.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:38.327+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:39.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:39.047+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:39.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:39.059+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:39.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:39.229+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:39.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:39.365+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:40.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:40.001+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:40.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:40.051+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:40.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:40.233+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:40.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:40.332+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:41.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:41.006+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:41.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:41.028+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:41.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:41.233+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:41.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:41.373+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:42.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:42.009+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:42.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:42.046+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:42.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:42.202+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:42.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:42.403+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:43.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:42.998+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:43.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:43.039+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:43.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:43.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:43.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:43.404+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:44.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:44.006+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:44.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:44.027+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:44.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:44.212+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:44.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:44.373+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:45.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:45.044+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:45.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:45.049+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:45.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:45.217+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:45.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:45.361+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:46.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:46.033+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:46.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:46.061+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:46.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:46.212+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:46.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:46.367+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:47.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:47.003+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:47.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:47.016+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:47.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:47.205+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:47.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:47.372+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:47.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:47.988+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:47.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:47.994+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:48.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:48.251+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:48.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:48.418+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:48.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:48.952+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:49.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:49.033+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:49.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:49.211+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:49.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:49.435+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:49.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:49.953+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:50.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:49.997+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:50.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:50.261+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:50.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:38:50.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:38:50.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:50.456+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:50.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:50.942+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:50.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:50.955+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:51.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:51.257+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:51.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:51.422+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:51.863 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:38:51.860+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:38:51.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:51.942+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:51.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:51.992+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:52.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:52.235+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:52.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:52.391+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:52.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:52.944+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:53.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:53.011+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:53.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:53.218+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:53.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:53.427+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:53.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:53.980+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:54.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:54.052+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:54.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:54.259+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:54.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:54.412+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:54.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:54.986+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:55.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:55.058+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:55.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:55.226+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:55.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:55.371+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:55.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:55.941+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:56.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:56.046+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:56.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:56.197+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:56.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:56.391+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:56.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:56.911+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:57.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:57.024+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:57.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:57.210+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:57.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:57.350+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:57.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:57.909+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:58.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:58.069+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:58.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:58.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:58.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:58.371+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:58.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:58.915+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:59.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:38:59.033+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:59.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:38:59.220+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:59.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:38:59.368+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:38:59.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:38:59.940+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:00.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:00.083+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:00.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:00.222+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:00.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:00.342+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:00.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:00.940+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:01.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:01.037+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:01.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:01.222+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:01.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:01.357+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:01.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:01.902+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:02.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:02.032+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:02.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:02.223+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:02.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:02.406+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:02.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:02.865+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:03.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:03.015+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:03.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:03.256+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:03.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:03.418+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:03.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:03.868+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:03.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:03.986+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:04.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:04.210+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:04.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:04.447+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:04.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:04.912+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:04.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:04.990+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:05.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:05.168+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:05.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:05.463+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:05.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:05.929+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:05.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:05.978+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:06.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:06.133+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:06.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:06.469+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:06.879 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:39:06.877+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:39:06.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:06.941+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:06.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:06.982+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:07.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:07.167+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:07.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:07.479+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:07.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:07.909+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:08.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:08.009+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:08.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:08.177+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:08.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:08.484+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:08.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:08.921+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:09.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:09.043+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:09.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:09.192+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:09.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:09.506+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:09.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:09.923+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:10.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:09.998+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:10.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:10.240+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:10.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:10.490+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:10.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:10.958+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:10.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:10.960+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:11.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:11.234+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:11.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:11.467+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:11.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:11.972+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:11.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:11.996+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:12.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:12.241+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:12.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:12.479+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:12.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:12.956+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:12.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:12.981+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:13.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:13.232+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:13.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:13.469+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:13.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:13.978+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:14.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:14.010+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:14.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:14.238+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:14.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:14.459+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:14.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:14.967+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:15.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:15.046+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:15.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:15.282+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:15.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:15.424+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:15.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:15.992+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:16.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:16.047+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:16.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:16.242+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:16.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:16.383+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:17.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:17.021+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:17.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:17.089+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:17.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:17.231+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:17.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:17.395+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:18.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:18.024+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:18.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:18.046+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:18.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:18.210+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:18.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:18.357+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:18.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:18.981+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:19.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:19.020+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:19.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:19.173+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:19.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:19.346+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:19.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:19.973+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:20.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:20.024+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:20.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:20.194+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:20.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:20.336+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:20.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:39:20.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:39:20.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:20.932+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:21.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:21.001+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:21.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:21.241+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:21.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:21.325+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:21.895 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:39:21.892+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:39:21.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:21.970+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:22.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:22.030+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:22.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:22.192+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:22.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:22.369+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:22.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:22.951+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:23.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:23.016+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:23.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:23.145+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:23.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:23.374+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:23.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:23.918+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:24.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:24.005+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:24.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:24.175+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:24.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:24.423+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:24.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:24.907+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:24.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:24.986+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:25.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:25.190+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:25.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:25.416+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:25.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:25.945+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:25.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:25.966+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:26.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:26.208+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:26.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:26.400+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:26.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:26.991+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:27.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:27.015+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:27.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:27.212+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:27.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:27.353+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:27.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:27.994+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:28.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:28.004+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:28.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:28.204+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:28.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:28.308+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:28.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:28.969+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:29.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:29.027+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:29.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:29.231+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:29.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:29.295+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:29.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:29.964+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:30.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:30.003+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:30.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:30.204+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:30.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:30.273+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:30.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:30.920+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:31.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:31.036+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:31.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:31.244+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:31.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:31.246+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:31.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:31.901+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:32.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:32.046+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:32.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:32.250+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:32.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:32.291+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:32.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:32.892+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:33.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:33.005+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:33.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:33.262+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:33.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:33.298+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:33.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:33.935+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:33.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:33.959+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:34.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:34.267+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:34.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:34.306+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:34.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:34.936+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:35.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:35.006+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:35.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:35.260+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:35.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:35.346+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:35.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:35.949+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:35.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:35.974+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:36.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:36.218+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:36.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:36.345+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:36.909 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:39:36.907+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:39:36.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:36.936+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:37.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:37.002+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:37.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:37.259+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:37.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:37.339+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:37.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:37.937+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:38.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:38.021+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:38.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:38.247+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:38.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:38.366+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:38.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:38.975+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:38.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:38.983+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:39.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:39.205+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:39.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:39.345+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:39.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:39.964+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:40.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:40.032+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:40.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:40.246+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:40.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:40.355+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:40.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:40.987+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:41.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:40.999+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:41.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:41.287+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:41.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:41.405+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:42.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:42.015+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:42.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:42.043+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:42.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:42.287+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:42.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:42.439+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:42.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:42.967+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:43.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:43.059+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:43.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:43.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:43.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:43.396+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:43.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:43.957+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:44.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:44.044+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:44.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:44.337+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:44.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:44.423+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:45.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:44.999+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:45.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:45.016+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:45.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:45.370+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:45.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:45.471+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:45.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:45.991+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:46.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:46.067+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:46.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:46.361+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:46.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:46.512+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:47.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:47.032+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:47.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:47.056+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:47.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:47.322+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:47.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:47.485+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:48.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:48.028+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:48.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:48.039+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:48.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:48.334+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:48.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:48.475+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:49.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:49.055+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:49.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:49.068+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:49.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:49.330+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:49.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:49.493+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:50.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:50.007+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:50.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:50.021+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:50.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:50.325+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:50.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:50.492+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:50.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:39:50.645 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:39:51.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:51.050+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:51.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:51.066+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:51.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:51.326+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:51.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:51.526+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:51.916 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:39:51.913+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:39:52.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:52.038+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:52.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:52.083+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:52.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:52.285+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:52.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:52.493+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:53.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:53.049+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:53.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:53.093+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:53.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:53.264+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:53.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:53.530+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:54.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:54.047+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:54.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:54.051+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:54.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:54.279+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:54.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:54.568+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:55.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:55.073+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:55.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:55.080+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:55.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:55.237+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:55.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:55.554+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:56.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:56.074+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:56.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:56.077+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:56.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:56.247+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:56.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:56.577+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:57.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:57.072+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:57.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:57.119+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:57.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:57.224+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:57.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:57.547+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:58.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:58.040+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:58.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:58.097+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:58.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:58.188+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:58.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:58.585+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:59.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:39:59.032+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:59.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:39:59.128+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:59.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:39:59.217+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:39:59.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:39:59.539+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:00.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:00.058+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:00.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:00.157+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:00.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:00.264+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:00.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:00.585+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:01.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:01.020+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:01.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:01.189+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:01.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:01.250+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:01.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:01.607+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:02.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:02.025+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:02.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:02.218+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:02.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:02.300+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:02.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:02.564+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:02.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:02.992+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:03.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:03.170+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:03.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:03.319+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:03.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:03.586+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:04.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:04.027+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:04.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:04.134+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:04.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:04.327+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:04.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:04.607+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:05.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:05.002+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:05.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:05.182+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:05.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:05.283+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:05.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:05.654+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:06.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:06.014+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:06.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:06.165+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:06.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:06.250+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:06.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:06.658+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:06.932 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:40:06.929+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:40:07.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:07.059+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:07.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:07.144+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:07.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:07.281+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:07.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:07.629+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:08.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:08.082+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:08.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:08.149+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:08.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:08.253+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:08.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:08.631+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:09.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:09.131+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:09.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:09.159+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:09.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:09.247+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:09.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:09.664+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:10.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:10.121+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:10.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:10.204+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:10.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:10.270+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:10.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:10.646+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:11.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:11.159+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:11.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:11.230+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:11.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:11.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:11.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:11.641+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:12.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:12.123+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:12.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:12.215+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:12.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:12.242+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:12.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:12.614+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:13.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:13.114+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:13.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:13.263+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:13.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:13.292+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:13.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:13.605+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:14.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:14.095+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:14.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:14.257+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:14.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:14.283+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:14.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:14.646+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:15.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:15.125+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:15.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:15.218+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:15.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:15.280+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:15.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:15.696+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:16.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:16.114+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:16.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:16.248+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:16.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:16.253+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:16.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:16.670+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:17.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:17.151+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:17.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:17.208+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:17.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:17.218+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:17.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:17.648+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:18.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:18.169+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:18.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:18.246+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:18.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:18.256+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:18.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:18.599+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:19.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:19.153+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:19.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:19.290+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:19.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:19.296+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:19.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:19.557+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:20.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:20.115+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:20.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:20.299+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:20.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:20.321+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:20.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:20.592+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:20.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:40:20.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:40:21.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:21.099+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:21.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:21.313+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:21.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:21.359+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:21.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:21.595+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:21.948 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:40:21.946+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:40:22.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:22.112+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:22.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:22.271+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:22.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:22.373+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:22.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:22.611+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:23.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:23.134+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:23.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:23.280+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:23.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:23.328+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:23.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:23.599+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:24.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:24.140+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:24.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:24.254+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:24.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:24.328+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:24.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:24.579+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:25.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:25.117+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:25.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:25.301+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:25.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:25.362+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:25.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:25.557+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:26.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:26.158+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:26.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:26.315+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:26.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:26.339+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:26.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:26.533+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:27.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:27.114+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:27.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:27.359+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:27.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:27.364+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:27.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:27.516+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:28.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:28.093+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:28.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:28.376+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:28.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:28.410+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:28.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:28.551+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:29.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:29.133+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:29.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:29.329+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:29.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:29.407+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:29.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:29.579+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:30.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:30.120+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:30.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:30.298+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:30.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:30.436+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:30.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:30.549+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:31.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:31.153+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:31.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:31.258+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:31.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:31.472+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:31.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:31.504+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:32.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:32.167+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:32.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:32.211+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:32.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:32.454+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:32.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:32.540+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:33.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:33.200+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:33.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:33.256+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:33.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:33.414+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:33.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:33.583+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:34.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:34.220+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:34.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:34.245+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:34.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:34.371+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:34.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:34.606+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:35.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:35.187+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:35.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:35.292+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:35.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:35.392+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:35.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:35.589+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:36.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:36.234+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:36.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:36.277+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:36.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:36.390+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:36.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:36.621+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:36.964 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:40:36.961+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:40:37.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:37.267+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:37.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:37.321+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:37.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:37.411+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:37.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:37.667+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:38.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:38.228+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:38.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:38.341+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:38.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:38.409+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:38.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:38.627+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:39.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:39.205+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:39.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:39.308+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:39.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:39.428+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:39.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:39.580+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:40.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:40.253+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:40.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:40.342+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:40.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:40.425+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:40.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:40.627+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:41.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:41.242+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:41.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:41.332+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:41.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:41.455+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:41.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:41.582+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:42.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:42.226+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:42.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:42.361+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:42.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:42.502+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:42.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:42.569+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:43.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:43.213+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:43.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:43.317+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:43.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:43.543+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:43.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:43.543+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:44.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:44.185+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:44.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:44.349+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:44.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:44.523+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:44.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:44.553+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:45.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:45.179+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:45.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:45.334+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:45.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:45.497+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:45.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:45.592+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:46.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:46.159+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:46.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:46.347+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:46.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:46.501+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:46.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:46.617+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:47.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:47.208+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:47.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:47.387+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:47.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:47.458+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:47.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:47.613+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:48.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:48.214+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:48.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:48.339+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:48.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:48.411+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:48.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:48.591+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:49.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:49.256+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:49.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:49.329+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:49.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:49.374+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:49.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:49.570+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:50.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:50.257+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:50.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:50.313+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:50.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:50.347+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:50.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:50.539+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:50.897 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:40:50.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:40:51.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:51.268+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:51.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:51.324+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:51.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:51.330+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:51.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:51.498+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:51.980 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:40:51.977+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:40:52.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:52.245+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:52.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:52.291+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:52.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:52.333+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:52.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:52.497+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:53.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:53.262+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:53.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:53.315+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:53.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:53.315+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:53.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:53.528+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:54.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:54.255+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:54.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:54.273+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:54.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:54.345+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:54.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:54.541+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:55.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:55.228+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:55.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:55.299+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:55.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:55.370+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:55.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:55.591+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:56.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:56.276+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:56.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:56.297+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:56.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:56.382+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:56.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:56.606+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:57.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:57.264+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:57.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:57.283+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:57.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:57.430+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:57.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:57.637+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:58.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:58.243+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:58.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:58.290+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:58.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:58.419+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:58.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:58.645+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:59.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:40:59.211+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:59.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:40:59.271+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:59.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:40:59.457+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:40:59.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:40:59.675+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:00.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:00.162+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:00.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:00.303+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:00.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:00.464+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:00.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:00.625+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:01.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:01.167+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:01.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:01.329+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:01.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:01.475+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:01.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:01.661+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:02.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:02.140+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:02.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:02.317+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:02.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:02.509+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:02.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:02.647+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:03.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:03.122+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:03.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:03.312+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:03.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:03.541+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:03.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:03.672+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:04.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:04.124+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:04.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:04.346+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:04.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:04.534+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:04.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:04.625+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:05.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:05.083+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:05.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:05.387+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:05.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:05.499+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:05.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:05.588+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:06.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:06.116+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:06.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:06.399+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:06.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:06.533+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:06.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:06.617+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:06.996 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:41:06.993+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:41:07.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:07.095+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:07.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:07.403+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:07.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:07.542+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:07.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:07.661+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:08.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:08.125+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:08.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:08.393+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:08.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:08.551+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:08.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:08.687+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:09.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:09.163+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:09.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:09.368+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:09.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:09.575+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:09.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:09.644+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:10.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:10.191+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:10.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:10.381+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:10.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:10.597+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:10.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:10.629+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:11.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:11.215+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:11.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:11.349+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:11.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:11.573+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:11.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:11.587+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:12.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:12.183+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:12.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:12.365+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:12.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:12.524+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:12.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:12.545+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:13.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:13.193+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:13.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:13.366+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:13.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:13.524+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:13.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:13.558+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:14.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:14.185+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:14.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:14.415+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:14.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:14.505+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:14.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:14.584+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:15.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:15.167+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:15.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:15.438+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:15.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:15.555+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:15.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:15.570+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:16.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:16.212+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:16.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:16.423+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:16.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:16.540+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:16.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:16.553+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:17.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:17.211+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:17.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:17.405+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:17.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:17.512+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:17.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:17.538+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:18.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:18.254+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:18.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:18.413+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:18.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:18.471+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:18.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:18.588+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:19.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:19.206+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:19.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:19.375+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:19.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:19.432+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:19.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:19.638+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:20.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:20.237+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:20.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:20.341+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:20.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:20.392+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:20.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:20.593+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:20.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:41:20.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:41:21.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:21.233+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:21.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:21.349+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:21.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:21.380+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:21.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:21.628+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:22.012 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:41:22.009+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:41:22.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:22.264+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:22.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:22.316+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:22.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:22.366+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:22.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:22.638+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:23.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:23.265+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:23.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:23.307+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:23.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:23.339+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:23.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:23.660+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:24.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:24.246+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:24.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:24.320+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:24.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:24.372+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:24.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:24.683+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:25.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:25.236+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:25.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:25.324+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:25.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:25.415+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:25.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:25.676+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:26.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:26.248+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:26.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:26.328+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:26.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:26.436+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:26.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:26.654+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:27.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:27.261+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:27.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:27.337+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:27.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:27.419+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:27.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:27.638+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:28.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:28.262+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:28.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:28.366+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:28.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:28.398+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:28.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:28.659+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:29.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:29.223+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:29.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:29.376+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:29.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:29.434+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:29.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:29.701+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:30.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:30.222+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:30.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:30.399+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:30.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:30.447+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:30.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:30.723+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:31.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:31.202+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:31.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:31.408+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:31.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:31.447+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:31.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:31.763+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:32.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:32.165+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:32.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:32.404+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:32.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:32.410+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:32.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:32.805+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:33.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:33.169+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:33.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:33.362+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:33.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:33.367+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:33.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:33.817+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:34.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:34.127+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:34.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:34.363+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:34.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:34.403+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:34.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:34.848+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:35.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:35.175+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:35.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:35.357+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:35.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:35.370+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:35.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:35.865+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:36.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:36.180+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:36.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:36.326+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:36.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:36.362+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:36.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:36.857+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:37.027 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:41:37.025+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:41:37.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:37.195+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:37.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:37.340+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:37.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:37.401+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:37.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:37.853+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:38.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:38.225+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:38.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:38.322+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:38.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:38.434+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:38.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:38.871+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:39.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:39.243+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:39.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:39.326+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:39.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:39.450+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:39.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:39.829+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:40.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:40.260+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:40.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:40.346+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:40.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:40.494+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:40.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:40.804+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:41.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:41.276+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:41.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:41.297+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:41.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:41.479+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:41.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:41.811+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:42.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:42.265+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:42.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:42.291+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:42.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:42.471+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:42.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:42.772+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:43.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:43.297+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:43.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:43.307+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:43.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:43.462+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:43.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:43.774+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:44.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:44.310+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:44.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:44.342+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:44.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:44.416+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:44.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:44.815+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:45.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:45.307+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:45.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:45.318+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:45.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:45.408+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:45.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:45.827+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:46.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:46.335+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:46.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:46.346+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:46.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:46.424+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:46.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:46.808+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:47.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:47.352+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:47.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:47.368+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:47.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:47.417+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:47.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:47.763+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:48.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:48.370+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:48.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:48.396+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:48.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:48.435+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:48.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:48.723+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:49.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:49.335+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:49.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:49.437+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:49.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:49.480+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:49.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:49.674+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:50.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:50.358+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:50.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:50.428+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:50.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:50.464+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:50.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:50.671+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:51.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:41:51.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:41:51.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:51.395+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:51.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:51.396+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:51.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:51.427+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:51.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:51.720+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:52.043 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:41:52.040+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:41:52.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:52.358+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:52.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:52.436+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:52.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:52.440+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:52.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:52.680+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:53.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:53.329+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:53.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:53.435+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:53.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:53.474+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:53.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:53.673+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:54.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:54.358+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:54.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:54.437+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:54.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:54.510+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:54.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:54.635+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:55.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:55.335+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:55.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:55.477+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:55.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:55.513+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:55.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:55.610+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:56.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:56.285+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:56.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:56.510+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:56.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:56.541+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:56.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:56.640+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:57.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:57.244+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:57.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:57.552+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:57.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:57.574+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:57.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:57.595+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:58.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:58.216+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:58.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:58.537+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:58.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:58.558+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:58.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:58.577+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:59.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:41:59.246+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:59.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:41:59.526+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:59.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:41:59.564+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:41:59.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:41:59.614+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:00.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:00.288+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:00.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:00.522+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:00.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:00.587+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:00.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:00.607+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:01.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:01.316+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:01.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:01.495+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:01.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:01.559+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:01.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:01.569+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:02.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:02.280+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:02.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:02.470+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:02.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:02.584+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:02.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:02.594+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:03.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:03.292+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:03.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:03.425+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:03.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:03.564+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:03.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:03.623+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:04.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:04.328+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:04.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:04.423+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:04.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:04.568+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:04.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:04.620+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:05.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:05.351+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:05.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:05.455+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:05.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:05.572+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:05.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:05.586+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:06.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:06.332+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:06.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:06.421+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:06.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:06.537+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:06.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:06.551+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:07.059 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:42:07.056+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:42:07.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:07.337+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:07.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:07.431+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:07.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:07.490+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:07.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:07.555+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:08.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:08.385+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:08.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:08.479+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:08.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:08.530+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:08.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:08.534+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:09.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:09.426+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:09.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:09.476+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:09.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:09.545+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:09.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:09.558+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:10.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:10.397+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:10.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:10.460+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:10.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:10.564+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:10.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:10.604+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:11.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:11.417+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:11.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:11.424+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:11.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:11.529+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:11.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:11.594+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:12.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:12.416+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:12.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:12.447+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:12.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:12.549+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:12.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:12.571+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:13.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:13.424+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:13.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:13.497+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:13.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:13.536+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:13.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:13.573+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:14.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:14.397+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:14.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:14.493+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:14.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:14.521+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:14.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:14.550+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:15.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:15.394+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:15.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:15.447+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:15.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:15.473+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:15.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:15.520+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:16.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:16.438+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:16.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:16.479+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:16.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:16.481+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:16.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:16.491+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:17.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:17.468+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:17.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:17.488+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:17.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:17.493+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:17.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:17.540+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:18.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:18.446+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:18.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:18.458+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:18.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:18.480+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:18.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:18.496+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:19.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:19.432+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:19.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:19.466+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:19.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:19.484+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:19.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:19.484+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:20.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:20.406+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:20.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:20.419+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:20.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:20.465+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:20.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:20.469+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:21.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:42:21.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:42:21.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:21.357+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:21.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:21.381+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:21.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:21.451+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:21.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:21.477+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:22.063 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:42:22.060+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:42:22.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:22.379+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:22.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:22.424+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:22.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:22.476+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:22.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:22.500+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:23.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:23.362+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:23.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:23.474+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:23.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:23.491+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:23.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:23.516+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:24.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:24.388+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:24.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:24.432+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:24.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:24.466+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:24.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:24.526+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:25.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:25.398+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:25.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:25.428+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:25.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:25.513+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:25.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:25.533+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:26.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:26.369+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:26.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:26.476+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:26.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:26.506+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:26.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:26.510+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:27.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:27.377+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:27.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:27.453+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:27.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:27.459+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:27.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:27.528+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:28.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:28.406+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:28.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:28.422+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:28.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:28.429+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:28.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:28.547+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:29.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:29.374+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:29.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:29.376+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:29.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:29.385+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:29.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:29.537+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:30.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:30.340+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:30.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:30.350+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:30.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:30.408+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:30.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:30.577+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:31.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:31.370+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:31.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:31.391+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:31.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:31.436+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:31.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:31.567+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:32.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:32.387+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:32.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:32.416+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:32.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:32.465+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:32.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:32.586+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:33.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:33.431+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:33.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:33.432+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:33.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:33.500+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:33.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:33.550+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:34.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:34.441+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:34.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:34.453+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:34.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:34.516+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:34.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:34.534+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:35.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:35.472+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:35.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:35.472+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:35.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:35.528+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:35.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:35.533+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:36.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:36.461+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:36.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:36.470+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:36.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:36.486+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:36.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:36.566+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:37.079 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:42:37.076+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:42:37.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:37.422+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:37.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:37.441+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:37.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:37.443+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:37.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:37.522+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:38.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:38.396+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:38.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:38.404+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:38.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:38.474+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:38.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:38.545+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:39.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:39.391+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:39.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:39.406+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:39.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:39.491+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:39.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:39.517+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:40.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:40.395+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:40.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:40.419+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:40.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:40.509+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:40.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:40.541+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:41.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:41.359+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:41.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:41.448+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:41.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:41.554+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:41.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:41.587+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:42.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:42.324+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:42.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:42.480+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:42.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:42.575+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:42.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:42.624+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:43.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:43.309+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:43.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:43.440+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:43.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:43.542+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:43.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:43.595+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:44.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:44.291+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:44.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:44.406+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:44.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:44.535+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:44.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:44.635+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:45.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:45.273+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:45.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:45.406+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:45.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:45.528+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:45.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:45.587+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:46.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:46.236+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:46.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:46.451+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:46.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:46.495+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:46.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:46.591+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:47.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:47.285+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:47.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:47.419+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:47.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:47.494+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:47.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:47.593+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:48.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:48.261+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:48.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:48.422+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:48.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:48.455+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:48.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:48.581+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:49.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:49.303+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:49.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:49.373+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:49.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:49.483+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:49.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:49.548+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:50.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:50.301+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:50.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:50.400+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:50.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:50.512+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:50.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:50.530+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:51.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:42:51.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:42:51.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:51.324+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:51.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:51.413+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:51.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:51.485+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:51.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:51.569+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:52.095 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:42:52.093+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:42:52.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:52.314+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:52.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:52.455+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:52.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:52.496+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:52.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:52.610+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:53.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:53.270+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:53.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:53.447+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:53.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:53.481+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:53.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:53.575+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:54.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:54.228+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:54.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:54.440+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:54.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:54.505+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:54.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:54.603+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:55.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:55.248+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:55.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:55.488+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:55.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:55.489+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:55.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:55.595+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:56.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:56.294+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:56.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:56.458+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:56.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:56.504+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:56.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:56.575+0000 7f72c425d700 -1 osd.5 103 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:57.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:57.334+0000 7f389e18e700 -1 osd.4 103 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:57.458 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-03T23:42:57.456+0000 7f0da8b11700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:42:57.473 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-03T23:42:57.456+0000 7f0da8b11700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:42:57.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:57.488+0000 7f6e44c9f700 -1 osd.7 103 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:57.496 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-03T23:42:57.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:57.504+0000 7f596d92c700 -1 osd.6 103 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:57.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:57.604+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:58.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:58.369+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:58.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:58.458+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:58.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:58.545+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:58.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:58.573+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:59.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:42:59.320+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:59.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:42:59.497+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:59.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:42:59.547+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:42:59.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:42:59.562+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:00.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:00.354+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:00.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:00.451+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:00.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:00.538+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:00.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:00.600+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:01.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:01.382+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:01.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:01.455+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:01.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:01.499+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:01.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:01.555+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:02.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:02.346+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:02.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:02.439+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:02.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:02.522+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:02.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:02.591+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:03.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:03.375+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:03.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:03.391+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:03.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:03.565+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:03.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:03.575+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:04.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:04.354+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:04.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:04.410+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:04.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:04.530+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:04.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:04.546+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:05.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:05.384+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:05.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:05.400+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:05.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:05.573+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:05.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:05.579+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:06.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:06.366+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:06.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:06.370+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:06.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:06.590+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:06.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:06.610+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:07.105 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:43:07.102+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:43:07.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:07.353+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:07.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:07.417+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:07.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:07.626+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:07.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:07.631+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:08.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:08.314+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:08.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:08.375+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:08.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:08.607+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:08.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:08.652+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:09.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:09.295+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:09.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:09.384+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:09.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:09.585+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:09.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:09.677+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:10.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:10.336+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:10.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:10.403+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:10.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:10.555+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:10.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:10.697+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:11.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:11.296+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:11.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:11.445+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:11.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:11.538+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:11.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:11.664+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:12.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:12.329+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:12.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:12.413+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:12.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:12.581+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:12.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:12.674+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:13.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:13.375+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:13.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:13.379+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:13.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:13.543+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:13.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:13.627+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:14.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:14.346+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:14.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:14.415+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:14.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:14.520+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:14.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:14.585+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:15.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:15.349+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:15.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:15.428+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:15.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:15.493+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:15.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:15.566+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:16.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:16.309+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:16.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:16.422+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:16.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:16.496+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:16.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:16.545+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:17.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:17.282+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:17.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:17.425+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:17.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:17.496+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:17.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:17.524+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:18.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:18.296+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:18.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:18.452+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:18.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:18.478+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:18.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:18.499+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:19.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:19.291+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:19.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:19.438+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:19.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:19.463+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:19.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:19.488+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:20.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:20.304+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:20.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:20.430+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:20.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:20.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:20.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:20.485+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:21.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:21.335+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:21.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:21.421+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:21.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:43:21.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:43:21.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:21.469+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:21.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:21.531+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:22.121 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:43:22.119+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:43:22.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:22.379+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:22.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:22.420+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:22.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:22.434+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:22.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:22.569+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:23.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:23.406+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:23.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:23.419+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:23.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:23.427+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:23.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:23.607+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:24.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:24.420+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:24.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:24.429+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:24.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:24.473+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:24.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:24.567+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:25.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:25.373+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:25.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:25.423+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:25.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:25.452+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:25.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:25.541+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:26.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:26.386+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:26.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:26.413+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:26.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:26.484+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:26.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:26.588+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:27.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:27.354+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:27.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:27.387+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:27.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:27.504+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:27.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:27.598+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:28.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:28.383+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:28.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:28.385+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:28.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:28.483+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:28.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:28.604+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:29.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:29.356+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:29.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:29.378+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:29.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:29.471+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:29.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:29.557+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:30.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:30.361+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:30.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:30.397+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:30.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:30.456+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:30.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:30.566+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:31.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:31.351+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:31.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:31.386+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:31.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:31.426+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:31.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:31.567+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:32.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:32.324+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:32.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:32.367+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:32.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:32.423+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:32.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:32.542+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:33.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:33.331+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:33.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:33.365+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:33.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:33.429+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:33.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:33.590+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:34.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:34.370+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:34.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:34.381+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:34.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:34.395+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:34.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:34.571+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:35.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:35.336+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:35.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:35.354+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:35.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:35.377+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:35.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:35.576+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:36.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:36.295+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:36.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:36.356+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:36.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:36.380+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:36.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:36.567+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:37.137 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:43:37.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:43:37.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:37.257+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:37.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:37.334+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:37.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:37.340+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:37.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:37.520+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:38.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:38.294+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:38.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:38.304+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:38.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:38.337+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:38.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:38.529+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:39.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:39.315+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:39.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:39.318+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:39.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:39.345+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:39.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:39.517+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:40.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:40.324+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:40.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:40.332+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:40.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:40.352+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:40.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:40.545+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:41.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:41.282+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:41.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:41.337+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:41.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:41.387+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:41.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:41.589+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:42.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:42.237+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:42.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:42.355+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:42.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:42.373+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:42.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:42.612+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:43.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:43.188+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:43.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:43.311+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:43.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:43.324+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:43.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:43.605+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:44.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:44.199+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:44.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:44.263+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:44.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:44.311+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:44.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:44.632+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:45.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:45.218+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:45.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:45.231+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:45.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:45.273+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:45.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:45.640+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:46.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:46.187+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:46.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:46.222+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:46.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:46.316+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:46.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:46.632+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:47.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:47.197+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:47.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:47.201+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:47.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:47.343+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:47.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:47.630+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:48.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:48.170+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:48.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:48.202+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:48.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:48.357+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:48.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:48.622+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:49.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:49.171+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:49.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:49.194+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:49.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:49.347+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:49.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:49.663+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:50.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:50.173+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:50.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:50.176+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:50.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:50.366+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:50.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:50.619+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:51.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:51.174+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:51.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:51.186+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:51.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:51.330+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:51.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:43:51.593 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:43:51.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:51.630+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:52.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:52.142+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:52.152 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:43:52.150+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:43:52.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:52.208+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:52.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:52.366+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:52.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:52.601+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:53.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:53.135+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:53.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:53.195+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:53.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:53.362+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:53.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:53.587+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:54.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:54.150+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:54.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:54.155+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:54.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:54.359+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:54.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:54.602+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:55.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:55.105+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:55.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:55.141+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:55.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:55.316+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:55.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:55.636+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:56.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:56.152+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:56.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:56.188+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:56.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:56.365+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:56.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:56.649+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:57.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:57.115+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:57.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:57.190+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:57.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:57.341+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:57.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:57.640+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:58.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:58.136+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:58.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:58.200+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:58.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:58.330+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:58.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:58.605+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:59.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:43:59.096+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:59.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:43:59.162+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:59.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:43:59.372+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:43:59.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:43:59.619+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:00.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:00.049+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:00.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:00.119+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:00.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:00.398+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:00.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:00.637+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:01.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:01.065+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:01.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:01.111+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:01.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:01.415+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:01.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:01.667+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:02.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:02.083+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:02.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:02.091+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:02.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:02.415+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:02.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:02.710+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:03.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:03.043+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:03.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:03.043+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:03.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:03.374+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:03.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:03.751+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:04.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:04.031+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:04.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:04.063+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:04.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:04.339+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:04.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:04.706+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:05.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:04.998+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:05.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:05.110+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:05.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:05.317+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:05.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:05.709+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:06.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:06.022+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:06.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:06.069+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:06.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:06.278+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:06.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:06.677+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:07.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:07.001+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:07.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:07.029+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:07.168 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:44:07.166+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:44:07.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:07.298+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:07.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:07.677+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:08.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:08.044+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:08.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:08.076+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:08.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:08.249+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:08.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:08.694+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:09.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:09.063+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:09.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:09.065+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:09.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:09.260+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:09.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:09.695+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:10.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:10.060+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:10.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:10.102+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:10.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:10.268+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:10.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:10.685+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:11.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:11.053+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:11.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:11.118+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:11.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:11.234+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:11.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:11.682+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:12.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:12.067+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:12.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:12.069+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:12.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:12.202+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:12.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:12.715+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:13.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:13.050+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:13.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:13.079+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:13.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:13.177+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:13.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:13.727+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:14.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:14.002+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:14.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:14.043+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:14.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:14.193+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:14.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:14.705+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:15.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:15.027+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:15.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:15.049+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:15.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:15.155+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:15.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:15.687+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:16.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:16.064+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:16.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:16.067+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:16.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:16.175+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:16.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:16.715+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:17.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:17.085+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:17.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:17.087+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:17.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:17.146+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:17.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:17.671+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:18.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:18.069+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:18.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:18.081+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:18.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:18.148+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:18.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:18.667+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:19.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:19.047+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:19.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:19.102+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:19.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:19.197+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:19.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:19.672+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:20.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:19.998+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:20.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:20.149+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:20.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:20.188+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:20.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:20.710+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:20.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:20.954+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:21.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:21.169+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:21.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:21.200+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:21.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:44:21.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:44:21.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:21.753+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:21.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:21.942+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:22.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:22.133+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:22.184 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:44:22.181+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:44:22.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:22.236+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:22.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:22.737+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:22.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:22.950+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:23.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:23.085+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:23.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:23.214+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:23.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:23.693+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:23.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:23.940+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:24.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:24.130+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:24.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:24.175+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:24.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:24.729+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:24.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:24.941+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:25.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:25.159+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:25.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:25.189+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:25.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:25.681+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:25.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:25.943+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:26.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:26.126+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:26.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:26.223+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:26.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:26.702+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:26.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:26.909+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:27.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:27.097+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:27.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:27.197+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:27.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:27.720+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:27.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:27.876+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:28.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:28.080+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:28.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:28.155+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:28.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:28.769+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:28.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:28.846+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:29.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:29.070+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:29.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:29.145+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:29.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:29.721+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:29.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:29.823+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:30.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:30.107+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:30.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:30.112+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:30.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:30.673+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:30.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:30.851+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:31.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:31.095+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:31.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:31.112+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:31.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:31.706+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:31.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:31.882+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:32.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:32.074+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:32.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:32.116+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:32.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:32.674+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:32.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:32.907+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:33.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:33.114+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:33.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:33.163+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:33.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:33.636+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:33.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:33.951+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:34.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:34.068+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:34.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:34.134+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:34.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:34.603+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:34.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:34.954+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:35.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:35.063+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:35.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:35.148+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:35.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:35.559+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:35.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:35.978+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:36.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:36.052+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:36.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:36.101+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:36.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:36.517+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:36.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:36.948+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:37.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:37.043+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:37.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:37.057+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:37.198 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:44:37.196+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:44:37.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:37.547+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:37.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:37.985+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:38.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:38.069+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:38.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:38.090+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:38.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:38.568+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:39.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:39.012+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:39.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:39.025+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:39.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:39.108+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:39.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:39.612+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:39.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:39.974+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:40.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:39.998+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:40.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:40.086+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:40.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:40.571+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:40.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:40.951+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:41.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:41.009+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:41.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:41.118+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:41.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:41.570+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:41.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:41.945+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:41.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:41.989+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:42.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:42.083+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:42.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:42.533+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:42.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:42.977+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:42.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:42.991+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:43.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:43.092+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:43.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:43.529+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:43.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:43.962+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:43.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:43.968+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:44.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:44.055+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:44.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:44.575+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:44.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:44.981+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:45.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:45.016+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:45.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:45.091+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:45.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:45.542+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:45.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:45.968+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:45.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:45.995+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:46.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:46.085+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:46.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:46.526+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:46.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:46.947+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:47.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:47.039+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:47.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:47.131+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:47.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:47.482+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:47.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:47.982+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:48.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:48.038+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:48.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:48.085+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:48.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:48.470+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:48.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:48.975+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:49.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:49.073+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:49.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:49.081+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:49.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:49.496+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:49.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:49.975+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:50.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:50.050+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:50.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:50.071+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:50.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:50.524+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:51.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:51.010+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:51.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:51.089+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:51.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:51.103+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:51.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:51.553+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:51.846 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:44:51.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:44:51.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:51.974+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:52.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:52.106+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:52.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:52.128+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:52.213 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:44:52.211+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:44:52.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:52.540+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:53.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:53.009+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:53.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:53.085+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:53.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:53.153+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:53.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:53.524+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:54.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:54.032+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:54.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:54.131+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:54.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:54.197+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:54.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:54.484+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:55.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:55.021+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:55.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:55.151+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:55.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:55.222+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:55.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:55.443+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:55.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:55.997+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:56.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:56.154+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:56.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:56.267+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:56.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:56.400+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:57.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:57.008+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:57.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:57.187+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:57.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:57.233+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:57.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:57.368+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:57.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:57.993+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:58.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:58.193+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:58.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:58.220+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:58.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:58.356+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:58.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:44:58.981+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:59.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:44:59.167+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:59.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:44:59.201+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:44:59.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:44:59.381+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:00.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:00.030+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:00.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:00.180+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:00.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:00.218+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:00.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:00.418+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:01.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:01.001+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:01.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:01.195+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:01.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:01.197+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:01.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:01.400+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:02.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:02.035+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:02.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:02.186+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:02.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:02.204+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:02.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:02.406+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:03.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:03.049+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:03.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:03.197+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:03.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:03.241+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:03.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:03.372+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:04.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:04.023+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:04.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:04.231+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:04.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:04.236+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:04.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:04.342+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:05.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:04.974+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:05.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:05.209+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:05.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:05.266+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:05.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:05.370+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:05.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:05.941+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:06.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:06.202+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:06.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:06.248+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:06.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:06.407+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:06.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:06.929+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:07.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:07.159+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:07.228 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:45:07.225+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:45:07.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:07.284+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:07.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:07.407+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:07.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:07.978+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:08.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:08.116+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:08.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:08.271+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:08.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:08.413+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:08.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:08.948+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:09.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:09.094+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:09.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:09.259+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:09.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:09.437+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:09.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:09.906+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:10.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:10.134+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:10.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:10.241+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:10.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:10.465+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:10.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:10.947+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:11.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:11.147+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:11.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:11.235+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:11.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:11.479+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:11.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:11.907+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:12.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:12.139+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:12.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:12.255+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:12.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:12.482+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:12.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:12.860+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:13.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:13.182+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:13.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:13.253+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:13.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:13.444+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:13.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:13.870+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:14.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:14.220+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:14.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:14.254+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:14.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:14.480+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:14.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:14.884+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:15.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:15.221+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:15.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:15.235+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:15.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:15.509+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:15.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:15.885+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:16.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:16.203+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:16.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:16.230+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:16.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:16.490+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:16.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:16.860+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:17.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:17.222+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:17.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:17.231+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:17.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:17.460+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:17.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:17.832+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:18.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:18.194+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:18.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:18.278+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:18.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:18.503+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:18.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:18.784+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:19.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:19.147+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:19.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:19.255+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:19.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:19.526+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:19.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:19.816+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:20.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:20.162+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:20.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:20.267+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:20.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:20.533+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:20.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:20.772+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:21.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:21.203+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:21.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:21.266+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:21.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:21.558+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:21.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:21.733+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:21.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:45:21.969 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:45:22.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:22.190+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:22.244 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:45:22.241+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:45:22.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:22.275+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:22.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:22.602+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:22.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:22.723+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:23.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:23.191+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:23.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:23.322+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:23.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:23.591+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:23.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:23.765+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:24.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:24.166+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:24.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:24.285+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:24.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:24.630+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:24.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:24.772+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:25.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:25.210+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:25.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:25.327+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:25.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:25.593+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:25.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:25.811+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:26.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:26.247+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:26.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:26.355+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:26.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:26.579+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:26.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:26.810+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:27.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:27.226+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:27.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:27.400+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:27.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:27.552+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:27.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:27.858+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:28.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:28.203+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:28.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:28.435+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:28.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:28.520+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:28.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:28.845+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:29.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:29.208+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:29.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:29.479+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:29.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:29.480+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:29.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:29.798+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:30.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:30.232+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:30.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:30.505+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:30.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:30.530+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:30.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:30.829+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:31.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:31.255+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:31.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:31.479+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:31.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:31.529+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:31.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:31.837+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:32.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:32.272+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:32.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:32.490+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:32.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:32.545+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:32.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:32.878+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:33.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:33.237+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:33.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:33.501+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:33.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:33.576+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:33.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:33.859+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:34.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:34.215+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:34.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:34.459+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:34.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:34.554+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:34.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:34.841+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:35.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:35.179+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:35.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:35.469+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:35.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:35.598+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:35.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:35.852+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:36.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:36.156+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:36.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:36.480+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:36.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:36.554+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:36.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:36.868+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:37.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:37.169+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:37.260 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:45:37.257+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:45:37.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:37.443+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:37.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:37.525+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:37.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:37.853+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:38.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:38.167+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:38.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:38.454+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:38.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:38.520+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:38.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:38.817+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:39.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:39.166+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:39.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:39.493+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:39.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:39.546+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:39.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:39.799+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:40.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:40.143+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:40.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:40.535+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:40.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:40.581+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:40.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:40.749+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:41.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:41.178+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:41.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:41.518+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:41.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:41.595+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:41.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:41.766+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:42.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:42.150+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:42.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:42.478+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:42.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:42.601+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:42.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:42.754+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:43.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:43.114+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:43.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:43.504+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:43.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:43.572+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:43.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:43.743+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:44.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:44.117+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:44.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:44.525+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:44.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:44.613+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:44.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:44.762+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:45.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:45.079+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:45.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:45.476+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:45.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:45.600+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:45.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:45.766+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:46.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:46.118+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:46.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:46.498+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:46.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:46.586+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:46.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:46.763+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:47.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:47.135+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:47.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:47.486+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:47.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:47.629+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:47.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:47.729+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:48.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:48.182+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:48.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:48.437+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:48.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:48.606+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:48.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:48.756+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:49.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:49.230+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:49.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:49.423+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:49.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:49.594+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:49.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:49.738+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:50.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:50.197+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:50.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:50.417+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:50.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:50.571+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:50.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:50.750+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:51.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:51.172+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:51.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:51.369+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:51.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:51.570+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:51.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:51.794+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:52.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:52.134+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:52.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:45:52.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:45:52.275 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:45:52.274+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:45:52.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:52.362+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:52.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:52.522+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:52.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:52.817+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:53.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:53.165+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:53.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:53.321+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:53.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:53.482+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:53.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:53.829+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:54.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:54.168+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:54.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:54.330+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:54.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:54.459+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:54.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:54.868+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:55.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:55.209+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:55.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:55.349+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:55.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:55.483+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:55.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:55.907+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:56.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:56.202+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:56.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:56.328+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:56.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:56.451+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:56.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:56.906+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:57.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:57.226+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 40 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:57.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:57.349+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:57.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:57.434+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 26 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:57.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:57.876+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:58.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:58.237+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:58.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:58.360+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:58.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:58.387+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:58.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:58.921+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:59.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:45:59.252+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:59.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:45:59.370+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:59.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:45:59.402+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:45:59.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:45:59.947+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:00.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:00.227+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:00.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:00.363+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:00.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:00.406+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:00.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:00.969+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:01.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:01.182+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:01.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:01.330+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:01.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:01.385+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:01.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:01.938+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:02.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:02.163+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:02.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:02.325+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:02.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:02.351+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:02.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:02.938+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:03.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:03.197+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:03.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:03.347+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:03.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:03.362+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:03.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:03.949+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:04.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:04.188+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:04.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:04.322+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:04.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:04.360+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:05.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:04.999+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:05.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:05.219+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:05.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:05.335+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:05.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:05.384+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:05.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:05.955+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:06.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:06.239+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:06.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:06.374+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:06.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:06.399+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:07.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:06.948+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:07.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:07.276+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:07.291 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:46:07.289+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:46:07.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:07.410+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:07.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:07.424+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:07.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:07.950+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:08.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:08.318+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:08.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:08.416+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:08.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:08.422+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:08.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:08.976+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:09.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:09.274+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:09.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:09.378+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:09.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:09.415+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:09.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:09.942+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:10.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:10.295+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:10.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:10.390+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:10.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:10.416+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:10.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:10.933+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:11.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:11.299+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:11.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:11.409+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:11.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:11.425+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:11.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:11.952+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:12.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:12.280+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:12.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:12.412+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:12.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:12.427+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:12.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:12.989+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:13.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:13.312+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:13.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:13.364+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:13.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:13.423+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:13.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:13.949+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:14.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:14.345+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:14.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:14.392+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:14.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:14.439+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:14.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:14.961+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:15.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:15.321+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:15.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:15.404+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:15.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:15.426+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:15.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:15.936+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:16.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:16.312+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:16.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:16.356+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:16.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:16.426+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:16.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:16.985+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:17.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:17.299+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:17.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:17.377+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:17.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:17.386+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:17.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:17.985+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:18.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:18.284+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:18.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:18.347+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:18.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:18.374+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:18.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:18.944+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:19.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:19.302+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:19.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:19.326+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:19.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:19.414+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:19.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:19.959+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:20.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:20.295+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:20.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:20.372+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:20.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:20.429+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:20.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:20.977+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:21.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:21.302+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:21.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:21.403+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:21.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:21.436+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:21.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:21.938+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:22.242 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:46:22.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:46:22.307 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:46:22.305+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:46:22.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:22.309+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:22.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:22.359+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:22.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:22.455+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:22.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:22.900+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:23.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:23.340+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:23.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:23.375+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:23.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:23.459+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:23.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:23.935+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:24.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:24.369+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:24.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:24.383+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:24.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:24.484+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:24.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:24.889+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:25.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:25.354+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:25.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:25.358+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:25.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:25.454+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:25.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:25.916+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:26.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:26.307+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:26.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:26.353+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:26.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:26.489+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:26.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:26.899+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:27.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:27.289+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:27.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:27.390+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:27.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:27.507+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:27.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:27.931+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:28.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:28.307+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:28.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:28.389+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:28.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:28.533+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:28.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:28.927+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:29.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:29.330+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:29.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:29.416+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:29.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:29.572+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:29.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:29.918+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:30.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:30.376+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:30.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:30.388+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:30.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:30.568+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:30.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:30.894+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:31.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:31.361+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:31.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:31.375+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:31.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:31.540+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:31.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:31.899+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:32.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:32.314+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:32.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:32.404+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:32.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:32.528+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:32.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:32.908+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:33.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:33.291+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:33.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:33.423+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:33.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:33.521+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:33.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:33.917+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:34.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:34.310+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:34.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:34.460+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:34.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:34.521+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:34.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:34.902+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:35.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:35.285+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:35.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:35.500+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:35.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:35.528+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:35.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:35.940+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:36.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:36.322+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:36.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:36.538+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:36.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:36.550+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:36.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:36.936+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:37.323 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:46:37.320+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:46:37.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:37.344+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:37.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:37.524+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:37.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:37.548+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:37.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:37.963+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:38.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:38.391+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:38.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:38.518+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:38.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:38.542+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:38.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:38.996+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:39.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:39.357+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:39.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:39.497+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:39.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:39.546+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:39.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:39.981+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:40.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:40.351+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:40.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:40.449+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:40.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:40.501+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:40.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:40.979+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:41.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:41.343+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:41.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:41.459+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:41.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:41.490+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:41.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:41.966+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:42.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:42.373+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:42.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:42.477+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:42.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:42.511+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:43.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:43.012+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:43.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:43.332+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:43.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:43.454+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:43.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:43.532+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:43.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:43.997+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:44.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:44.316+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:44.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:44.435+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:44.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:44.558+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:44.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:44.978+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:45.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:45.305+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:45.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:45.414+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:45.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:45.540+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:45.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:45.973+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:46.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:46.331+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:46.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:46.430+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:46.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:46.524+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:46.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:46.962+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:47.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:47.325+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:47.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:47.428+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:47.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:47.514+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:48.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:47.999+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:48.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:48.371+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:48.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:48.382+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:48.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:48.564+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:48.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:48.992+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:49.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:49.331+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:49.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:49.426+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:49.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:49.537+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:50.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:50.025+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:50.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:50.302+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:50.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:50.404+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:50.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:50.498+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:51.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:51.002+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:51.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:51.346+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:51.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:51.383+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:51.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:51.511+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:52.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:52.004+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:52.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:52.316+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:52.338 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:46:52.336+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:46:52.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:46:52.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:46:52.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:52.425+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:52.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:52.553+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:52.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:52.955+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:53.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:53.332+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:53.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:53.422+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:53.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:53.520+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:53.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:53.960+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:54.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:54.320+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:54.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:54.417+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:54.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:54.504+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:54.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:54.925+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:55.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:55.324+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:55.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:55.445+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:55.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:55.522+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:55.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:55.923+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:56.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:56.279+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:56.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:56.435+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:56.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:56.479+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:56.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:56.935+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:57.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:57.315+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:57.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:57.459+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:57.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:57.479+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:57.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:57.963+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:58.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:58.316+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:58.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:58.436+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:58.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:58.446+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:58.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:58.918+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:59.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:46:59.359+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:59.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:46:59.412+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:59.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:46:59.450+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:46:59.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:46:59.904+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:00.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:00.352+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:00.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:00.391+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:00.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:00.426+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:00.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:00.875+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:01.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:01.304+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:01.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:01.391+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:01.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:01.423+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:01.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:01.902+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:02.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:02.280+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:02.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:02.418+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:02.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:02.422+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:02.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:02.867+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:03.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:03.281+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:03.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:03.445+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:03.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:03.448+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:04.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:03.831+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:04.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:04.320+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:04.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:04.409+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:04.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:04.486+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:04.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:04.842+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:05.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:05.366+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:05.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:05.374+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:05.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:05.527+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:05.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:05.825+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:06.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:06.354+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:06.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:06.392+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:06.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:06.531+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:06.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:06.833+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:07.354 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:47:07.353+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:47:07.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:07.374+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:07.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:07.394+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:07.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:07.544+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:07.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:07.837+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:08.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:08.403+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:08.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:08.411+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:08.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:08.570+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:08.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:08.860+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:09.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:09.381+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:09.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:09.395+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:09.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:09.583+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:09.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:09.846+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:10.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:10.333+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:10.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:10.402+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:10.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:10.545+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:10.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:10.800+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:11.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:11.340+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:11.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:11.353+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:11.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:11.553+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:11.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:11.839+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:12.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:12.304+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:12.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:12.316+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:12.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:12.508+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:12.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:12.819+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:13.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:13.329+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:13.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:13.347+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:13.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:13.546+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:13.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:13.859+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:14.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:14.337+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:14.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:14.342+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:14.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:14.563+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:14.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:14.849+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:15.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:15.312+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:15.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:15.341+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:15.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:15.541+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:15.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:15.833+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:16.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:16.278+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:16.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:16.317+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:16.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:16.530+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:16.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:16.847+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:17.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:17.280+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:17.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:17.357+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:17.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:17.514+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:17.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:17.833+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:18.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:18.262+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:18.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:18.398+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:18.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:18.552+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:18.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:18.856+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:19.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:19.214+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:19.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:19.379+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:19.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:19.522+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:19.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:19.893+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:20.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:20.172+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:20.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:20.408+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:20.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:20.551+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:20.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:20.870+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:21.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:21.213+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:21.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:21.397+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:21.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:21.592+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:21.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:21.874+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:22.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:22.234+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:22.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:22.365+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:22.370 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:47:22.368+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:47:22.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:47:22.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:47:22.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:22.543+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:22.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:22.855+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:23.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:23.276+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:23.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:23.336+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:23.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:23.512+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:23.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:23.848+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:24.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:24.230+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:24.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:24.304+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:24.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:24.514+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:24.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:24.829+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:25.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:25.188+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:25.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:25.274+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:25.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:25.481+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:25.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:25.871+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:26.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:26.238+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:26.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:26.241+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:26.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:26.457+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:26.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:26.841+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:27.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:27.228+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:27.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:27.276+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:27.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:27.459+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:27.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:27.845+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:28.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:28.244+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:28.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:28.278+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:28.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:28.505+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:28.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:28.831+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:29.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:29.240+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:29.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:29.272+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:29.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:29.487+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:29.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:29.851+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:30.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:30.213+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:30.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:30.267+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:30.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:30.502+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:30.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:30.845+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:31.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:31.243+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:31.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:31.303+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:31.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:31.475+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:31.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:31.827+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:32.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:32.224+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:32.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:32.321+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:32.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:32.500+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:32.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:32.877+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:33.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:33.218+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:33.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:33.303+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:33.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:33.480+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:33.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:33.901+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:34.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:34.202+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:34.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:34.268+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:34.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:34.524+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:34.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:34.853+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:35.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:35.154+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:35.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:35.272+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:35.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:35.531+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:35.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:35.874+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:36.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:36.143+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:36.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:36.309+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:36.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:36.562+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:36.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:36.900+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:37.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:37.182+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:37.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:37.352+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:37.386 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:47:37.384+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:47:37.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:37.596+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:37.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:37.887+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:38.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:38.137+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:38.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:38.337+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:38.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:38.585+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:38.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:38.922+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:39.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:39.090+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:39.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:39.299+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:39.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:39.617+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:39.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:39.971+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:40.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:40.052+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:40.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:40.274+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:40.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:40.624+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:40.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:40.973+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:41.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:41.019+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:41.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:41.232+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:41.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:41.638+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:41.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:41.971+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:42.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:42.061+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:42.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:42.203+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:42.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:42.628+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:43.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:43.019+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:43.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:43.081+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:43.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:43.222+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:43.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:43.593+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:44.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:44.033+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:44.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:44.055+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:44.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:44.239+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:44.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:44.587+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:45.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:45.005+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:45.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:45.066+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:45.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:45.273+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:45.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:45.573+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:46.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:46.019+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:46.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:46.074+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:46.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:46.233+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:46.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:46.571+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:47.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:47.041+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:47.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:47.121+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:47.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:47.274+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:47.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:47.611+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:48.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:48.018+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:48.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:48.119+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:48.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:48.297+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:48.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:48.637+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:49.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:49.035+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:49.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:49.117+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:49.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:49.249+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:49.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:49.686+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:49.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:49.988+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:50.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:50.095+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:50.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:50.270+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:50.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:50.637+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:50.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:50.996+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:51.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:51.102+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:51.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:51.230+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:51.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:51.606+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:52.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:52.037+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:52.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:52.102+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:52.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:52.249+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:52.397 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:47:52.394+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:47:52.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:52.619+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:52.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:47:52.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:47:53.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:53.043+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:53.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:53.126+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:53.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:53.216+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:53.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:53.603+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:54.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:54.074+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:54.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:54.078+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:54.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:54.245+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:54.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:54.617+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:55.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:55.041+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:55.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:55.053+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:55.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:55.264+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:55.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:55.612+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:56.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:56.005+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:56.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:56.091+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:56.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:56.254+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:56.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:56.634+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:57.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:57.038+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:57.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:57.046+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:57.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:57.279+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:57.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:57.638+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:58.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:58.006+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:58.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:58.062+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:58.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:58.290+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:58.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:58.642+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:58.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:58.995+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:59.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:47:59.109+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:59.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:47:59.315+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:59.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:47:59.683+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:47:59.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:47:59.968+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:00.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:00.115+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:00.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:00.335+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:00.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:00.645+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:00.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:00.982+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:01.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:01.106+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:01.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:01.372+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:01.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:01.619+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:01.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:01.941+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:02.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:02.148+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:02.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:02.390+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:02.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:02.635+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:02.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:02.916+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:03.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:03.117+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:03.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:03.349+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:03.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:03.591+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:03.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:03.915+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:04.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:04.070+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:04.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:04.309+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:04.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:04.572+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:04.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:04.895+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:05.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:05.053+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:05.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:05.262+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:05.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:05.608+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:05.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:05.859+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:06.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:06.018+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:06.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:06.293+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:06.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:06.593+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:06.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:06.859+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:07.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:07.039+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:07.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:07.332+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:07.413 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:48:07.410+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:48:07.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:07.622+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:07.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:07.892+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:08.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:08.072+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:08.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:08.305+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:08.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:08.656+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:08.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:08.844+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:09.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:09.030+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:09.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:09.286+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:09.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:09.633+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:09.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:09.853+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:10.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:10.065+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:10.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:10.317+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:10.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:10.636+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:10.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:10.903+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:11.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:11.045+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:11.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:11.297+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:11.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:11.631+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:11.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:11.898+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:12.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:12.077+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:12.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:12.265+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:12.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:12.603+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:12.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:12.848+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:13.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:13.043+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:13.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:13.288+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:13.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:13.580+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:13.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:13.888+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:14.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:14.002+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:14.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:14.304+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:14.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:14.576+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:14.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:14.863+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:14.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:14.958+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:15.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:15.266+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:15.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:15.532+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:15.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:15.831+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:15.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:15.977+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:16.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:16.282+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:16.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:16.534+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:16.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:16.783+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:16.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:16.928+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:17.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:17.287+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:17.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:17.564+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:17.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:17.820+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:17.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:17.932+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:18.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:18.291+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:18.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:18.583+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:18.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:18.870+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:18.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:18.965+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:19.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:19.297+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:19.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:19.633+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:19.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:19.846+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:19.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:19.988+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:20.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:20.258+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:20.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:20.656+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:20.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:20.818+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:20.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:20.986+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:21.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:21.210+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:21.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:21.610+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:21.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:21.854+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:22.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:22.029+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:22.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:22.226+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:22.429 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:48:22.426+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:48:22.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:22.581+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:22.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:22.861+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:22.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:48:22.919 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:48:23.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:23.034+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:23.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:23.207+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:23.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:23.549+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:23.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:23.889+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:24.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:24.080+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:24.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:24.159+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:24.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:24.576+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:24.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:24.863+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:25.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:25.045+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:25.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:25.123+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:25.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:25.619+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:25.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:25.827+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:26.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:26.050+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:26.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:26.080+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:26.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:26.649+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:26.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:26.816+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:27.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:27.017+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:27.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:27.114+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:27.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:27.628+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:27.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:27.768+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:28.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:28.002+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:28.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:28.141+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:28.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:28.663+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:28.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:28.735+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:29.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:29.012+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:29.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:29.118+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:29.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:29.667+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:29.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:29.707+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:30.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:30.018+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:30.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:30.079+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:30.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:30.665+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:30.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:30.722+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:31.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:31.068+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:31.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:31.095+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:31.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:31.678+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:31.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:31.746+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:32.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:32.019+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:32.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:32.083+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:32.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:32.683+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:32.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:32.709+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:33.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:33.050+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:33.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:33.108+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:33.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:33.675+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:33.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:33.694+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:34.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:34.008+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:34.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:34.130+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:34.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:34.695+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:34.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:34.723+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:35.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:35.003+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:35.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:35.144+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:35.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:35.670+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:35.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:35.753+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:35.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:35.963+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:36.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:36.173+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:36.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:36.676+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:36.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:36.801+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:36.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:36.962+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:37.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:37.185+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:37.442 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:48:37.439+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:48:37.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:37.662+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:37.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:37.752+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:38.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:38.007+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:38.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:38.226+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:38.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:38.657+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:38.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:38.742+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:38.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:38.987+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:39.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:39.176+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:39.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:39.630+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:39.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:39.696+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:40.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:39.999+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:40.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:40.206+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:40.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:40.635+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:40.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:40.710+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:41.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:41.045+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:41.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:41.254+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:41.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:41.606+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:41.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:41.745+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:42.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:42.060+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:42.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:42.237+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:42.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:42.579+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:42.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:42.701+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:43.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:43.050+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:43.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:43.225+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:43.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:43.551+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:43.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:43.684+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:44.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:44.081+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:44.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:44.229+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:44.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:44.594+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:44.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:44.727+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:45.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:45.125+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:45.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:45.246+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:45.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:45.625+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:45.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:45.705+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:46.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:46.170+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:46.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:46.234+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:46.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:46.661+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:46.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:46.715+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:47.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:47.145+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:47.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:47.220+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:47.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:47.638+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:47.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:47.759+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:48.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:48.125+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:48.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:48.212+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:48.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:48.621+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:48.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:48.717+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:49.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:49.084+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:49.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:49.191+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:49.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:49.591+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:49.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:49.731+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:50.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:50.132+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:50.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:50.213+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:50.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:50.606+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:50.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:50.709+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:51.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:51.086+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:51.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:51.181+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:51.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:51.655+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:51.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:51.675+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:52.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:52.125+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:52.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:52.137+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:52.453 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:48:52.452+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:48:52.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:52.667+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:52.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:52.693+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:52.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:48:53.002 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:48:53.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:53.101+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:53.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:53.150+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:53.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:53.712+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:53.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:53.726+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:54.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:54.097+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:54.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:54.176+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:54.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:54.713+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:54.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:54.758+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:55.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:55.076+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:55.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:55.199+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:55.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:55.744+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:55.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:55.750+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:56.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:56.040+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:56.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:56.227+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:56.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:56.720+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:56.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:56.736+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:56.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:56.992+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:57.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:57.206+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:57.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:57.686+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:57.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:57.711+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:58.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:58.010+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:58.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:58.208+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:58.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:58.653+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:58.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:58.709+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:59.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:48:59.048+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:59.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:48:59.165+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:59.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:48:59.669+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:48:59.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:48:59.669+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:00.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:00.076+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:00.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:00.158+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:00.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:00.644+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:00.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:00.697+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:01.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:01.065+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:01.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:01.147+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:01.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:01.678+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:01.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:01.709+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:02.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:02.041+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:02.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:02.128+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:02.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:02.667+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:02.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:02.753+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:03.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:03.039+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:03.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:03.172+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:03.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:03.645+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:03.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:03.794+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:04.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:04.019+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:04.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:04.219+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:04.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:04.684+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:04.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:04.843+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:05.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:05.038+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:05.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:05.233+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:05.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:05.671+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:05.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:05.827+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:06.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:06.050+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:06.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:06.213+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:06.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:06.710+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:06.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:06.784+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:07.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:07.042+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:07.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:07.225+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:07.469 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:49:07.466+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:49:07.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:07.668+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:07.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:07.742+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:08.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:08.040+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:08.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:08.241+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:08.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:08.622+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:08.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:08.788+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:09.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:09.016+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:09.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:09.270+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:09.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:09.619+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:09.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:09.837+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:09.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:09.986+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:10.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:10.279+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:10.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:10.621+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:10.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:10.830+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:10.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:10.983+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:11.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:11.285+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:11.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:11.583+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:11.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:11.805+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:12.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:12.030+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:12.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:12.278+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:12.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:12.594+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:12.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:12.799+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:13.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:12.998+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:13.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:13.309+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:13.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:13.549+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:13.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:13.759+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:13.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:13.995+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:14.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:14.300+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:14.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:14.542+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:14.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:14.716+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:14.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:14.948+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:15.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:15.309+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:15.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:15.555+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:15.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:15.750+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:15.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:15.923+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:16.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:16.315+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:16.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:16.584+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:16.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:16.745+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:16.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:16.901+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:17.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:17.333+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:17.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:17.561+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:17.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:17.760+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:17.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:17.869+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:18.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:18.317+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:18.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:18.528+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:18.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:18.783+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:18.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:18.824+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:19.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:19.270+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:19.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:19.498+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:19.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:19.749+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:19.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:19.840+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:20.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:20.245+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:20.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:20.528+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:20.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:20.746+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:20.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:20.850+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:21.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:21.196+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:21.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:21.494+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:21.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:21.791+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:21.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:21.881+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:22.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:22.155+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:22.485 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:49:22.482+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:49:22.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:22.484+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:22.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:22.840+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:22.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:22.887+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:23.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:23.119+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:23.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:49:23.125 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:49:23.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:23.466+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:23.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:23.798+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:23.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:23.885+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:24.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:24.124+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:24.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:24.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:24.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:24.844+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:24.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:24.924+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:25.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:25.167+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:25.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:25.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:25.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:25.837+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:25.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:25.927+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:26.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:26.198+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:26.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:26.439+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:26.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:26.880+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:26.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:26.910+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:27.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:27.208+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:27.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:27.401+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:27.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:27.880+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:27.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:27.938+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:28.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:28.247+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:28.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:28.392+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:28.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:28.849+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:28.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:28.931+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:29.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:29.206+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:29.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:29.415+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:29.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:29.863+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:29.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:29.975+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:30.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:30.221+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:30.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:30.437+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:30.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:30.836+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:31.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:31.018+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:31.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:31.201+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:31.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:31.480+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:31.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:31.819+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:32.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:31.998+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:32.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:32.246+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:32.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:32.495+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:32.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:32.863+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:33.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:33.035+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:33.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:33.265+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:33.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:33.472+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:33.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:33.913+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:34.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:34.001+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:34.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:34.264+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:34.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:34.506+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:34.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:34.872+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:35.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:35.010+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:35.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:35.296+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:35.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:35.502+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:35.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:35.882+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:36.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:36.002+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:36.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:36.271+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:36.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:36.516+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:36.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:36.876+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:37.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:37.001+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:37.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:37.311+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:37.501 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:49:37.498+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:49:37.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:37.534+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:37.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:37.897+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:38.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:38.032+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:38.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:38.273+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:38.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:38.501+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:38.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:38.885+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:39.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:39.075+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:39.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:39.247+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:39.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:39.514+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:39.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:39.899+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:40.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:40.044+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:40.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:40.293+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:40.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:40.536+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:40.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:40.931+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:41.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:41.005+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:41.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:41.325+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:41.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:41.507+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:41.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:41.954+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:41.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:41.991+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:42.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:42.331+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:42.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:42.506+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:42.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:42.987+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:43.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:42.998+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:43.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:43.324+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:43.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:43.479+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:43.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:43.963+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:44.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:44.021+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:44.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:44.372+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:44.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:44.487+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:44.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:44.931+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:45.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:45.010+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:45.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:45.337+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:45.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:45.440+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:45.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:45.895+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:46.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:46.056+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:46.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:46.304+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:46.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:46.395+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:46.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:46.875+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:47.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:47.017+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:47.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:47.304+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:47.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:47.393+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:47.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:47.865+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:48.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:48.012+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:48.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:48.319+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:48.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:48.436+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:48.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:48.868+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:49.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:49.031+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:49.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:49.278+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:49.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:49.484+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:49.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:49.891+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:50.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:50.028+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:50.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:50.260+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:50.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:50.481+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:50.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:50.925+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:51.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:51.053+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:51.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:51.296+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:51.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:51.468+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:51.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:51.938+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:52.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:52.057+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:52.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:52.346+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:52.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:52.462+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:52.516 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:49:52.514+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:49:52.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:52.946+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:53.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:53.027+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:53.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:49:53.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:49:53.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:53.380+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:53.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:53.445+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:53.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:53.946+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:54.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:54.048+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:54.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:54.398+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:54.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:54.412+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:54.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:54.967+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:55.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:55.002+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:55.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:55.352+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:55.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:55.414+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:55.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:55.937+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:56.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:56.023+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:56.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:56.335+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:56.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:56.373+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:56.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:56.926+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:57.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:57.014+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:57.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:57.345+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:57.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:57.391+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:57.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:57.883+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:58.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:58.020+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:58.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:58.367+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:58.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:58.379+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:58.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:58.871+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:59.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:49:59.063+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:59.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:49:59.368+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:59.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:49:59.372+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:49:59.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:49:59.871+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:00.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:00.104+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:00.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:00.393+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:00.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:00.411+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:00.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:00.915+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:01.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:01.146+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:01.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:01.352+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:01.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:01.370+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:01.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:01.886+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:02.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:02.114+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:02.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:02.337+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:02.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:02.363+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:02.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:02.865+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:03.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:03.077+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:03.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:03.316+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:03.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:03.389+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:03.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:03.900+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:04.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:04.065+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:04.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:04.342+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:04.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:04.363+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:04.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:04.875+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:05.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:05.057+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:05.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:05.375+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:05.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:05.387+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:05.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:05.921+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:06.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:06.097+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:06.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:06.372+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:06.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:06.415+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:06.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:06.895+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:07.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:07.098+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:07.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:07.341+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:07.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:07.368+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:07.519 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:50:07.517+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:50:07.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:07.934+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:08.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:08.054+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:08.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:08.348+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:08.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:08.349+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:08.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:08.897+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:09.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:09.073+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:09.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:09.322+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:09.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:09.396+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:09.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:09.886+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:10.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:10.103+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:10.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:10.299+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:10.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:10.367+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:10.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:10.896+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:11.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:11.138+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:11.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:11.316+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:11.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:11.406+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:11.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:11.871+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:12.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:12.170+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:12.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:12.294+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:12.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:12.448+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:12.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:12.838+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:13.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:13.178+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:13.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:13.322+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:13.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:13.417+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:13.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:13.848+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:14.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:14.160+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:14.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:14.360+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:14.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:14.376+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:14.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:14.875+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:15.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:15.205+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:15.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:15.360+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:15.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:15.383+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:15.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:15.910+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:16.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:16.202+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:16.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:16.319+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:16.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:16.376+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:16.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:16.884+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:17.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:17.181+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:17.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:17.345+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:17.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:17.390+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:17.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:17.849+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:18.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:18.152+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:18.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:18.298+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:18.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:18.349+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:18.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:18.883+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:19.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:19.147+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:19.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:19.324+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:19.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:19.331+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:19.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:19.857+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:20.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:20.157+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:20.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:20.293+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:20.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:20.351+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:20.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:20.820+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:21.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:21.196+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:21.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:21.306+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:21.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:21.362+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:21.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:21.809+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:22.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:22.228+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:22.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:22.296+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:22.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:22.390+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:22.532 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:50:22.529+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:50:22.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:22.791+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:23.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:23.255+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:23.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:23.274+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:23.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:50:23.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:50:23.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:23.433+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:23.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:23.791+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:24.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:24.206+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:24.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:24.235+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:24.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:24.423+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:24.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:24.835+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:25.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:25.217+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:25.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:25.269+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:25.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:25.467+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:25.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:25.846+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:26.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:26.242+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:26.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:26.251+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:26.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:26.437+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:26.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:26.849+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:27.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:27.232+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:27.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:27.279+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:27.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:27.485+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:27.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:27.812+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:28.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:28.196+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:28.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:28.257+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:28.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:28.489+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:28.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:28.808+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:29.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:29.228+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:29.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:29.285+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:29.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:29.466+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:29.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:29.778+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:30.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:30.239+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:30.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:30.268+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:30.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:30.470+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:30.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:30.798+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:31.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:31.251+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:31.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:31.301+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:31.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:31.470+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:31.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:31.788+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:32.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:32.282+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:32.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:32.286+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:32.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:32.494+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:32.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:32.788+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:33.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:33.236+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:33.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:33.298+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:33.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:33.531+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:33.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:33.758+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:34.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:34.281+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:34.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:34.294+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:34.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:34.546+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:34.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:34.756+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:35.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:35.274+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:35.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:35.283+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:35.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:35.515+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:35.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:35.793+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:36.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:36.299+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:36.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:36.313+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:36.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:36.467+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:36.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:36.790+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:37.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:37.272+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:37.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:37.298+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:37.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:37.445+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:37.536 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:50:37.533+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:50:37.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:37.830+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:38.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:38.264+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:38.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:38.268+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:38.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:38.410+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:38.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:38.826+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:39.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:39.276+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:39.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:39.277+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:39.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:39.435+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:39.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:39.851+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:40.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:40.250+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:40.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:40.259+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:40.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:40.469+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:40.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:40.895+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:41.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:41.279+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:41.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:41.281+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:41.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:41.492+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:41.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:41.865+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:42.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:42.242+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:42.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:42.327+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:42.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:42.537+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:42.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:42.854+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:43.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:43.208+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:43.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:43.332+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:43.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:43.509+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:43.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:43.839+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:44.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:44.217+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:44.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:44.341+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:44.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:44.497+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:44.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:44.852+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:45.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:45.193+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:45.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:45.374+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:45.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:45.528+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:45.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:45.874+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:46.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:46.171+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:46.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:46.348+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:46.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:46.513+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:46.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:46.876+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:47.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:47.184+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:47.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:47.365+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:47.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:47.551+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:47.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:47.889+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:48.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:48.176+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:48.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:48.391+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:48.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:48.599+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:48.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:48.848+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:49.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:49.221+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:49.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:49.407+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:49.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:49.591+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:49.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:49.814+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:50.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:50.185+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:50.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:50.413+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:50.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:50.587+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:50.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:50.802+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:51.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:51.197+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:51.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:51.410+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:51.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:51.562+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:51.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:51.763+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:52.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:52.155+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:52.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:52.443+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:52.552 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:50:52.549+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:50:52.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:52.603+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:52.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:52.803+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:53.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:53.199+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:53.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:50:53.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:50:53.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:53.468+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:53.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:53.577+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:53.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:53.801+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:54.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:54.247+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:54.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:54.455+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:54.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:54.601+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:54.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:54.781+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:55.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:55.216+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:55.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:55.409+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:55.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:55.618+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:55.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:55.764+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:56.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:56.260+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:56.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:56.390+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:56.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:56.587+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:56.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:56.732+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:57.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:57.233+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:57.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:57.434+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:57.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:57.548+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:57.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:57.752+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:58.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:58.240+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:58.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:58.400+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:58.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:58.540+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:58.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:58.704+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:59.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:50:59.280+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:59.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:50:59.381+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:59.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:50:59.564+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:50:59.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:50:59.664+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:00.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:00.254+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:00.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:00.346+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:00.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:00.602+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:00.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:00.704+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:01.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:01.283+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:01.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:01.388+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:01.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:01.614+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:01.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:01.711+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:02.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:02.291+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:02.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:02.378+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:02.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:02.598+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:02.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:02.754+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:03.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:03.315+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:03.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:03.399+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:03.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:03.563+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:03.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:03.782+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:04.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:04.319+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:04.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:04.359+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:04.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:04.610+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:04.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:04.760+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:05.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:05.283+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:05.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:05.363+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:05.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:05.624+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:05.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:05.792+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:06.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:06.265+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:06.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:06.407+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:06.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:06.632+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:06.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:06.806+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:07.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:07.309+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:07.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:07.438+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:07.553 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:51:07.550+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:51:07.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:07.680+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:07.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:07.771+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:08.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:08.269+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:08.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:08.391+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:08.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:08.695+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:08.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:08.734+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:09.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:09.292+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:09.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:09.440+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:09.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:09.685+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:09.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:09.700+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:10.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:10.254+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:10.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:10.449+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:10.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:10.646+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:10.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:10.737+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:11.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:11.207+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:11.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:11.400+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:11.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:11.609+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:11.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:11.691+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:12.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:12.173+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:12.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:12.446+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:12.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:12.631+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:12.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:12.727+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:13.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:13.156+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:13.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:13.491+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:13.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:13.650+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:13.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:13.691+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:14.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:14.172+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:14.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:14.470+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:14.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:14.681+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:14.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:14.703+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:15.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:15.162+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:15.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:15.442+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:15.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:15.662+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:15.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:15.706+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:16.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:16.151+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:16.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:16.409+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:16.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:16.647+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:16.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:16.680+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:17.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:17.159+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:17.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:17.419+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:17.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:17.660+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:17.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:17.695+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:18.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:18.191+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:18.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:18.464+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:18.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:18.678+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:18.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:18.704+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:19.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:19.225+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:19.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:19.501+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:19.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:19.639+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:19.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:19.752+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:20.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:20.190+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:20.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:20.495+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:20.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:20.619+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:20.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:20.729+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:21.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:21.205+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:21.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:21.462+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:21.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:21.594+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:21.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:21.752+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:22.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:22.203+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:22.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:22.438+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:22.569 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:51:22.567+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:51:22.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:22.635+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:22.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:22.757+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:23.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:23.221+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:23.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:23.469+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:23.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:51:23.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:51:23.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:23.667+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:23.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:23.746+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:24.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:24.201+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:24.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:24.512+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:24.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:24.684+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:24.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:24.773+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:25.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:25.224+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:25.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:25.525+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:25.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:25.703+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:25.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:25.773+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:26.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:26.267+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:26.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:26.480+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:26.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:26.751+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:26.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:26.755+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:27.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:27.314+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:27.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:27.525+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:27.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:27.746+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:27.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:27.773+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:28.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:28.334+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:28.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:28.535+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:28.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:28.770+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:28.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:28.776+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:29.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:29.321+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:29.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:29.558+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:29.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:29.733+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:29.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:29.745+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:30.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:30.316+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:30.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:30.575+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:30.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:30.726+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:30.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:30.775+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:31.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:31.332+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:31.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:31.583+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:31.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:31.773+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:31.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:31.805+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:32.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:32.372+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:32.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:32.606+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:32.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:32.764+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:32.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:32.810+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:33.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:33.383+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:33.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:33.648+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:33.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:33.760+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:33.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:33.842+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:34.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:34.412+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:34.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:34.631+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:34.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:34.715+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:34.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:34.874+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:35.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:35.404+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:35.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:35.592+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:35.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:35.762+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:35.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:35.857+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:36.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:36.354+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:36.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:36.611+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:36.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:36.741+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:36.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:36.891+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:37.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:37.305+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:37.585 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:51:37.582+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:51:37.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:37.611+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:37.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:37.732+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:37.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:37.870+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:38.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:38.285+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:38.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:38.563+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:38.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:38.712+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:38.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:38.839+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:39.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:39.282+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:39.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:39.586+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:39.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:39.723+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:39.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:39.806+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:40.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:40.326+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:40.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:40.556+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:40.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:40.715+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:40.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:40.780+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:41.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:41.278+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:41.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:41.524+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:41.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:41.666+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:41.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:41.806+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:42.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:42.252+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:42.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:42.523+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:42.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:42.674+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:42.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:42.838+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:43.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:43.270+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:43.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:43.490+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:43.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:43.648+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:43.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:43.862+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:44.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:44.297+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:44.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:44.509+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:44.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:44.603+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:44.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:44.895+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:45.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:45.325+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:45.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:45.488+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:45.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:45.581+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:45.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:45.857+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:46.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:46.316+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:46.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:46.456+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:46.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:46.593+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:46.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:46.811+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:47.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:47.292+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:47.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:47.446+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:47.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:47.550+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:47.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:47.839+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:48.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:48.308+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:48.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:48.453+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:48.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:48.507+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:48.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:48.877+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:49.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:49.304+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:49.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:49.449+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:49.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:49.554+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:49.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:49.867+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:50.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:50.306+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:50.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:50.443+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:50.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:50.601+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:50.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:50.913+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:51.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:51.307+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:51.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:51.456+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:51.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:51.600+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:51.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:51.932+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:52.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:52.305+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:52.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:52.497+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:52.599 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:51:52.597+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:51:52.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:52.601+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:52.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:52.978+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:53.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:53.338+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:53.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:53.455+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:53.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:53.553+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:53.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:51:53.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:51:53.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:53.976+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:54.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:54.291+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:54.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:54.413+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:54.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:54.599+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:54.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:54.977+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:55.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:55.248+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:55.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:55.394+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:55.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:55.631+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:55.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:55.942+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:56.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:56.276+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:56.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:56.382+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:56.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:56.629+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:56.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:56.953+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:57.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:57.320+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:57.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:57.344+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:57.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:57.616+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:57.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:57.971+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:58.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:58.345+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:58.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:58.369+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:58.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:58.586+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:59.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:51:59.006+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:59.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:51:59.355+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:59.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:51:59.362+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:51:59.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:51:59.617+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:00.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:00.034+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:00.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:00.389+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:00.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:00.394+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:00.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:00.599+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:01.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:01.028+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:01.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:01.416+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:01.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:01.431+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:01.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:01.621+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:02.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:02.011+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:02.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:02.394+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:02.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:02.454+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:02.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:02.639+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:02.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:02.983+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:03.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:03.413+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:03.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:03.460+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:03.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:03.650+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:03.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:03.959+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:04.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:04.385+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:04.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:04.466+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:04.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:04.691+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:04.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:04.953+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:05.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:05.415+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:05.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:05.475+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:05.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:05.709+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:05.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:05.944+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:06.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:06.414+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:06.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:06.461+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:06.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:06.704+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:06.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:06.986+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:07.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:07.440+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:07.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:07.481+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:07.603 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:52:07.600+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:52:07.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:07.741+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:07.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:07.968+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:08.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:08.442+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:08.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:08.478+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:08.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:08.748+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:08.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:08.944+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:09.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:09.460+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:09.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:09.462+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:09.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:09.739+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:09.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:09.979+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:10.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:10.415+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:10.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:10.478+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:10.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:10.731+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:11.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:11.003+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:11.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:11.379+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:11.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:11.527+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:11.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:11.719+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:11.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:11.965+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:12.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:12.406+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:12.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:12.508+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:12.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:12.755+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:12.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:12.916+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:13.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:13.384+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:13.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:13.510+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:13.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:13.730+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:13.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:13.941+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:14.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:14.364+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:14.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:14.521+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:14.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:14.701+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:14.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:14.975+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:15.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:15.404+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:15.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:15.546+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:15.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:15.683+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:15.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:15.988+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:16.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:16.441+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:16.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:16.583+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:16.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:16.722+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:16.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:16.957+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:17.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:17.393+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:17.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:17.625+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:17.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:17.733+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:17.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:17.995+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:18.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:18.402+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:18.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:18.626+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:18.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:18.716+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:19.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:19.032+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:19.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:19.401+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:19.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:19.585+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:19.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:19.733+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:20.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:20.048+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:20.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:20.419+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:20.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:20.622+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:20.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:20.692+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:21.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:21.016+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:21.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:21.413+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:21.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:21.671+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:21.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:21.698+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:22.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:22.005+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:22.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:22.442+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:22.619 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:52:22.616+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:52:22.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:22.672+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:22.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:22.718+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:22.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:22.969+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:23.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:23.476+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:23.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:23.658+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:23.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:23.725+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:23.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:52:23.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:52:23.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:23.958+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:24.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:24.443+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:24.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:24.693+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:24.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:24.743+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:24.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:24.936+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:25.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:25.477+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:25.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:25.723+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:25.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:25.748+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:25.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:25.904+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:26.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:26.441+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:26.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:26.707+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:26.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:26.778+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:26.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:26.894+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:27.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:27.398+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:27.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:27.746+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:27.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:27.792+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:27.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:27.914+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:28.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:28.392+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:28.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:28.742+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:28.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:28.777+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:28.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:28.932+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:29.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:29.359+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:29.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:29.746+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:29.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:29.791+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:29.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:29.908+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:30.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:30.371+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:30.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:30.708+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:30.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:30.809+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:30.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:30.897+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:31.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:31.329+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:31.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:31.750+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:31.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:31.789+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:31.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:31.857+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:32.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:32.349+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:32.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:32.752+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:32.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:32.788+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:32.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:32.848+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:33.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:33.336+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:33.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:33.710+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:33.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:33.797+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:33.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:33.806+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:34.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:34.296+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:34.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:34.699+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:34.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:34.792+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:34.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:34.792+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:35.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:35.268+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:35.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:35.672+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:35.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:35.835+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:35.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:35.837+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:36.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:36.245+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:36.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:36.626+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:36.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:36.807+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:36.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:36.812+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:37.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:37.231+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:37.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:37.588+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:37.635 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:52:37.632+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:52:37.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:37.807+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:37.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:37.853+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:38.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:38.204+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:38.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:38.589+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:38.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:38.764+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:38.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:38.857+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:39.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:39.201+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:39.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:39.619+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:39.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:39.765+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:39.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:39.827+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:40.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:40.216+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:40.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:40.666+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:40.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:40.781+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:40.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:40.827+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:41.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:41.188+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:41.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:41.702+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:41.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:41.769+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:41.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:41.853+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:42.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:42.221+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:42.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:42.709+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:42.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:42.792+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:42.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:42.809+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:43.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:43.257+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:43.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:43.736+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:43.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:43.785+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:43.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:43.823+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:44.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:44.231+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:44.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:44.737+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:44.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:44.762+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:44.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:44.796+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:45.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:45.195+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:45.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:45.736+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:45.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:45.750+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:45.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:45.793+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:46.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:46.146+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:46.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:46.710+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:46.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:46.717+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:46.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:46.826+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:47.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:47.182+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:47.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:47.671+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:47.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:47.677+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:47.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:47.799+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:48.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:48.217+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:48.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:48.622+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:48.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:48.670+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:48.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:48.822+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:49.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:49.218+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:49.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:49.624+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:49.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:49.676+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:49.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:49.812+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:50.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:50.242+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:50.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:50.647+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:50.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:50.671+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:50.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:50.780+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:51.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:51.261+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:51.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:51.662+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:51.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:51.687+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:51.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:51.758+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:52.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:52.221+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:52.636 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:52:52.633+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:52:52.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:52.660+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:52.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:52.676+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:52.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:52.741+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:53.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:53.209+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:53.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:53.646+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:53.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:53.715+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:53.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:53.765+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:53.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:52:53.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:52:54.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:54.237+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:54.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:54.632+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:54.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:54.674+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:54.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:54.728+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:55.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:55.213+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:55.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:55.647+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:55.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:55.713+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:55.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:55.737+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:56.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:56.199+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:56.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:56.619+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:56.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:56.725+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:56.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:56.786+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:57.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:57.206+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:57.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:57.588+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:57.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:57.753+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:57.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:57.800+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:58.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:58.174+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:58.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:58.616+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:58.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:58.784+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:58.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:58.810+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:59.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:52:59.206+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:59.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:52:59.607+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:59.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:52:59.770+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:52:59.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:52:59.836+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:00.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:00.161+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:00.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:00.644+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:00.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:00.729+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:00.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:00.852+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:01.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:01.123+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:01.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:01.608+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:01.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:01.745+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:01.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:01.866+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:02.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:02.112+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:02.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:02.602+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:02.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:02.794+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:02.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:02.909+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:03.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:03.115+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:03.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:03.583+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:03.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:03.794+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:03.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:03.875+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:04.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:04.164+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:04.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:04.546+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:04.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:04.823+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:04.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:04.863+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:05.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:05.193+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:05.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:05.561+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:05.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:05.804+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:05.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:05.877+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:06.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:06.147+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:06.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:06.525+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:06.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:06.757+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:06.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:06.855+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:07.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:07.110+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:07.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:07.543+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:07.639 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:53:07.637+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:53:07.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:07.737+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:07.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:07.819+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:08.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:08.126+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:08.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:08.521+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:08.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:08.771+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:08.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:08.865+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:09.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:09.140+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:09.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:09.475+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:09.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:09.815+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:09.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:09.912+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:10.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:10.126+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:10.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:10.461+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:10.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:10.835+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:10.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:10.874+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:11.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:11.120+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:11.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:11.459+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:11.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:11.855+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:11.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:11.885+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:12.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:12.088+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:12.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:12.489+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:12.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:12.807+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:12.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:12.864+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:13.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:13.110+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:13.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:13.484+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:13.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:13.835+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:13.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:13.844+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:14.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:14.085+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:14.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:14.502+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:14.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:14.827+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:14.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:14.881+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:15.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:15.068+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:15.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:15.460+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:15.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:15.875+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:15.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:15.905+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:16.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:16.115+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:16.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:16.466+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:16.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:16.846+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:16.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:16.864+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:17.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:17.142+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:17.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:17.442+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:17.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:17.815+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:17.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:17.828+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:18.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:18.097+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:18.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:18.413+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:18.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:18.774+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:18.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:18.877+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:19.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:19.090+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:19.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:19.393+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:19.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:19.766+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:19.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:19.880+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:20.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:20.139+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:20.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:20.364+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:20.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:20.734+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:20.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:20.836+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:21.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:21.173+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:21.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:21.317+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:21.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:21.693+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:21.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:21.840+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:22.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:22.159+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:22.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:22.276+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:22.655 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:53:22.652+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:53:22.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:22.668+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:22.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:22.853+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:23.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:23.110+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:23.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:23.288+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:23.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:23.623+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:23.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:23.818+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:23.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:53:23.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:53:24.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:24.161+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:24.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:24.258+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:24.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:24.612+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:24.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:24.769+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:25.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:25.115+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:25.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:25.278+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:25.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:25.600+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:25.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:25.762+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:26.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:26.132+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:26.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:26.275+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:26.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:26.646+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:26.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:26.718+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:27.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:27.158+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:27.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:27.282+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:27.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:27.671+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:27.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:27.718+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:28.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:28.146+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:28.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:28.236+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:28.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:28.682+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:28.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:28.754+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:29.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:29.137+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:29.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:29.286+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:29.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:29.726+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:29.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:29.785+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:30.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:30.182+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:30.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:30.309+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:30.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:30.697+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:30.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:30.827+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:31.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:31.176+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:31.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:31.271+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:31.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:31.708+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:31.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:31.841+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:32.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:32.205+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:32.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:32.316+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:32.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:32.693+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:32.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:32.805+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:33.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:33.164+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:33.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:33.352+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:33.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:33.699+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:33.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:33.785+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:34.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:34.119+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:34.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:34.370+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:34.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:34.701+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:34.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:34.786+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:35.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:35.093+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:35.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:35.402+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:35.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:35.665+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:35.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:35.767+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:36.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:36.123+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:36.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:36.433+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:36.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:36.636+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:36.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:36.774+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:37.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:37.171+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:37.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:37.412+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:37.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:37.599+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:37.671 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:53:37.668+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:53:37.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:37.784+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:38.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:38.156+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:38.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:38.439+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:38.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:38.570+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:38.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:38.791+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:39.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:39.117+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:39.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:39.419+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:39.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:39.584+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:39.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:39.798+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:40.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:40.075+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:40.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:40.372+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:40.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:40.539+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:40.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:40.830+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:41.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:41.029+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:41.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:41.377+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:41.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:41.545+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:41.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:41.820+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:41.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:41.989+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:42.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:42.359+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:42.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:42.549+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:42.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:42.860+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:43.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:43.016+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:43.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:43.351+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:43.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:43.513+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:43.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:43.868+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:44.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:44.014+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:44.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:44.324+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:44.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:44.545+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:44.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:44.896+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:44.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:44.977+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:45.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:45.331+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:45.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:45.570+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:45.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:45.847+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:45.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:45.955+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:46.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:46.315+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:46.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:46.533+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:46.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:46.854+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:46.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:46.947+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:47.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:47.324+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:47.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:47.532+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:47.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:47.886+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:47.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:47.935+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:48.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:48.372+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:48.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:48.507+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:48.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:48.859+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:48.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:48.960+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:49.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:49.364+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:49.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:49.481+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:49.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:49.854+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:49.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:49.930+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:50.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:50.410+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:50.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:50.437+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:50.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:50.896+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:50.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:50.916+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:51.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:51.395+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:51.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:51.421+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:51.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:51.855+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:51.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:51.949+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:52.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:52.367+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:52.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:52.372+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:52.686 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:53:52.684+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:53:52.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:52.842+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:52.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:52.949+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:53.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:53.326+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:53.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:53.353+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:53.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:53.819+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:53.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:53.970+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:54.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:53:54.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:53:54.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:54.310+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:54.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:54.314+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:54.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:54.784+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:54.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:54.939+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:55.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:55.279+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:55.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:55.317+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:55.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:55.773+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:55.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:55.912+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:56.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:56.276+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:56.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:56.319+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:56.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:56.750+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:56.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:56.920+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:57.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:57.265+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:57.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:57.368+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:57.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:57.764+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:57.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:57.872+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:58.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:58.225+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:58.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:58.323+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:58.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:58.769+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:58.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:58.862+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:59.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:53:59.224+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:59.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:53:59.280+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:59.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:53:59.734+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:53:59.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:53:59.870+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:00.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:00.226+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:00.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:00.266+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:00.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:00.756+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:00.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:00.876+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:01.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:01.209+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:01.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:01.296+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:01.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:01.731+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:01.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:01.867+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:02.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:02.172+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:02.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:02.277+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:02.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:02.701+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:02.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:02.915+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:03.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:03.188+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:03.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:03.237+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:03.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:03.699+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:03.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:03.919+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:04.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:04.149+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:04.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:04.214+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:04.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:04.711+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:04.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:04.954+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:05.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:05.153+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:05.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:05.170+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:05.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:05.667+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:05.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:05.966+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:06.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:06.130+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:06.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:06.193+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:06.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:06.655+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:06.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:06.931+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:07.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:07.115+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:07.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:07.235+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:07.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:07.618+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:07.702 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:54:07.699+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:54:07.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:07.920+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:08.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:08.069+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:08.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:08.224+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:08.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:08.581+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:08.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:08.924+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:09.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:09.038+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:09.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:09.231+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:09.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:09.573+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:09.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:09.946+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:09.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:09.995+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:10.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:10.251+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:10.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:10.572+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:10.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:10.944+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:10.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:10.979+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:11.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:11.219+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:11.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:11.556+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:11.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:11.949+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:12.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:11.998+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:12.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:12.198+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:12.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:12.536+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:12.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:12.973+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:12.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:12.975+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:13.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:13.219+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:13.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:13.503+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:13.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:13.955+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:13.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:13.959+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:14.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:14.182+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:14.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:14.537+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:14.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:14.924+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:14.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:14.954+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:15.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:15.204+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:15.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:15.520+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:15.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:15.907+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:15.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:15.954+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:16.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:16.217+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:16.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:16.512+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:16.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:16.914+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:16.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:16.966+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:17.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:17.200+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:17.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:17.467+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:17.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:17.934+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:17.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:17.954+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:18.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:18.250+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:18.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:18.450+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:18.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:18.920+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:18.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:18.944+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:19.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:19.296+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:19.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:19.461+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:19.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:19.895+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:19.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:19.942+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:20.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:20.343+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:20.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:20.452+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:20.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:20.918+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:20.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:20.938+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:21.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:21.354+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:21.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:21.425+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:21.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:21.905+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:21.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:21.925+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:22.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:22.335+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:22.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:22.426+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:22.718 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:54:22.716+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:54:22.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:22.884+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:22.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:22.933+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:23.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:23.365+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:23.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:23.451+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:23.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:23.848+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:23.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:23.924+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:24.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:54:24.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:54:24.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:24.381+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:24.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:24.433+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:24.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:24.856+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:24.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:24.970+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:25.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:25.353+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:25.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:25.440+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:25.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:25.904+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:25.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:25.959+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:26.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:26.328+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:26.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:26.459+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:26.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:26.855+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:26.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:26.985+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:27.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:27.363+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:27.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:27.419+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:27.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:27.864+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:27.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:27.972+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:28.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:28.316+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:28.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:28.450+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:28.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:28.817+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:28.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:28.941+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:29.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:29.353+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:29.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:29.452+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:29.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:29.772+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:29.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:29.978+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:30.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:30.338+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:30.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:30.495+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:30.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:30.766+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:30.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:30.981+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:31.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:31.324+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:31.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:31.526+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:31.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:31.788+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:32.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:32.015+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:32.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:32.353+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:32.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:32.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:32.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:32.745+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:33.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:33.004+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:33.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:33.322+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:33.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:33.454+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:33.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:33.794+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:34.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:34.052+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:34.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:34.273+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:34.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:34.468+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:34.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:34.750+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:35.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:35.057+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:35.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:35.268+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:35.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:35.450+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:35.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:35.773+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:36.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:36.040+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:36.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:36.286+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:36.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:36.451+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:36.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:36.823+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:37.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:37.072+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:37.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:37.265+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:37.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:37.415+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:37.734 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:54:37.731+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:54:37.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:37.816+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:38.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:38.045+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:38.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:38.254+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:38.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:38.371+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:38.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:38.866+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:39.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:39.013+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:39.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:39.213+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:39.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:39.400+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:39.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:39.914+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:39.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:39.993+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:40.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:40.195+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:40.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:40.449+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:40.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:40.874+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:40.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:40.948+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:41.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:41.156+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:41.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:41.402+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:41.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:41.881+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:41.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:41.939+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:42.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:42.135+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:42.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:42.443+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:42.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:42.882+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:42.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:42.964+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:43.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:43.156+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:43.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:43.481+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:43.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:43.838+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:43.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:43.939+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:44.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:44.133+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:44.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:44.440+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:44.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:44.815+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:44.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:44.897+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:45.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:45.156+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:45.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:45.478+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:45.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:45.776+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:45.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:45.899+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:46.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:46.154+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:46.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:46.511+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:46.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:46.794+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:46.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:46.896+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:47.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:47.135+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:47.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:47.487+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:47.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:47.819+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:47.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:47.925+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:48.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:48.166+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:48.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:48.488+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:48.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:48.806+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:48.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:48.953+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:49.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:49.141+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:49.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:49.525+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:49.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:49.805+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:49.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:49.936+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:50.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:50.104+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:50.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:50.531+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:50.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:50.760+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:50.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:50.931+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:51.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:51.102+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:51.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:51.568+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:51.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:51.721+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:51.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:51.923+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:52.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:52.064+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:52.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:52.555+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:52.749 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:54:52.747+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:54:52.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:52.752+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:52.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:52.906+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:53.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:53.023+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:53.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:53.604+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:53.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:53.758+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:53.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:53.949+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:54.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:54.031+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:54.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:54:54.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:54:54.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:54.572+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:54.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:54.735+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:54.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:54.978+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:55.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:55.003+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:55.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:55.587+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:55.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:55.707+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:56.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:55.999+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:56.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:56.026+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:56.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:56.605+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:56.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:56.733+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:57.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:57.039+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:57.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:57.052+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:57.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:57.638+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:57.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:57.732+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:58.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:58.017+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:58.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:58.047+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:58.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:58.625+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:58.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:58.724+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:58.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:58.987+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:59.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:54:59.079+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:59.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:54:59.662+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:59.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:54:59.720+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:54:59.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:54:59.981+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:00.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:00.084+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:00.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:00.642+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:00.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:00.752+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:00.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:00.940+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:01.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:01.107+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:01.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:01.663+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:01.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:01.732+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:01.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:01.923+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:02.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:02.130+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:02.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:02.627+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:02.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:02.733+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:02.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:02.892+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:03.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:03.086+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:03.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:03.598+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:03.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:03.763+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:03.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:03.862+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:04.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:04.066+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:04.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:04.566+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:04.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:04.790+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:04.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:04.831+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:05.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:05.097+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:05.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:05.590+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:05.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:05.806+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:05.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:05.857+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:06.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:06.136+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:06.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:06.615+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:06.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:06.819+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:06.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:06.850+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:07.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:07.139+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:07.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:07.609+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:07.759 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:55:07.756+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:55:07.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:07.816+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:07.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:07.837+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:08.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:08.127+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:08.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:08.598+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:08.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:08.848+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:08.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:08.871+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:09.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:09.102+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:09.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:09.559+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:09.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:09.819+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:09.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:09.896+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:10.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:10.071+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:10.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:10.596+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:10.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:10.800+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:10.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:10.857+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:11.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:11.099+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:11.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:11.599+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:11.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:11.825+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:11.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:11.837+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:12.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:12.127+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:12.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:12.590+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:12.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:12.796+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:12.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:12.812+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:13.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:13.126+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:13.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:13.627+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:13.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:13.750+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:13.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:13.860+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:14.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:14.113+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:14.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:14.600+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:14.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:14.782+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:14.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:14.860+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:15.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:15.157+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:15.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:15.590+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:15.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:15.774+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:15.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:15.846+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:16.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:16.204+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:16.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:16.617+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:16.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:16.770+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:16.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:16.875+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:17.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:17.171+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:17.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:17.637+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:17.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:17.735+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:17.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:17.917+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:18.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:18.181+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:18.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:18.645+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:18.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:18.699+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:18.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:18.899+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:19.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:19.192+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:19.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:19.622+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:19.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:19.692+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:19.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:19.940+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:20.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:20.164+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:20.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:20.642+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:20.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:20.658+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:20.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:20.963+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:21.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:21.212+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:21.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:21.598+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:21.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:21.674+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:22.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:22.006+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:22.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:22.191+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:22.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:22.639+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:22.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:22.643+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:22.775 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:55:22.772+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:55:23.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:23.035+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:23.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:23.214+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:23.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:23.668+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:23.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:23.678+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:24.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:24.063+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:24.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:24.216+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:24.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:55:24.452 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:55:24.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:24.666+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:24.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:24.707+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:25.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:25.091+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:25.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:25.210+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:25.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:25.706+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:25.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:25.734+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:26.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:26.075+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:26.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:26.257+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:26.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:26.658+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:26.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:26.769+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:27.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:27.124+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:27.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:27.218+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:27.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:27.621+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:27.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:27.776+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:28.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:28.086+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:28.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:28.248+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:28.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:28.630+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:28.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:28.818+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:29.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:29.045+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:29.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:29.230+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:29.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:29.597+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:29.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:29.854+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:30.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:30.024+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:30.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:30.219+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:30.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:30.645+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:30.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:30.863+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:31.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:31.025+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:31.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:31.242+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:31.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:31.677+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:31.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:31.890+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:31.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:31.976+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:32.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:32.236+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:32.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:32.630+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:32.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:32.922+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:32.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:32.943+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:33.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:33.192+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:33.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:33.606+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:33.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:33.929+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:33.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:33.966+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:34.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:34.176+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:34.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:34.568+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:34.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:34.918+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:34.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:34.956+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:35.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:35.215+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:35.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:35.592+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:35.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:35.914+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:35.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:35.932+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:36.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:36.180+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:36.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:36.636+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:36.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:36.941+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:36.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:36.976+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:37.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:37.132+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:37.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:37.638+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:37.791 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:55:37.789+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:55:37.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:37.956+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:37.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:37.982+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:38.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:38.147+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:38.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:38.678+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:38.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:38.938+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:38.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:38.983+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:39.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:39.148+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:39.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:39.694+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:39.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:39.953+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:39.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:39.993+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:40.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:40.180+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:40.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:40.693+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:40.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:40.943+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:40.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:40.966+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:41.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:41.190+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:41.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:41.734+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:41.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:41.942+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:41.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:41.986+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:42.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:42.229+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:42.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:42.743+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:42.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:42.949+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:42.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:42.984+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:43.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:43.232+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:43.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:43.760+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:43.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:43.967+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:44.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:44.003+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:44.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:44.191+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:44.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:44.743+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:45.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:45.014+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:45.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:45.023+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:45.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:45.217+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:45.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:45.748+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:45.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:45.984+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:46.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:46.023+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:46.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:46.197+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:46.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:46.739+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:46.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:46.991+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:47.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:47.002+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:47.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:47.241+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:47.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:47.730+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:48.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:48.012+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:48.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:48.025+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:48.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:48.248+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:48.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:48.684+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:49.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:49.012+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:49.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:49.034+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:49.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:49.266+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:49.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:49.648+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:49.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:49.992+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:49.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:49.994+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:50.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:50.303+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:50.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:50.603+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:50.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:50.954+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:50.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:50.978+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:51.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:51.326+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:51.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:51.571+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:51.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:51.935+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:52.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:52.017+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:52.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:52.350+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:52.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:52.602+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:52.807 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:55:52.804+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:55:52.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:52.973+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:53.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:53.002+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:53.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:53.392+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:53.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:53.615+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:53.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:53.951+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:54.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:54.050+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:54.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:54.420+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:54.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:55:54.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:54.592+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:54.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:55:54.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:54.923+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:55.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:55.001+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:55.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:55.428+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:55.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:55.596+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:55.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:55.922+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:56.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:56.039+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:56.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:56.398+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:56.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:56.597+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:56.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:56.884+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:57.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:57.046+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:57.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:57.400+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:57.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:57.578+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:57.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:57.881+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:58.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:58.008+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:58.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:58.391+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:58.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:58.599+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:58.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:58.915+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:59.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:59.009+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:59.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:55:59.396+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:59.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:55:59.555+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:59.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:55:59.961+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:55:59.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:55:59.979+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:00.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:00.367+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:00.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:00.534+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:00.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:00.962+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:01.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:00.999+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:01.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:01.352+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:01.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:01.513+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:01.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:01.915+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:02.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:02.007+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:02.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:02.315+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:02.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:02.491+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:02.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:02.889+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:03.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:03.001+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:03.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:03.301+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:03.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:03.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:03.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:03.920+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:04.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:03.998+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:04.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:04.312+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:04.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:04.492+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:04.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:04.891+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:04.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:04.962+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:05.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:05.331+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:05.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:05.511+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:05.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:05.922+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:05.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:05.949+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:06.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:06.362+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:06.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:06.486+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:06.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:06.930+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:07.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:06.999+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:07.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:07.393+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:07.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:07.492+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:07.822 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:56:07.821+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:56:07.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:07.967+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:08.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:08.029+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:08.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:08.373+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:08.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:08.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:09.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:09.009+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:09.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:09.027+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:09.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:09.356+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:09.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:09.496+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:10.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:09.998+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:10.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:10.036+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:10.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:10.352+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:10.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:10.467+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:10.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:10.996+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:11.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:11.047+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:11.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:11.381+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:11.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:11.499+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:11.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:11.990+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:12.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:12.058+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:12.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:12.366+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:12.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:12.464+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:13.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:13.039+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:13.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:13.081+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:13.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:13.387+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:13.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:13.431+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:14.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:13.999+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:14.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:14.071+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:14.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:14.391+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:14.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:14.394+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:14.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:14.956+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:15.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:15.035+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:15.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:15.385+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:15.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:15.425+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:15.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:15.952+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:15.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:15.996+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:16.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:16.352+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:16.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:16.463+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:16.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:16.914+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:17.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:17.011+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:17.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:17.347+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:17.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:17.424+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:17.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:17.866+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:18.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:18.042+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:18.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:18.359+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:18.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:18.446+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:18.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:18.868+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:19.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:19.012+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:19.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:19.372+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:19.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:19.475+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:19.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:19.907+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:19.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:19.991+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:20.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:20.412+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:20.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:20.488+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:20.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:20.858+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:21.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:21.008+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:21.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:21.423+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:21.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:21.494+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:21.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:21.829+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:22.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:22.021+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:22.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:22.429+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:22.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:22.452+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:22.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:22.817+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:22.838 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:56:22.835+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:56:23.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:23.062+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:23.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:23.430+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:23.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:23.462+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:23.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:23.784+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:24.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:24.027+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:24.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:24.450+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:24.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:24.505+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:24.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:56:24.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:56:24.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:24.784+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:25.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:25.022+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:25.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:25.457+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:25.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:25.471+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:25.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:25.735+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:26.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:26.004+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:26.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:26.427+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:26.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:26.484+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:26.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:26.695+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:27.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:27.048+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:27.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:27.412+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:27.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:27.520+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:27.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:27.694+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:28.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:28.072+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:28.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:28.414+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:28.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:28.521+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:28.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:28.700+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:29.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:29.081+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:29.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:29.426+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:29.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:29.500+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:29.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:29.713+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:30.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:30.093+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:30.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:30.456+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:30.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:30.482+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:30.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:30.718+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:31.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:31.050+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:31.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:31.421+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:31.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:31.474+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:31.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:31.729+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:32.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:32.012+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:32.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:32.471+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:32.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:32.472+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:32.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:32.719+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:33.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:33.012+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:33.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:33.425+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:33.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:33.476+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:33.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:33.686+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:34.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:34.045+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:34.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:34.388+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:34.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:34.485+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:34.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:34.727+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:35.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:35.043+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:35.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:35.400+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:35.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:35.514+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:35.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:35.687+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:35.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:35.994+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:36.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:36.412+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:36.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:36.467+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:36.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:36.733+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:37.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:37.023+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:37.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:37.423+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:37.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:37.443+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:37.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:37.722+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:37.851 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:56:37.849+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:56:38.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:38.067+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:38.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:38.428+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:38.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:38.448+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:38.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:38.718+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:39.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:39.047+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:39.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:39.398+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:39.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:39.411+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:39.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:39.753+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:40.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:40.034+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:40.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:40.415+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:40.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:40.432+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:40.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:40.779+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:41.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:41.079+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:41.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:41.387+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:41.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:41.459+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:41.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:41.776+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:42.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:42.084+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:42.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:42.361+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:42.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:42.413+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:42.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:42.801+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:43.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:43.058+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:43.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:43.317+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:43.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:43.424+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:43.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:43.847+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:44.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:44.079+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:44.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:44.274+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:44.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:44.462+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:44.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:44.850+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:45.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:45.122+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:45.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:45.277+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:45.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:45.465+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:45.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:45.841+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:46.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:46.125+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:46.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:46.230+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:46.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:46.509+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:46.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:46.886+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:47.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:47.098+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:47.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:47.236+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:47.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:47.537+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:47.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:47.847+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:48.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:48.073+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:48.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:48.229+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:48.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:48.551+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:48.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:48.859+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:49.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:49.058+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:49.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:49.235+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:49.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:49.598+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:49.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:49.850+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:50.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:50.066+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:50.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:50.272+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:50.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:50.553+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:50.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:50.809+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:51.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:51.024+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:51.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:51.253+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:51.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:51.574+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:51.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:51.838+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:52.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:52.053+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:52.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:52.283+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:52.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:52.550+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:52.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:52.841+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:52.867 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:56:52.864+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:56:53.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:53.095+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:53.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:53.329+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:53.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:53.576+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:53.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:53.862+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:54.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:54.084+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:54.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:54.372+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:54.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:54.548+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:54.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:56:54.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:56:54.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:54.844+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:55.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:55.038+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:55.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:55.337+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:55.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:55.538+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:55.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:55.838+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:56.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:55.999+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:56.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:56.371+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:56.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:56.528+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:56.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:56.798+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:56.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:56.978+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:57.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:57.398+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:57.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:57.502+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:57.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:57.768+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:58.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:58.009+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:58.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:58.419+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:58.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:58.513+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:58.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:58.751+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:59.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:59.004+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:59.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:56:59.464+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:59.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:56:59.470+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:59.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:56:59.775+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:56:59.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:56:59.980+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:00.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:00.459+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:00.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:00.489+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:00.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:00.777+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:01.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:01.023+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:01.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:01.481+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:01.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:01.492+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:01.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:01.764+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:02.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:02.041+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:02.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:02.456+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:02.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:02.487+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:02.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:02.721+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:03.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:03.074+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:03.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:03.436+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:03.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:03.475+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:03.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:03.756+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:04.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:04.121+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:04.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:04.454+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:04.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:04.456+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:04.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:04.734+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:05.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:05.086+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:05.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:05.454+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:05.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:05.499+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:05.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:05.720+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:06.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:06.040+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:06.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:06.450+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:06.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:06.472+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:06.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:06.677+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:07.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:07.017+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:07.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:07.496+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:07.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:07.512+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:07.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:07.652+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:07.883 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:57:07.880+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:57:08.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:08.035+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:08.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:08.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:08.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:08.490+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:08.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:08.678+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:09.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:09.064+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:09.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:09.441+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:09.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:09.450+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:09.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:09.693+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:10.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:10.029+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:10.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:10.414+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:10.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:10.482+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:10.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:10.680+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:11.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:11.029+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:11.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:11.418+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:11.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:11.442+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:11.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:11.670+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:12.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:12.017+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:12.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:12.451+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:12.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:12.483+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:12.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:12.711+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:13.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:13.016+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:13.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:13.467+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:13.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:13.494+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:13.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:13.667+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:14.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:14.024+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:14.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:14.447+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:14.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:14.460+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:14.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:14.680+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:15.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:15.049+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:15.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:15.418+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:15.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:15.474+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:15.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:15.729+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:16.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:16.039+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:16.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:16.413+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:16.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:16.437+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:16.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:16.692+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:17.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:17.063+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:17.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:17.393+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:17.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:17.395+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:17.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:17.664+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:18.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:18.037+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:18.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:18.363+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:18.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:18.435+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:18.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:18.696+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:19.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:19.033+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:19.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:19.349+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:19.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:19.436+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:19.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:19.654+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:20.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:20.063+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:20.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:20.345+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:20.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:20.464+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:20.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:20.678+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:21.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:21.111+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:21.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:21.324+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:21.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:21.499+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:21.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:21.660+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:22.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:22.080+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:22.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:22.325+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:22.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:22.470+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:22.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:22.702+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:22.899 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:57:22.897+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:57:23.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:23.042+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:23.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:23.291+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:23.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:23.442+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:23.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:23.665+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:24.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:24.065+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:24.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:24.335+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:24.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:24.421+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:24.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:24.641+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:24.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:57:24.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:57:25.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:25.024+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:25.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:25.371+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:25.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:25.457+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:25.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:25.624+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:26.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:26.067+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:26.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:26.417+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:26.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:26.447+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:26.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:26.629+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:27.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:27.095+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:27.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:27.425+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:27.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:27.429+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:27.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:27.598+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:28.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:28.125+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:28.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:28.401+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:28.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:28.455+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:28.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:28.609+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:29.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:29.078+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:29.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:29.405+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:29.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:29.497+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:29.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:29.610+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:30.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:30.114+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:30.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:30.369+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:30.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:30.522+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:30.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:30.574+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:31.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:31.164+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:31.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:31.361+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:31.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:31.545+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:31.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:31.546+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:32.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:32.169+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:32.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:32.352+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:32.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:32.507+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:32.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:32.577+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:33.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:33.152+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:33.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:33.351+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:33.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:33.532+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:33.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:33.563+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:34.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:34.105+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:34.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:34.331+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:34.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:34.502+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:34.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:34.578+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:35.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:35.087+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:35.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:35.297+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:35.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:35.504+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:35.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:35.606+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:36.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:36.088+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:36.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:36.325+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:36.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:36.541+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:36.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:36.580+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:37.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:37.091+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:37.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:37.315+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:37.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:37.493+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:37.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:37.603+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:37.915 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:57:37.912+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:57:38.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:38.047+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:38.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:38.311+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:38.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:38.476+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:38.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:38.638+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:39.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:39.092+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:39.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:39.314+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:39.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:39.523+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:39.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:39.603+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:40.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:40.130+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:40.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:40.272+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:40.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:40.525+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:40.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:40.624+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:41.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:41.090+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:41.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:41.252+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:41.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:41.497+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:41.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:41.620+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:42.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:42.069+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:42.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:42.211+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:42.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:42.467+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:42.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:42.666+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:43.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:43.025+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:43.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:43.214+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:43.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:43.517+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:43.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:43.657+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:44.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:44.043+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:44.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:44.177+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:44.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:44.493+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:44.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:44.612+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:45.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:45.062+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:45.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:45.223+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:45.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:45.497+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:45.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:45.637+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:46.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:46.058+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:46.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:46.240+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:46.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:46.448+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:46.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:46.627+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:47.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:47.082+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:47.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:47.250+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:47.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:47.420+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:47.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:47.630+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:48.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:48.095+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:48.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:48.282+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:48.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:48.390+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:48.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:48.583+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:49.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:49.116+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:49.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:49.290+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:49.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:49.428+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:49.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:49.596+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:50.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:50.113+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:50.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:50.332+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:50.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:50.432+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:50.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:50.584+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:51.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:51.074+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:51.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:51.380+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:51.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:51.405+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:51.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:51.609+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:52.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:52.102+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:52.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:52.413+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:52.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:52.432+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:52.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:52.567+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:52.930 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:57:52.928+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:57:53.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:53.116+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:53.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:53.368+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:53.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:53.461+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:53.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:53.617+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:54.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:54.112+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:54.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:54.386+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:54.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:54.500+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:54.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:54.645+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:55.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:57:55.025 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:57:55.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:55.112+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:55.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:55.349+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:55.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:55.523+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:55.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:55.602+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:56.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:56.157+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:56.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:56.300+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:56.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:56.493+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:56.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:56.571+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:57.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:57.134+0000 7f389e18e700 -1 osd.4 104 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:57.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:57.307+0000 7f596d92c700 -1 osd.6 104 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:57.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:57.531+0000 7f72c425d700 -1 osd.5 104 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:57.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:57.603+0000 7f6e44c9f700 -1 osd.7 104 get_health_metrics reporting 41 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:57.640 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-03T23:57:57.638+0000 7fee7d9d8700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:57:57.654 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-03T23:57:57.638+0000 7fee7d9d8700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-03T23:57:57.676 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-03T23:57:58.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:58.114+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:58.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:58.351+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:58.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:58.573+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:58.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:58.583+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:59.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:57:59.117+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:59.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:57:59.387+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:59.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:57:59.557+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:57:59.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:57:59.606+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:00.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:00.163+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:00.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:00.380+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:00.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:00.602+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:00.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:00.610+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:01.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:01.193+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:01.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:01.389+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:01.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:01.593+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:01.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:01.595+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:02.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:02.158+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:02.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:02.341+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:02.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:02.562+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:02.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:02.567+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:03.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:03.151+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:03.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:03.297+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:03.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:03.534+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:03.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:03.605+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:04.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:04.125+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:04.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:04.250+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:04.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:04.506+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:04.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:04.646+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:05.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:05.113+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:05.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:05.227+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:05.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:05.521+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:05.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:05.643+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:06.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:06.077+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:06.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:06.190+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:06.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:06.541+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:06.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:06.661+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:07.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:07.100+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:07.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:07.201+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:07.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:07.566+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:07.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:07.623+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:07.941 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:58:07.938+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:58:08.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:08.051+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:08.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:08.183+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:08.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:08.536+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:08.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:08.647+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:09.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:09.021+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:09.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:09.156+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:09.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:09.508+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:09.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:09.616+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:10.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:10.069+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:10.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:10.200+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:10.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:10.461+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:10.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:10.582+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:11.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:11.089+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:11.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:11.224+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:11.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:11.476+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:11.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:11.546+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:12.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:12.067+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:12.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:12.180+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:12.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:12.442+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:12.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:12.499+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:13.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:13.080+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:13.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:13.225+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:13.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:13.452+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:13.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:13.467+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:14.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:14.035+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:14.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:14.181+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:14.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:14.427+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:14.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:14.471+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:15.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:15.007+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:15.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:15.188+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:15.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:15.406+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:15.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:15.476+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:16.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:16.053+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:16.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:16.199+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:16.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:16.375+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:16.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:16.440+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:17.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:17.039+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:17.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:17.158+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:17.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:17.377+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:17.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:17.487+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:18.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:18.006+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:18.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:18.135+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:18.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:18.387+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:18.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:18.529+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:18.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:18.971+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:19.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:19.111+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:19.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:19.383+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:19.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:19.530+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:19.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:19.931+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:20.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:20.133+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:20.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:20.348+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:20.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:20.568+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:20.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:20.923+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:21.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:21.119+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:21.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:21.348+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:21.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:21.566+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:21.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:21.898+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:22.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:22.122+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:22.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:22.372+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:22.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:22.551+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:22.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:22.889+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:22.957 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:58:22.954+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:58:23.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:23.074+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:23.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:23.350+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:23.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:23.525+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:23.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:23.841+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:24.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:24.056+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:24.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:24.311+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:24.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:24.551+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:24.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:24.814+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:25.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:25.074+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:25.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:58:25.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:58:25.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:25.359+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:25.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:25.559+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:25.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:25.806+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:26.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:26.058+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:26.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:26.345+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:26.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:26.530+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:26.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:26.846+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:27.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:27.095+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:27.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:27.361+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:27.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:27.509+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:27.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:27.891+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:28.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:28.096+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:28.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:28.332+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:28.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:28.526+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:28.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:28.864+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:29.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:29.131+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:29.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:29.300+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:29.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:29.509+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:29.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:29.913+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:30.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:30.108+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:30.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:30.330+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:30.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:30.533+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:30.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:30.956+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:31.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:31.089+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:31.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:31.353+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:31.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:31.582+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:31.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:31.938+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:32.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:32.053+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:32.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:32.353+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:32.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:32.575+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:32.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:32.980+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:33.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:33.029+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:33.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:33.353+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:33.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:33.535+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:34.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:34.010+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:34.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:34.049+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:34.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:34.371+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:34.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:34.536+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:35.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:35.036+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:35.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:35.097+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:35.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:35.334+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:35.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:35.513+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:36.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:36.025+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:36.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:36.056+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:36.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:36.340+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:36.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:36.523+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:37.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:37.032+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:37.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:37.074+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:37.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:37.301+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:37.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:37.493+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:37.964 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:58:37.962+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:58:38.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:37.996+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:38.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:38.110+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:38.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:38.267+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:38.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:38.471+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:39.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:39.034+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:39.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:39.064+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:39.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:39.311+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:39.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:39.520+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:40.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:40.002+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:40.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:40.106+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:40.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:40.326+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:40.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:40.541+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:40.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:40.977+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:41.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:41.093+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:41.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:41.351+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:41.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:41.518+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:42.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:42.000+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:42.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:42.045+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:42.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:42.321+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:42.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:42.546+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:42.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:42.956+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:43.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:43.065+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:43.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:43.279+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:43.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:43.528+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:43.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:43.953+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:44.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:44.099+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:44.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:44.314+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:44.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:44.522+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:44.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:44.954+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:45.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:45.130+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:45.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:45.321+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:45.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:45.483+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:45.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:45.989+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:46.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:46.122+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:46.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:46.315+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:46.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:46.534+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:46.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:46.963+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:47.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:47.108+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:47.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:47.337+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:47.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:47.520+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:47.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:47.982+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:48.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:48.143+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:48.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:48.374+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:48.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:48.492+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:48.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:48.955+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:49.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:49.093+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:49.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:49.386+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:49.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:49.482+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:49.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:49.924+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:50.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:50.111+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:50.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:50.337+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:50.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:50.455+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:50.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:50.904+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:51.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:51.076+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:51.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:51.358+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:51.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:51.418+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:51.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:51.863+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:52.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:52.087+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:52.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:52.311+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:52.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:52.451+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:52.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:52.880+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:52.980 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:58:52.977+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:58:53.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:53.077+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:53.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:53.337+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:53.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:53.405+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:53.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:53.906+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:54.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:54.056+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:54.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:54.335+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:54.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:54.373+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:54.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:54.877+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:55.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:55.046+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:55.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:58:55.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:58:55.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:55.362+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:55.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:55.410+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:55.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:55.925+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:56.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:56.019+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:56.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:56.348+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:56.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:56.376+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:56.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:56.943+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:57.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:57.058+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:57.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:57.360+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:57.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:57.360+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:57.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:57.959+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:58.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:58.017+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:58.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:58.360+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:58.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:58.386+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:58.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:58.960+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:58.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:58:58.973+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:59.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:58:59.331+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:59.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:58:59.413+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:58:59.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:58:59.962+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:00.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:00.006+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:00.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:00.307+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:00.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:00.442+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:00.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:00.935+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:01.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:01.026+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:01.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:01.270+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:01.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:01.491+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:01.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:01.888+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:02.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:02.015+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:02.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:02.282+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:02.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:02.533+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:02.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:02.934+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:03.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:02.997+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:03.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:03.239+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:03.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:03.527+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:03.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:03.900+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:03.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:03.950+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:04.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:04.284+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:04.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:04.528+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:04.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:04.930+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:04.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:04.947+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:05.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:05.314+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:05.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:05.482+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:05.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:05.914+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:05.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:05.949+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:06.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:06.362+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:06.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:06.454+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:06.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:06.888+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:06.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:06.899+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:07.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:07.375+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:07.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:07.437+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:07.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:07.877+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:07.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:07.914+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:07.982 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:59:07.979+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:59:08.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:08.404+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:08.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:08.406+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:08.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:08.899+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:08.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:08.911+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:09.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:09.364+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:09.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:09.442+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:09.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:09.862+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:09.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:09.943+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:10.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:10.325+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:10.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:10.402+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:10.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:10.815+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:10.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:10.938+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:11.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:11.305+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:11.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:11.408+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:11.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:11.769+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:11.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:11.980+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:12.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:12.263+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:12.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:12.372+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:12.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:12.751+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:13.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:13.026+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:13.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:13.303+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:13.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:13.339+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:13.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:13.725+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:14.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:14.005+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:14.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:14.254+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:14.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:14.372+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:14.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:14.720+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:14.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:14.987+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:15.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:15.222+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:15.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:15.340+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:15.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:15.696+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:16.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:16.019+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:16.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:16.176+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:16.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:16.378+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:16.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:16.696+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:17.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:17.060+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:17.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:17.168+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:17.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:17.369+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:17.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:17.727+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:18.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:18.039+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:18.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:18.132+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:18.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:18.405+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:18.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:18.707+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:18.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:18.993+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:19.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:19.135+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:19.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:19.356+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:19.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:19.730+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:20.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:20.017+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:20.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:20.176+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:20.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:20.365+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:20.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:20.707+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:20.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:20.978+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:21.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:21.131+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:21.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:21.379+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:21.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:21.712+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:22.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:22.027+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:22.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:22.094+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:22.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:22.403+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:22.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:22.678+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:22.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:22.978+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:22.998 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:59:22.995+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:59:23.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:23.123+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:23.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:23.404+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:23.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:23.643+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:24.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:24.012+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:24.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:24.101+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:24.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:24.410+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:24.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:24.624+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:25.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:25.036+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:25.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:25.150+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:25.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:25.430+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:25.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:59:25.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:59:25.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:25.595+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:26.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:26.084+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:26.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:26.136+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:26.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:26.394+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:26.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:26.546+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:27.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:27.076+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:27.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:27.099+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:27.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:27.397+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:27.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:27.497+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:28.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:28.041+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:28.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:28.127+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:28.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:28.392+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:28.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:28.524+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:29.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:29.014+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:29.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:29.127+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:29.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:29.384+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:29.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:29.556+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:30.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:30.002+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:30.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:30.171+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:30.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:30.428+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:30.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:30.580+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:31.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:31.002+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:31.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:31.168+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:31.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:31.475+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:31.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:31.584+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:32.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:32.045+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:32.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:32.211+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:32.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:32.515+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:32.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:32.550+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:33.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:33.021+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:33.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:33.172+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:33.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:33.527+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:33.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:33.589+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:34.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:34.015+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:34.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:34.210+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:34.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:34.548+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:34.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:34.579+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:34.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:34.979+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:35.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:35.160+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:35.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:35.588+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:35.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:35.594+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:36.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:36.019+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:36.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:36.126+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:36.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:36.583+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:36.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:36.611+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:36.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:36.983+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:37.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:37.102+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:37.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:37.613+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:37.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:37.640+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:37.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:37.952+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:38.013 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:59:38.011+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:59:38.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:38.097+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:38.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:38.597+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:38.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:38.653+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:38.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:38.967+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:39.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:39.118+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:39.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:39.605+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:39.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:39.634+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:40.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:40.002+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:40.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:40.074+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:40.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:40.584+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:40.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:40.660+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:41.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:41.041+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:41.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:41.042+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:41.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:41.548+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:41.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:41.612+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:42.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:42.068+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:42.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:42.091+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:42.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:42.530+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:42.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:42.650+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:43.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:43.021+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:43.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:43.091+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:43.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:43.524+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:43.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:43.632+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:44.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:44.012+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:44.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:44.072+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:44.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:44.563+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:44.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:44.658+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:44.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:44.970+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:45.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:45.059+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:45.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:45.536+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:45.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:45.645+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:45.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:45.945+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:46.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:46.089+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:46.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:46.529+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:46.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:46.605+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:46.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:46.971+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:47.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:47.074+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:47.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:47.561+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:47.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:47.622+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:47.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:47.929+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:48.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:48.085+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:48.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:48.606+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:48.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:48.611+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:48.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:48.929+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:49.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:49.078+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:49.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:49.583+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:49.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:49.650+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:49.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:49.907+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:50.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:50.128+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:50.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:50.632+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:50.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:50.648+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:50.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:50.915+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:51.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:51.114+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:51.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:51.599+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:51.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:51.650+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:51.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:51.935+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:52.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:52.148+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:52.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:52.631+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:52.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:52.645+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:52.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:52.887+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:53.029 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-03T23:59:53.027+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-03T23:59:53.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:53.128+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:53.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:53.641+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:53.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:53.671+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:53.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:53.867+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:54.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:54.125+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:54.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:54.616+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:54.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:54.624+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:54.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:54.821+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:55.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:55.108+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:55.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:55.588+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:55.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:59:55.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-03T23:59:55.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:55.632+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:55.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:55.775+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:56.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:56.122+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:56.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:56.591+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:56.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:56.632+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:56.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:56.751+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:57.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:57.087+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:57.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:57.617+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:57.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:57.675+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:57.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:57.725+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:58.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:58.128+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:58.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:58.605+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:58.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:58.716+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:58.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:58.740+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:59.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-03T23:59:59.085+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:59.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-03T23:59:59.605+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:59.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-03T23:59:59.715+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-03T23:59:59.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-03T23:59:59.747+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:00.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:00.103+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:00.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:00.610+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:00.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:00.737+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:00.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:00.753+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:01.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:01.107+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:01.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:01.574+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:01.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:01.694+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:01.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:01.748+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:02.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:02.117+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:02.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:02.601+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:02.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:02.711+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:02.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:02.735+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:03.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:03.087+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:03.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:03.638+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:03.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:03.732+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:03.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:03.735+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:04.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:04.127+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:04.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:04.607+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:04.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:04.768+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:04.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:04.768+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:05.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:05.102+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:05.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:05.604+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:05.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:05.771+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:05.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:05.793+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:06.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:06.096+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:06.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:06.641+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:06.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:06.782+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:06.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:06.817+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:07.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:07.122+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:07.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:07.622+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:07.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:07.790+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:07.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:07.802+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:08.045 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:00:08.042+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:00:08.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:08.118+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:08.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:08.615+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:08.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:08.755+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:08.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:08.831+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:09.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:09.136+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:09.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:09.589+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:09.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:09.748+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:09.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:09.841+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:10.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:10.177+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:10.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:10.595+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:10.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:10.773+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:10.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:10.813+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:11.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:11.168+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:11.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:11.645+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:11.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:11.743+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:11.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:11.774+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:12.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:12.200+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:12.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:12.658+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:12.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:12.759+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:12.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:12.763+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:13.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:13.173+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:13.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:13.636+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:13.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:13.758+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:13.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:13.808+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:14.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:14.144+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:14.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:14.591+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:14.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:14.759+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:14.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:14.857+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:15.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:15.128+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:15.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:15.632+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:15.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:15.728+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:15.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:15.817+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:16.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:16.101+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:16.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:16.629+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:16.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:16.685+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:16.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:16.843+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:17.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:17.139+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:17.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:17.618+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:17.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:17.688+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:17.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:17.877+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:18.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:18.131+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:18.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:18.593+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:18.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:18.645+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:18.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:18.865+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:19.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:19.140+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:19.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:19.546+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:19.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:19.676+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:19.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:19.903+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:20.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:20.160+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:20.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:20.586+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:20.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:20.697+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:20.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:20.867+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:21.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:21.176+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:21.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:21.557+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:21.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:21.736+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:21.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:21.842+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:22.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:22.177+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:22.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:22.528+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:22.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:22.707+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:22.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:22.849+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:23.061 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:00:23.058+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:00:23.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:23.196+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:23.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:23.560+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:23.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:23.685+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:23.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:23.834+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:24.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:24.207+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:24.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:24.539+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:24.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:24.696+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:24.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:24.879+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:25.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:25.235+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:25.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:25.509+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:25.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:00:25.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:00:25.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:25.698+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:25.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:25.918+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:26.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:26.286+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:26.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:26.528+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:26.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:26.689+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:26.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:26.880+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:27.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:27.301+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:27.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:27.574+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:27.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:27.647+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:27.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:27.880+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:28.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:28.271+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:28.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:28.556+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:28.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:28.613+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:28.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:28.884+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:29.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:29.301+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:29.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:29.553+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:29.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:29.658+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:29.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:29.856+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:30.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:30.280+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:30.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:30.572+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:30.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:30.655+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:30.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:30.899+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:31.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:31.281+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:31.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:31.579+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:31.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:31.661+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:31.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:31.916+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:32.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:32.291+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:32.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:32.533+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:32.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:32.652+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:32.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:32.889+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:33.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:33.328+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:33.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:33.573+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:33.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:33.665+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:33.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:33.935+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:34.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:34.357+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:34.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:34.616+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:34.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:34.619+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:34.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:34.936+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:35.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:35.364+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:35.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:35.587+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:35.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:35.628+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:35.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:35.984+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:36.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:36.385+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:36.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:36.601+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:36.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:36.613+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:36.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:36.992+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:37.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:37.337+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:37.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:37.626+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:37.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:37.660+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:37.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:37.965+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:38.077 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:00:38.074+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:00:38.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:38.334+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:38.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:38.596+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:38.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:38.688+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:39.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:39.000+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:39.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:39.357+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:39.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:39.549+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:39.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:39.722+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:40.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:40.005+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:40.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:40.317+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:40.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:40.507+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:40.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:40.681+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:40.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:40.962+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:41.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:41.295+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:41.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:41.473+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:41.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:41.637+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:41.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:41.984+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:42.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:42.345+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:42.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:42.453+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:42.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:42.680+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:42.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:42.969+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:43.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:43.316+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:43.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:43.455+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:43.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:43.715+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:43.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:43.988+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:44.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:44.294+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:44.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:44.456+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:44.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:44.717+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:44.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:44.973+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:45.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:45.256+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:45.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:45.451+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:45.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:45.689+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:45.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:45.925+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:46.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:46.255+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:46.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:46.479+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:46.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:46.704+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:46.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:46.920+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:47.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:47.237+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:47.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:47.475+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:47.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:47.718+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:47.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:47.955+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:48.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:48.247+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:48.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:48.524+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:48.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:48.694+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:48.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:48.969+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:49.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:49.252+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:49.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:49.476+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:49.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:49.738+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:49.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:49.977+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:50.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:50.300+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:50.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:50.489+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:50.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:50.753+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:50.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:50.988+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:51.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:51.331+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:51.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:51.494+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:51.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:51.781+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:51.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:51.961+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:52.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:52.292+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:52.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:52.451+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:52.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:52.768+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:53.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:53.008+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:53.093 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:00:53.090+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:00:53.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:53.271+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:53.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:53.476+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:53.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:53.719+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:53.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:53.959+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:54.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:54.274+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:54.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:54.488+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:54.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:54.701+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:54.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:54.921+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:55.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:55.257+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:55.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:55.439+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:55.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:55.709+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:55.822 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:00:55.826 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:00:55.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:55.908+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:56.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:56.239+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:56.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:56.438+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:56.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:56.672+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:56.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:56.937+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:57.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:57.245+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:57.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:57.470+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:57.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:57.687+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:57.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:57.967+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:58.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:58.278+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:58.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:58.483+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:58.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:58.712+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:58.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:58.932+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:59.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:00:59.301+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:59.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:00:59.472+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:59.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:00:59.753+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:00:59.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:00:59.968+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:00.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:00.334+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:00.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:00.452+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:00.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:00.754+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:00.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:00.942+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:01.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:01.367+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:01.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:01.437+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:01.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:01.776+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:01.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:01.901+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:02.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:02.364+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:02.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:02.460+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:02.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:02.793+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:02.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:02.932+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:03.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:03.352+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:03.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:03.458+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:03.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:03.780+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:03.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:03.898+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:04.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:04.312+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:04.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:04.502+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:04.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:04.780+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:04.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:04.854+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:05.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:05.282+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:05.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:05.474+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:05.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:05.761+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:05.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:05.855+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:06.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:06.241+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:06.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:06.463+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:06.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:06.809+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:06.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:06.886+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:07.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:07.263+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:07.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:07.474+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:07.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:07.771+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:07.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:07.926+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:08.109 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:01:08.106+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:01:08.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:08.228+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:08.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:08.508+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:08.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:08.732+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:08.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:08.913+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:09.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:09.208+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:09.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:09.480+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:09.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:09.734+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:09.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:09.897+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:10.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:10.231+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:10.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:10.454+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:10.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:10.749+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:10.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:10.911+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:11.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:11.235+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:11.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:11.411+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:11.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:11.745+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:11.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:11.896+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:12.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:12.262+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:12.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:12.459+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:12.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:12.756+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:12.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:12.900+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:13.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:13.226+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:13.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:13.506+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:13.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:13.717+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:13.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:13.851+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:14.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:14.259+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:14.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:14.482+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:14.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:14.745+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:14.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:14.880+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:15.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:15.252+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:15.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:15.511+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:15.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:15.739+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:15.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:15.857+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:16.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:16.271+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:16.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:16.552+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:16.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:16.691+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:16.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:16.841+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:17.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:17.321+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:17.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:17.509+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:17.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:17.703+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:17.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:17.840+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:18.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:18.282+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:18.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:18.478+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:18.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:18.664+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:18.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:18.811+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:19.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:19.254+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:19.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:19.439+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:19.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:19.658+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:19.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:19.777+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:20.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:20.249+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:20.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:20.406+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:20.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:20.637+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:20.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:20.821+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:21.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:21.232+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:21.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:21.378+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:21.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:21.592+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:21.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:21.804+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:22.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:22.217+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:22.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:22.375+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:22.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:22.620+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:22.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:22.850+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:23.125 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:01:23.122+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:01:23.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:23.181+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:23.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:23.336+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:23.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:23.583+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:23.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:23.856+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:24.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:24.148+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:24.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:24.360+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:24.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:24.610+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:24.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:24.836+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:25.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:25.177+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:25.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:25.340+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:25.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:25.632+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:25.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:25.815+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:25.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:01:25.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:01:26.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:26.197+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:26.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:26.292+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:26.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:26.621+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:26.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:26.851+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:27.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:27.209+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:27.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:27.302+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:27.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:27.594+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:27.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:27.840+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:28.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:28.176+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:28.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:28.340+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:28.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:28.610+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:28.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:28.870+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:29.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:29.179+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:29.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:29.375+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:29.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:29.619+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:29.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:29.844+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:30.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:30.142+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:30.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:30.385+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:30.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:30.614+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:30.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:30.846+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:31.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:31.100+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:31.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:31.435+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:31.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:31.629+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:31.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:31.812+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:32.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:32.124+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:32.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:32.428+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:32.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:32.650+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:32.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:32.771+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:33.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:33.119+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:33.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:33.393+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:33.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:33.640+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:33.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:33.812+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:34.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:34.134+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:34.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:34.348+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:34.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:34.649+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:34.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:34.771+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:35.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:35.137+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:35.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:35.345+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:35.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:35.611+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:35.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:35.768+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:36.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:36.169+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:36.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:36.367+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:36.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:36.653+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:36.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:36.788+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:37.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:37.132+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:37.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:37.338+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:37.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:37.684+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:37.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:37.761+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:38.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:38.091+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:38.141 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:01:38.139+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:01:38.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:38.369+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:38.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:38.670+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:38.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:38.785+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:39.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:39.055+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:39.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:39.341+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:39.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:39.625+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:39.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:39.746+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:40.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:40.069+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:40.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:40.315+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:40.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:40.667+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:40.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:40.771+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:41.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:41.094+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:41.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:41.322+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:41.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:41.676+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:41.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:41.727+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:42.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:42.116+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:42.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:42.304+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:42.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:42.701+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:42.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:42.714+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:43.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:43.079+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:43.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:43.302+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:43.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:43.699+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:43.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:43.723+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:44.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:44.044+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:44.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:44.261+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:44.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:44.720+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:44.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:44.741+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:45.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:45.037+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:45.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:45.248+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:45.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:45.706+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:45.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:45.732+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:46.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:46.086+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:46.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:46.237+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:46.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:46.677+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:46.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:46.719+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:47.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:47.125+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:47.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:47.251+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:47.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:47.650+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:47.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:47.686+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:48.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:48.130+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:48.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:48.219+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:48.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:48.633+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:48.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:48.701+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:49.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:49.095+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:49.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:49.267+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:49.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:49.681+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:49.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:49.697+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:50.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:50.139+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:50.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:50.290+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:50.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:50.658+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:50.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:50.692+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:51.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:51.168+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:51.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:51.317+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:51.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:51.674+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:51.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:51.704+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:52.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:52.173+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:52.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:52.347+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:52.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:52.697+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:52.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:52.699+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:53.156 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:01:53.153+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:01:53.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:53.177+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:53.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:53.382+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:53.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:53.663+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:53.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:53.726+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:54.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:54.218+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:54.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:54.334+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:54.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:54.704+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:54.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:54.743+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:55.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:55.185+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:55.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:55.285+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:55.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:55.712+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:55.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:55.774+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:56.052 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:01:56.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:01:56.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:56.152+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:56.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:56.240+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:56.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:56.690+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:56.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:56.765+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:57.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:57.146+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:57.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:57.228+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:57.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:57.661+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:57.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:57.811+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:58.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:58.109+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:58.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:58.257+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:58.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:58.660+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:58.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:58.809+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:59.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:01:59.156+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:59.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:01:59.231+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:59.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:01:59.690+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:01:59.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:01:59.797+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:00.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:00.190+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:00.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:00.251+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:00.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:00.738+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:00.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:00.837+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:01.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:01.150+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:01.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:01.278+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:01.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:01.737+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:01.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:01.808+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:02.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:02.152+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:02.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:02.268+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:02.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:02.714+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:02.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:02.834+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:03.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:03.105+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:03.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:03.240+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:03.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:03.757+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:03.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:03.868+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:04.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:04.137+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:04.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:04.265+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:04.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:04.805+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:04.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:04.911+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:05.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:05.177+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:05.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:05.312+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:05.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:05.770+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:05.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:05.900+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:06.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:06.141+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:06.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:06.333+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:06.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:06.752+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:06.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:06.927+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:07.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:07.092+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:07.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:07.309+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:07.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:07.769+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:07.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:07.916+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:08.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:08.094+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:08.172 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:02:08.169+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:02:08.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:08.352+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:08.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:08.724+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:08.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:08.928+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:09.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:09.066+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:09.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:09.331+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:09.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:09.712+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:09.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:09.950+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:10.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:10.020+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:10.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:10.305+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:10.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:10.708+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:10.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:10.939+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:10.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:10.980+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:11.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:11.257+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:11.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:11.732+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:11.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:11.977+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:11.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:11.984+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:12.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:12.297+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:12.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:12.714+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:12.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:12.945+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:13.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:13.009+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:13.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:13.314+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:13.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:13.693+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:13.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:13.976+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:14.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:14.053+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:14.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:14.315+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:14.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:14.706+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:15.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:15.004+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:15.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:15.052+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:15.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:15.298+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:15.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:15.662+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:15.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:15.982+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:16.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:16.056+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:16.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:16.342+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:16.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:16.621+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:17.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:17.033+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:17.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:17.095+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:17.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:17.308+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:17.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:17.576+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:18.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:18.005+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:18.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:18.137+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:18.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:18.282+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:18.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:18.601+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:18.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:18.987+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:19.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:19.175+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:19.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:19.279+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:19.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:19.607+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:19.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:19.938+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:20.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:20.204+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:20.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:20.262+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:20.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:20.642+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:20.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:20.914+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:21.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:21.234+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:21.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:21.273+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:21.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:21.679+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:21.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:21.952+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:22.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:22.240+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:22.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:22.279+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:22.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:22.725+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:22.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:22.943+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:23.187 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:02:23.184+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:02:23.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:23.251+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:23.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:23.260+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:23.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:23.723+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:23.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:23.982+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:24.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:24.277+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:24.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:24.284+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:24.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:24.757+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:25.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:25.020+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:25.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:25.282+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:25.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:25.321+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:25.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:25.802+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:26.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:26.065+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:26.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:02:26.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:02:26.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:26.287+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:26.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:26.349+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:26.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:26.812+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:27.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:27.087+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:27.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:27.313+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:27.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:27.369+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:27.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:27.814+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:28.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:28.126+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:28.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:28.276+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:28.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:28.333+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:28.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:28.836+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:29.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:29.125+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:29.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:29.283+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:29.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:29.317+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:29.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:29.874+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:30.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:30.158+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:30.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:30.267+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:30.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:30.289+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:30.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:30.852+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:31.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:31.159+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:31.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:31.295+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:31.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:31.313+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:31.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:31.803+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:32.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:32.192+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:32.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:32.259+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:32.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:32.283+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:32.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:32.847+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:33.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:33.218+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:33.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:33.224+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:33.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:33.318+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:33.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:33.870+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:34.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:34.180+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:34.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:34.246+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:34.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:34.274+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:34.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:34.837+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:35.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:35.143+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:35.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:35.248+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:35.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:35.286+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:35.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:35.798+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:36.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:36.109+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:36.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:36.212+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:36.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:36.297+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:36.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:36.836+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:37.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:37.071+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:37.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:37.196+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:37.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:37.315+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:37.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:37.880+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:38.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:38.098+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:38.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:38.185+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:38.193 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:02:38.190+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:02:38.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:38.360+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:38.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:38.850+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:39.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:39.130+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:39.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:39.197+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:39.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:39.384+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:39.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:39.815+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:40.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:40.125+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:40.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:40.230+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:40.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:40.382+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:40.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:40.806+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:41.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:41.124+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:41.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:41.224+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:41.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:41.334+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:41.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:41.835+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:42.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:42.106+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:42.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:42.254+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:42.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:42.355+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:42.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:42.878+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:43.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:43.115+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:43.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:43.231+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:43.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:43.338+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:43.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:43.929+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:44.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:44.160+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:44.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:44.275+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:44.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:44.323+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:44.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:44.933+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:45.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:45.138+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:45.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:45.326+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:45.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:45.327+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:45.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:45.943+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:46.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:46.102+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:46.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:46.282+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:46.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:46.337+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:46.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:46.968+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:47.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:47.079+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:47.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:47.294+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:47.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:47.313+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:47.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:47.918+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:48.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:48.049+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:48.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:48.265+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:48.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:48.324+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:48.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:48.909+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:49.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:49.050+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:49.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:49.299+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:49.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:49.327+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:49.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:49.958+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:50.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:50.018+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:50.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:50.321+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:50.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:50.368+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:50.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:50.991+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:51.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:51.022+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:51.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:51.288+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:51.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:51.379+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:51.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:51.962+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:52.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:52.050+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:52.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:52.281+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:52.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:52.374+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:52.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:52.947+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:53.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:53.041+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:53.209 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:02:53.207+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:02:53.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:53.313+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:53.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:53.353+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:53.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:53.900+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:54.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:54.056+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:54.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:54.324+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:54.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:54.331+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:54.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:54.915+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:55.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:55.091+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:55.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:55.320+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:55.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:55.361+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:55.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:55.893+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:56.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:56.123+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:56.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:02:56.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:02:56.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:56.359+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:56.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:56.402+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:56.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:56.861+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:57.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:57.079+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:57.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:57.380+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:57.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:57.441+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:57.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:57.811+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:58.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:58.117+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:58.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:58.350+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:58.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:58.428+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:58.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:58.802+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:59.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:02:59.072+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:59.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:02:59.372+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:59.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:02:59.449+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:02:59.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:02:59.838+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:00.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:00.116+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:00.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:00.401+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:00.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:00.441+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:00.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:00.844+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:01.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:01.139+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:01.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:01.391+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:01.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:01.440+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:01.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:01.884+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:02.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:02.174+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:02.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:02.428+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:02.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:02.487+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:02.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:02.905+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:03.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:03.176+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:03.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:03.422+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:03.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:03.519+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:03.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:03.926+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:04.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:04.218+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:04.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:04.415+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:04.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:04.532+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:04.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:04.901+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:05.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:05.245+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:05.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:05.427+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:05.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:05.529+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:05.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:05.937+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:06.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:06.217+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:06.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:06.421+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:06.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:06.538+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:06.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:06.899+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:07.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:07.199+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:07.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:07.465+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:07.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:07.567+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:07.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:07.873+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:08.225 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:03:08.222+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:03:08.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:08.235+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:08.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:08.501+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:08.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:08.530+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:08.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:08.860+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:09.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:09.284+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:09.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:09.511+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:09.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:09.543+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:09.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:09.847+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:10.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:10.317+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:10.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:10.556+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:10.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:10.558+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:10.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:10.832+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:11.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:11.362+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:11.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:11.566+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:11.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:11.603+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:11.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:11.824+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:12.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:12.361+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:12.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:12.535+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:12.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:12.649+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:12.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:12.872+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:13.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:13.385+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:13.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:13.490+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:13.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:13.653+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:13.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:13.920+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:14.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:14.411+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:14.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:14.482+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:14.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:14.609+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:14.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:14.923+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:15.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:15.444+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:15.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:15.453+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:15.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:15.656+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:15.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:15.973+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:16.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:16.439+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:16.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:16.456+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:16.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:16.676+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:16.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:16.936+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:17.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:17.417+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:17.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:17.445+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:17.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:17.633+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:17.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:17.892+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:18.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:18.400+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:18.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:18.422+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:18.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:18.646+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:18.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:18.910+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:19.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:19.403+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:19.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:19.455+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:19.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:19.630+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:19.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:19.911+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:20.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:20.424+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:20.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:20.477+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:20.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:20.610+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:20.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:20.942+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:21.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:21.391+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:21.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:21.497+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:21.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:21.651+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:21.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:21.919+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:22.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:22.371+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:22.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:22.522+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:22.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:22.610+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:22.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:22.943+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:23.228 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:03:23.225+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:03:23.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:23.410+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:23.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:23.565+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:23.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:23.652+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:23.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:23.960+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:24.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:24.365+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:24.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:24.607+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:24.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:24.667+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:24.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:24.990+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:25.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:25.337+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:25.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:25.619+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:25.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:25.626+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:25.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:25.965+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:26.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:26.343+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:26.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:03:26.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:03:26.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:26.587+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:26.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:26.647+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:26.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:26.951+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:27.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:27.308+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:27.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:27.595+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:27.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:27.603+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:27.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:27.929+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:28.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:28.301+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:28.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:28.550+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:28.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:28.577+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:28.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:28.967+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:29.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:29.325+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:29.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:29.541+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:29.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:29.588+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:29.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:29.993+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:30.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:30.309+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:30.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:30.566+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:30.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:30.578+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:30.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:30.977+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:31.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:31.309+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:31.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:31.589+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:31.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:31.628+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:31.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:31.948+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:32.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:32.300+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:32.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:32.570+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:32.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:32.614+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:32.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:32.940+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:33.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:33.333+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:33.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:33.616+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:33.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:33.640+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:33.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:33.987+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:34.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:34.315+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:34.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:34.635+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:34.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:34.652+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:34.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:34.993+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:35.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:35.309+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:35.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:35.637+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:35.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:35.679+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:36.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:36.029+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:36.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:36.302+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:36.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:36.599+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:36.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:36.680+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:37.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:37.008+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:37.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:37.255+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:37.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:37.595+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:37.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:37.665+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:38.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:38.035+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:38.244 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:03:38.241+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:03:38.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:38.288+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:38.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:38.592+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:38.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:38.705+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:38.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:38.994+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:39.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:39.298+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:39.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:39.608+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:39.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:39.657+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:40.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:40.025+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:40.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:40.288+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:40.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:40.594+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:40.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:40.620+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:40.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:40.995+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:41.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:41.306+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:41.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:41.545+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:41.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:41.578+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:42.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:42.035+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:42.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:42.355+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:42.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:42.532+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:42.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:42.599+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:43.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:43.055+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:43.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:43.356+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:43.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:43.514+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:43.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:43.584+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:44.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:44.074+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:44.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:44.366+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:44.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:44.511+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:44.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:44.581+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:45.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:45.075+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:45.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:45.354+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:45.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:45.542+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:45.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:45.608+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:46.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:46.044+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:46.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:46.361+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:46.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:46.565+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:46.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:46.584+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:47.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:47.083+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:47.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:47.352+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:47.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:47.517+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:47.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:47.551+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:48.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:48.132+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:48.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:48.305+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:48.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:48.515+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:48.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:48.522+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:49.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:49.159+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:49.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:49.302+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:49.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:49.499+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:49.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:49.534+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:50.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:50.193+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:50.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:50.267+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:50.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:50.518+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:50.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:50.526+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:51.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:51.208+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:51.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:51.253+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:51.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:51.525+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:51.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:51.552+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:52.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:52.202+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:52.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:52.233+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:52.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:52.556+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:52.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:52.561+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:53.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:53.175+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:53.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:53.213+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:53.260 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:03:53.257+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:03:53.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:53.537+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:53.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:53.541+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:54.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:54.152+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:54.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:54.183+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:54.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:54.523+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:54.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:54.536+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:55.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:55.184+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:55.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:55.194+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:55.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:55.542+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:55.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:55.551+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:56.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:56.152+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:56.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:56.179+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:56.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:03:56.541 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:03:56.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:56.564+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:56.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:56.582+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:57.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:57.151+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:57.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:57.176+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:57.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:57.541+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:57.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:57.549+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:58.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:58.124+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:58.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:58.212+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:58.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:58.542+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:58.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:58.547+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:59.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:03:59.108+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:59.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:03:59.209+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:59.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:03:59.509+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:03:59.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:03:59.515+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:00.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:00.124+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:00.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:00.172+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:00.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:00.477+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:00.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:00.512+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:01.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:01.134+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:01.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:01.141+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:01.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:01.497+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:01.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:01.515+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:02.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:02.136+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:02.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:02.174+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:02.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:02.507+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:02.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:02.521+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:03.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:03.101+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:03.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:03.155+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:03.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:03.485+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:03.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:03.551+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:04.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:04.068+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:04.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:04.164+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:04.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:04.439+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:04.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:04.547+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:05.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:05.081+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:05.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:05.164+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:05.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:05.445+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:05.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:05.518+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:06.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:06.071+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:06.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:06.160+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:06.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:06.406+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:06.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:06.563+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:07.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:07.081+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:07.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:07.131+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:07.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:07.411+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:07.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:07.560+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:08.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:08.044+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:08.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:08.150+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:08.276 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:04:08.274+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:04:08.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:08.409+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:08.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:08.573+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:09.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:09.051+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:09.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:09.184+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:09.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:09.396+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:09.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:09.592+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:10.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:10.037+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:10.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:10.201+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:10.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:10.371+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:10.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:10.640+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:11.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:11.082+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:11.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:11.244+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:11.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:11.369+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:11.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:11.627+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:12.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:12.068+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:12.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:12.216+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:12.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:12.386+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:12.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:12.611+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:13.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:13.022+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:13.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:13.250+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:13.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:13.402+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:13.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:13.593+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:14.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:14.064+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:14.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:14.293+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:14.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:14.401+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:14.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:14.637+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:15.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:15.108+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:15.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:15.253+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:15.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:15.398+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:15.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:15.671+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:16.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:16.088+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:16.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:16.263+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:16.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:16.406+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:16.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:16.625+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:17.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:17.137+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:17.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:17.279+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:17.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:17.438+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:17.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:17.635+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:18.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:18.161+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:18.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:18.279+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:18.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:18.429+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:18.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:18.634+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:19.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:19.119+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:19.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:19.238+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:19.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:19.431+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:19.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:19.662+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:20.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:20.159+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:20.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:20.281+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:20.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:20.421+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:20.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:20.649+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:21.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:21.200+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:21.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:21.315+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:21.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:21.450+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:21.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:21.631+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:22.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:22.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:22.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:22.275+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:22.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:22.433+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:22.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:22.649+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:23.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:23.196+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:23.292 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:04:23.289+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:04:23.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:23.325+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:23.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:23.430+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:23.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:23.667+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:24.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:24.223+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:24.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:24.340+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:24.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:24.431+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:24.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:24.700+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:25.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:25.211+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:25.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:25.331+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:25.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:25.478+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:25.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:25.741+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:26.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:26.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:26.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:26.344+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:26.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:26.453+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:26.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:04:26.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:04:26.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:26.741+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:27.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:27.211+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:27.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:27.305+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:27.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:27.453+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:27.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:27.714+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:28.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:28.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:28.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:28.266+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:28.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:28.415+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:28.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:28.679+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:29.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:29.196+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:29.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:29.253+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:29.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:29.382+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:29.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:29.699+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:30.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:30.196+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:30.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:30.259+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:30.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:30.416+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:30.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:30.684+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:31.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:31.206+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:31.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:31.277+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:31.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:31.370+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:31.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:31.687+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:32.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:32.189+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:32.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:32.272+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:32.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:32.365+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:32.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:32.693+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:33.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:33.150+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:33.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:33.267+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:33.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:33.373+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:33.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:33.667+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:34.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:34.186+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:34.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:34.276+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:34.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:34.394+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:34.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:34.682+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:35.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:35.217+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:35.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:35.257+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:35.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:35.385+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:35.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:35.704+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:36.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:36.210+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:36.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:36.226+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:36.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:36.398+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:36.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:36.751+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:37.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:37.203+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:37.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:37.223+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:37.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:37.421+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:37.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:37.793+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:38.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:38.252+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:38.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:38.267+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:38.307 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:04:38.305+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:04:38.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:38.390+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:38.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:38.800+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:39.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:39.237+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:39.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:39.238+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:39.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:39.398+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:39.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:39.847+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:40.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:40.214+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:40.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:40.281+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:40.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:40.443+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:40.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:40.862+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:41.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:41.227+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:41.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:41.295+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:41.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:41.473+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:41.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:41.841+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:42.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:42.203+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:42.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:42.269+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:42.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:42.506+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:42.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:42.863+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:43.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:43.193+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:43.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:43.291+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:43.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:43.507+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:43.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:43.888+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:44.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:44.172+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:44.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:44.284+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:44.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:44.476+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:44.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:44.891+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:45.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:45.168+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:45.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:45.320+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:45.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:45.440+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:45.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:45.857+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:46.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:46.154+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:46.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:46.273+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:46.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:46.421+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:46.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:46.809+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:47.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:47.188+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:47.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:47.248+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:47.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:47.374+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:47.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:47.820+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:48.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:48.160+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:48.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:48.271+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:48.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:48.346+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:48.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:48.778+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:49.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:49.147+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:49.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:49.241+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:49.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:49.355+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:49.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:49.752+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:50.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:50.113+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:50.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:50.288+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:50.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:50.350+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:50.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:50.775+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:51.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:51.070+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:51.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:51.323+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:51.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:51.333+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:51.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:51.763+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:52.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:52.059+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:52.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:52.275+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:52.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:52.351+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:52.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:52.778+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:53.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:53.100+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:53.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:53.291+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:53.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:53.311+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:53.323 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:04:53.320+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:04:53.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:53.771+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:54.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:54.073+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:54.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:54.326+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:54.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:54.359+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:54.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:54.791+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:55.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:55.048+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:55.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:55.288+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:55.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:55.335+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:55.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:55.795+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:56.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:56.080+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:56.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:56.242+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:56.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:56.325+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:56.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:56.781+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:56.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:04:56.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:04:57.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:57.061+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:57.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:57.232+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:57.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:57.292+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:57.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:57.777+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:58.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:58.095+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:58.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:58.184+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:58.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:58.328+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:58.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:58.772+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:59.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:04:59.054+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:59.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:04:59.205+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:59.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:04:59.316+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:04:59.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:04:59.728+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:00.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:00.088+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:00.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:00.231+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:00.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:00.268+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:00.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:00.735+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:01.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:01.105+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:01.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:01.228+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:01.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:01.279+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:01.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:01.687+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:02.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:02.083+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:02.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:02.185+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:02.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:02.260+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:02.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:02.658+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:03.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:03.096+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:03.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:03.227+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:03.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:03.231+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:03.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:03.707+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:04.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:04.117+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:04.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:04.184+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:04.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:04.199+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:04.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:04.674+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:05.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:05.083+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:05.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:05.174+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:05.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:05.244+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:05.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:05.717+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:06.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:06.043+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:06.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:06.197+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:06.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:06.224+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:06.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:06.745+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:07.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:07.001+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:07.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:07.192+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:07.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:07.210+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:07.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:07.718+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:07.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:07.956+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:08.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:08.183+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:08.327 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:05:08.324+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:05:08.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:08.194+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:08.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:08.673+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:08.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:08.976+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:09.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:09.179+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:09.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:09.188+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:09.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:09.669+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:09.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:09.941+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:10.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:10.145+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:10.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:10.195+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:10.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:10.717+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:10.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:10.907+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:11.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:11.131+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:11.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:11.232+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:11.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:11.697+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:11.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:11.910+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:12.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:12.094+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:12.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:12.245+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:12.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:12.679+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:12.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:12.881+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:13.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:13.131+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:13.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:13.197+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:13.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:13.701+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:13.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:13.922+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:14.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:14.134+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:14.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:14.216+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:14.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:14.734+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:14.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:14.907+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:15.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:15.093+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:15.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:15.198+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:15.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:15.744+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:15.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:15.940+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:16.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:16.083+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:16.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:16.203+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:16.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:16.741+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:16.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:16.954+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:17.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:17.132+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:17.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:17.228+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:17.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:17.776+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:17.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:17.951+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:18.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:18.095+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:18.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:18.219+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:18.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:18.818+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:19.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:18.998+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:19.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:19.085+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:19.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:19.239+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:19.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:19.868+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:19.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:19.992+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:20.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:20.097+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:20.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:20.225+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:20.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:20.854+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:20.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:20.979+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:21.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:21.122+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:21.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:21.235+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:21.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:21.890+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:21.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:21.948+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:22.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:22.117+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:22.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:22.253+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:22.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:22.912+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:22.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:22.989+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:23.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:23.110+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:23.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:23.287+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:23.343 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:05:23.341+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:05:23.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:23.936+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:24.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:24.022+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:24.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:24.062+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:24.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:24.238+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:24.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:24.960+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:25.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:25.043+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:25.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:25.063+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:25.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:25.263+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:25.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:25.939+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:26.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:26.001+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:26.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:26.034+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:26.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:26.308+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:26.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:05:26.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:05:26.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:26.939+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:27.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:27.030+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:27.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:27.054+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:27.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:27.337+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:27.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:27.961+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:28.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:28.014+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:28.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:28.090+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:28.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:28.303+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:29.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:29.004+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:29.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:29.062+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:29.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:29.101+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:29.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:29.321+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:29.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:29.955+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:30.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:30.030+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:30.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:30.074+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:30.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:30.295+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:30.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:30.927+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:31.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:31.062+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:31.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:31.122+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:31.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:31.298+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:31.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:31.937+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:32.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:32.052+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:32.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:32.094+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:32.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:32.278+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:32.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:32.979+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:33.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:33.081+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:33.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:33.100+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:33.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:33.294+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:33.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:33.952+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:34.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:34.094+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:34.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:34.102+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:34.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:34.332+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:34.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:34.931+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:35.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:35.109+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:35.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:35.120+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:35.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:35.331+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:35.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:35.962+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:36.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:36.098+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:36.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:36.110+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:36.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:36.379+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:36.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:36.996+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:37.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:37.064+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:37.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:37.127+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:37.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:37.355+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:37.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:37.969+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:38.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:38.093+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:38.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:38.152+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:38.359 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:05:38.356+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:05:38.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:38.371+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:39.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:39.003+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:39.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:39.064+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:39.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:39.183+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:39.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:39.347+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:40.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:40.026+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:40.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:40.032+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:40.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:40.170+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:40.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:40.377+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:41.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:41.026+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:41.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:41.048+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:41.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:41.219+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:41.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:41.345+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:42.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:42.015+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:42.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:42.067+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:42.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:42.238+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:42.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:42.296+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:42.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:42.975+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:43.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:43.038+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:43.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:43.274+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:43.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:43.279+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:43.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:43.957+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:44.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:44.016+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:44.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:44.227+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:44.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:44.282+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:45.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:45.005+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:45.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:45.007+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:45.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:45.238+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:45.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:45.270+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:46.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:46.015+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:46.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:46.028+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:46.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:46.210+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:46.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:46.222+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:47.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:47.040+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:47.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:47.049+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:47.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:47.222+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:47.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:47.262+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:48.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:48.009+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:48.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:48.059+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:48.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:48.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:48.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:48.288+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:49.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:49.028+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:49.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:49.043+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:49.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:49.177+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:49.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:49.316+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:50.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:50.051+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:50.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:50.068+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:50.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:50.145+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:50.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:50.360+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:51.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:51.024+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:51.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:51.073+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:51.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:51.101+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:51.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:51.312+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:52.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:52.053+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:52.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:52.071+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:52.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:52.120+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:52.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:52.275+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:53.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:53.039+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:53.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:53.041+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:53.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:53.143+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:53.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:53.236+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:53.369 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:05:53.367+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:05:54.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:54.025+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:54.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:54.046+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:54.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:54.145+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:54.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:54.229+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:54.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:54.986+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:55.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:55.084+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:55.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:55.100+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:55.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:55.211+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:55.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:55.979+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:56.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:56.126+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:56.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:56.128+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:56.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:56.228+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:56.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:56.991+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:57.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:05:57.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:05:57.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:57.092+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:57.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:57.092+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:57.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:57.190+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:58.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:58.032+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:58.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:58.105+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:58.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:58.129+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:58.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:58.146+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:59.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:05:59.000+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:59.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:05:59.077+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:59.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:05:59.102+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:05:59.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:05:59.130+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:00.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:00.035+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:00.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:00.071+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:00.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:00.091+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:00.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:00.175+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:01.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:01.002+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:01.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:01.023+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:01.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:01.089+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:01.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:01.215+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:02.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:02.044+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:02.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:02.044+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:02.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:02.092+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:02.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:02.214+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:03.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:03.030+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:03.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:03.046+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:03.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:03.116+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:03.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:03.176+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:04.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:04.007+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:04.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:04.054+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:04.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:04.080+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:04.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:04.182+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:04.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:04.973+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:05.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:05.042+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:05.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:05.116+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:05.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:05.160+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:06.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:06.010+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:06.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:06.014+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:06.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:06.068+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:06.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:06.161+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:07.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:07.027+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:07.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:07.033+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:07.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:07.061+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:07.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:07.126+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:08.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:08.033+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:08.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:08.041+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:08.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:08.078+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:08.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:08.171+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:08.385 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:06:08.382+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:06:09.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:09.017+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:09.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:09.025+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:09.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:09.101+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:09.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:09.209+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:10.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:10.004+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:10.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:10.063+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:10.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:10.090+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:10.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:10.202+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:10.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:10.966+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:11.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:11.074+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:11.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:11.085+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:11.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:11.156+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:11.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:11.939+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:12.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:12.053+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:12.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:12.057+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:12.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:12.147+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:12.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:12.898+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:13.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:13.050+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:13.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:13.089+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:13.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:13.159+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:13.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:13.939+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:14.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:14.058+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:14.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:14.112+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:14.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:14.137+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:14.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:14.897+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:15.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:15.020+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:15.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:15.078+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:15.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:15.180+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:15.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:15.874+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:16.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:16.032+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:16.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:16.037+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:16.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:16.206+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:16.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:16.833+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:17.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:17.010+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:17.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:17.028+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:17.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:17.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:17.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:17.865+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:18.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:18.017+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:18.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:18.035+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:18.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:18.196+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:18.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:18.868+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:19.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:19.008+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:19.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:19.056+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:19.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:19.176+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:19.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:19.887+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:19.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:19.988+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:20.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:20.074+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:20.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:20.131+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:20.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:20.892+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:21.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:21.022+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:21.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:21.069+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:21.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:21.165+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:21.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:21.868+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:21.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:21.980+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:22.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:22.038+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:22.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:22.157+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:22.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:22.863+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:22.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:22.933+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:23.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:23.048+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:23.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:23.207+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:23.401 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:06:23.398+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:06:23.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:23.860+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:23.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:23.950+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:24.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:24.079+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:24.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:24.193+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:24.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:24.813+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:24.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:24.983+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:25.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:25.074+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:25.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:25.226+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:25.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:25.802+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:25.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:25.975+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:26.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:26.078+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:26.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:26.198+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:26.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:26.782+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:26.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:26.972+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:27.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:27.061+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:27.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:06:27.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:06:27.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:27.172+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:27.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:27.746+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:27.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:27.946+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:28.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:28.034+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:28.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:28.142+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:28.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:28.748+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:28.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:28.897+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:29.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:29.044+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:29.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:29.096+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:29.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:29.700+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:29.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:29.853+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:30.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:30.085+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:30.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:30.092+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:30.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:30.748+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:30.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:30.826+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:31.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:31.081+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:31.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:31.106+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:31.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:31.740+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:31.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:31.876+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:32.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:32.088+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:32.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:32.111+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:32.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:32.789+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:32.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:32.836+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:33.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:33.118+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:33.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:33.124+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:33.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:33.764+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:33.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:33.822+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:34.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:34.131+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:34.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:34.160+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:34.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:34.808+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:34.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:34.815+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:35.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:35.107+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:35.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:35.204+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:35.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:35.768+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:35.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:35.837+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:36.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:36.089+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:36.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:36.254+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:36.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:36.817+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:36.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:36.869+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:37.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:37.065+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:37.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:37.260+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:37.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:37.809+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:37.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:37.827+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:38.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:38.088+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:38.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:38.243+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:38.403 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:06:38.400+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:06:38.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:38.827+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:38.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:38.836+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:39.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:39.136+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:39.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:39.201+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:39.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:39.832+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:39.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:39.848+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:40.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:40.136+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:40.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:40.171+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:40.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:40.837+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:40.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:40.873+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:41.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:41.122+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:41.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:41.162+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:41.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:41.799+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:41.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:41.920+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:42.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:42.135+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:42.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:42.141+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:42.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:42.794+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:42.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:42.885+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:43.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:43.119+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:43.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:43.180+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:43.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:43.836+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:43.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:43.923+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:44.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:44.145+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:44.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:44.147+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:44.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:44.800+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:44.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:44.900+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:45.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:45.144+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:45.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:45.157+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:45.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:45.775+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:45.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:45.864+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:46.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:46.135+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:46.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:46.155+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:46.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:46.755+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:46.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:46.903+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:47.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:47.116+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:47.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:47.158+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:47.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:47.716+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:47.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:47.920+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:48.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:48.139+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:48.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:48.157+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:48.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:48.718+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:48.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:48.927+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:49.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:49.095+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:49.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:49.193+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:49.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:49.710+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:49.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:49.903+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:50.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:50.116+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:50.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:50.225+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:50.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:50.688+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:50.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:50.878+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:51.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:51.079+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:51.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:51.220+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:51.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:51.732+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:51.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:51.856+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:52.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:52.040+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:52.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:52.192+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:52.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:52.735+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:52.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:52.903+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:53.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:53.008+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:53.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:53.237+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:53.419 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:06:53.416+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:06:53.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:53.732+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:53.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:53.856+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:53.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:53.978+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:54.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:54.220+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:54.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:54.742+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:54.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:54.841+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:55.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:55.017+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:55.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:55.171+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:55.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:55.735+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:55.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:55.826+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:56.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:56.037+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:56.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:56.154+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:56.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:56.763+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:56.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:56.815+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:57.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:57.062+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:57.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:57.142+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:57.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:06:57.237 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:06:57.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:57.749+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:57.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:57.767+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:58.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:58.030+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:58.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:58.188+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:58.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:58.735+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:58.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:58.808+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:59.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:06:59.038+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:59.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:06:59.153+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:59.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:06:59.695+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:06:59.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:06:59.838+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:00.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:00.014+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:00.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:00.202+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:00.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:00.732+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:00.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:00.882+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:01.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:01.039+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:01.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:01.226+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:01.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:01.756+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:01.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:01.872+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:02.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:02.065+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:02.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:02.177+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:02.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:02.796+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:02.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:02.923+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:03.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:03.061+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:03.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:03.195+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:03.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:03.809+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:03.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:03.904+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:04.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:04.021+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:04.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:04.208+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:04.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:04.830+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:04.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:04.892+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:04.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:04.974+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:05.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:05.198+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:05.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:05.805+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:05.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:05.874+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:05.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:05.946+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:06.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:06.157+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:06.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:06.764+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:06.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:06.895+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:06.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:06.969+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:07.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:07.123+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:07.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:07.801+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:07.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:07.903+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:08.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:08.010+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:08.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:08.171+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:08.435 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:07:08.433+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:07:08.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:08.796+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:08.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:08.858+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:09.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:09.009+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:09.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:09.165+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:09.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:09.754+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:09.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:09.881+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:10.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:10.002+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:10.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:10.209+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:10.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:10.709+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:10.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:10.901+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:10.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:10.974+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:11.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:11.230+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:11.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:11.700+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:11.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:11.905+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:11.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:11.944+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:12.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:12.220+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:12.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:12.710+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:12.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:12.882+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:12.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:12.906+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:13.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:13.223+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:13.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:13.734+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:13.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:13.864+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:13.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:13.938+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:14.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:14.246+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:14.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:14.719+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:14.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:14.891+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:14.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:14.895+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:15.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:15.273+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:15.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:15.722+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:15.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:15.874+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:15.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:15.908+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:16.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:16.313+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:16.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:16.726+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:16.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:16.846+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:16.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:16.927+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:17.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:17.320+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:17.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:17.739+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:17.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:17.824+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:17.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:17.955+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:18.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:18.270+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:18.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:18.741+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:18.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:18.866+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:18.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:18.915+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:19.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:19.230+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:19.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:19.771+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:19.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:19.832+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:19.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:19.947+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:20.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:20.225+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:20.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:20.764+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:20.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:20.796+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:20.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:20.904+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:21.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:21.206+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:21.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:21.814+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:21.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:21.772+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:21.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:21.885+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:22.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:22.166+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:22.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:22.742+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:22.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:22.809+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:22.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:22.933+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:23.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:23.198+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:23.451 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:07:23.448+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:07:23.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:23.714+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:23.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:23.832+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:23.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:23.932+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:24.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:24.214+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:24.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:24.717+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:24.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:24.801+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:24.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:24.915+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:25.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:25.203+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:25.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:25.719+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:25.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:25.772+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:25.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:25.917+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:26.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:26.214+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:26.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:26.740+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:26.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:26.749+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:26.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:26.880+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:27.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:27.236+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:27.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:07:27.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:07:27.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:27.758+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:27.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:27.788+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:27.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:27.925+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:28.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:28.265+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:28.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:28.739+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:28.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:28.755+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:28.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:28.966+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:29.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:29.240+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:29.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:29.771+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:29.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:29.777+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:29.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:29.989+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:30.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:30.258+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:30.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:30.748+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:30.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:30.780+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:31.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:31.019+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:31.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:31.267+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:31.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:31.753+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:31.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:31.798+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:32.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:32.016+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:32.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:32.236+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:32.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:32.748+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:32.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:32.765+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:33.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:33.019+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:33.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:33.279+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:33.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:33.719+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:33.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:33.736+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:34.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:34.012+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:34.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:34.251+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:34.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:34.714+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:34.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:34.754+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:34.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:34.981+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:35.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:35.214+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:35.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:35.665+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:35.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:35.769+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:35.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:35.963+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:36.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:36.193+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:36.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:36.667+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:36.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:36.757+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:36.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:36.932+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:37.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:37.169+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:37.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:37.681+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:37.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:37.727+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:37.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:37.941+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:38.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:38.189+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:38.466 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:07:38.464+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:07:38.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:38.639+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:38.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:38.750+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:38.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:38.902+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:39.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:39.202+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:39.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:39.631+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:39.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:39.744+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:39.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:39.941+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:40.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:40.209+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:40.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:40.584+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:40.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:40.786+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:40.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:40.982+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:41.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:41.225+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:41.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:41.560+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:41.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:41.784+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:42.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:42.006+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:42.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:42.177+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:42.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:42.548+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:42.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:42.778+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:43.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:43.012+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:43.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:43.208+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:43.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:43.550+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:43.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:43.818+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:44.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:44.037+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:44.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:44.230+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:44.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:44.515+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:44.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:44.799+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:45.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:45.082+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:45.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:45.210+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:45.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:45.488+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:45.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:45.849+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:46.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:46.076+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:46.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:46.192+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:46.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:46.516+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:46.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:46.810+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:47.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:47.074+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:47.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:47.152+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:47.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:47.527+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:47.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:47.818+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:48.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:48.051+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:48.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:48.155+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:48.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:48.495+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:48.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:48.783+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:49.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:49.070+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:49.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:49.150+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:49.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:49.461+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:49.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:49.807+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:50.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:50.023+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:50.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:50.141+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:50.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:50.487+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:50.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:50.785+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:50.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:50.985+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:51.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:51.184+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:51.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:51.448+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:51.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:51.752+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:51.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:51.937+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:52.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:52.155+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:52.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:52.491+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:52.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:52.790+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:52.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:52.982+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:53.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:53.148+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:53.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:53.455+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:53.478 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:07:53.475+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:07:53.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:53.783+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:53.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:53.949+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:54.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:54.163+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:54.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:54.486+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:54.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:54.828+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:54.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:54.979+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:55.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:55.149+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:55.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:55.487+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:55.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:55.789+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:55.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:55.983+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:56.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:56.191+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:56.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:56.520+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:56.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:56.796+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:57.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:57.032+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:57.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:57.230+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:57.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:07:57.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:07:57.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:57.483+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:57.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:57.841+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:58.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:58.042+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:58.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:58.248+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:58.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:58.495+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:58.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:58.853+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:59.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:07:59.072+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:59.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:07:59.252+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:59.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:07:59.503+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:07:59.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:07:59.862+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:00.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:00.108+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:00.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:00.216+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:00.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:00.464+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:00.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:00.832+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:01.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:01.128+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:01.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:01.233+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:01.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:01.472+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:01.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:01.859+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:02.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:02.159+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:02.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:02.197+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:02.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:02.484+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:02.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:02.813+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:03.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:03.163+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:03.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:03.237+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:03.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:03.486+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:03.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:03.803+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:04.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:04.196+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:04.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:04.244+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:04.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:04.513+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:04.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:04.760+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:05.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:05.240+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:05.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:05.270+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:05.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:05.544+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:05.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:05.759+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:06.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:06.233+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:06.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:06.279+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:06.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:06.533+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:06.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:06.791+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:07.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:07.233+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:07.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:07.294+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:07.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:07.552+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:07.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:07.785+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:08.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:08.217+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:08.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:08.253+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:08.494 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:08:08.491+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:08:08.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:08.571+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:08.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:08.760+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:09.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:09.209+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:09.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:09.225+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:09.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:09.616+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:09.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:09.714+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:10.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:10.169+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:10.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:10.274+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:10.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:10.625+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:10.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:10.691+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:11.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:11.206+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:11.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:11.244+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:11.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:11.614+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:11.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:11.701+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:12.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:12.165+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:12.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:12.259+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:12.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:12.589+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:12.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:12.730+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:13.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:13.198+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:13.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:13.242+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:13.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:13.601+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:13.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:13.762+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:14.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:14.214+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:14.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:14.276+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:14.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:14.617+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:14.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:14.778+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:15.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:15.233+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:15.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:15.271+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:15.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:15.593+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:15.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:15.732+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:16.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:16.221+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:16.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:16.259+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:16.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:16.581+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:16.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:16.689+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:17.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:17.202+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:17.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:17.269+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:17.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:17.585+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:17.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:17.705+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:18.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:18.234+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:18.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:18.251+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:18.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:18.603+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:18.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:18.724+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:19.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:19.276+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:19.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:19.279+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:19.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:19.637+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:19.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:19.709+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:20.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:20.252+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:20.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:20.297+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:20.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:20.637+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:20.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:20.722+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:21.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:21.227+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:21.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:21.311+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:21.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:21.615+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:21.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:21.691+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:22.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:22.220+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:22.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:22.283+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:22.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:22.643+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:22.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:22.668+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:23.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:23.200+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:23.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:23.333+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:23.510 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:08:23.508+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:08:23.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:23.629+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:23.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:23.706+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:24.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:24.232+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:24.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:24.355+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:24.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:24.625+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:24.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:24.724+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:25.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:25.219+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:25.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:25.350+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:25.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:25.642+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:25.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:25.699+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:26.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:26.256+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:26.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:26.311+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:26.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:26.601+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:26.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:26.736+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:27.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:27.218+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:27.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:27.332+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:27.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:08:27.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:08:27.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:27.586+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:27.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:27.691+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:28.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:28.183+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:28.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:28.284+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:28.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:28.591+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:28.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:28.728+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:29.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:29.171+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:29.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:29.251+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:29.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:29.560+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:29.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:29.754+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:30.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:30.124+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:30.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:30.254+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:30.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:30.521+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:30.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:30.736+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:31.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:31.100+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:31.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:31.222+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:31.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:31.480+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:31.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:31.774+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:32.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:32.056+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:32.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:32.209+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:32.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:32.447+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:32.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:32.765+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:33.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:33.047+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:33.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:33.205+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:33.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:33.484+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:33.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:33.784+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:34.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:34.013+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:34.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:34.248+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:34.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:34.503+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:34.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:34.806+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:34.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:34.984+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:35.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:35.289+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:35.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:35.499+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:35.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:35.787+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:35.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:35.939+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:36.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:36.311+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:36.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:36.543+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:36.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:36.803+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:36.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:36.976+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:37.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:37.290+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:37.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:37.579+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:37.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:37.767+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:37.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:37.931+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:38.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:38.317+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:38.526 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:08:38.523+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:08:38.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:38.558+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:38.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:38.798+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:38.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:38.977+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:39.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:39.296+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:39.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:39.577+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:39.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:39.838+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:39.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:39.951+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:40.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:40.290+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:40.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:40.571+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:40.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:40.877+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:40.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:40.992+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:41.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:41.265+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:41.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:41.583+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:41.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:41.922+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:41.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:41.956+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:42.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:42.260+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:42.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:42.587+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:42.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:42.925+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:42.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:42.982+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:43.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:43.281+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:43.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:43.552+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:43.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:43.953+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:43.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:43.954+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:44.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:44.258+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:44.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:44.529+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:44.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:44.948+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:44.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:44.953+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:45.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:45.236+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:45.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:45.537+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:45.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:45.933+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:45.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:45.976+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:46.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:46.253+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:46.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:46.540+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:46.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:46.936+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:46.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:46.965+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:47.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:47.255+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:47.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:47.545+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:47.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:47.887+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:47.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:47.945+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:48.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:48.207+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:48.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:48.541+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:48.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:48.868+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:48.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:48.913+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:49.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:49.172+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:49.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:49.506+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:49.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:49.904+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:49.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:49.913+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:50.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:50.147+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:50.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:50.472+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:50.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:50.863+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:50.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:50.952+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:51.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:51.168+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:51.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:51.462+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:51.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:51.825+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:51.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:51.969+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:52.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:52.144+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:52.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:52.422+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:52.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:52.835+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:52.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:52.978+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:53.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:53.127+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:53.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:53.423+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:53.541 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:08:53.539+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:08:53.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:53.825+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:54.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:53.943+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:54.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:54.119+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:54.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:54.459+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:54.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:54.841+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:54.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:54.950+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:55.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:55.089+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:55.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:55.485+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:55.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:55.817+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:55.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:55.973+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:56.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:56.072+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:56.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:56.502+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:56.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:56.825+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:57.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:57.012+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:57.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:57.095+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:57.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:57.500+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:57.696 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:08:57.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:08:57.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:57.793+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:58.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:58.035+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:58.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:58.058+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:58.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:58.477+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:58.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:58.765+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:59.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:08:59.060+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:59.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:08:59.105+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:59.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:08:59.449+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:08:59.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:08:59.784+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:00.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:00.057+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:00.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:00.151+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:00.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:00.487+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:00.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:00.801+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:01.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:01.027+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:01.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:01.192+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:01.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:01.533+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:01.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:01.757+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:02.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:02.056+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:02.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:02.167+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:02.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:02.549+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:02.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:02.732+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:03.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:03.039+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:03.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:03.174+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:03.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:03.543+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:03.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:03.711+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:04.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:04.019+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:04.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:04.184+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:04.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:04.590+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:04.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:04.757+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:05.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:04.998+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:05.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:05.178+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:05.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:05.636+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:05.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:05.742+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:06.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:06.009+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:06.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:06.208+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:06.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:06.631+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:06.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:06.730+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:07.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:07.008+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:07.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:07.207+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:07.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:07.623+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:07.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:07.697+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:08.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:08.001+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:08.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:08.257+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:08.555 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:09:08.552+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:09:08.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:08.606+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:08.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:08.697+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:09.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:08.997+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:09.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:09.252+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:09.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:09.656+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:09.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:09.715+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:10.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:10.008+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:10.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:10.229+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:10.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:10.668+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:10.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:10.675+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:10.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:10.995+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:11.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:11.230+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:11.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:11.650+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:11.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:11.705+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:12.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:12.001+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:12.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:12.223+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:12.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:12.672+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:12.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:12.729+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:13.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:12.999+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:13.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:13.239+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:13.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:13.720+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:13.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:13.726+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:13.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:13.971+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:14.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:14.202+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:14.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:14.695+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:14.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:14.744+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:14.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:14.995+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:15.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:15.210+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:15.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:15.712+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:15.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:15.723+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:15.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:15.983+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:16.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:16.173+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:16.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:16.731+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:16.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:16.739+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:16.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:16.937+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:17.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:17.160+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:17.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:17.718+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:17.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:17.745+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:17.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:17.941+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:18.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:18.169+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:18.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:18.720+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:18.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:18.755+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:18.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:18.964+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:19.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:19.202+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:19.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:19.750+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:19.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:19.762+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:19.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:19.967+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:20.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:20.234+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:20.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:20.751+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:20.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:20.770+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:20.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:20.929+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:21.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:21.269+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:21.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:21.714+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:21.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:21.750+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:21.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:21.905+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:22.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:22.267+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:22.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:22.682+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:22.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:22.782+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:22.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:22.909+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:23.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:23.286+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:23.571 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:09:23.568+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:09:23.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:23.679+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:23.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:23.779+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:23.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:23.880+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:24.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:24.255+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:24.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:24.653+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:24.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:24.816+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:24.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:24.847+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:25.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:25.284+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:25.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:25.645+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:25.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:25.798+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:25.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:25.843+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:26.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:26.326+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:26.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:26.673+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:26.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:26.813+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:26.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:26.825+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:27.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:27.320+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:27.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:27.682+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:27.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:09:27.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:09:27.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:27.792+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:27.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:27.815+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:28.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:28.312+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:28.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:28.660+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:28.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:28.827+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:28.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:28.846+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:29.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:29.294+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:29.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:29.702+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:29.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:29.836+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:29.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:29.851+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:30.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:30.318+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:30.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:30.655+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:30.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:30.820+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:30.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:30.830+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:31.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:31.315+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:31.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:31.668+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:31.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:31.820+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:31.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:31.851+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:32.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:32.287+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:32.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:32.657+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:32.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:32.845+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:32.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:32.872+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:33.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:33.310+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:33.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:33.679+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:33.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:33.850+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:33.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:33.892+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:34.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:34.346+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:34.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:34.696+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:34.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:34.829+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:34.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:34.877+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:35.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:35.355+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:35.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:35.655+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:35.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:35.800+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:35.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:35.830+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:36.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:36.338+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:36.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:36.648+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:36.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:36.818+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:36.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:36.826+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:37.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:37.369+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:37.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:37.633+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:37.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:37.844+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:37.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:37.864+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:38.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:38.382+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:38.587 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:09:38.585+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:09:38.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:38.617+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:38.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:38.862+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:38.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:38.874+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:39.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:39.333+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:39.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:39.585+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:39.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:39.883+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:39.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:39.892+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:40.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:40.340+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:40.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:40.634+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:40.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:40.865+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:40.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:40.926+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:41.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:41.337+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:41.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:41.611+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:41.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:41.843+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:41.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:41.967+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:42.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:42.361+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:42.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:42.616+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:42.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:42.797+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:42.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:42.977+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:43.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:43.366+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:43.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:43.622+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:43.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:43.822+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:44.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:44.011+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:44.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:44.355+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:44.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:44.645+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:44.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:44.869+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:44.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:44.972+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:45.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:45.362+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:45.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:45.633+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:45.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:45.859+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:45.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:45.981+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:46.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:46.363+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:46.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:46.630+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:46.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:46.858+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:47.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:47.011+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:47.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:47.383+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:47.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:47.611+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:47.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:47.834+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:47.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:47.967+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:48.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:48.396+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:48.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:48.572+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:48.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:48.807+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:48.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:48.953+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:49.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:49.396+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:49.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:49.595+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:49.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:49.817+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:49.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:49.925+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:50.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:50.360+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:50.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:50.637+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:50.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:50.810+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:50.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:50.892+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:51.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:51.311+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:51.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:51.666+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:51.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:51.819+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:51.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:51.871+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:52.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:52.337+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:52.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:52.711+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:52.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:52.839+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:52.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:52.848+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:53.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:53.335+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:53.588 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:09:53.585+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:09:53.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:53.746+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:53.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:53.864+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:53.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:53.894+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:54.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:54.353+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:54.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:54.771+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:54.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:54.874+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:54.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:54.939+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:55.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:55.316+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:55.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:55.750+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:55.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:55.898+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:55.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:55.912+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:56.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:56.282+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:56.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:56.748+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:56.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:56.937+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:56.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:56.961+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:57.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:57.322+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:57.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:57.708+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:57.904 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:09:57.907 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:09:57.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:57.956+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:57.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:57.961+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:58.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:58.364+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:58.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:58.688+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:58.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:58.927+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:59.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:09:58.998+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:59.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:09:59.384+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:59.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:09:59.718+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:09:59.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:09:59.927+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:00.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:00.003+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:00.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:00.340+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:00.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:00.768+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:00.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:00.939+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:00.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:00.991+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:01.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:01.354+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:01.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:01.767+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:01.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:01.930+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:02.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:02.021+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:02.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:02.352+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:02.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:02.776+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:02.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:02.892+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:03.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:03.071+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:03.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:03.350+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:03.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:03.823+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:03.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:03.868+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:04.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:04.099+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:04.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:04.354+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:04.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:04.791+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:04.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:04.843+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:05.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:05.117+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:05.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:05.334+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:05.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:05.758+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:05.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:05.821+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:06.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:06.079+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:06.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:06.336+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:06.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:06.767+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:06.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:06.800+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:07.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:07.053+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:07.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:07.340+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:07.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:07.725+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:07.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:07.777+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:08.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:08.052+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:08.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:08.364+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:08.604 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:10:08.601+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:10:08.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:08.701+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:08.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:08.769+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:09.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:09.052+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:09.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:09.380+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:09.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:09.733+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:09.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:09.736+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:10.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:10.060+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:10.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:10.363+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:10.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:10.707+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:10.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:10.742+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:11.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:11.038+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:11.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:11.354+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:11.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:11.685+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:11.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:11.781+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:12.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:12.031+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:12.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:12.342+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:12.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:12.666+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:12.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:12.829+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:13.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:13.018+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:13.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:13.340+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:13.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:13.710+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:13.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:13.806+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:14.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:14.007+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:14.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:14.373+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:14.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:14.720+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:14.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:14.799+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:15.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:15.014+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:15.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:15.415+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:15.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:15.698+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:15.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:15.821+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:16.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:16.035+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:16.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:16.408+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:16.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:16.697+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:16.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:16.807+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:17.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:17.016+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:17.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:17.391+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:17.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:17.741+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:17.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:17.788+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:18.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:18.059+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:18.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:18.392+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:18.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:18.712+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:18.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:18.835+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:19.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:19.033+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:19.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:19.435+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:19.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:19.665+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:19.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:19.796+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:20.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:20.013+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:20.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:20.427+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:20.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:20.661+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:20.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:20.838+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:21.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:21.050+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:21.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:21.386+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:21.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:21.647+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:21.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:21.800+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:22.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:22.009+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:22.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:22.435+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:22.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:22.622+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:22.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:22.814+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:23.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:23.032+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:23.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:23.411+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:23.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:23.607+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:23.619 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:10:23.617+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:10:23.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:23.799+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:24.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:24.032+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:24.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:24.368+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:24.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:24.618+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:24.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:24.774+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:25.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:25.028+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:25.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:25.387+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:25.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:25.584+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:25.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:25.741+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:25.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:25.996+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:26.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:26.363+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:26.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:26.598+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:26.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:26.694+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:27.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:27.046+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:27.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:27.395+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:27.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:27.561+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:27.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:27.699+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:28.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:28.018+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:28.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:10:28.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:10:28.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:28.347+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:28.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:28.600+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:28.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:28.725+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:29.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:29.016+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:29.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:29.336+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:29.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:29.562+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:29.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:29.720+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:30.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:30.063+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:30.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:30.341+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:30.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:30.581+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:30.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:30.714+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:31.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:31.110+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:31.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:31.310+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:31.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:31.600+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:31.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:31.745+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:32.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:32.143+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:32.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:32.349+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:32.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:32.555+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:32.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:32.755+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:33.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:33.180+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:33.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:33.331+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:33.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:33.576+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:33.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:33.802+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:34.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:34.217+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:34.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:34.321+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:34.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:34.555+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:34.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:34.818+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:35.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:35.265+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:35.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:35.281+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:35.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:35.563+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:35.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:35.851+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:36.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:36.237+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:36.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:36.238+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:36.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:36.527+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:36.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:36.803+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:37.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:37.220+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:37.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:37.247+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:37.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:37.569+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:37.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:37.771+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:38.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:38.198+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:38.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:38.218+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:38.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:38.570+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:38.635 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:10:38.633+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:10:38.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:38.772+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:39.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:39.222+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:39.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:39.236+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:39.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:39.610+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:39.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:39.745+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:40.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:40.176+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:40.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:40.280+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:40.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:40.572+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:40.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:40.700+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:41.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:41.137+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:41.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:41.286+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:41.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:41.620+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:41.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:41.679+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:42.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:42.118+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:42.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:42.331+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:42.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:42.605+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:42.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:42.662+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:43.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:43.085+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:43.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:43.320+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:43.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:43.573+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:43.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:43.677+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:44.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:44.122+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:44.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:44.339+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:44.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:44.591+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:44.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:44.643+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:45.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:45.107+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:45.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:45.372+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:45.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:45.612+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:45.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:45.655+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:46.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:46.090+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:46.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:46.337+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:46.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:46.659+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:46.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:46.677+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:47.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:47.136+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:47.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:47.343+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:47.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:47.618+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:47.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:47.646+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:48.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:48.133+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:48.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:48.304+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:48.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:48.593+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:48.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:48.685+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:49.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:49.148+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:49.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:49.266+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:49.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:49.622+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:49.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:49.654+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:50.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:50.103+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:50.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:50.218+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:50.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:50.615+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:50.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:50.669+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:51.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:51.122+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:51.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:51.199+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:51.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:51.591+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:51.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:51.660+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:52.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:52.109+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:52.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:52.165+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:52.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:52.639+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:52.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:52.661+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:53.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:53.084+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:53.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:53.193+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:53.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:53.623+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:53.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:53.626+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:53.648 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:10:53.647+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:10:54.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:54.119+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:54.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:54.199+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:54.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:54.599+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:54.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:54.636+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:55.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:55.072+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:55.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:55.210+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:55.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:55.595+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:55.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:55.618+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:56.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:56.064+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:56.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:56.186+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:56.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:56.546+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:56.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:56.653+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:57.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:57.080+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:57.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:57.141+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:57.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:57.579+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:57.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:57.661+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:58.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:58.067+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:58.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:10:58.145 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:10:58.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:58.167+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:58.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:58.589+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:58.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:58.698+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:59.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:10:59.115+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:59.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:10:59.162+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:59.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:10:59.621+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:10:59.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:10:59.650+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:00.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:00.131+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:00.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:00.138+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:00.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:00.587+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:00.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:00.629+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:01.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:01.153+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:01.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:01.158+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:01.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:01.623+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:01.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:01.631+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:02.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:02.155+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:02.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:02.176+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:02.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:02.617+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:02.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:02.667+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:03.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:03.129+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:03.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:03.184+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:03.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:03.577+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:03.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:03.709+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:04.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:04.157+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:04.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:04.170+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:04.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:04.579+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:04.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:04.733+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:05.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:05.150+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:05.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:05.174+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:05.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:05.602+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:05.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:05.757+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:06.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:06.124+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:06.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:06.169+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:06.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:06.562+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:06.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:06.787+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:07.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:07.122+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:07.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:07.160+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:07.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:07.528+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:07.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:07.809+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:08.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:08.096+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:08.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:08.152+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:08.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:08.535+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:08.665 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:11:08.662+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:11:08.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:08.823+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:09.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:09.118+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:09.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:09.125+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:09.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:09.564+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:09.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:09.781+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:10.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:10.103+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:10.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:10.155+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:10.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:10.588+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:10.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:10.755+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:11.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:11.090+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:11.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:11.176+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:11.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:11.600+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:11.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:11.720+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:12.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:12.072+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:12.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:12.156+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:12.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:12.600+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:12.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:12.671+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:13.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:13.074+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:13.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:13.188+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:13.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:13.572+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:13.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:13.655+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:14.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:14.048+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:14.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:14.202+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:14.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:14.548+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:14.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:14.674+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:15.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:15.094+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:15.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:15.220+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:15.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:15.557+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:15.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:15.625+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:16.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:16.050+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:16.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:16.185+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:16.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:16.570+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:16.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:16.642+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:17.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:17.014+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:17.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:17.202+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:17.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:17.618+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:17.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:17.623+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:17.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:17.991+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:18.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:18.195+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:18.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:18.585+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:18.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:18.608+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:19.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:19.030+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:19.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:19.214+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:19.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:19.541+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:19.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:19.605+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:19.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:19.987+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:20.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:20.213+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:20.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:20.525+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:20.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:20.655+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:20.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:20.984+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:21.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:21.248+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:21.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:21.494+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:21.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:21.621+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:21.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:21.940+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:22.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:22.226+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:22.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:22.524+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:22.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:22.593+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:22.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:22.919+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:23.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:23.198+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:23.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:23.524+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:23.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:23.630+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:23.676 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:11:23.674+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:11:23.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:23.893+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:24.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:24.219+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:24.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:24.538+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:24.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:24.612+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:24.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:24.856+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:25.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:25.211+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:25.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:25.538+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:25.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:25.577+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:25.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:25.860+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:26.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:26.196+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:26.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:26.530+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:26.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:26.582+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:26.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:26.838+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:27.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:27.186+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:27.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:27.550+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:27.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:27.629+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:27.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:27.888+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:28.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:28.138+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:28.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:11:28.224 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:11:28.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:28.578+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:28.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:28.606+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:28.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:28.903+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:29.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:29.152+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:29.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:29.535+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:29.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:29.621+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:29.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:29.927+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:30.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:30.116+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:30.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:30.522+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:30.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:30.626+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:30.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:30.961+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:31.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:31.139+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:31.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:31.525+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:31.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:31.627+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:32.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:32.003+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:32.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:32.183+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:32.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:32.560+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:32.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:32.615+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:32.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:32.958+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:33.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:33.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:33.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:33.549+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:33.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:33.566+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:33.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:33.993+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:34.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:34.175+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:34.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:34.562+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:34.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:34.572+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:34.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:34.983+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:35.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:35.194+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:35.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:35.559+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:35.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:35.578+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:35.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:35.982+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:36.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:36.178+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:36.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:36.597+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:36.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:36.607+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:36.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:36.973+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:37.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:37.164+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:37.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:37.606+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:37.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:37.616+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:38.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:38.000+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:38.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:38.158+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:38.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:38.581+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:38.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:38.630+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:38.692 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:11:38.689+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:11:38.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:38.965+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:39.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:39.135+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:39.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:39.550+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:39.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:39.589+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:39.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:39.943+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:40.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:40.157+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:40.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:40.515+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:40.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:40.592+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:40.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:40.977+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:41.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:41.182+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:41.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:41.501+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:41.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:41.575+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:42.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:42.020+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:42.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:42.191+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:42.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:42.490+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:42.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:42.621+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:42.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:42.977+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:43.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:43.231+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:43.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:43.537+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:43.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:43.618+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:44.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:43.999+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:44.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:44.208+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:44.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:44.524+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:44.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:44.630+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:45.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:45.039+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:45.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:45.232+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:45.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:45.493+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:45.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:45.625+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:46.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:46.035+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:46.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:46.275+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:46.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:46.531+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:46.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:46.606+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:47.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:47.046+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:47.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:47.255+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:47.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:47.490+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:47.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:47.620+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:48.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:48.067+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:48.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:48.290+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:48.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:48.465+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:48.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:48.591+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:49.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:49.091+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:49.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:49.241+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:49.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:49.465+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:49.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:49.618+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:50.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:50.056+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:50.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:50.262+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:50.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:50.465+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:50.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:50.664+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:51.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:51.047+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:51.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:51.267+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:51.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:51.478+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:51.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:51.697+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:52.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:52.014+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:52.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:52.308+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:52.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:52.516+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:52.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:52.660+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:52.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:52.978+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:53.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:53.307+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:53.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:53.548+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:53.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:53.616+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:53.708 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:11:53.705+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:11:54.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:54.014+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:54.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:54.275+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:54.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:54.536+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:54.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:54.602+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:55.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:55.047+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:55.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:55.322+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:55.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:55.504+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:55.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:55.644+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:56.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:56.057+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:56.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:56.324+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:56.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:56.518+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:56.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:56.673+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:57.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:57.068+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:57.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:57.364+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:57.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:57.535+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:57.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:57.671+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:58.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:58.074+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:58.364 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:11:58.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:11:58.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:58.401+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:58.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:58.540+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:58.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:58.686+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:59.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:11:59.056+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:59.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:11:59.396+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:59.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:11:59.578+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:11:59.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:11:59.735+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:00.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:00.053+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:00.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:00.425+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:00.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:00.575+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:00.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:00.733+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:01.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:01.069+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:01.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:01.459+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:01.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:01.602+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:01.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:01.782+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:02.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:02.045+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:02.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:02.415+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:02.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:02.651+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:02.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:02.809+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:03.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:03.035+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:03.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:03.407+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:03.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:03.642+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:03.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:03.785+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:04.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:04.005+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:04.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:04.446+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:04.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:04.672+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:04.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:04.833+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:05.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:05.023+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:05.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:05.456+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:05.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:05.704+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:05.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:05.864+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:05.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:05.987+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:06.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:06.478+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:06.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:06.663+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:06.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:06.897+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:06.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:06.972+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:07.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:07.505+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:07.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:07.699+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:07.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:07.905+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:07.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:07.947+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:08.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:08.493+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:08.724 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:12:08.722+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:12:08.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:08.737+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:08.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:08.910+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:08.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:08.950+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:09.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:09.499+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:09.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:09.780+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:09.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:09.911+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:09.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:09.965+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:10.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:10.469+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:10.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:10.748+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:10.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:10.897+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:10.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:10.916+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:11.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:11.438+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:11.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:11.796+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:11.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:11.848+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:11.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:11.900+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:12.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:12.447+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:12.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:12.804+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:12.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:12.814+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:12.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:12.858+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:13.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:13.433+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:13.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:13.779+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:13.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:13.848+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:13.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:13.894+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:14.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:14.400+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:14.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:14.782+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:14.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:14.858+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:14.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:14.933+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:15.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:15.362+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:15.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:15.800+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:15.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:15.864+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:15.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:15.887+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:16.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:16.398+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:16.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:16.839+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:16.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:16.906+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:16.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:16.915+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:17.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:17.367+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:17.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:17.869+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:17.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:17.891+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:17.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:17.921+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:18.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:18.393+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:18.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:18.823+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:18.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:18.927+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:18.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:18.962+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:19.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:19.403+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:19.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:19.774+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:19.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:19.880+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:19.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:19.942+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:20.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:20.397+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:20.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:20.732+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:20.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:20.913+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:20.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:20.944+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:21.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:21.418+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:21.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:21.709+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:21.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:21.886+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:21.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:21.991+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:22.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:22.394+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:22.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:22.746+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:22.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:22.863+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:23.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:23.009+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:23.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:23.391+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:23.740 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:12:23.737+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:12:23.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:23.753+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:23.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:23.882+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:23.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:23.964+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:24.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:24.343+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:24.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:24.769+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:24.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:24.892+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:24.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:24.923+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:25.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:25.339+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:25.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:25.806+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:25.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:25.892+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:25.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:25.948+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:26.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:26.327+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:26.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:26.846+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:26.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:26.848+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:26.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:26.964+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:27.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:27.319+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:27.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:27.800+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:27.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:27.888+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:28.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:27.997+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:28.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:28.326+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:28.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:12:28.487 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:12:28.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:28.760+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:28.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:28.848+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:28.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:28.995+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:29.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:29.298+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:29.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:29.800+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:29.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:29.809+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:29.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:29.966+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:30.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:30.280+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:30.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:30.756+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:30.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:30.764+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:30.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:30.917+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:31.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:31.312+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:31.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:31.733+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:31.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:31.763+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:31.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:31.895+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:32.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:32.341+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:32.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:32.687+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:32.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:32.725+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:32.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:32.854+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:33.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:33.363+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:33.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:33.694+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:33.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:33.724+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:33.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:33.813+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:34.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:34.391+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:34.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:34.659+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:34.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:34.751+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:34.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:34.788+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:35.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:35.421+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:35.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:35.639+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:35.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:35.709+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:35.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:35.808+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:36.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:36.409+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:36.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:36.648+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:36.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:36.663+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:36.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:36.839+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:37.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:37.427+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:37.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:37.650+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:37.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:37.711+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:37.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:37.796+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:38.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:38.473+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:38.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:38.608+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:38.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:38.737+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:38.755 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:12:38.754+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:12:38.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:38.845+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:39.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:39.509+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:39.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:39.614+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:39.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:39.769+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:39.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:39.843+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:40.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:40.480+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:40.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:40.618+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:40.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:40.748+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:40.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:40.883+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:41.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:41.507+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:41.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:41.588+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:41.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:41.719+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:41.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:41.900+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:42.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:42.516+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:42.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:42.590+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:42.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:42.678+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:42.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:42.918+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:43.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:43.538+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:43.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:43.639+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:43.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:43.647+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:43.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:43.922+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:44.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:44.523+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:44.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:44.606+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:44.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:44.646+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:44.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:44.967+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:45.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:45.552+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:45.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:45.619+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:45.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:45.654+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:45.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:45.988+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:46.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:46.523+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:46.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:46.633+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:46.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:46.636+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:46.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:46.941+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:47.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:47.514+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:47.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:47.607+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:47.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:47.682+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:47.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:47.954+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:48.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:48.496+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:48.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:48.564+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:48.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:48.665+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:48.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:48.997+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:49.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:49.524+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:49.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:49.545+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:49.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:49.623+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:50.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:50.012+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:50.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:50.475+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:50.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:50.549+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:50.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:50.654+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:51.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:51.026+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:51.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:51.481+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:51.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:51.588+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:51.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:51.693+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:52.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:51.997+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:52.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:52.477+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:52.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:52.548+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:52.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:52.652+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:53.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:53.036+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:53.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:53.440+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:53.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:53.525+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:53.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:53.631+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:53.771 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:12:53.769+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:12:54.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:54.036+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:54.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:54.423+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:54.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:54.515+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:54.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:54.645+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:55.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:55.064+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:55.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:55.403+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:55.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:55.556+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:55.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:55.625+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:56.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:56.095+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:56.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:56.428+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:56.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:56.569+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:56.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:56.640+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:57.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:57.111+0000 7f6e44c9f700 -1 osd.7 105 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:57.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:57.454+0000 7f596d92c700 -1 osd.6 105 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:57.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:57.565+0000 7f72c425d700 -1 osd.5 105 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:57.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:57.646+0000 7f389e18e700 -1 osd.4 105 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:57.854 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:12:57.851+0000 7f7cb8e0f700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:12:57.868 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T00:12:57.851+0000 7f7cb8e0f700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:12:57.891 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T00:12:58.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:58.152+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:58.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:58.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:58.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:58.558+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:58.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:12:58.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:12:58.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:58.692+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:59.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:12:59.177+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:59.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:12:59.446+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:59.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:12:59.578+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:12:59.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:12:59.659+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:00.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:00.222+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:00.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:00.397+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:00.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:00.596+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:00.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:00.662+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:01.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:01.265+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:01.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:01.380+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:01.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:01.614+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:01.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:01.661+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:02.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:02.237+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:02.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:02.408+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:02.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:02.569+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:02.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:02.649+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:03.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:03.263+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:03.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:03.360+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:03.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:03.617+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:03.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:03.678+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:04.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:04.285+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:04.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:04.324+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:04.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:04.648+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:04.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:04.660+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:05.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:05.293+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:05.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:05.308+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:05.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:05.635+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:05.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:05.635+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:06.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:06.272+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:06.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:06.317+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:06.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:06.667+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:06.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:06.677+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:07.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:07.292+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:07.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:07.325+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:07.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:07.662+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:07.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:07.698+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:08.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:08.246+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:08.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:08.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:08.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:08.643+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:08.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:08.680+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:08.784 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:13:08.781+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:13:09.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:09.282+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:09.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:09.388+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:09.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:09.684+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:09.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:09.692+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:10.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:10.271+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:10.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:10.431+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:10.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:10.678+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:10.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:10.730+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:11.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:11.261+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:11.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:11.386+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:11.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:11.679+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:11.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:11.742+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:12.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:12.290+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:12.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:12.356+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:12.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:12.674+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:12.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:12.751+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:13.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:13.250+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:13.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:13.312+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:13.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:13.629+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:13.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:13.794+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:14.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:14.234+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:14.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:14.295+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:14.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:14.636+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:14.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:14.754+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:15.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:15.232+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:15.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:15.257+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:15.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:15.684+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:15.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:15.771+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:16.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:16.241+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:16.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:16.266+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:16.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:16.704+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:16.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:16.759+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:17.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:17.208+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:17.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:17.229+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:17.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:17.751+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:17.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:17.751+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:18.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:18.187+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:18.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:18.236+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:18.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:18.716+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:18.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:18.723+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:19.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:19.205+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:19.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:19.234+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:19.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:19.730+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:19.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:19.739+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:20.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:20.183+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:20.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:20.254+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:20.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:20.755+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:20.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:20.758+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:21.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:21.176+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:21.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:21.206+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:21.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:21.708+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:21.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:21.733+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:22.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:22.190+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:22.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:22.246+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:22.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:22.726+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:22.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:22.756+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:23.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:23.178+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:23.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:23.221+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:23.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:23.767+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:23.786 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:13:23.783+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:13:23.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:23.802+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:24.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:24.149+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:24.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:24.237+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:24.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:24.739+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:24.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:24.789+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:25.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:25.179+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:25.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:25.278+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:25.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:25.774+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:25.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:25.786+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:26.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:26.227+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:26.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:26.265+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:26.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:26.725+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:26.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:26.795+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:27.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:27.192+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:27.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:27.267+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:27.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:27.727+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:27.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:27.818+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:28.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:28.226+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:28.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:28.304+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:28.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:13:28.768 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:13:28.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:28.775+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:28.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:28.803+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:29.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:29.202+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:29.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:29.303+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:29.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:29.818+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:29.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:29.832+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:30.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:30.182+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:30.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:30.325+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:30.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:30.842+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:30.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:30.864+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:31.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:31.226+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:31.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:31.306+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:31.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:31.822+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:31.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:31.828+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:32.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:32.203+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:32.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:32.307+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:32.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:32.793+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:32.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:32.797+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:33.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:33.226+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:33.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:33.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:33.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:33.754+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:33.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:33.809+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:34.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:34.241+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:34.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:34.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:34.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:34.772+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:34.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:34.801+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:35.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:35.197+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:35.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:35.312+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:35.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:35.752+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:35.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:35.789+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:36.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:36.183+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:36.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:36.288+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:36.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:36.726+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:36.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:36.760+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:37.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:37.224+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:37.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:37.313+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:37.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:37.722+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:37.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:37.802+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:38.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:38.211+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:38.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:38.349+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:38.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:38.762+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:38.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:38.778+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:38.792 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:13:38.789+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:13:39.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:39.184+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:39.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:39.391+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:39.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:39.770+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:39.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:39.787+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:40.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:40.187+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:40.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:40.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:40.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:40.738+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:40.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:40.800+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:41.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:41.144+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:41.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:41.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:41.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:41.772+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:41.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:41.800+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:42.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:42.107+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:42.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:42.411+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:42.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:42.743+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:42.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:42.773+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:43.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:43.064+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:43.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:43.388+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:43.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:43.741+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:43.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:43.758+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:44.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:44.069+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:44.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:44.431+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:44.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:44.709+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:44.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:44.782+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:45.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:45.054+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:45.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:45.431+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:45.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:45.708+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:45.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:45.761+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:46.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:46.025+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:46.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:46.429+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:46.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:46.729+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:46.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:46.756+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:47.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:47.042+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:47.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:47.437+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:47.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:47.727+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:47.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:47.783+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:48.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:48.041+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:48.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:48.441+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:48.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:48.757+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:48.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:48.764+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:49.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:49.055+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:49.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:49.465+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:49.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:49.754+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:49.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:49.774+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:50.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:50.059+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:50.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:50.437+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:50.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:50.747+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:50.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:50.801+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:51.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:51.096+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:51.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:51.460+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:51.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:51.741+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:51.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:51.825+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:52.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:52.144+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:52.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:52.435+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:52.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:52.758+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:52.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:52.817+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:53.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:53.102+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:53.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:53.410+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:53.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:53.750+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:53.804 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:13:53.802+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:13:53.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:53.866+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:54.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:54.115+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:54.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:54.372+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:54.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:54.740+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:54.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:54.907+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:55.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:55.122+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:55.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:55.372+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:55.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:55.696+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:55.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:55.942+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:56.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:56.086+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:56.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:56.398+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:56.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:56.670+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:56.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:56.964+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:57.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:57.063+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:57.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:57.369+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:57.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:57.695+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:58.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:58.005+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:58.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:58.016+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:58.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:58.336+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:58.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:58.710+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:58.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:13:58.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:13:58.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:13:58.986+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:59.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:13:59.011+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:59.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:13:59.342+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:13:59.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:13:59.753+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:00.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:00.013+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:00.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:00.039+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:00.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:00.333+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:00.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:00.732+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:00.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:00.996+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:01.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:01.066+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:01.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:01.373+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:01.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:01.707+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:01.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:01.954+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:02.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:02.088+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:02.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:02.418+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:02.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:02.731+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:02.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:02.912+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:03.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:03.117+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:03.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:03.387+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:03.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:03.733+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:03.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:03.869+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:04.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:04.126+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:04.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:04.363+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:04.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:04.771+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:04.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:04.826+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:05.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:05.150+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:05.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:05.401+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:05.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:05.820+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:05.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:05.820+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:06.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:06.147+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:06.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:06.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:06.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:06.781+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:06.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:06.804+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:07.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:07.131+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:07.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:07.469+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:07.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:07.762+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:07.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:07.810+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:08.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:08.178+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:08.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:08.452+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:08.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:08.713+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:08.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:08.778+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:08.819 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:14:08.817+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:14:09.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:09.221+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:09.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:09.489+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:09.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:09.702+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:09.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:09.777+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:10.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:10.196+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:10.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:10.450+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:10.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:10.691+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:10.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:10.748+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:11.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:11.154+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:11.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:11.413+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:11.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:11.715+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:11.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:11.725+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:12.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:12.169+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:12.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:12.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:12.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:12.700+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:12.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:12.735+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:13.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:13.194+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:13.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:13.396+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:13.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:13.656+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:13.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:13.712+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:14.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:14.208+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:14.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:14.433+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:14.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:14.673+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:14.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:14.704+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:15.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:15.199+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:15.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:15.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:15.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:15.642+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:15.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:15.668+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:16.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:16.174+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:16.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:16.435+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:16.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:16.665+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:16.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:16.692+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:17.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:17.163+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:17.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:17.424+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:17.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:17.647+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:17.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:17.694+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:18.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:18.180+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:18.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:18.465+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:18.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:18.660+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:18.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:18.736+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:19.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:19.225+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:19.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:19.499+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:19.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:19.667+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:19.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:19.707+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:20.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:20.271+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:20.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:20.523+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:20.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:20.692+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:20.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:20.693+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:21.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:21.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:21.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:21.486+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:21.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:21.666+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:21.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:21.696+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:22.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:22.215+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:22.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:22.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:22.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:22.682+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:22.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:22.709+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:23.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:23.214+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:23.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:23.439+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:23.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:23.681+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:23.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:23.714+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:23.835 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:14:23.833+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:14:24.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:24.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:24.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:24.426+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:24.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:24.720+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:24.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:24.720+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:25.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:25.280+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:25.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:25.395+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:25.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:25.698+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:25.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:25.744+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:26.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:26.282+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:26.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:26.355+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:26.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:26.729+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:26.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:26.780+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:27.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:27.285+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:27.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:27.399+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:27.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:27.719+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:27.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:27.754+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:28.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:28.273+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:28.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:28.366+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:28.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:28.709+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:28.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:28.745+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:29.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:14:29.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:14:29.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:29.251+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:29.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:29.349+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:29.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:29.751+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:29.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:29.780+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:30.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:30.270+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:30.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:30.317+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:30.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:30.774+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:30.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:30.788+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:31.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:31.274+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:31.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:31.281+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:31.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:31.736+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:31.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:31.739+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:32.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:32.249+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:32.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:32.326+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:32.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:32.732+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:32.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:32.783+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:33.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:33.253+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:33.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:33.297+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:33.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:33.758+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:33.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:33.834+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:34.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:34.242+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:34.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:34.286+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:34.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:34.733+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:34.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:34.826+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:35.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:35.264+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:35.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:35.337+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:35.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:35.765+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:35.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:35.871+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:36.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:36.303+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:36.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:36.371+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:36.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:36.798+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:36.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:36.870+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:37.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:37.333+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:37.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:37.350+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:37.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:37.755+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:37.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:37.837+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:38.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:38.337+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:38.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:38.344+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:38.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:38.725+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:38.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:38.799+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:38.852 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:14:38.849+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:14:39.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:39.351+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:39.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:39.365+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:39.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:39.746+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:39.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:39.842+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:40.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:40.335+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:40.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:40.359+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:40.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:40.754+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:40.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:40.849+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:41.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:41.316+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:41.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:41.354+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:41.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:41.744+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:41.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:41.874+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:42.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:42.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:42.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:42.361+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:42.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:42.710+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:42.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:42.827+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:43.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:43.300+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:43.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:43.324+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:43.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:43.731+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:43.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:43.823+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:44.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:44.332+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:44.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:44.359+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:44.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:44.723+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:44.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:44.830+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:45.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:45.288+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:45.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:45.365+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:45.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:45.721+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:45.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:45.879+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:46.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:46.322+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:46.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:46.352+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:46.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:46.685+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:46.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:46.838+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:47.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:47.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:47.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:47.366+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:47.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:47.705+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:47.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:47.843+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:48.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:48.319+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:48.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:48.412+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:48.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:48.711+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:48.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:48.887+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:49.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:49.321+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:49.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:49.402+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:49.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:49.740+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:49.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:49.897+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:50.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:50.290+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:50.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:50.427+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:50.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:50.743+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:50.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:50.863+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:51.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:51.272+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:51.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:51.415+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:51.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:51.710+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:51.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:51.869+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:52.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:52.302+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:52.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:52.390+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:52.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:52.753+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:52.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:52.834+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:53.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:53.341+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:53.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:53.365+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:53.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:53.758+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:53.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:53.805+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:53.853 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:14:53.850+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:14:54.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:54.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:54.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:54.378+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:54.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:54.764+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:54.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:54.825+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:55.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:55.324+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:55.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:55.381+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:55.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:55.774+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:55.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:55.792+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:56.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:56.329+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:56.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:56.357+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:56.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:56.783+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:56.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:56.808+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:57.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:57.305+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:57.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:57.324+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:57.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:57.738+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:57.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:57.783+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:58.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:58.282+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:58.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:58.291+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:58.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:58.699+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:58.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:58.803+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:59.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:14:59.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:14:59.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:14:59.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:59.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:14:59.285+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:59.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:14:59.704+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:14:59.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:14:59.804+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:00.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:00.276+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:00.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:00.332+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:00.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:00.740+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:00.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:00.844+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:01.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:01.307+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:01.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:01.378+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:01.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:01.738+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:01.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:01.811+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:02.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:02.291+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:02.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:02.375+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:02.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:02.774+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:02.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:02.792+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:03.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:03.266+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:03.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:03.390+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:03.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:03.741+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:03.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:03.800+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:04.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:04.284+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:04.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:04.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:04.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:04.716+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:04.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:04.759+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:05.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:05.304+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:05.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:05.379+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:05.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:05.754+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:05.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:05.764+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:06.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:06.295+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:06.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:06.390+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:06.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:06.716+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:06.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:06.737+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:07.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:07.279+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:07.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:07.439+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:07.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:07.697+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:07.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:07.753+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:08.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:08.308+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:08.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:08.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:08.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:08.670+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:08.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:08.712+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:08.869 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:15:08.867+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:15:09.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:09.280+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:09.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:09.409+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:09.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:09.628+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:09.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:09.691+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:10.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:10.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:10.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:10.360+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:10.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:10.622+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:10.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:10.732+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:11.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:11.274+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:11.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:11.340+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:11.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:11.617+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:11.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:11.764+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:12.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:12.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:12.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:12.294+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:12.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:12.626+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:12.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:12.732+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:13.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:13.265+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:13.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:13.285+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:13.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:13.653+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:13.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:13.779+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:14.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:14.226+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:14.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:14.335+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:14.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:14.652+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:14.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:14.735+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:15.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:15.270+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:15.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:15.332+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:15.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:15.636+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:15.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:15.759+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:16.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:16.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:16.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:16.378+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:16.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:16.643+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:16.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:16.801+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:17.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:17.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:17.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:17.331+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:17.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:17.598+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:17.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:17.841+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:18.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:18.208+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:18.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:18.373+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:18.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:18.645+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:18.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:18.799+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:19.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:19.225+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:19.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:19.378+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:19.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:19.658+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:19.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:19.771+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:20.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:20.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:20.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:20.399+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:20.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:20.674+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:20.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:20.778+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:21.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:21.248+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:21.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:21.408+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:21.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:21.703+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:21.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:21.768+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:22.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:22.214+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:22.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:22.425+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:22.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:22.664+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:22.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:22.813+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:23.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:23.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:23.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:23.438+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:23.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:23.708+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:23.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:23.825+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:23.884 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:15:23.881+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:15:24.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:24.236+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:24.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:24.434+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:24.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:24.707+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:24.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:24.848+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:25.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:25.222+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:25.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:25.416+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:25.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:25.713+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:25.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:25.817+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:26.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:26.218+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:26.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:26.416+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:26.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:26.672+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:26.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:26.787+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:27.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:27.253+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:27.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:27.426+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:27.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:27.634+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:27.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:27.804+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:28.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:28.214+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:28.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:28.440+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:28.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:28.634+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:28.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:28.782+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:29.226 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:15:29.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:15:29.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:29.258+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:29.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:29.441+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:29.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:29.671+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:29.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:29.771+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:30.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:30.271+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:30.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:30.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:30.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:30.634+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:30.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:30.768+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:31.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:31.297+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:31.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:31.418+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:31.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:31.684+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:31.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:31.812+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:32.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:32.339+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:32.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:32.427+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:32.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:32.727+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:32.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:32.814+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:33.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:33.342+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:33.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:33.440+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:33.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:33.682+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:33.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:33.806+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:34.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:34.308+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:34.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:34.399+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:34.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:34.649+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:34.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:34.761+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:35.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:35.277+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:35.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:35.358+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:35.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:35.627+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:35.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:35.772+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:36.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:36.240+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:36.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:36.405+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:36.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:36.587+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:36.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:36.768+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:37.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:37.213+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:37.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:37.431+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:37.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:37.606+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:37.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:37.762+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:38.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:38.256+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:38.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:38.422+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:38.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:38.595+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:38.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:38.730+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:38.887 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:15:38.884+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:15:39.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:39.276+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:39.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:39.382+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:39.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:39.583+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:39.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:39.778+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:40.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:40.265+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:40.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:40.365+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:40.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:40.629+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:40.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:40.772+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:41.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:41.297+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:41.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:41.334+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:41.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:41.654+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:41.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:41.766+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:42.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:42.293+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:42.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:42.327+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:42.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:42.635+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:42.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:42.810+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:43.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:43.310+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:43.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:43.314+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:43.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:43.659+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:43.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:43.827+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:44.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:44.302+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:44.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:44.358+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:44.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:44.680+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:44.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:44.877+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:45.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:45.274+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:45.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:45.314+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:45.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:45.665+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:45.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:45.907+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:46.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:46.310+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:46.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:46.330+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:46.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:46.700+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:46.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:46.876+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:47.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:47.262+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:47.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:47.300+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:47.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:47.662+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:47.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:47.901+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:48.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:48.243+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:48.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:48.299+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:48.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:48.623+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:48.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:48.898+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:49.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:49.200+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:49.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:49.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:49.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:49.596+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:49.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:49.913+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:50.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:50.159+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:50.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:50.307+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:50.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:50.625+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:50.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:50.907+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:51.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:51.148+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:51.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:51.292+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:51.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:51.622+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:51.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:51.926+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:52.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:52.134+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:52.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:52.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:52.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:52.574+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:52.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:52.928+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:53.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:53.113+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:53.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:53.306+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:53.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:53.619+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:53.900 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:15:53.897+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:15:53.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:53.933+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:54.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:54.097+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:54.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:54.355+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:54.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:54.578+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:54.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:54.911+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:55.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:55.060+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:55.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:55.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:55.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:55.596+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:55.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:55.952+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:56.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:56.086+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:56.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:56.350+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:56.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:56.583+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:56.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:56.947+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:57.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:57.125+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 42 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:57.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:57.353+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:57.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:57.615+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:57.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:57.912+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:58.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:58.112+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:58.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:58.356+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:58.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:58.632+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:58.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:58.949+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:59.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:15:59.109+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:59.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:15:59.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:15:59.370+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:15:59.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:15:59.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:15:59.636+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:00.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:15:59.998+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:00.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:00.131+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:00.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:00.354+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:00.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:00.660+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:00.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:00.964+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:01.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:01.119+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:01.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:01.394+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:01.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:01.649+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:01.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:01.919+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:02.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:02.130+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:02.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:02.383+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:02.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:02.684+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:02.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:02.932+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:03.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:03.097+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:03.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:03.426+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:03.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:03.665+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:03.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:03.966+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:04.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:04.062+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:04.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:04.467+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:04.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:04.658+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:04.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:04.928+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:05.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:05.021+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:05.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:05.492+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:05.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:05.661+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:05.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:05.915+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:05.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:05.990+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:06.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:06.506+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:06.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:06.698+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:06.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:06.874+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:06.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:06.976+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:07.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:07.512+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:07.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:07.730+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:07.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:07.915+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:07.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:07.952+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:08.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:08.473+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:08.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:08.773+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:08.916 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:16:08.913+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:16:08.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:08.937+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:08.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:08.945+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:09.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:09.444+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:09.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:09.820+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:09.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:09.897+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:09.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:09.930+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:10.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:10.448+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:10.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:10.858+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:10.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:10.891+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:10.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:10.943+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:11.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:11.421+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:11.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:11.838+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:11.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:11.941+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:11.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:11.941+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:12.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:12.432+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:12.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:12.838+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:12.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:12.936+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:12.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:12.980+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:13.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:13.387+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:13.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:13.859+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:13.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:13.955+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:13.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:13.989+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:14.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:14.434+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:14.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:14.896+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:14.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:14.927+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:14.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:14.967+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:15.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:15.398+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:15.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:15.883+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:15.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:15.916+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:16.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:16.009+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:16.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:16.375+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:16.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:16.929+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:16.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:16.929+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:17.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:16.998+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:17.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:17.350+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:17.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:17.894+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:17.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:17.935+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:18.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:18.023+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:18.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:18.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:18.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:18.894+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:18.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:18.909+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:19.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:19.028+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:19.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:19.395+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:19.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:19.896+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:19.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:19.918+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:20.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:20.003+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:20.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:20.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:20.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:20.910+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:20.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:20.939+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:20.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:20.982+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:21.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:21.362+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:21.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:21.914+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:21.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:21.922+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:22.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:22.002+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:22.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:22.313+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:22.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:22.936+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:22.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:22.951+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:23.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:23.001+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:23.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:23.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:23.931 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:16:23.930+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:16:23.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:23.949+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:23.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:23.977+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:24.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:24.025+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:24.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:24.372+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:24.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:24.910+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:25.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:25.015+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:25.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:25.020+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:25.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:25.388+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:25.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:25.879+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:25.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:25.992+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:26.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:26.004+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:26.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:26.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:26.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:26.868+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:26.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:26.982+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:26.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:26.990+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:27.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:27.416+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:27.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:27.888+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:27.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:27.979+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:27.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:27.984+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:28.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:28.456+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:28.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:28.937+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:28.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:28.948+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:29.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:29.019+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:29.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:29.444+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:29.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:16:29.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:16:29.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:29.891+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:29.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:29.926+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:30.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:30.007+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:30.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:30.452+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:30.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:30.860+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:30.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:30.927+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:30.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:30.991+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:31.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:31.406+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:31.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:31.819+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:31.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:31.960+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:32.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:32.006+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:32.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:32.384+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:32.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:32.785+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:32.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:32.950+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:32.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:32.987+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:33.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:33.369+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:33.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:33.835+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:33.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:33.914+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:33.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:33.976+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:34.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:34.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:34.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:34.831+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:34.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:34.875+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:35.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:35.000+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:35.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:35.381+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:35.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:35.839+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:35.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:35.920+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:35.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:35.993+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:36.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:36.403+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:36.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:36.821+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:36.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:36.944+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:37.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:37.023+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:37.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:37.406+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:37.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:37.836+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:37.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:37.940+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:38.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:38.012+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:38.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:38.381+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:38.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:38.856+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:38.938 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:16:38.936+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:16:38.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:38.965+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:39.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:39.025+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:39.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:39.418+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:39.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:39.826+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:39.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:39.986+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:39.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:39.987+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:40.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:40.403+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:40.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:40.846+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:40.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:40.946+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:40.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:40.947+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:41.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:41.398+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:41.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:41.812+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:41.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:41.941+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:41.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:41.954+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:42.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:42.371+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:42.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:42.782+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:42.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:42.915+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:42.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:42.984+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:43.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:43.408+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:43.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:43.750+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:43.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:43.955+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:43.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:43.963+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:44.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:44.424+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:44.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:44.784+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:44.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:44.924+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:44.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:44.972+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:45.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:45.404+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:45.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:45.750+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:45.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:45.905+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:45.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:45.956+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:46.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:46.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:46.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:46.765+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:46.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:46.905+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:46.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:46.962+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:47.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:47.423+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:47.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:47.734+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:47.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:47.876+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:47.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:47.981+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:48.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:48.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:48.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:48.767+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:48.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:48.921+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:49.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:48.933+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:49.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:49.442+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:49.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:49.761+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:49.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:49.899+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:49.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:49.956+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:50.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:50.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:50.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:50.798+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:50.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:50.923+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:50.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:50.939+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:51.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:51.399+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:51.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:51.756+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:51.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:51.910+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:51.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:51.957+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:52.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:52.371+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:52.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:52.790+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:52.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:52.864+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:52.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:52.938+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:53.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:53.410+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:53.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:53.773+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:53.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:53.819+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:53.954 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:16:53.952+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:16:53.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:53.971+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:54.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:54.395+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:54.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:54.762+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:54.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:54.863+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:54.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:54.962+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:55.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:55.440+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:55.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:55.756+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:55.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:55.845+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:55.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:55.975+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:56.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:56.472+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:56.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:56.717+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:56.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:56.872+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:57.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:57.020+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:57.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:57.515+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:57.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:57.722+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:57.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:57.872+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:58.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:58.014+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:58.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:58.535+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:58.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:58.691+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:58.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:58.850+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:59.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:16:59.034+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:59.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:16:59.500+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:59.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:16:59.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:16:59.651+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:16:59.656 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:16:59.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:16:59.817+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:00.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:00.028+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:00.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:00.469+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:00.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:00.633+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:00.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:00.821+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:01.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:01.045+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:01.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:01.448+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:01.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:01.601+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:01.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:01.834+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:02.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:02.094+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:02.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:02.498+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:02.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:02.570+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:02.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:02.814+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:03.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:03.133+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:03.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:03.473+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:03.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:03.608+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:03.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:03.838+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:04.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:04.155+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:04.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:04.463+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:04.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:04.630+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:04.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:04.849+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:05.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:05.127+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:05.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:05.492+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:05.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:05.618+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:05.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:05.859+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:06.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:06.134+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:06.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:06.508+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:06.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:06.576+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:06.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:06.813+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:07.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:07.175+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:07.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:07.480+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:07.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:07.556+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:07.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:07.800+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:08.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:08.128+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:08.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:08.482+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:08.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:08.570+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:08.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:08.809+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:08.970 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:17:08.967+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:17:09.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:09.158+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:09.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:09.506+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:09.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:09.559+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:09.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:09.846+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:10.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:10.135+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:10.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:10.513+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:10.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:10.540+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:10.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:10.869+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:11.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:11.145+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:11.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:11.561+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:11.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:11.583+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:11.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:11.855+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:12.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:12.096+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:12.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:12.553+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:12.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:12.571+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:12.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:12.831+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:13.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:13.081+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:13.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:13.600+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:13.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:13.601+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:13.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:13.848+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:14.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:14.078+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:14.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:14.553+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:14.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:14.582+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:14.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:14.799+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:15.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:15.091+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:15.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:15.524+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:15.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:15.593+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:15.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:15.782+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:16.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:16.081+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:16.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:16.549+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:16.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:16.616+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:16.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:16.814+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:17.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:17.104+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:17.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:17.597+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:17.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:17.664+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:17.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:17.850+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:18.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:18.137+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:18.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:18.556+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:18.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:18.657+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:18.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:18.886+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:19.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:19.105+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:19.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:19.547+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:19.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:19.612+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:19.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:19.904+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:20.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:20.106+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:20.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:20.575+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:20.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:20.584+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:20.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:20.891+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:21.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:21.084+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:21.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:21.593+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:21.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:21.597+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:21.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:21.860+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:22.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:22.115+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:22.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:22.563+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:22.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:22.634+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:22.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:22.876+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:23.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:23.091+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:23.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:23.585+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:23.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:23.681+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:23.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:23.856+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:23.986 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:17:23.983+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:17:24.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:24.079+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:24.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:24.539+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:24.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:24.683+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:24.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:24.885+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:25.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:25.052+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:25.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:25.546+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:25.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:25.730+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:25.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:25.933+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:26.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:26.094+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:26.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:26.550+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:26.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:26.685+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:26.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:26.954+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:27.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:27.096+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:27.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:27.596+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:27.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:27.649+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:27.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:27.918+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:28.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:28.130+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:28.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:28.562+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:28.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:28.624+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:28.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:28.949+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:29.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:29.148+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:29.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:29.608+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:29.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:29.670+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:29.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:17:29.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:17:29.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:29.984+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:30.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:30.156+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:30.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:30.612+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:30.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:30.683+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:30.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:30.956+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:31.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:31.199+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:31.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:31.583+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:31.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:31.713+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:31.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:31.959+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:32.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:32.227+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:32.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:32.578+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:32.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:32.753+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:33.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:33.006+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:33.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:33.277+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:33.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:33.551+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:33.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:33.798+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:34.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:34.041+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:34.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:34.265+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:34.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:34.552+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:34.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:34.799+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:35.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:35.066+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:35.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:35.270+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:35.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:35.596+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:35.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:35.797+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:36.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:36.050+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:36.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:36.235+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:36.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:36.553+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:36.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:36.846+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:37.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:37.079+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:37.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:37.248+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:37.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:37.525+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:37.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:37.818+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:38.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:38.113+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:38.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:38.262+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:38.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:38.510+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:38.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:38.821+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:39.002 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:17:39.000+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:17:39.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:39.119+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:39.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:39.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:39.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:39.541+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:39.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:39.802+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:40.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:40.149+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:40.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:40.217+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:40.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:40.533+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:40.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:40.801+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:41.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:41.154+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:41.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:41.179+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:41.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:41.514+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:41.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:41.771+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:42.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:42.167+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:42.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:42.174+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:42.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:42.553+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:42.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:42.766+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:43.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:43.213+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:43.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:43.219+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:43.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:43.557+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:43.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:43.780+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:44.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:44.194+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:44.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:44.260+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:44.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:44.539+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:44.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:44.780+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:45.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:45.164+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:45.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:45.302+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:45.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:45.520+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:45.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:45.825+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:46.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:46.196+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:46.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:46.333+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:46.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:46.482+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:46.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:46.786+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:47.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:47.216+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:47.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:47.304+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:47.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:47.487+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:47.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:47.779+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:48.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:48.192+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:48.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:48.301+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:48.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:48.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:48.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:48.794+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:49.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:49.154+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:49.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:49.311+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:49.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:49.430+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:49.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:49.760+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:50.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:50.200+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:50.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:50.266+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:50.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:50.394+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:50.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:50.784+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:51.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:51.216+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:51.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:51.260+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:51.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:51.368+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:51.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:51.832+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:52.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:52.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:52.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:52.266+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:52.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:52.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:52.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:52.814+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:53.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:53.293+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:53.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:53.295+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:53.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:53.298+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:53.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:53.791+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:54.018 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:17:54.015+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:17:54.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:54.307+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:54.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:54.328+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:54.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:54.330+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:54.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:54.809+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:55.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:55.303+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:55.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:55.304+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:55.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:55.357+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:55.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:55.840+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:56.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:56.325+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:56.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:56.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:56.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:56.405+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:56.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:56.877+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:57.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:57.302+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:57.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:57.313+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:57.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:57.358+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:57.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:57.922+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:58.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:58.259+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:58.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:58.312+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:58.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:58.338+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:58.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:58.965+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:59.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:17:59.220+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:59.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:17:59.271+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:59.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:17:59.362+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:17:59.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:17:59.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:17:59.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:17:59.969+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:00.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:00.186+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:00.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:00.256+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:00.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:00.315+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:00.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:00.973+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:01.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:01.150+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:01.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:01.228+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:01.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:01.278+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:01.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:01.985+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:02.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:02.153+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:02.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:02.226+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:02.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:02.247+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:02.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:02.980+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:03.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:03.168+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:03.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:03.247+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:03.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:03.252+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:04.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:03.999+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:04.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:04.141+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:04.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:04.234+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:04.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:04.259+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:04.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:04.969+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:05.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:05.125+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:05.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:05.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:05.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:05.296+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:05.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:05.921+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:06.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:06.100+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:06.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:06.211+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:06.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:06.253+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:06.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:06.931+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:07.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:07.122+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:07.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:07.211+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:07.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:07.253+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:07.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:07.932+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:08.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:08.158+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:08.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:08.248+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:08.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:08.287+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:08.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:08.932+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:09.033 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:18:09.032+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:18:09.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:09.146+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:09.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:09.283+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:09.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:09.331+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:09.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:09.891+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:10.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:10.155+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:10.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:10.303+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:10.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:10.310+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:10.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:10.876+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:11.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:11.204+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:11.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:11.280+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:11.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:11.310+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:11.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:11.895+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:12.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:12.156+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:12.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:12.278+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:12.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:12.299+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:12.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:12.874+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:13.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:13.181+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:13.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:13.253+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:13.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:13.307+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:13.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:13.868+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:14.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:14.131+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:14.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:14.242+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:14.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:14.341+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:14.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:14.853+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:15.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:15.173+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:15.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:15.240+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:15.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:15.364+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:15.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:15.890+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:16.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:16.134+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:16.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:16.222+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:16.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:16.412+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:16.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:16.890+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:17.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:17.184+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:17.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:17.262+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:17.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:17.404+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:17.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:17.864+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:18.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:18.194+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:18.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:18.241+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:18.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:18.417+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:18.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:18.870+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:19.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:19.241+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:19.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:19.270+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:19.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:19.393+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:19.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:19.893+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:20.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:20.252+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:20.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:20.263+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:20.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:20.368+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:20.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:20.920+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:21.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:21.294+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:21.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:21.308+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:21.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:21.400+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:21.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:21.901+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:22.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:22.264+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:22.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:22.287+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:22.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:22.424+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:22.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:22.863+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:23.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:23.241+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:23.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:23.241+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:23.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:23.429+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:23.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:23.814+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:24.049 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:18:24.046+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:18:24.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:24.276+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:24.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:24.283+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:24.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:24.456+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:24.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:24.793+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:25.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:25.291+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:25.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:25.298+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:25.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:25.426+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:25.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:25.795+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:26.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:26.309+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:26.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:26.328+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:26.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:26.470+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:26.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:26.801+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:27.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:27.262+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:27.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:27.282+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:27.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:27.438+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:27.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:27.832+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:28.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:28.275+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:28.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:28.295+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:28.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:28.423+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:28.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:28.841+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:29.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:29.268+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:29.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:29.284+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:29.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:29.405+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:29.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:29.878+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:29.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:18:29.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:18:30.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:30.280+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:30.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:30.281+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:30.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:30.406+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:30.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:30.912+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:31.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:31.294+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:31.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:31.330+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:31.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:31.456+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:31.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:31.905+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:32.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:32.326+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:32.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:32.365+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:32.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:32.478+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:32.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:32.937+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:33.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:33.371+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:33.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:33.401+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:33.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:33.457+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:33.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:33.901+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:34.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:34.332+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:34.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:34.423+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:34.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:34.444+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:34.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:34.861+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:35.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:35.367+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:35.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:35.375+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:35.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:35.427+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:35.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:35.907+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:36.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:36.322+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:36.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:36.402+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:36.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:36.474+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:36.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:36.926+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:37.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:37.288+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:37.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:37.446+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:37.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:37.524+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:37.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:37.957+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:38.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:38.277+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:38.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:38.453+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:38.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:38.518+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:39.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:39.004+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:39.057 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:18:39.055+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:18:39.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:39.322+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:39.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:39.423+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:39.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:39.489+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:39.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:39.989+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:40.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:40.314+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:40.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:40.389+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:40.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:40.499+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:41.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:41.001+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:41.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:41.297+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:41.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:41.390+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:41.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:41.537+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:42.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:41.997+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:42.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:42.248+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:42.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:42.387+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:42.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:42.530+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:42.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:42.954+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:43.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:43.222+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:43.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:43.397+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:43.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:43.558+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:43.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:43.991+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:44.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:44.266+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:44.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:44.400+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:44.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:44.608+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:45.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:45.034+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:45.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:45.244+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:45.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:45.365+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:45.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:45.596+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:45.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:45.989+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:46.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:46.224+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:46.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:46.391+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:46.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:46.601+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:46.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:46.995+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:47.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:47.247+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:47.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:47.434+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:47.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:47.614+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:48.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:48.033+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:48.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:48.271+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:48.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:48.419+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:48.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:48.579+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:49.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:49.025+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:49.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:49.243+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:49.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:49.443+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:49.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:49.550+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:50.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:50.017+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:50.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:50.205+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:50.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:50.459+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:50.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:50.525+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:51.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:51.021+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:51.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:51.159+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:51.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:51.484+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:51.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:51.496+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:52.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:52.035+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:52.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:52.204+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:52.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:52.457+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:52.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:52.513+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:53.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:53.066+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:53.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:53.194+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:53.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:53.413+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:53.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:53.481+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:54.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:54.030+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:54.073 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:18:54.071+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:18:54.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:54.207+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:54.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:54.406+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:54.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:54.532+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:55.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:55.001+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:55.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:55.222+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:55.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:55.396+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:55.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:55.500+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:56.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:56.030+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:56.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:56.239+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:56.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:56.388+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:56.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:56.532+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:57.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:57.048+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:57.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:57.233+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:57.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:57.431+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:57.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:57.489+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:58.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:58.042+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:58.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:58.247+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:58.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:58.445+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:58.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:58.512+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:59.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:59.011+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:59.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:18:59.218+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:59.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:18:59.413+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:59.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:18:59.519+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:18:59.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:18:59.965+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:00.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:19:00.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:19:00.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:00.196+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:00.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:00.433+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:00.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:00.555+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:00.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:00.919+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:01.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:01.161+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:01.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:01.414+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:01.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:01.566+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:01.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:01.970+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:02.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:02.136+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:02.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:02.385+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:02.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:02.610+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:03.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:03.001+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:03.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:03.121+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:03.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:03.375+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:03.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:03.560+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:03.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:03.969+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:04.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:04.093+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:04.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:04.325+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:04.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:04.517+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:04.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:04.920+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:05.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:05.141+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:05.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:05.312+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:05.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:05.498+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:05.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:05.942+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:06.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:06.125+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:06.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:06.306+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:06.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:06.479+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:06.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:06.941+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:07.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:07.126+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:07.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:07.276+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:07.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:07.494+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:07.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:07.976+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:08.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:08.106+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:08.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:08.298+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:08.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:08.450+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:08.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:08.976+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:09.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:09.060+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:09.089 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:19:09.086+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:19:09.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:09.311+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:09.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:09.401+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:09.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:09.968+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:10.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:10.108+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:10.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:10.275+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:10.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:10.425+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:10.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:10.996+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:11.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:11.067+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:11.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:11.273+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:11.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:11.394+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:12.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:12.042+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:12.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:12.051+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:12.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:12.299+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:12.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:12.429+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:13.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:13.084+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:13.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:13.085+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:13.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:13.291+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:13.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:13.472+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:14.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:14.065+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:14.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:14.109+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:14.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:14.253+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:14.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:14.520+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:15.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:15.099+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:15.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:15.151+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:15.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:15.294+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:15.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:15.492+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:16.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:16.078+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:16.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:16.118+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:16.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:16.277+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:16.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:16.472+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:17.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:17.051+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:17.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:17.070+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:17.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:17.246+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:17.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:17.492+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:18.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:18.056+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:18.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:18.083+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:18.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:18.219+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:18.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:18.539+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:19.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:19.021+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:19.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:19.063+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:19.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:19.204+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:19.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:19.568+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:20.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:20.044+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:20.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:20.058+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:20.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:20.198+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:20.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:20.518+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:21.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:21.039+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:21.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:21.094+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:21.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:21.153+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:21.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:21.564+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:22.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:22.022+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:22.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:22.052+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:22.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:22.106+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:22.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:22.604+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:23.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:23.006+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:23.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:23.051+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:23.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:23.079+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:23.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:23.626+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:24.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:24.000+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:24.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:24.017+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:24.105 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:19:24.103+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:19:24.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:24.121+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:24.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:24.646+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:24.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:24.984+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:25.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:25.021+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:25.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:25.082+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:25.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:25.603+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:25.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:25.964+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:26.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:26.026+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:26.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:26.066+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:26.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:26.623+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:26.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:26.961+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:26.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:26.982+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:27.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:27.019+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:27.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:27.588+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:27.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:27.948+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:28.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:28.012+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:28.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:28.027+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:28.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:28.620+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:28.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:28.967+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:28.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:28.978+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:29.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:29.007+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:29.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:29.634+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:29.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:29.924+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:30.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:29.997+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:30.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:30.014+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:30.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:19:30.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:19:30.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:30.668+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:30.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:30.953+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:30.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:30.983+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:31.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:31.000+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:31.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:31.645+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:31.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:31.936+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:31.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:31.972+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:31.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:31.978+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:32.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:32.657+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:32.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:32.966+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:32.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:32.969+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:33.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:33.027+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:33.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:33.704+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:33.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:33.964+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:33.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:33.984+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:34.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:34.005+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:34.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:34.694+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:34.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:34.982+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:34.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:34.989+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:35.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:34.998+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:35.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:35.647+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:35.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:35.946+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:36.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:36.029+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:36.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:36.031+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:36.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:36.683+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:36.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:36.931+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:36.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:36.996+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:37.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:37.053+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:37.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:37.671+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:37.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:37.960+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:38.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:38.000+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:38.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:38.028+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:38.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:38.657+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:39.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:38.997+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:39.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:39.008+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:39.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:39.027+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:39.121 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:19:39.118+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:19:39.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:39.631+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:39.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:39.959+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:39.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:39.960+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:40.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:40.060+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:40.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:40.656+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:40.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:40.937+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:40.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:40.940+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:41.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:41.110+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:41.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:41.650+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:41.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:41.921+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:41.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:41.968+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:42.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:42.107+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:42.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:42.682+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:42.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:42.948+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:43.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:43.009+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:43.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:43.128+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:43.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:43.693+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:43.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:43.962+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:43.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:43.981+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:44.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:44.130+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:44.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:44.697+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:44.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:44.986+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:44.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:44.996+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:45.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:45.130+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:45.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:45.655+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:45.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:45.962+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:46.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:46.022+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:46.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:46.123+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:46.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:46.614+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:46.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:46.974+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:46.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:46.990+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:47.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:47.123+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:47.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:47.577+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:48.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:48.007+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:48.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:48.012+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:48.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:48.109+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:48.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:48.575+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:48.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:48.990+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:49.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:49.023+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:49.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:49.101+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:49.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:49.561+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:50.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:50.015+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:50.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:50.017+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:50.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:50.075+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:50.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:50.592+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:50.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:50.967+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:51.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:51.053+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:51.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:51.087+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:51.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:51.632+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:51.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:51.930+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:52.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:52.035+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:52.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:52.131+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:52.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:52.600+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:52.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:52.918+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:53.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:53.044+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:53.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:53.122+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:53.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:53.609+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:53.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:53.875+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:54.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:54.044+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:54.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:54.118+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:54.137 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:19:54.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:19:54.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:54.639+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:54.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:54.832+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:55.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:55.041+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:55.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:55.159+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:55.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:55.640+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:55.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:55.832+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:56.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:56.032+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:56.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:56.162+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:56.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:56.602+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:56.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:56.829+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:56.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:56.994+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:57.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:57.143+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:57.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:57.575+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:57.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:57.810+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:57.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:57.966+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:58.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:58.123+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:58.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:58.569+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:58.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:58.767+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:58.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:58.963+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:59.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:19:59.077+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:59.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:19:59.520+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:59.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:19:59.720+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:19:59.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:19:59.932+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:00.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:00.050+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:00.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:20:00.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:20:00.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:00.502+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:00.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:00.718+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:00.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:00.895+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:01.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:01.008+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:01.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:01.479+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:01.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:01.695+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:01.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:01.897+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:01.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:01.994+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:02.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:02.474+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:02.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:02.732+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:02.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:02.868+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:02.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:02.958+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:03.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:03.524+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:03.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:03.759+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:03.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:03.867+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:03.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:03.961+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:04.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:04.492+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:04.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:04.710+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:04.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:04.871+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:04.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:04.994+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:05.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:05.525+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:05.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:05.712+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:05.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:05.852+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:06.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:06.022+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:06.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:06.518+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:06.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:06.694+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:06.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:06.831+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:06.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:06.987+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:07.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:07.521+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:07.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:07.722+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:07.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:07.867+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:08.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:08.032+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:08.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:08.498+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:08.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:08.752+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:08.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:08.867+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:09.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:09.036+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:09.143 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:20:09.140+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:20:09.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:09.465+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:09.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:09.784+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:09.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:09.870+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:10.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:10.062+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:10.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:10.440+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:10.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:10.737+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:10.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:10.864+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:11.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:11.052+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:11.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:11.419+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:11.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:11.783+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:11.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:11.899+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:12.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:12.017+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:12.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:12.391+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:12.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:12.807+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:12.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:12.939+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:12.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:12.972+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:13.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:13.369+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:13.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:13.808+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:13.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:13.959+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:13.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:13.963+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:14.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:14.338+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:14.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:14.797+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:14.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:14.963+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:14.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:14.991+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:15.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:15.388+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:15.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:15.758+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:15.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:15.946+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:15.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:15.953+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:16.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:16.388+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:16.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:16.794+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:16.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:16.936+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:16.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:16.977+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:17.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:17.368+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:17.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:17.792+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:17.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:17.887+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:18.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:18.011+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:18.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:18.324+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:18.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:18.763+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:18.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:18.912+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:19.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:18.997+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:19.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:19.288+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:19.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:19.784+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:19.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:19.906+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:19.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:19.976+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:20.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:20.329+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:20.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:20.742+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:20.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:20.921+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:20.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:20.977+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:21.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:21.283+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:21.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:21.773+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:21.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:21.920+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:22.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:22.024+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:22.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:22.296+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:22.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:22.776+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:22.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:22.893+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:23.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:23.052+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:23.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:23.267+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:23.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:23.777+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:23.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:23.868+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:24.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:24.079+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:24.159 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:20:24.156+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:20:24.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:24.292+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:24.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:24.808+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:24.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:24.831+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:25.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:25.121+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:25.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:25.276+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:25.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:25.835+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:25.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:25.854+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:26.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:26.114+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:26.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:26.264+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:26.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:26.842+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:26.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:26.859+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:27.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:27.081+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:27.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:27.214+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:27.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:27.800+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:27.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:27.833+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:28.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:28.110+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:28.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:28.249+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:28.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:28.833+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:28.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:28.836+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:29.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:29.080+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:29.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:29.255+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:29.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:29.799+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:29.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:29.875+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:30.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:30.102+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:30.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:30.226+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:30.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:20:30.477 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:20:30.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:30.799+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:30.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:30.895+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:31.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:31.139+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:31.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:31.218+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:31.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:31.828+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:31.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:31.927+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:32.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:32.108+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:32.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:32.264+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:32.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:32.878+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:32.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:32.917+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:33.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:33.144+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:33.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:33.279+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:33.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:33.850+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:33.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:33.963+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:34.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:34.101+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:34.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:34.293+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:34.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:34.867+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:34.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:34.976+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:35.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:35.135+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:35.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:35.278+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:35.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:35.826+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:35.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:35.941+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:36.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:36.164+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:36.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:36.301+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:36.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:36.850+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:36.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:36.984+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:37.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:37.213+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:37.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:37.256+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:37.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:37.858+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:37.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:37.997+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:38.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:38.226+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:38.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:38.231+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:38.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:38.894+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:38.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:38.959+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:39.174 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:20:39.173+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:20:39.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:39.227+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:39.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:39.239+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:39.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:39.893+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:40.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:40.000+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:40.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:40.193+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:40.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:40.243+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:40.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:40.868+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:40.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:40.977+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:41.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:41.204+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:41.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:41.234+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:41.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:41.827+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:41.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:41.927+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:42.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:42.196+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:42.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:42.198+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:42.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:42.875+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:42.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:42.900+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:43.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:43.182+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:43.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:43.207+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:43.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:43.879+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:43.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:43.889+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:44.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:44.192+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:44.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:44.231+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:44.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:44.839+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:44.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:44.902+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:45.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:45.211+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:45.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:45.235+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:45.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:45.813+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:45.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:45.950+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:46.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:46.200+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:46.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:46.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:46.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:46.766+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:46.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:46.991+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:47.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:47.243+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:47.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:47.249+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:47.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:47.809+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:47.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:47.985+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:48.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:48.237+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:48.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:48.263+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:48.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:48.776+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:48.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:48.997+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:49.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:49.224+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:49.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:49.238+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:49.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:49.791+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:49.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:49.973+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:50.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:50.199+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:50.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:50.272+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:50.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:50.760+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:50.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:50.940+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:51.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:51.199+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:51.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:51.227+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:51.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:51.733+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:51.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:51.940+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:52.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:52.238+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:52.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:52.273+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:52.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:52.765+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:52.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:52.892+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:53.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:53.261+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:53.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:53.271+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:53.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:53.756+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:53.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:53.902+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:54.190 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:20:54.188+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:20:54.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:54.214+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:54.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:54.224+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:54.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:54.743+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:54.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:54.951+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:55.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:55.169+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:55.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:55.184+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:55.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:55.729+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:55.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:55.940+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:56.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:56.174+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:56.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:56.230+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:56.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:56.777+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:56.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:56.944+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:57.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:57.187+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:57.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:57.208+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:57.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:57.804+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:57.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:57.936+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:58.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:58.164+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:58.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:58.205+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:58.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:58.848+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:58.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:58.909+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:59.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:20:59.124+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:59.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:20:59.215+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:59.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:20:59.842+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:20:59.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:20:59.943+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:00.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:00.111+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:00.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:00.184+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:00.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:21:00.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:21:00.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:00.866+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:00.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:00.940+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:01.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:01.134+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:01.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:01.172+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:01.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:01.895+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:01.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:01.978+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:02.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:02.123+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:02.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:02.131+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:02.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:02.877+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:03.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:03.012+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:03.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:03.127+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:03.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:03.158+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:03.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:03.892+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:03.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:03.988+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:04.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:04.133+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:04.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:04.170+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:04.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:04.910+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:05.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:05.021+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:05.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:05.159+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:05.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:05.217+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:05.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:05.866+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:06.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:06.020+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:06.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:06.208+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:06.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:06.244+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:06.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:06.857+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:07.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:07.031+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:07.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:07.200+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:07.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:07.283+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:07.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:07.856+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:07.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:07.995+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:08.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:08.164+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:08.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:08.281+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:08.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:08.855+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:09.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:09.012+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:09.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:09.141+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:09.206 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:21:09.204+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:21:09.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:09.264+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:09.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:09.881+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:10.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:10.003+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:10.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:10.165+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:10.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:10.288+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:10.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:10.865+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:11.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:11.011+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:11.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:11.139+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:11.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:11.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:11.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:11.862+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:12.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:12.001+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:12.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:12.090+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:12.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:12.274+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:12.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:12.848+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:12.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:12.987+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:13.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:13.052+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:13.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:13.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:13.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:13.889+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:13.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:13.962+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:14.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:14.088+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:14.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:14.323+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:14.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:14.848+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:15.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:14.998+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:15.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:15.071+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:15.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:15.352+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:15.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:15.825+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:15.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:15.968+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:16.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:16.097+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:16.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:16.306+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:16.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:16.787+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:17.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:17.006+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:17.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:17.120+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:17.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:17.349+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:17.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:17.811+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:18.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:18.018+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:18.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:18.088+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:18.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:18.380+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:18.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:18.856+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:19.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:19.019+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:19.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:19.044+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:19.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:19.335+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:19.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:19.883+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:20.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:20.028+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:20.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:20.039+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:20.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:20.342+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:20.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:20.840+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:21.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:21.023+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:21.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:21.078+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:21.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:21.292+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:21.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:21.815+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:22.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:22.051+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:22.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:22.052+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:22.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:22.245+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:22.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:22.853+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:23.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:23.036+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:23.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:23.084+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:23.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:23.263+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:23.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:23.878+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:24.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:24.027+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:24.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:24.077+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:24.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:24.214+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:24.222 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:21:24.219+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:21:24.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:24.872+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:25.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:25.011+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:25.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:25.030+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:25.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:25.166+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:25.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:25.842+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:25.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:25.969+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:26.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:26.039+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:26.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:26.179+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:26.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:26.866+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:26.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:26.965+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:27.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:27.068+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:27.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:27.192+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:27.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:27.906+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:27.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:27.928+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:28.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:28.084+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:28.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:28.228+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:28.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:28.903+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:28.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:28.953+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:29.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:29.090+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:29.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:29.188+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:29.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:29.910+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:29.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:29.979+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:30.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:30.055+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:30.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:30.168+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:30.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:21:30.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:21:30.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:30.889+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:30.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:30.965+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:31.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:31.058+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:31.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:31.214+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:31.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:31.874+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:31.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:31.921+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:32.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:32.030+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:32.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:32.242+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:32.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:32.893+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:32.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:32.954+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:33.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:33.044+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:33.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:33.281+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:33.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:33.860+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:33.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:33.996+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:34.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:34.041+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:34.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:34.251+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:34.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:34.896+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:34.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:34.964+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:35.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:35.001+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:35.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:35.222+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:35.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:35.857+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:35.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:35.943+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:36.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:36.000+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:36.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:36.260+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:36.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:36.870+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:36.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:36.941+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:36.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:36.978+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:37.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:37.268+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:37.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:37.878+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:37.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:37.933+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:37.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:37.970+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:38.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:38.271+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:38.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:38.896+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:38.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:38.964+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:38.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:38.985+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:39.238 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:21:39.235+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:21:39.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:39.253+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:39.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:39.872+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:39.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:39.957+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:39.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:39.967+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:40.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:40.253+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:40.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:40.865+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:40.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:40.974+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:40.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:40.998+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:41.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:41.268+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:41.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:41.885+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:41.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:41.932+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:41.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:41.975+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:42.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:42.227+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:42.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:42.930+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:42.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:42.942+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:42.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:42.958+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:43.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:43.261+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:43.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:43.906+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:43.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:43.907+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:44.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:44.008+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:44.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:44.223+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:44.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:44.890+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:44.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:44.938+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:44.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:44.972+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:45.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:45.176+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:45.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:45.889+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:45.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:45.911+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:45.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:45.977+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:46.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:46.193+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:46.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:46.886+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:46.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:46.891+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:47.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:47.020+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:47.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:47.159+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:47.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:47.894+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:47.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:47.930+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:48.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:48.030+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:48.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:48.153+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:48.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:48.923+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:48.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:48.973+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:49.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:49.036+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:49.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:49.180+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:49.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:49.967+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:50.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:50.022+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:50.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:50.035+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:50.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:50.212+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:50.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:50.920+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:51.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:51.033+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:51.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:51.070+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:51.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:51.251+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:51.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:51.936+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:52.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:52.010+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:52.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:52.087+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:52.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:52.273+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:52.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:52.930+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:53.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:53.051+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:53.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:53.073+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:53.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:53.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:53.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:53.923+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:54.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:54.024+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:54.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:54.058+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:54.254 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:21:54.252+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:21:54.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:54.268+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:54.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:54.900+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:55.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:55.028+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:55.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:55.036+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:55.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:55.314+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:55.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:55.861+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:55.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:55.989+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:56.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:56.051+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:56.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:56.327+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:56.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:56.878+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:56.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:56.996+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:57.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:57.002+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:57.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:57.312+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:57.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:57.852+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:57.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:57.967+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:58.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:58.028+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:58.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:58.296+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:58.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:58.865+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:58.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:58.990+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:59.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:21:59.043+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:59.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:21:59.299+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:59.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:21:59.884+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:21:59.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:21:59.978+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:00.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:00.053+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:00.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:00.332+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:00.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:22:00.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:22:00.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:00.899+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:01.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:01.003+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:01.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:01.059+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:01.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:01.285+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:01.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:01.917+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:01.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:01.990+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:02.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:02.065+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:02.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:02.297+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:02.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:02.881+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:03.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:03.009+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:03.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:03.056+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:03.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:03.337+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:03.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:03.883+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:03.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:03.966+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:04.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:04.056+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:04.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:04.369+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:04.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:04.889+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:04.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:04.958+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:05.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:05.061+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:05.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:05.342+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:05.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:05.934+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:05.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:05.935+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:06.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:06.068+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:06.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:06.321+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:06.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:06.935+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:06.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:06.949+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:07.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:07.088+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:07.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:07.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:07.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:07.954+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:07.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:07.961+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:08.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:08.072+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:08.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:08.388+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:08.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:08.915+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:08.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:08.996+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:09.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:09.110+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:09.270 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:22:09.267+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:22:09.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:09.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:09.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:09.903+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:10.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:10.002+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:10.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:10.088+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:10.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:10.344+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:10.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:10.869+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:11.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:11.035+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:11.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:11.100+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:11.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:11.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:11.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:11.827+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:12.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:12.070+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:12.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:12.118+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:12.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:12.372+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:12.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:12.835+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:13.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:13.089+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:13.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:13.115+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:13.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:13.347+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:13.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:13.856+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:14.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:14.050+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:14.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:14.146+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:14.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:14.352+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:14.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:14.869+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:15.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:15.083+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:15.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:15.112+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:15.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:15.364+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:15.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:15.893+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:16.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:16.106+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:16.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:16.152+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:16.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:16.400+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:16.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:16.846+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:17.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:17.075+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:17.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:17.173+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:17.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:17.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:17.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:17.824+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:18.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:18.055+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:18.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:18.219+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:18.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:18.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:18.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:18.841+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:19.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:19.101+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:19.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:19.241+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:19.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:19.323+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:19.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:19.828+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:20.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:20.118+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:20.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:20.209+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:20.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:20.297+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:20.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:20.804+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:21.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:21.105+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:21.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:21.176+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:21.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:21.267+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:21.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:21.825+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:22.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:22.152+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:22.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:22.218+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:22.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:22.224+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:22.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:22.805+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:23.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:23.143+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:23.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:23.169+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:23.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:23.236+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:23.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:23.770+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:24.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:24.180+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:24.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:24.200+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:24.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:24.232+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:24.284 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:22:24.282+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:22:24.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:24.728+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:25.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:25.132+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:25.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:25.240+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:25.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:25.244+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:25.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:25.730+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:26.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:26.144+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:26.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:26.257+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:26.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:26.291+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:26.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:26.706+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:27.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:27.113+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:27.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:27.213+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:27.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:27.271+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:27.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:27.692+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:28.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:28.095+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:28.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:28.228+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:28.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:28.304+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:28.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:28.684+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:29.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:29.052+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:29.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:29.274+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:29.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:29.323+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:29.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:29.710+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:30.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:30.063+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:30.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:30.322+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:30.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:30.329+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:30.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:30.662+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:30.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:22:30.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:22:31.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:31.020+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:31.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:31.320+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:31.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:31.343+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:31.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:31.696+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:32.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:32.021+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:32.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:32.303+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:32.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:32.335+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:32.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:32.653+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:33.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:33.061+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:33.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:33.262+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:33.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:33.315+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:33.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:33.690+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:34.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:34.052+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:34.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:34.247+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:34.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:34.339+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:34.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:34.655+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:35.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:35.081+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:35.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:35.213+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:35.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:35.343+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:35.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:35.655+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:36.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:36.105+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:36.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:36.192+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:36.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:36.307+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:36.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:36.612+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:37.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:37.060+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:37.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:37.181+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:37.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:37.310+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:37.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:37.619+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:38.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:38.105+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:38.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:38.179+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:38.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:38.314+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:38.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:38.588+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:39.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:39.081+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:39.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:39.185+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:39.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:39.278+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:39.285 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:22:39.282+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:22:39.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:39.543+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:40.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:40.054+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:40.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:40.208+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:40.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:40.236+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:40.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:40.559+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:41.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:41.013+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:41.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:41.248+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:41.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:41.252+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:41.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:41.537+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:41.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:41.973+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:42.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:42.260+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:42.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:42.289+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:42.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:42.508+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:43.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:43.016+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:43.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:43.233+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:43.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:43.312+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:43.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:43.496+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:44.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:44.012+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:44.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:44.235+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:44.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:44.359+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:44.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:44.464+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:44.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:44.989+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:45.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:45.277+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:45.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:45.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:45.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:45.419+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:45.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:45.957+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:46.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:46.326+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:46.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:46.385+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:46.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:46.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:46.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:46.978+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:47.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:47.279+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:47.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:47.373+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:47.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:47.428+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:48.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:48.020+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:48.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:48.275+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:48.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:48.421+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:48.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:48.427+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:49.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:49.025+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:49.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:49.261+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:49.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:49.392+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:49.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:49.411+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:50.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:50.035+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:50.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:50.307+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:50.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:50.383+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:50.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:50.385+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:51.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:51.040+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:51.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:51.314+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:51.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:51.376+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:51.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:51.380+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:52.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:52.044+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:52.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:52.290+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:52.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:52.352+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:52.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:52.376+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:53.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:53.056+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:53.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:53.329+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:53.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:53.380+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:53.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:53.401+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:54.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:54.058+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:54.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:54.292+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:54.301 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:22:54.298+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:22:54.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:54.353+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:54.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:54.354+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:55.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:55.036+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:55.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:55.324+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:55.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:55.391+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:55.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:55.399+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:56.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:56.078+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:56.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:56.292+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:56.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:56.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:56.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:56.373+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:57.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:57.086+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:57.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:57.261+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:57.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:57.400+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:57.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:57.403+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:58.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:58.122+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:58.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:58.235+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:58.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:58.414+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:58.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:58.415+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:59.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:22:59.134+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:59.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:22:59.215+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:59.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:22:59.422+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:22:59.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:22:59.431+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:00.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:00.162+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:00.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:00.197+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:00.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:00.395+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:00.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:00.402+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:00.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:23:00.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:23:01.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:01.143+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:01.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:01.232+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:01.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:01.362+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:01.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:01.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:02.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:02.188+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:02.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:02.189+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:02.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:02.404+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:02.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:02.437+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:03.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:03.201+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:03.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:03.214+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:03.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:03.409+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:03.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:03.455+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:04.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:04.170+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:04.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:04.244+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:04.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:04.417+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:04.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:04.422+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:05.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:05.194+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:05.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:05.217+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:05.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:05.391+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:05.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:05.467+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:06.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:06.186+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:06.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:06.250+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:06.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:06.419+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:06.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:06.440+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:07.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:07.157+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:07.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:07.232+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:07.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:07.394+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:07.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:07.466+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:08.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:08.158+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:08.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:08.201+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:08.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:08.379+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:08.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:08.462+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:09.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:09.186+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:09.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:09.240+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:09.317 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:23:09.314+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:23:09.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:09.341+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:09.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:09.424+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:10.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:10.203+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:10.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:10.221+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:10.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:10.376+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:10.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:10.457+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:11.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:11.160+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:11.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:11.230+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:11.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:11.413+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:11.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:11.448+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:12.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:12.183+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:12.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:12.207+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:12.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:12.442+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:12.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:12.468+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:13.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:13.162+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:13.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:13.217+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:13.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:13.412+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:13.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:13.476+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:14.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:14.129+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:14.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:14.248+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:14.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:14.426+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:14.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:14.443+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:15.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:15.143+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:15.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:15.245+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:15.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:15.435+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:15.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:15.467+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:16.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:16.103+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:16.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:16.202+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:16.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:16.437+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:16.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:16.481+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:17.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:17.147+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:17.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:17.218+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:17.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:17.431+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:17.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:17.495+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:18.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:18.147+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:18.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:18.192+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:18.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:18.428+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:18.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:18.544+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:19.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:19.120+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:19.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:19.196+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:19.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:19.443+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:19.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:19.510+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:20.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:20.143+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:20.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:20.182+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:20.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:20.397+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:20.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:20.483+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:21.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:21.106+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:21.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:21.157+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:21.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:21.365+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:21.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:21.527+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:22.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:22.092+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:22.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:22.157+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:22.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:22.386+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:22.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:22.559+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:23.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:23.123+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:23.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:23.140+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:23.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:23.427+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:23.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:23.552+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:24.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:24.103+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:24.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:24.185+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:24.333 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:23:24.330+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:23:24.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:24.425+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:24.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:24.580+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:25.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:25.053+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:25.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:25.233+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:25.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:25.395+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:25.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:25.619+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:26.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:26.054+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:26.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:26.276+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:26.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:26.416+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:26.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:26.573+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:27.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:27.032+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:27.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:27.239+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:27.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:27.375+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:27.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:27.550+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:28.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:28.052+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:28.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:28.207+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:28.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:28.349+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:28.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:28.587+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:29.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:29.028+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:29.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:29.161+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:29.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:29.373+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:29.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:29.615+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:30.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:30.071+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:30.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:30.209+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:30.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:30.346+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:30.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:30.585+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:31.092 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:23:31.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:23:31.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:31.093+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:31.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:31.253+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:31.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:31.311+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:31.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:31.592+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:32.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:32.095+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:32.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:32.207+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:32.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:32.348+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:32.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:32.612+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:33.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:33.129+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:33.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:33.219+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:33.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:33.330+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:33.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:33.648+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:34.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:34.110+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:34.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:34.193+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:34.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:34.314+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:34.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:34.641+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:35.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:35.086+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:35.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:35.188+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:35.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:35.364+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:35.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:35.597+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:36.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:36.041+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:36.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:36.161+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:36.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:36.339+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:36.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:36.644+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:37.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:37.051+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:37.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:37.207+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:37.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:37.360+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:37.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:37.606+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:38.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:38.057+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:38.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:38.191+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:38.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:38.338+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:38.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:38.582+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:39.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:39.061+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:39.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:39.153+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:39.348 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:23:39.347+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:23:39.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:39.367+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:39.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:39.558+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:40.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:40.062+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:40.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:40.202+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:40.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:40.365+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:40.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:40.515+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:41.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:41.030+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:41.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:41.188+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:41.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:41.387+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:41.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:41.511+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:41.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:41.993+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:42.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:42.193+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:42.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:42.437+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:42.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:42.525+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:42.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:42.945+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:43.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:43.161+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:43.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:43.428+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:43.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:43.528+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:43.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:43.926+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:44.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:44.163+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:44.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:44.431+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:44.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:44.545+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:44.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:44.969+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:45.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:45.118+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:45.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:45.409+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:45.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:45.563+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:45.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:45.931+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:46.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:46.090+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:46.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:46.406+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:46.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:46.567+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:46.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:46.900+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:47.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:47.055+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:47.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:47.367+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:47.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:47.614+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:47.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:47.851+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:48.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:48.104+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:48.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:48.326+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:48.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:48.617+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:48.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:48.873+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:49.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:49.067+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:49.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:49.300+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:49.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:49.572+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:49.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:49.831+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:50.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:50.075+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:50.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:50.315+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:50.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:50.569+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:50.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:50.840+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:51.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:51.096+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:51.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:51.312+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:51.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:51.554+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:51.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:51.799+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:52.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:52.099+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:52.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:52.291+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:52.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:52.556+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:52.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:52.764+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:53.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:53.144+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:53.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:53.277+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:53.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:53.575+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:53.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:53.747+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:54.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:54.138+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:54.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:54.264+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:54.358 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:23:54.355+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:23:54.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:54.527+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:54.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:54.774+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:55.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:55.152+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:55.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:55.250+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:55.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:55.499+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:55.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:55.752+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:56.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:56.108+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:56.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:56.218+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:56.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:56.525+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:56.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:56.720+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:57.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:57.076+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:57.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:57.200+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:57.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:57.509+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:57.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:57.753+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:58.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:58.089+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:58.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:58.234+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:58.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:58.523+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:58.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:58.800+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:59.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:23:59.111+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:59.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:23:59.281+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:59.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:23:59.525+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:23:59.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:23:59.787+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:00.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:00.131+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:00.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:00.291+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:00.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:00.557+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:00.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:00.787+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:01.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:01.110+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:01.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:24:01.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:24:01.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:01.246+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:01.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:01.542+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:01.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:01.798+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:02.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:02.136+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:02.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:02.211+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:02.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:02.546+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:02.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:02.831+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:03.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:03.114+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:03.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:03.184+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:03.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:03.565+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:03.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:03.827+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:04.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:04.104+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:04.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:04.190+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:04.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:04.540+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:04.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:04.825+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:05.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:05.111+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:05.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:05.180+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:05.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:05.501+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:05.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:05.807+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:06.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:06.107+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:06.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:06.217+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:06.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:06.475+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:06.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:06.818+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:07.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:07.092+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:07.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:07.245+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:07.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:07.480+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:07.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:07.798+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:08.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:08.082+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:08.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:08.218+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:08.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:08.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:08.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:08.838+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:09.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:09.125+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:09.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:09.184+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:09.374 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:24:09.371+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:24:09.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:09.424+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:09.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:09.789+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:10.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:10.130+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:10.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:10.185+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:10.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:10.381+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:10.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:10.788+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:11.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:11.145+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:11.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:11.180+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:11.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:11.414+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:11.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:11.792+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:12.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:12.153+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:12.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:12.194+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:12.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:12.428+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:12.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:12.793+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:13.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:13.112+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:13.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:13.191+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:13.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:13.420+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:13.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:13.786+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:14.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:14.156+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:14.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:14.156+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:14.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:14.422+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:14.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:14.786+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:15.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:15.152+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:15.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:15.189+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:15.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:15.413+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:15.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:15.829+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:16.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:16.134+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:16.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:16.236+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:16.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:16.375+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:16.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:16.816+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:17.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:17.148+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:17.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:17.246+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:17.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:17.389+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:17.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:17.866+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:18.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:18.100+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:18.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:18.208+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:18.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:18.370+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:18.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:18.867+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:19.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:19.099+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:19.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:19.235+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:19.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:19.358+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:19.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:19.843+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:20.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:20.125+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:20.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:20.261+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:20.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:20.357+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:20.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:20.872+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:21.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:21.132+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:21.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:21.265+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:21.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:21.405+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:21.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:21.831+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:22.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:22.114+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:22.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:22.246+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:22.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:22.412+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:22.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:22.821+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:23.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:23.108+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:23.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:23.263+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:23.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:23.387+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:23.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:23.772+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:24.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:24.116+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:24.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:24.303+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:24.390 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:24:24.387+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:24:24.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:24.437+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:24.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:24.793+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:25.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:25.138+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:25.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:25.325+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:25.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:25.460+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:25.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:25.766+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:26.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:26.091+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:26.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:26.312+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:26.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:26.490+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:26.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:26.749+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:27.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:27.103+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:27.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:27.317+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:27.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:27.457+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:27.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:27.786+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:28.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:28.124+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:28.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:28.349+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:28.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:28.465+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:28.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:28.782+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:29.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:29.142+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:29.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:29.364+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:29.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:29.482+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:29.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:29.763+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:30.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:30.097+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:30.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:30.317+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:30.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:30.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:30.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:30.796+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:31.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:31.124+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:31.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:24:31.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:31.296+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:31.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:24:31.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:31.459+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:31.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:31.769+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:32.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:32.121+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:32.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:32.255+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:32.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:32.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:32.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:32.744+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:33.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:33.155+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:33.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:33.241+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:33.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:33.480+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:33.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:33.703+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:34.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:34.181+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:34.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:34.196+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:34.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:34.515+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:34.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:34.670+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:35.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:35.220+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:35.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:35.228+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:35.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:35.546+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:35.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:35.716+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:36.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:36.217+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:36.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:36.224+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:36.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:36.584+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:36.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:36.750+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:37.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:37.171+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:37.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:37.190+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:37.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:37.592+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:37.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:37.798+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:38.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:38.129+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:38.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:38.167+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:38.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:38.565+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:38.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:38.779+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:39.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:39.115+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:39.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:39.181+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:39.406 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:24:39.403+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:24:39.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:39.594+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:39.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:39.790+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:40.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:40.092+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:40.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:40.176+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:40.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:40.588+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:40.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:40.770+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:41.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:41.136+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:41.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:41.210+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:41.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:41.625+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:41.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:41.790+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:42.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:42.130+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:42.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:42.172+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:42.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:42.600+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:42.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:42.795+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:43.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:43.092+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:43.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:43.128+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:43.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:43.557+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:43.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:43.838+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:44.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:44.118+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:44.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:44.174+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:44.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:44.588+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:44.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:44.806+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:45.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:45.106+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:45.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:45.220+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:45.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:45.635+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:45.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:45.773+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:46.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:46.138+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:46.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:46.203+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:46.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:46.662+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:46.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:46.728+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:47.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:47.160+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:47.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:47.169+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:47.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:47.683+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:47.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:47.776+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:48.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:48.131+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:48.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:48.200+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:48.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:48.692+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:48.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:48.739+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:49.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:49.179+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:49.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:49.210+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:49.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:49.655+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:49.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:49.737+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:50.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:50.152+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:50.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:50.214+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:50.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:50.682+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:50.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:50.695+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:51.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:51.164+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:51.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:51.247+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:51.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:51.691+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:51.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:51.697+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:52.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:52.131+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:52.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:52.258+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:52.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:52.650+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:52.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:52.716+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:53.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:53.089+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:53.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:53.255+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:53.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:53.600+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:53.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:53.754+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:54.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:54.050+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:54.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:54.251+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:54.422 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:24:54.420+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:24:54.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:54.555+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:54.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:54.714+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:55.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:55.033+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:55.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:55.228+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:55.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:55.560+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:55.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:55.763+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:56.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:56.042+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:56.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:56.184+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:56.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:56.562+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:56.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:56.732+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:57.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:57.036+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:57.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:57.147+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:57.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:57.520+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:57.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:57.717+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:58.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:58.082+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:58.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:58.139+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:58.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:58.534+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:58.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:58.759+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:59.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:24:59.084+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:59.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:24:59.182+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:59.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:24:59.545+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:24:59.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:24:59.800+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:00.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:00.064+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:00.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:00.166+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:00.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:00.525+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:00.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:00.841+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:01.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:01.075+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:01.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:01.186+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:01.376 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:25:01.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:25:01.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:01.554+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:01.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:01.820+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:02.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:02.120+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:02.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:02.184+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:02.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:02.541+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:02.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:02.850+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:03.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:03.087+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:03.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:03.191+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:03.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:03.536+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:03.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:03.826+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:04.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:04.119+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:04.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:04.167+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:04.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:04.487+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:04.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:04.792+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:05.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:05.122+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:05.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:05.175+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:05.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:05.491+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:05.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:05.832+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:06.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:06.124+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:06.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:06.183+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:06.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:06.482+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:06.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:06.879+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:07.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:07.097+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:07.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:07.139+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:07.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:07.498+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:07.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:07.924+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:08.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:08.127+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:08.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:08.165+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:08.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:08.538+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:08.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:08.944+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:09.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:09.094+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:09.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:09.168+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:09.431 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:25:09.428+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:25:09.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:09.530+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:09.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:09.952+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:10.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:10.058+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:10.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:10.177+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:10.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:10.535+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:10.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:10.971+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:11.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:11.037+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:11.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:11.190+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:11.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:11.556+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:11.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:11.990+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:12.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:12.043+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:12.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:12.238+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:12.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:12.594+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:13.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:13.008+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:13.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:13.017+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:13.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:13.253+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:13.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:13.581+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:14.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:14.044+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:14.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:14.047+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:14.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:14.262+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:14.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:14.581+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:15.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:15.014+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:15.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:15.021+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:15.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:15.260+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:15.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:15.541+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:16.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:16.014+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:16.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:16.039+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:16.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:16.226+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:16.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:16.521+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:16.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:16.986+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:17.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:17.043+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:17.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:17.184+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:17.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:17.481+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:18.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:18.017+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:18.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:18.035+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:18.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:18.197+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:18.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:18.500+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:18.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:18.993+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:19.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:19.012+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:19.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:19.154+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:19.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:19.501+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:19.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:19.960+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:20.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:20.029+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:20.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:20.174+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:20.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:20.505+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:20.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:20.985+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:21.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:21.027+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:21.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:21.209+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:21.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:21.515+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:21.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:21.982+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:22.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:22.008+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:22.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:22.243+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:22.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:22.476+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:23.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:23.003+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:23.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:23.022+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:23.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:23.226+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:23.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:23.502+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:23.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:23.973+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:24.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:24.020+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:24.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:24.264+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:24.447 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:25:24.444+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:25:24.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:24.489+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:24.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:24.960+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:25.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:25.024+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:25.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:25.265+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:25.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:25.496+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:25.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:25.931+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:26.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:26.008+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:26.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:26.304+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:26.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:26.512+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:26.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:26.948+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:27.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:27.026+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:27.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:27.330+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:27.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:27.470+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:27.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:27.965+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:28.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:28.035+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:28.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:28.367+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:28.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:28.467+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:28.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:28.929+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:28.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:28.995+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:29.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:29.320+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:29.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:29.448+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:29.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:29.928+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:30.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:30.020+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:30.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:30.317+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:30.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:30.452+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:30.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:30.967+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:30.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:30.981+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:31.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:31.324+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:31.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:31.452+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:31.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:25:31.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:25:31.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:31.982+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:32.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:32.010+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:32.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:32.340+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:32.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:32.488+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:32.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:32.936+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:32.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:32.965+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:33.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:33.373+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:33.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:33.524+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:33.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:33.941+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:33.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:33.970+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:34.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:34.384+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:34.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:34.527+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:34.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:34.954+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:34.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:34.992+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:35.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:35.395+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:35.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:35.493+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:35.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:35.979+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:36.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:36.002+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:36.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:36.348+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:36.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:36.494+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:36.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:36.967+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:36.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:36.981+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:37.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:37.371+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:37.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:37.498+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:37.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:37.938+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:37.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:37.943+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:38.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:38.340+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:38.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:38.541+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:38.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:38.914+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:38.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:38.946+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:39.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:39.313+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:39.463 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:25:39.460+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:25:39.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:39.582+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:39.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:39.900+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:39.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:39.980+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:40.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:40.318+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:40.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:40.619+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:40.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:40.950+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:41.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:41.003+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:41.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:41.282+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:41.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:41.586+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:41.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:41.974+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:42.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:41.998+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:42.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:42.304+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:42.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:42.575+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:42.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:42.941+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:42.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:42.971+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:43.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:43.293+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:43.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:43.584+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:43.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:43.938+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:43.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:43.972+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:44.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:44.317+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:44.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:44.591+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:44.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:44.901+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:44.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:44.934+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:45.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:45.333+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:45.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:45.630+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:45.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:45.887+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:45.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:45.892+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:46.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:46.290+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:46.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:46.628+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:46.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:46.848+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:46.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:46.883+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:47.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:47.278+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:47.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:47.616+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:47.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:47.832+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:47.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:47.864+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:48.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:48.314+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:48.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:48.573+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:48.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:48.796+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:48.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:48.838+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:49.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:49.306+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:49.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:49.561+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:49.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:49.780+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:49.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:49.810+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:50.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:50.322+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:50.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:50.524+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:50.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:50.782+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:50.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:50.835+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:51.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:51.364+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:51.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:51.497+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:51.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:51.790+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:51.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:51.832+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:52.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:52.330+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:52.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:52.502+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:52.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:52.745+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:52.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:52.827+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:53.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:53.334+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:53.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:53.491+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:53.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:53.706+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:53.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:53.869+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:54.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:54.363+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:54.479 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:25:54.476+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:25:54.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:54.498+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:54.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:54.709+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:54.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:54.847+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:55.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:55.326+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:55.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:55.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:55.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:55.712+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:55.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:55.840+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:56.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:56.372+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:56.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:56.441+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:56.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:56.702+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:56.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:56.833+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:57.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:57.338+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:57.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:57.419+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:57.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:57.662+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:57.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:57.824+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:58.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:58.367+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:58.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:58.394+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:58.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:58.640+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:58.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:58.815+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:59.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:25:59.375+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:59.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:25:59.397+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:59.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:25:59.599+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:25:59.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:25:59.789+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:00.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:00.387+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:00.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:00.405+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:00.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:00.588+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:00.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:00.813+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:01.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:01.401+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:01.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:01.455+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:01.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:26:01.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:26:01.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:01.630+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:01.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:01.779+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:02.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:02.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:02.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:02.441+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:02.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:02.581+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:02.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:02.790+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:03.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:03.331+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:03.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:03.445+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:03.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:03.546+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:03.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:03.820+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:04.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:04.345+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:04.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:04.492+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:04.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:04.513+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:04.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:04.804+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:05.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:05.348+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:05.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:05.459+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:05.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:05.543+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:05.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:05.797+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:06.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:06.306+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:06.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:06.445+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:06.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:06.565+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:06.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:06.751+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:07.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:07.327+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:07.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:07.419+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:07.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:07.542+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:07.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:07.727+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:08.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:08.335+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:08.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:08.381+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:08.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:08.543+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:08.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:08.678+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:09.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:09.367+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:09.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:09.411+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:09.495 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:26:09.493+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:26:09.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:09.542+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:09.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:09.644+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:10.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:10.367+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:10.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:10.438+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:10.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:10.532+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:10.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:10.660+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:11.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:11.327+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:11.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:11.481+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:11.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:11.548+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:11.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:11.619+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:12.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:12.369+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:12.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:12.513+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:12.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:12.549+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:12.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:12.641+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:13.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:13.416+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:13.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:13.491+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:13.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:13.517+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:13.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:13.614+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:14.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:14.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:14.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:14.454+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:14.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:14.536+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:14.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:14.640+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:15.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:15.486+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:15.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:15.495+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:15.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:15.569+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:15.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:15.604+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:16.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:16.456+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:16.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:16.483+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:16.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:16.538+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:16.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:16.561+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:17.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:17.493+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:17.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:17.500+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:17.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:17.500+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:17.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:17.556+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:18.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:18.482+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:18.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:18.493+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:18.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:18.505+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:18.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:18.552+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:19.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:19.471+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:19.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:19.479+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:19.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:19.543+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:19.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:19.550+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:20.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:20.496+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:20.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:20.497+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:20.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:20.512+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:20.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:20.583+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:21.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:21.468+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:21.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:21.482+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:21.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:21.506+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:21.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:21.609+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:22.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:22.444+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:22.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:22.501+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:22.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:22.521+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:22.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:22.581+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:23.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:23.413+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:23.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:23.460+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:23.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:23.480+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:23.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:23.572+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:24.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:24.392+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:24.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:24.417+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:24.511 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:26:24.508+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:26:24.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:24.525+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:24.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:24.621+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:25.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:25.345+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:25.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:25.409+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:25.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:25.566+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:25.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:25.626+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:26.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:26.336+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:26.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:26.432+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:26.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:26.547+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:26.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:26.639+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:27.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:27.369+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:27.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:27.445+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:27.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:27.527+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:27.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:27.649+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:28.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:28.330+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:28.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:28.459+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:28.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:28.509+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:28.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:28.662+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:29.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:29.309+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:29.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:29.431+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:29.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:29.508+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:29.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:29.657+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:30.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:30.280+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:30.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:30.413+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:30.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:30.543+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:30.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:30.647+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:31.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:31.286+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:31.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:31.373+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:31.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:31.557+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:31.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:31.632+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:31.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:26:31.772 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:26:32.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:32.262+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:32.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:32.399+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:32.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:32.589+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:32.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:32.621+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:33.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:33.239+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:33.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:33.428+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:33.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:33.562+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:33.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:33.658+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:34.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:34.222+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:34.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:34.416+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:34.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:34.585+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:34.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:34.695+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:35.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:35.237+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:35.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:35.411+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:35.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:35.589+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:35.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:35.673+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:36.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:36.216+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:36.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:36.414+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:36.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:36.617+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:36.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:36.719+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:37.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:37.192+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:37.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:37.453+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:37.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:37.575+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:37.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:37.744+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:38.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:38.154+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:38.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:38.486+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:38.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:38.616+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:38.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:38.777+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:39.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:39.182+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:39.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:39.516+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:39.526 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:26:39.524+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:26:39.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:39.658+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:39.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:39.756+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:40.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:40.150+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:40.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:40.538+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:40.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:40.646+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:40.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:40.803+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:41.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:41.160+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:41.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:41.557+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:41.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:41.631+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:41.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:41.796+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:42.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:42.182+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:42.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:42.568+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:42.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:42.582+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:42.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:42.837+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:43.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:43.135+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:43.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:43.538+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:43.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:43.544+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:43.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:43.835+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:44.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:44.088+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:44.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:44.507+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:44.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:44.550+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:44.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:44.819+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:45.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:45.052+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:45.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:45.463+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:45.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:45.538+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:45.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:45.869+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:46.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:46.096+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:46.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:46.479+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:46.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:46.557+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:46.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:46.853+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:47.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:47.139+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:47.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:47.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:47.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:47.533+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:47.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:47.828+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:48.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:48.117+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:48.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:48.482+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:48.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:48.548+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:48.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:48.848+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:49.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:49.102+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:49.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:49.435+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:49.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:49.524+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:49.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:49.874+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:50.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:50.137+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:50.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:50.402+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:50.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:50.563+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:50.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:50.869+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:51.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:51.160+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:51.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:51.408+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:51.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:51.606+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:51.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:51.913+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:52.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:52.141+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:52.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:52.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:52.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:52.608+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:52.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:52.928+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:53.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:53.119+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:53.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:53.371+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:53.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:53.593+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:53.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:53.900+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:54.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:54.141+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:54.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:54.327+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:54.542 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:26:54.540+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:26:54.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:54.619+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:54.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:54.919+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:55.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:55.113+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:55.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:55.290+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:55.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:55.598+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:55.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:55.962+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:56.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:56.150+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:56.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:56.312+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:56.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:56.565+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:56.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:56.996+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:57.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:57.114+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:57.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:57.311+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:57.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:57.553+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:58.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:58.010+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:58.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:58.134+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:58.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:58.290+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:58.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:58.588+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:58.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:58.975+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:59.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:26:59.159+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:59.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:26:59.306+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:59.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:26:59.551+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:26:59.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:26:59.929+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:00.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:00.207+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:00.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:00.316+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:00.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:00.529+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:00.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:00.979+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:01.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:01.252+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:01.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:01.341+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:01.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:01.576+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:01.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:27:01.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:27:01.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:01.943+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:02.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:02.276+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:02.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:02.391+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:02.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:02.568+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:02.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:02.957+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:03.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:03.288+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:03.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:03.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:03.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:03.551+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:03.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:03.966+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:04.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:04.282+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:04.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:04.405+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:04.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:04.503+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:04.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:04.952+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:05.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:05.300+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:05.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:05.451+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:05.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:05.459+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:05.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:05.957+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:06.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:06.350+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:06.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:06.443+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:06.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:06.449+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:06.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:06.964+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:07.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:07.364+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:07.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:07.420+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:07.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:07.445+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:07.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:07.960+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:08.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:08.361+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:08.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:08.443+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:08.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:08.485+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:08.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:08.915+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:09.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:09.405+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:09.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:09.420+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:09.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:09.447+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:09.551 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:27:09.548+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:27:09.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:09.877+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:10.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:10.402+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:10.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:10.404+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:10.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:10.447+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:10.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:10.899+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:11.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:11.353+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:11.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:11.404+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:11.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:11.426+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:11.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:11.853+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:12.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:12.364+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:12.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:12.376+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:12.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:12.466+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:12.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:12.815+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:13.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:13.331+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:13.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:13.335+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:13.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:13.441+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:13.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:13.779+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:14.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:14.351+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:14.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:14.369+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:14.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:14.411+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:14.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:14.814+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:15.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:15.360+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:15.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:15.365+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:15.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:15.410+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:15.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:15.805+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:16.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:16.356+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:16.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:16.377+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:16.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:16.439+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:16.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:16.777+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:17.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:17.357+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:17.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:17.380+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:17.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:17.416+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:17.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:17.735+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:18.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:18.328+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:18.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:18.389+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:18.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:18.419+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:18.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:18.732+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:19.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:19.311+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:19.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:19.354+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:19.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:19.451+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:19.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:19.727+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:20.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:20.277+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:20.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:20.355+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:20.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:20.473+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:20.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:20.733+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:21.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:21.235+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:21.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:21.323+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:21.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:21.461+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:21.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:21.743+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:22.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:22.282+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:22.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:22.303+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:22.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:22.414+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:22.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:22.724+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:23.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:23.251+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:23.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:23.282+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:23.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:23.422+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:23.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:23.689+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:24.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:24.271+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:24.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:24.281+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:24.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:24.393+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:24.557 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:27:24.555+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:27:24.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:24.712+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:25.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:25.287+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:25.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:25.318+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:25.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:25.417+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:25.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:25.705+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:26.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:26.273+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:26.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:26.320+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:26.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:26.440+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:26.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:26.723+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:27.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:27.292+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:27.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:27.363+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:27.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:27.438+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:27.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:27.750+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:28.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:28.289+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:28.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:28.313+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:28.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:28.444+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:28.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:28.736+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:29.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:29.281+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:29.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:29.327+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:29.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:29.490+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:29.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:29.716+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:30.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:30.323+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:30.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:30.372+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:30.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:30.502+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:30.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:30.700+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:31.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:31.346+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:31.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:31.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:31.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:31.534+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:31.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:31.664+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:32.098 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:27:32.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:27:32.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:32.338+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:32.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:32.407+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:32.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:32.536+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:32.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:32.696+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:33.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:33.324+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:33.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:33.409+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:33.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:33.556+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:33.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:33.699+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:34.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:34.355+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:34.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:34.435+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:34.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:34.566+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:34.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:34.726+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:35.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:35.388+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:35.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:35.398+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:35.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:35.520+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:35.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:35.682+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:36.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:36.376+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:36.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:36.408+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:36.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:36.490+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:36.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:36.682+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:37.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:37.379+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:37.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:37.413+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:37.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:37.526+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:37.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:37.704+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:38.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:38.374+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:38.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:38.426+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:38.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:38.526+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:38.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:38.730+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:39.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:39.354+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:39.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:39.411+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:39.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:39.552+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:39.573 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:27:39.570+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:27:39.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:39.737+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:40.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:40.346+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:40.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:40.385+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:40.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:40.545+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:40.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:40.777+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:41.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:41.302+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:41.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:41.394+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:41.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:41.524+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:41.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:41.730+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:42.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:42.351+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:42.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:42.382+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:42.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:42.552+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:42.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:42.688+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:43.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:43.369+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:43.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:43.388+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:43.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:43.592+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:43.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:43.669+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:44.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:44.333+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:44.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:44.361+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:44.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:44.621+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:44.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:44.630+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:45.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:45.337+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:45.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:45.368+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:45.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:45.588+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:45.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:45.600+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:46.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:46.299+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:46.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:46.407+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:46.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:46.563+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:46.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:46.600+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:47.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:47.289+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:47.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:47.368+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:47.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:47.611+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:47.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:47.622+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:48.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:48.287+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:48.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:48.337+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:48.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:48.601+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:48.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:48.622+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:49.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:49.290+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:49.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:49.387+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:49.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:49.630+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:49.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:49.646+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:50.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:50.311+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:50.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:50.357+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:50.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:50.608+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:50.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:50.647+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:51.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:51.340+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:51.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:51.406+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:51.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:51.608+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:51.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:51.652+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:52.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:52.329+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:52.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:52.438+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:52.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:52.606+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:52.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:52.617+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:53.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:53.376+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:53.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:53.420+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:53.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:53.638+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:53.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:53.640+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:54.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:54.377+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:54.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:54.393+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:54.589 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:27:54.587+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:27:54.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:54.637+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:54.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:54.653+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:55.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:55.426+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:55.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:55.441+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:55.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:55.608+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:55.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:55.657+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:56.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:56.402+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:56.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:56.415+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:56.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:56.587+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:56.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:56.700+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:57.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:57.410+0000 7f596d92c700 -1 osd.6 106 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:57.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:57.443+0000 7f72c425d700 -1 osd.5 106 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:57.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:57.571+0000 7f389e18e700 -1 osd.4 106 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:57.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:57.739+0000 7f6e44c9f700 -1 osd.7 106 get_health_metrics reporting 43 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:58.061 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:27:58.058+0000 7f0863d73700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:27:58.076 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T00:27:58.058+0000 7f0863d73700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:27:58.076 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:27:58.069+0000 7f0863572700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T00:27:58.098 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T00:27:58.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:58.410+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:58.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:58.442+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:58.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:58.539+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:58.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:58.782+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:59.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:27:59.367+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:59.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:27:59.454+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:59.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:27:59.585+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:27:59.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:27:59.788+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:00.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:00.318+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:00.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:00.479+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:00.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:00.570+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:00.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:00.812+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:01.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:01.328+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:01.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:01.499+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:01.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:01.573+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:01.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:01.846+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:02.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:28:02.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:28:02.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:02.355+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:02.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:02.519+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:02.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:02.545+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:02.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:02.878+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:03.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:03.401+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:03.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:03.515+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:03.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:03.531+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:03.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:03.877+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:04.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:04.386+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:04.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:04.468+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:04.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:04.493+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:04.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:04.908+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:05.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:05.395+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:05.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:05.445+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:05.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:05.510+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:05.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:05.876+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:06.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:06.372+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:06.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:06.441+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:06.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:06.532+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:06.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:06.914+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:07.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:07.378+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:07.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:07.483+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:07.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:07.583+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:07.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:07.952+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:08.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:08.410+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:08.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:08.508+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:08.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:08.566+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:08.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:08.989+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:09.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:09.452+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:09.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:09.476+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:09.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:09.582+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:09.601 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:28:09.599+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:28:10.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:10.014+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:10.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:10.423+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:10.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:10.438+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:10.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:10.600+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:11.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:11.049+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:11.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:11.399+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:11.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:11.461+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:11.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:11.568+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:12.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:12.082+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:12.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:12.364+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:12.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:12.438+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:12.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:12.611+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:13.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:13.067+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:13.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:13.403+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:13.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:13.433+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:13.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:13.576+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:14.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:14.112+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:14.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:14.416+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:14.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:14.440+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:14.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:14.619+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:15.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:15.151+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:15.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:15.384+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:15.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:15.391+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:15.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:15.663+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:16.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:16.113+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:16.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:16.353+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:16.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:16.379+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:16.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:16.700+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:17.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:17.131+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:17.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:17.331+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:17.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:17.348+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:17.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:17.747+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:18.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:18.119+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:18.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:18.304+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:18.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:18.358+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:18.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:18.728+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:19.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:19.100+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:19.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:19.307+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:19.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:19.381+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:19.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:19.723+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:20.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:20.075+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:20.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:20.299+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:20.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:20.336+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:20.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:20.752+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:21.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:21.026+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:21.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:21.299+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:21.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:21.316+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:21.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:21.765+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:21.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:21.995+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:22.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:22.309+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:22.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:22.309+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:22.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:22.750+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:22.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:22.968+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:23.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:23.288+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:23.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:23.315+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:23.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:23.772+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:23.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:23.941+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:24.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:24.315+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:24.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:24.316+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:24.607 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:28:24.605+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:28:24.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:24.776+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:24.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:24.961+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:25.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:25.280+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:25.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:25.353+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:25.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:25.820+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:25.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:25.922+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:26.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:26.252+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:26.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:26.330+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:26.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:26.781+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:26.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:26.952+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:27.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:27.236+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:27.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:27.282+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:27.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:27.783+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:27.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:27.946+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:28.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:28.267+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:28.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:28.279+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:28.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:28.799+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:28.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:28.918+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:29.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:29.271+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:29.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:29.301+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:29.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:29.794+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:29.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:29.925+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:30.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:30.285+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:30.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:30.286+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:30.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:30.831+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:30.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:30.932+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:31.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:31.278+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:31.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:31.281+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:31.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:31.792+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:31.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:31.978+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:32.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:28:32.252 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:28:32.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:32.278+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:32.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:32.321+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:32.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:32.807+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:33.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:33.023+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:33.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:33.313+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:33.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:33.322+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:33.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:33.815+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:34.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:34.022+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:34.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:34.272+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:34.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:34.345+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:34.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:34.795+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:34.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:34.996+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:35.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:35.271+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:35.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:35.385+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:35.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:35.807+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:35.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:35.966+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:36.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:36.245+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:36.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:36.392+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:36.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:36.819+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:36.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:36.936+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:37.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:37.272+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:37.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:37.442+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:37.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:37.867+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:37.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:37.947+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:38.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:38.267+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:38.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:38.427+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:38.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:38.907+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:38.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:38.960+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:39.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:39.313+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:39.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:39.472+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:39.623 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:28:39.621+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:28:39.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:39.912+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:39.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:39.959+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:40.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:40.314+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:40.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:40.482+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:40.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:40.958+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:40.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:40.963+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:41.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:41.357+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:41.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:41.466+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:42.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:42.005+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:42.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:42.006+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:42.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:42.378+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:42.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:42.506+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:43.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:43.005+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:43.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:43.029+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:43.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:43.404+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:43.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:43.463+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:44.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:44.002+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:44.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:44.031+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:44.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:44.422+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:44.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:44.494+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:45.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:45.043+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:45.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:45.058+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:45.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:45.472+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:45.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:45.528+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:46.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:46.008+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:46.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:46.024+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:46.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:46.455+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:46.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:46.555+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:47.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:47.013+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:47.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:47.021+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:47.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:47.502+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:47.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:47.560+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:48.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:47.997+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:48.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:48.017+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:48.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:48.480+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:48.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:48.578+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:49.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:49.031+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:49.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:49.059+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:49.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:49.514+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:49.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:49.549+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:50.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:50.038+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:50.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:50.046+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:50.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:50.517+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:50.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:50.560+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:51.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:51.002+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:51.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:51.059+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:51.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:51.515+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:51.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:51.570+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:51.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:51.955+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:52.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:52.091+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:52.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:52.524+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:52.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:52.552+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:52.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:52.914+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:53.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:53.123+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:53.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:53.486+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:53.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:53.546+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:53.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:53.943+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:54.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:54.096+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:54.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:54.486+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:54.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:54.546+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:54.639 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:28:54.636+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:28:54.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:54.909+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:55.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:55.068+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:55.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:55.501+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:55.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:55.533+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:55.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:55.894+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:56.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:56.052+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:56.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:56.499+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:56.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:56.509+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:56.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:56.855+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:57.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:57.048+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:57.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:57.487+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:57.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:57.521+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:57.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:57.898+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:58.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:58.022+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:58.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:58.486+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:58.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:58.490+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:58.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:58.938+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:58.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:28:58.979+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:59.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:28:59.463+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:59.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:28:59.483+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:28:59.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:28:59.910+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:00.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:00.004+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:00.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:00.430+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:00.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:00.455+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:00.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:00.869+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:00.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:00.986+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:01.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:01.437+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:01.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:01.454+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:01.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:01.848+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:01.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:01.938+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:02.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:29:02.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:29:02.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:02.448+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:02.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:02.467+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:02.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:02.868+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:02.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:02.941+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:03.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:03.452+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:03.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:03.512+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:03.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:03.834+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:03.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:03.976+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:04.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:04.480+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:04.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:04.535+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:04.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:04.877+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:05.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:05.018+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:05.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:05.436+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:05.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:05.542+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:05.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:05.842+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:06.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:06.033+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:06.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:06.478+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:06.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:06.496+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:06.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:06.873+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:07.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:07.018+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:07.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:07.432+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:07.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:07.470+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:07.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:07.907+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:07.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:07.977+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:08.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:08.457+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:08.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:08.460+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:08.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:08.865+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:08.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:08.995+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:09.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:09.446+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:09.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:09.475+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:09.655 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:29:09.653+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:29:09.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:09.890+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:09.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:09.961+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:10.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:10.426+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:10.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:10.457+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:10.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:10.875+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:10.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:10.964+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:11.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:11.438+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:11.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:11.471+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:11.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:11.876+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:11.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:11.942+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:12.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:12.459+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:12.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:12.499+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:12.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:12.840+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:12.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:12.928+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:13.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:13.438+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:13.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:13.469+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:13.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:13.803+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:13.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:13.896+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:14.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:14.459+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:14.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:14.485+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:14.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:14.801+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:14.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:14.921+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:15.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:15.411+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:15.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:15.442+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:15.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:15.776+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:15.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:15.887+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:16.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:16.452+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:16.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:16.457+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:16.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:16.731+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:16.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:16.864+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:17.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:17.445+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:17.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:17.463+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:17.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:17.772+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:17.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:17.889+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:18.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:18.419+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:18.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:18.507+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:18.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:18.813+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:18.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:18.930+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:19.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:19.395+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:19.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:19.556+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:19.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:19.796+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:19.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:19.970+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:20.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:20.441+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:20.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:20.534+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:20.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:20.820+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:20.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:20.987+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:21.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:21.433+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:21.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:21.497+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:21.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:21.806+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:21.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:21.989+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:22.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:22.461+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:22.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:22.474+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:22.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:22.855+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:23.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:23.035+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:23.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:23.440+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:23.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:23.483+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:23.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:23.902+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:24.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:24.063+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:24.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:24.478+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:24.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:24.497+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:24.671 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:29:24.668+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:29:24.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:24.897+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:25.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:25.053+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:25.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:25.445+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:25.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:25.489+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:25.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:25.880+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:26.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:26.013+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:26.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:26.453+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:26.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:26.487+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:26.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:26.916+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:27.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:27.012+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:27.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:27.473+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:27.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:27.501+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:27.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:27.880+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:28.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:28.004+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:28.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:28.455+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:28.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:28.482+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:28.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:28.851+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:28.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:28.973+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:29.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:29.437+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:29.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:29.438+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:29.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:29.835+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:29.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:29.929+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:30.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:30.436+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:30.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:30.448+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:30.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:30.851+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:30.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:30.978+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:31.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:31.429+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:31.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:31.446+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:31.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:31.898+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:31.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:31.982+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:32.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:29:32.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:29:32.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:32.464+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:32.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:32.477+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:32.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:32.937+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:32.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:32.978+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:33.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:33.472+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:33.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:33.507+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:33.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:33.908+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:33.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:33.938+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:34.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:34.505+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:34.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:34.523+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:34.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:34.872+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:34.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:34.897+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:35.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:35.482+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:35.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:35.527+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:35.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:35.830+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:35.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:35.871+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:36.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:36.441+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:36.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:36.527+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:36.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:36.831+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:36.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:36.850+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:37.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:37.475+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:37.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:37.480+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:37.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:37.825+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:37.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:37.831+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:38.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:38.453+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:38.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:38.460+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:38.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:38.793+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:38.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:38.825+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:39.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:39.479+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:39.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:39.508+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:39.687 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:29:39.685+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:29:39.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:39.842+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:39.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:39.865+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:40.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:40.471+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:40.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:40.548+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:40.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:40.802+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:40.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:40.904+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:41.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:41.476+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:41.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:41.559+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:41.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:41.779+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:41.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:41.890+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:42.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:42.438+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:42.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:42.593+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:42.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:42.819+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:42.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:42.937+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:43.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:43.391+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:43.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:43.603+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:43.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:43.825+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:43.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:43.919+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:44.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:44.417+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:44.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:44.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:44.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:44.803+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:44.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:44.951+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:45.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:45.402+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:45.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:45.579+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:45.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:45.824+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:45.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:45.937+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:46.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:46.408+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:46.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:46.608+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:46.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:46.855+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:46.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:46.903+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:47.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:47.405+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:47.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:47.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:47.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:47.884+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:47.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:47.921+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:48.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:48.387+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:48.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:48.588+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:48.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:48.842+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:48.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:48.935+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:49.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:49.380+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:49.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:49.599+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:49.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:49.814+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:49.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:49.928+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:50.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:50.411+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:50.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:50.557+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:50.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:50.771+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:50.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:50.961+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:51.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:51.403+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:51.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:51.595+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:51.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:51.802+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:52.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:52.010+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:52.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:52.406+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:52.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:52.638+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:52.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:52.786+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:53.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:53.022+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:53.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:53.392+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:53.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:53.591+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:53.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:53.793+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:53.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:53.992+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:54.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:54.344+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:54.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:54.580+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:54.703 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:29:54.699+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:29:54.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:54.838+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:55.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:55.003+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:55.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:55.382+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:55.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:55.593+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:55.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:55.861+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:55.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:55.976+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:56.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:56.419+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:56.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:56.578+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:56.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:56.838+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:57.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:57.022+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:57.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:57.411+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:57.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:57.599+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:57.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:57.853+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:58.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:58.010+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:58.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:58.457+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:58.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:58.606+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:58.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:58.822+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:59.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:59.013+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:59.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:29:59.446+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:59.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:29:59.622+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:59.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:29:59.825+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:29:59.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:29:59.988+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:00.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:00.421+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:00.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:00.609+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:00.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:00.827+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:00.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:00.966+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:01.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:01.387+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:01.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:01.609+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:01.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:01.782+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:01.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:01.972+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:02.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:02.433+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:02.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:30:02.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:30:02.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:02.622+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:02.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:02.765+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:03.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:02.999+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:03.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:03.470+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:03.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:03.595+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:03.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:03.796+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:04.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:04.047+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:04.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:04.448+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:04.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:04.576+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:04.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:04.750+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:05.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:05.080+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:05.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:05.424+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:05.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:05.572+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:05.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:05.784+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:06.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:06.107+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:06.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:06.376+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:06.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:06.544+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:06.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:06.809+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:07.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:07.089+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:07.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:07.361+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:07.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:07.592+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:07.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:07.832+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:08.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:08.102+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:08.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:08.388+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:08.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:08.552+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:08.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:08.840+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:09.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:09.125+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:09.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:09.410+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:09.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:09.543+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:09.718 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:30:09.715+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:30:09.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:09.880+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:10.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:10.101+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:10.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:10.408+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:10.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:10.586+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:10.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:10.871+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:11.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:11.127+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:11.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:11.413+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:11.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:11.565+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:11.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:11.836+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:12.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:12.170+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:12.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:12.443+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:12.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:12.556+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:12.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:12.854+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:13.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:13.211+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:13.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:13.470+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:13.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:13.547+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:13.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:13.875+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:14.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:14.233+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:14.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:14.476+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:14.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:14.550+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:14.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:14.862+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:15.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:15.268+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:15.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:15.497+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:15.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:15.576+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:15.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:15.828+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:16.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:16.227+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:16.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:16.544+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:16.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:16.591+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:16.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:16.850+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:17.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:17.269+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:17.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:17.578+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:17.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:17.595+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:17.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:17.862+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:18.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:18.273+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:18.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:18.558+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:18.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:18.622+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:18.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:18.888+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:19.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:19.306+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:19.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:19.574+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:19.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:19.671+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:19.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:19.891+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:20.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:20.298+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:20.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:20.612+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:20.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:20.621+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:20.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:20.885+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:21.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:21.251+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:21.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:21.618+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:21.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:21.657+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:21.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:21.912+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:22.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:22.262+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:22.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:22.618+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:22.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:22.631+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:22.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:22.906+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:23.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:23.271+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:23.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:23.626+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:23.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:23.640+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:23.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:23.894+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:24.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:24.272+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:24.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:24.595+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:24.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:24.615+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:24.734 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:30:24.732+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:30:24.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:24.925+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:25.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:25.235+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:25.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:25.579+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:25.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:25.655+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:25.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:25.909+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:26.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:26.207+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:26.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:26.613+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:26.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:26.623+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:26.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:26.861+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:27.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:27.251+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:27.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:27.576+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:27.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:27.595+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:27.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:27.867+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:28.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:28.233+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:28.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:28.544+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:28.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:28.602+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:28.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:28.881+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:29.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:29.242+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:29.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:29.552+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:29.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:29.611+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:29.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:29.870+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:30.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:30.263+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:30.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:30.557+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:30.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:30.602+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:30.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:30.913+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:31.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:31.240+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:31.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:31.565+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:31.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:31.592+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:31.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:31.864+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:32.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:32.246+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:32.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:32.557+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:32.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:32.626+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:32.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:30:32.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:30:32.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:32.904+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:33.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:33.267+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:33.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:33.557+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:33.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:33.665+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:33.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:33.899+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:34.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:34.269+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:34.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:34.517+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:34.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:34.675+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:34.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:34.901+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:35.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:35.237+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:35.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:35.552+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:35.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:35.632+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:35.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:35.924+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:36.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:36.270+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:36.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:36.563+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:36.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:36.602+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:36.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:36.938+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:37.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:37.291+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:37.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:37.539+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:37.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:37.567+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:37.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:37.957+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:38.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:38.280+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:38.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:38.547+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:38.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:38.598+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:39.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:39.002+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:39.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:39.324+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:39.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:39.548+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:39.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:39.616+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:39.736 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:30:39.733+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:30:40.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:40.031+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:40.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:40.357+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:40.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:40.599+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:40.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:40.615+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:40.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:40.995+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:41.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:41.322+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:41.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:41.604+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:41.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:41.622+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:41.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:41.975+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:42.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:42.295+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:42.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:42.571+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:42.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:42.613+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:43.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:43.012+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:43.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:43.333+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:43.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:43.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:43.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:43.632+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:43.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:43.980+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:44.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:44.291+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:44.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:44.571+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:44.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:44.671+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:44.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:44.941+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:45.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:45.303+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:45.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:45.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:45.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:45.655+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:45.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:45.990+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:46.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:46.323+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:46.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:46.524+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:46.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:46.681+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:47.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:47.022+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:47.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:47.275+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:47.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:47.476+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:47.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:47.721+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:48.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:48.046+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:48.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:48.234+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:48.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:48.430+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:48.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:48.685+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:49.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:49.087+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:49.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:49.253+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:49.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:49.410+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:49.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:49.698+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:50.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:50.113+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:50.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:50.299+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:50.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:50.408+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:50.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:50.689+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:51.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:51.115+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:51.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:51.331+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:51.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:51.364+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:51.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:51.737+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:52.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:52.147+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:52.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:52.351+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:52.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:52.397+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:52.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:52.741+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:53.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:53.123+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:53.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:53.355+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:53.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:53.373+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:53.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:53.765+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:54.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:54.148+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:54.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:54.328+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:54.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:54.362+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:54.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:54.729+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:54.752 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:30:54.749+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:30:55.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:55.152+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:55.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:55.289+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:55.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:55.371+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:55.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:55.692+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:56.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:56.113+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:56.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:56.314+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:56.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:56.350+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:56.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:56.706+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:57.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:57.158+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:57.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:57.273+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:57.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:57.374+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:57.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:57.676+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:58.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:58.147+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 27 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:58.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:58.299+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:58.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:58.380+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:58.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:58.721+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:59.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:30:59.189+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:59.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:30:59.342+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:59.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:30:59.346+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:30:59.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:30:59.743+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:00.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:00.183+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:00.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:00.316+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:00.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:00.331+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:00.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:00.774+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:01.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:01.147+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:01.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:01.350+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:01.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:01.369+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:01.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:01.747+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:02.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:02.161+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:02.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:02.323+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:02.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:02.377+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:02.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:02.737+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:02.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:31:02.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:31:03.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:03.156+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:03.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:03.361+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:03.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:03.363+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:03.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:03.786+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:04.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:04.206+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:04.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:04.377+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:04.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:04.389+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:04.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:04.832+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:05.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:05.199+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:05.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:05.385+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:05.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:05.417+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:05.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:05.815+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:06.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:06.204+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:06.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:06.362+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:06.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:06.429+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:06.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:06.831+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:07.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:07.197+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:07.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:07.381+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:07.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:07.426+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:07.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:07.784+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:08.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:08.191+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:08.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:08.334+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:08.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:08.415+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:08.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:08.794+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:09.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:09.220+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:09.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:09.408+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:09.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:09.379+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:09.767 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:31:09.765+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:31:09.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:09.821+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:10.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:10.241+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:10.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:10.338+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:10.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:10.415+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:10.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:10.869+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:11.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:11.233+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:11.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:11.327+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:11.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:11.457+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:11.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:11.893+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:12.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:12.205+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:12.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:12.349+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:12.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:12.487+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:12.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:12.900+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:13.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:13.175+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:13.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:13.301+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:13.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:13.519+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:13.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:13.900+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:14.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:14.136+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:14.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:14.289+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:14.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:14.509+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:14.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:14.929+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:15.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:15.184+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:15.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:15.313+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:15.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:15.520+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:15.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:15.955+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:16.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:16.180+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:16.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:16.349+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:16.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:16.531+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:16.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:16.951+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:17.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:17.176+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:17.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:17.322+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:17.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:17.495+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:17.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:17.915+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:18.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:18.215+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:18.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:18.306+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:18.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:18.506+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:18.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:18.927+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:19.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:19.231+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:19.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:19.329+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:19.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:19.545+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:19.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:19.950+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:20.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:20.187+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:20.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:20.338+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:20.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:20.581+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:20.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:20.966+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:21.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:21.176+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:21.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:21.323+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:21.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:21.606+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:22.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:22.007+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:22.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:22.158+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:22.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:22.319+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:22.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:22.651+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:22.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:22.960+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:23.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:23.137+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:23.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:23.339+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:23.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:23.643+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:23.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:23.917+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:24.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:24.177+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:24.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:24.328+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:24.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:24.684+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:24.770 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:31:24.767+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:31:24.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:24.899+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:25.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:25.153+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:25.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:25.355+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:25.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:25.642+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:25.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:25.900+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:26.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:26.169+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:26.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:26.342+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:26.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:26.673+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:26.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:26.867+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:27.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:27.184+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:27.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:27.312+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:27.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:27.641+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:27.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:27.848+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:28.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:28.227+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:28.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:28.304+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:28.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:28.600+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:28.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:28.818+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:29.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:29.186+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:29.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:29.332+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:29.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:29.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:29.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:29.799+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:30.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:30.203+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:30.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:30.358+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:30.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:30.568+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:30.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:30.779+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:31.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:31.229+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:31.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:31.388+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:31.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:31.529+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:31.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:31.800+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:32.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:32.218+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:32.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:32.409+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:32.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:32.521+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:32.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:32.785+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:33.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:31:33.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:31:33.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:33.244+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:33.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:33.387+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:33.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:33.562+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:33.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:33.774+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:34.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:34.245+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:34.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:34.349+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:34.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:34.598+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:34.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:34.806+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:35.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:35.241+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:35.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:35.391+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:35.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:35.607+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:35.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:35.769+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:36.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:36.277+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:36.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:36.341+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:36.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:36.595+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:36.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:36.761+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:37.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:37.321+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:37.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:37.384+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:37.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:37.555+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:37.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:37.761+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:38.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:38.308+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:38.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:38.342+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:38.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:38.516+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:38.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:38.807+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:39.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:39.286+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:39.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:39.389+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:39.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:39.542+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:39.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:39.783+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:39.786 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:31:39.784+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:31:40.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:40.330+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:40.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:40.435+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:40.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:40.565+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:40.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:40.829+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:41.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:41.359+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:41.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:41.481+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:41.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:41.551+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:41.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:41.785+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:42.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:42.354+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:42.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:42.509+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:42.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:42.522+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:42.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:42.828+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:43.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:43.376+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:43.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:43.472+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:43.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:43.484+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:43.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:43.860+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:44.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:44.373+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:44.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:44.458+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:44.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:44.511+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:44.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:44.837+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:45.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:45.419+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:45.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:45.422+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:45.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:45.551+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:45.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:45.874+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:46.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:46.403+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:46.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:46.434+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:46.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:46.594+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:46.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:46.922+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:47.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:47.389+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:47.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:47.394+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:47.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:47.565+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:47.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:47.891+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:48.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:48.374+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:48.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:48.436+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:48.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:48.612+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:48.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:48.849+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:49.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:49.326+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:49.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:49.393+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:49.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:49.581+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:49.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:49.823+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:50.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:50.331+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:50.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:50.444+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:50.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:50.626+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:50.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:50.813+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:51.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:51.363+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:51.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:51.418+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:51.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:51.589+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:51.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:51.790+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:52.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:52.346+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:52.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:52.456+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:52.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:52.546+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:52.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:52.781+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:53.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:53.385+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:53.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:53.505+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:53.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:53.553+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:53.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:53.803+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:54.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:54.339+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:54.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:54.494+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:54.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:54.525+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:54.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:54.799+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:54.801 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:31:54.799+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:31:55.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:55.331+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:55.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:55.453+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:55.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:55.575+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:55.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:55.773+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:56.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:56.378+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:56.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:56.479+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:56.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:56.543+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:56.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:56.745+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:57.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:57.366+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:57.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:57.465+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:57.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:57.530+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:57.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:57.713+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:58.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:58.346+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:58.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:58.422+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:58.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:58.539+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:58.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:58.683+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:59.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:31:59.303+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:59.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:31:59.432+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:59.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:31:59.571+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:31:59.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:31:59.668+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:00.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:00.276+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:00.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:00.387+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:00.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:00.523+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:00.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:00.646+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:01.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:01.314+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:01.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:01.428+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:01.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:01.481+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:01.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:01.651+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:02.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:02.320+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:02.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:02.407+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:02.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:02.449+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:02.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:02.639+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:03.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:32:03.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:32:03.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:03.314+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:03.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:03.374+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:03.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:03.407+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:03.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:03.637+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:04.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:04.311+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:04.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:04.397+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:04.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:04.408+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:04.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:04.660+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:05.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:05.332+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:05.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:05.415+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:05.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:05.447+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:05.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:05.627+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:06.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:06.307+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:06.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:06.398+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:06.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:06.405+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:06.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:06.590+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:07.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:07.306+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:07.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:07.370+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:07.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:07.435+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:07.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:07.571+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:08.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:08.355+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:08.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:08.358+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:08.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:08.470+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:08.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:08.540+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:09.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:09.378+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:09.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:09.397+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:09.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:09.447+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:09.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:09.501+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:09.806 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:32:09.804+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:32:10.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:10.347+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:10.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:10.441+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:10.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:10.460+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:10.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:10.492+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:11.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:11.387+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:11.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:11.417+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:11.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:11.444+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:11.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:11.457+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:12.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:12.428+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:12.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:12.434+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:12.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:12.436+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:12.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:12.497+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:13.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:13.392+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:13.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:13.411+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:13.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:13.444+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:13.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:13.487+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:14.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:14.349+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:14.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:14.384+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:14.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:14.477+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:14.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:14.480+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:15.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:15.306+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:15.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:15.382+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:15.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:15.455+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:15.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:15.486+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:16.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:16.327+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:16.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:16.408+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:16.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:16.418+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:16.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:16.476+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:17.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:17.319+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:17.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:17.395+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:17.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:17.400+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:17.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:17.457+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:18.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:18.279+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:18.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:18.381+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:18.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:18.424+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:18.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:18.427+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:19.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:19.282+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:19.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:19.356+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:19.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:19.398+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:19.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:19.456+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:20.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:20.298+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:20.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:20.401+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:20.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:20.408+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:20.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:20.506+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:21.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:21.294+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:21.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:21.433+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:21.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:21.438+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:21.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:21.556+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:22.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:22.322+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:22.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:22.399+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:22.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:22.482+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:22.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:22.528+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:23.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:23.316+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:23.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:23.427+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:23.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:23.510+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:23.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:23.512+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:24.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:24.315+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:24.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:24.382+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:24.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:24.476+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:24.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:24.542+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:24.822 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:32:24.819+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:32:25.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:25.365+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:25.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:25.432+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:25.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:25.443+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:25.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:25.502+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:26.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:26.332+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:26.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:26.448+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:26.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:26.463+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:26.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:26.535+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:27.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:27.321+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:27.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:27.429+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:27.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:27.463+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:27.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:27.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:28.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:28.358+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:28.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:28.420+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:28.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:28.482+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:28.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:28.533+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:29.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:29.363+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:29.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:29.402+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:29.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:29.517+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:29.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:29.540+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:30.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:30.367+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:30.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:30.394+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:30.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:30.546+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:30.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:30.564+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:31.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:31.338+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:31.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:31.386+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:31.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:31.512+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:31.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:31.588+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:32.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:32.293+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:32.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:32.358+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:32.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:32.481+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:32.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:32.611+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:33.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:33.248+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:33.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:32:33.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:32:33.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:33.316+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:33.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:33.451+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:33.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:33.638+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:34.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:34.273+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:34.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:34.283+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:34.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:34.499+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:34.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:34.651+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:35.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:35.256+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:35.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:35.263+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:35.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:35.483+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:35.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:35.632+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:36.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:36.248+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:36.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:36.254+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:36.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:36.488+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:36.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:36.623+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:37.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:37.263+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:37.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:37.267+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:37.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:37.509+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:37.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:37.672+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:38.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:38.235+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:38.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:38.263+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:38.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:38.490+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:38.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:38.686+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:39.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:39.208+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:39.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:39.223+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:39.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:39.461+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:39.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:39.678+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:39.838 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:32:39.835+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:32:40.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:40.183+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:40.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:40.244+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:40.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:40.481+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:40.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:40.720+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:41.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:41.141+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:41.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:41.282+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:41.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:41.487+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:41.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:41.757+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:42.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:42.177+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:42.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:42.299+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:42.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:42.507+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:42.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:42.729+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:43.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:43.226+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:43.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:43.327+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:43.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:43.492+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:43.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:43.760+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:44.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:44.185+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:44.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:44.297+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:44.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:44.495+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:44.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:44.782+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:45.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:45.187+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:45.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:45.309+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:45.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:45.471+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:45.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:45.788+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:46.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:46.230+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:46.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:46.288+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:46.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:46.514+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:46.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:46.830+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:47.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:47.255+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:47.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:47.295+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:47.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:47.498+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:47.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:47.844+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:48.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:48.274+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:48.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:48.304+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:48.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:48.481+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:48.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:48.825+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:49.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:49.268+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:49.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:49.309+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:49.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:49.475+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:49.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:49.862+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:50.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:50.284+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:50.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:50.327+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:50.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:50.450+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:50.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:50.897+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:51.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:51.281+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:51.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:51.301+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:51.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:51.438+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:51.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:51.882+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:52.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:52.302+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:52.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:52.325+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:52.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:52.402+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:52.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:52.834+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:53.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:53.306+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:53.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:53.372+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:53.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:53.394+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:53.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:53.790+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:54.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:54.273+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:54.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:54.420+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:54.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:54.424+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:54.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:54.832+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:54.854 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:32:54.851+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:32:55.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:55.266+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:55.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:55.383+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:55.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:55.407+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:55.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:55.876+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:56.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:56.313+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:56.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:56.343+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:56.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:56.393+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:56.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:56.919+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:57.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:57.296+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:57.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:57.377+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:57.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:57.441+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:57.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:57.949+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:58.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:58.251+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:58.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:58.383+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:58.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:58.449+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:58.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:58.970+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:59.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:32:59.294+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:59.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:32:59.418+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:59.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:32:59.420+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:32:59.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:32:59.962+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:00.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:00.257+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:00.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:00.369+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:00.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:00.383+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:00.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:00.940+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:01.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:01.257+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:01.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:01.373+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:01.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:01.416+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:01.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:01.953+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:02.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:02.261+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:02.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:02.351+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:02.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:02.431+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:02.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:02.966+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:03.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:03.230+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:03.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:03.357+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:03.382 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:33:03.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:33:03.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:03.440+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:03.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:03.993+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:04.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:04.271+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:04.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:04.327+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:04.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:04.468+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:05.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:04.999+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:05.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:05.281+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:05.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:05.286+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:05.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:05.451+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:06.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:05.998+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:06.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:06.244+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:06.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:06.316+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:06.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:06.442+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:06.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:06.968+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:07.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:07.267+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:07.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:07.361+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:07.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:07.473+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:07.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:07.984+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:08.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:08.245+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:08.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:08.324+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:08.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:08.472+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:08.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:08.991+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:09.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:09.269+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:09.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:09.337+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:09.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:09.504+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:09.870 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:33:09.867+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:33:10.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:10.019+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:10.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:10.254+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:10.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:10.313+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:10.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:10.495+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:11.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:11.064+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:11.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:11.290+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:11.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:11.353+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:11.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:11.449+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:12.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:12.114+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:12.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:12.322+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:12.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:12.326+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:12.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:12.465+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:13.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:13.074+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:13.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:13.334+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:13.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:13.340+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:13.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:13.508+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:14.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:14.025+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:14.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:14.321+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:14.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:14.330+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:14.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:14.506+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:15.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:15.019+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:15.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:15.310+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:15.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:15.334+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:15.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:15.544+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:15.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:15.977+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:16.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:16.279+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:16.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:16.329+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:16.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:16.556+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:17.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:17.008+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:17.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:17.267+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:17.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:17.336+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:17.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:17.509+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:17.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:17.967+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:18.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:18.231+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:18.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:18.316+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:18.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:18.498+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:18.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:18.977+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:19.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:19.183+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:19.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:19.267+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:19.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:19.472+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:19.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:19.936+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:20.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:20.204+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:20.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:20.238+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:20.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:20.445+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:20.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:20.959+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:21.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:21.195+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:21.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:21.285+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:21.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:21.407+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:21.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:21.966+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:22.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:22.203+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:22.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:22.281+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:22.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:22.400+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:22.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:22.922+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:23.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:23.189+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:23.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:23.234+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:23.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:23.395+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:23.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:23.922+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:24.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:24.215+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:24.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:24.273+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:24.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:24.374+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:24.879 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:33:24.877+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:33:24.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:24.939+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:25.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:25.239+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:25.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:25.243+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:25.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:25.338+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:25.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:25.944+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:26.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:26.216+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:26.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:26.223+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:26.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:26.382+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:26.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:26.943+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:27.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:27.183+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:27.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:27.223+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:27.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:27.413+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:27.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:27.960+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:28.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:28.201+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:28.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:28.207+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:28.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:28.388+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:28.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:28.923+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:29.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:29.167+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:29.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:29.191+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:29.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:29.347+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:29.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:29.876+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:30.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:30.154+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:30.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:30.158+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:30.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:30.393+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:30.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:30.864+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:31.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:31.114+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:31.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:31.162+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:31.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:31.438+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:31.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:31.817+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:32.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:32.078+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:32.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:32.186+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:32.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:32.408+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:32.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:32.791+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:33.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:33.102+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:33.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:33.175+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:33.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:33.446+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:33.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:33:33.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:33:33.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:33.815+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:34.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:34.089+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:34.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:34.154+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:34.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:34.438+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:34.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:34.785+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:35.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:35.076+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:35.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:35.164+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:35.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:35.420+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:35.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:35.807+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:36.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:36.070+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:36.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:36.211+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:36.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:36.447+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:36.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:36.822+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:37.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:37.072+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:37.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:37.204+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:37.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:37.488+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:37.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:37.855+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:38.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:38.119+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:38.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:38.246+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:38.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:38.513+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:38.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:38.870+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:39.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:39.144+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:39.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:39.270+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:39.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:39.542+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:39.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:39.884+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:39.895 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:33:39.892+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:33:40.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:40.113+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:40.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:40.293+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:40.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:40.586+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:40.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:40.932+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:41.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:41.083+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:41.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:41.294+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:41.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:41.617+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:41.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:41.896+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:42.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:42.093+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:42.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:42.301+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:42.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:42.598+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:42.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:42.933+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:43.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:43.046+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:43.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:43.252+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:43.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:43.551+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:43.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:43.924+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:44.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:44.067+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:44.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:44.251+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:44.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:44.512+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:44.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:44.936+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:45.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:45.105+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:45.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:45.201+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:45.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:45.561+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:45.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:45.987+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:46.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:46.092+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:46.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:46.205+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:46.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:46.581+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:47.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:47.031+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:47.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:47.088+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:47.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:47.215+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:47.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:47.616+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:48.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:48.055+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:48.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:48.058+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:48.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:48.179+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:48.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:48.600+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:49.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:49.021+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:49.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:49.053+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:49.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:49.223+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:49.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:49.612+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:50.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:50.028+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:50.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:50.047+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:50.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:50.203+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:50.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:50.605+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:51.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:51.040+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:51.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:51.047+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:51.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:51.253+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:51.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:51.588+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:52.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:52.006+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:52.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:52.072+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:52.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:52.281+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:52.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:52.627+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:53.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:53.006+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:53.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:53.101+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:53.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:53.272+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:53.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:53.623+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:54.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:54.005+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:54.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:54.074+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:54.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:54.225+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:54.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:54.578+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:54.911 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:33:54.908+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:33:55.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:55.036+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:55.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:55.104+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:55.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:55.176+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:55.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:55.572+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:56.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:56.081+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:56.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:56.143+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:56.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:56.207+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:56.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:56.612+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:57.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:57.127+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:57.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:57.147+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:57.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:57.202+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:57.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:57.650+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:58.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:58.106+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:58.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:58.190+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:58.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:58.222+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:58.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:58.681+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:59.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:33:59.114+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:59.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:33:59.201+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:59.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:33:59.234+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:33:59.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:33:59.697+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:00.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:00.138+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:00.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:00.201+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:00.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:00.201+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:00.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:00.715+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:01.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:01.143+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:01.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:01.201+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:01.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:01.226+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:01.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:01.735+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:02.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:02.175+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:02.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:02.226+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:02.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:02.245+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:02.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:02.728+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:03.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:03.157+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:03.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:03.221+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:03.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:03.246+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:03.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:34:03.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:34:03.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:03.736+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:04.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:04.137+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:04.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:04.193+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:04.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:04.291+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:04.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:04.701+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:05.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:05.146+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:05.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:05.178+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:05.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:05.262+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:05.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:05.741+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:06.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:06.099+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:06.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:06.135+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:06.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:06.266+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:06.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:06.693+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:07.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:07.098+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:07.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:07.184+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:07.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:07.299+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:07.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:07.717+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:08.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:08.069+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:08.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:08.143+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:08.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:08.291+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:08.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:08.697+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:09.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:09.047+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:09.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:09.105+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:09.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:09.308+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:09.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:09.681+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:09.927 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:34:09.924+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:34:10.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:10.065+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:10.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:10.096+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:10.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:10.335+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:10.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:10.664+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:11.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:11.039+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:11.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:11.112+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:11.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:11.373+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:11.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:11.674+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:12.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:12.001+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:12.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:12.123+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:12.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:12.331+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:12.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:12.714+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:13.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:13.039+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:13.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:13.162+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:13.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:13.370+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:13.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:13.719+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:14.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:14.055+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:14.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:14.196+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:14.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:14.420+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:14.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:14.737+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:15.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:15.024+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:15.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:15.189+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:15.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:15.456+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:15.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:15.735+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:16.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:16.001+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:16.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:16.142+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:16.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:16.501+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:16.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:16.717+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:16.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:16.979+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:17.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:17.126+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:17.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:17.516+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:17.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:17.708+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:17.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:17.936+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:18.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:18.096+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:18.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:18.554+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:18.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:18.709+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:18.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:18.903+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:19.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:19.058+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:19.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:19.581+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:19.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:19.753+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:19.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:19.891+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:20.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:20.095+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:20.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:20.541+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:20.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:20.740+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:20.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:20.910+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:21.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:21.053+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:21.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:21.546+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:21.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:21.741+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:21.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:21.947+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:22.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:22.011+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:22.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:22.515+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:22.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:22.768+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:22.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:22.994+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:22.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:22.997+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:23.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:23.526+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:23.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:23.748+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:23.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:23.965+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:24.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:24.031+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:24.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:24.482+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:24.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:24.797+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:24.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:24.930+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:24.942 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:34:24.940+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:34:25.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:25.062+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:25.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:25.511+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:25.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:25.800+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:25.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:25.911+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:26.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:26.057+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:26.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:26.479+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:26.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:26.806+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:26.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:26.927+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:27.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:27.040+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:27.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:27.458+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:27.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:27.814+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:27.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:27.950+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:28.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:28.063+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:28.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:28.492+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:28.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:28.800+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:28.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:28.929+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:29.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:29.066+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:29.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:29.538+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:29.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:29.781+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:29.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:29.922+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:30.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:30.059+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:30.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:30.573+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:30.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:30.801+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:30.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:30.930+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:31.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:31.055+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:31.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:31.556+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:31.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:31.756+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:31.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:31.937+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:32.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:32.103+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:32.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:32.516+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:32.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:32.711+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:32.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:32.906+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:33.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:33.148+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:33.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:33.518+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:33.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:33.758+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:33.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:34:33.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:34:33.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:33.875+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:34.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:34.174+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:34.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:34.544+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:34.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:34.744+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:34.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:34.905+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:35.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:35.147+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:35.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:35.507+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:35.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:35.740+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:35.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:35.953+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:36.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:36.135+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:36.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:36.464+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:36.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:36.696+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:36.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:36.967+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:37.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:37.100+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:37.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:37.466+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:37.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:37.741+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:37.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:37.922+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:38.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:38.084+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:38.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:38.444+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:38.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:38.757+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:38.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:38.937+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:39.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:39.120+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:39.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:39.449+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:39.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:39.774+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:39.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:39.923+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:39.958 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:34:39.957+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:34:40.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:40.117+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:40.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:40.499+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:40.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:40.767+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:40.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:40.917+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:41.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:41.111+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:41.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:41.495+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:41.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:41.796+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:41.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:41.931+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:42.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:42.095+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:42.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:42.455+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:42.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:42.757+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:42.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:42.891+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:43.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:43.118+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:43.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:43.409+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:43.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:43.736+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:43.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:43.860+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:44.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:44.118+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:44.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:44.446+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:44.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:44.736+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:44.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:44.889+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:45.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:45.158+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:45.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:45.472+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:45.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:45.730+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:45.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:45.839+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:46.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:46.110+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:46.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:46.448+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:46.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:46.687+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:46.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:46.806+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:47.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:47.070+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:47.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:47.407+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:47.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:47.667+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:47.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:47.819+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:48.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:48.050+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:48.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:48.447+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:48.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:48.624+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:48.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:48.786+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:49.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:49.031+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:49.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:49.429+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:49.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:49.591+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:49.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:49.784+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:50.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:50.056+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:50.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:50.467+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:50.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:50.577+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:50.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:50.778+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:51.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:51.036+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:51.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:51.502+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:51.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:51.538+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:51.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:51.769+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:52.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:52.016+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:52.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:52.483+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:52.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:52.549+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:52.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:52.764+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:53.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:53.032+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:53.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:53.462+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:53.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:53.558+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:53.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:53.780+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:54.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:54.042+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:54.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:54.505+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:54.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:54.511+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:54.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:54.795+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:54.974 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:34:54.972+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:34:55.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:55.016+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:55.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:55.457+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:55.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:55.540+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:55.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:55.776+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:56.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:56.040+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:56.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:56.478+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:56.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:56.539+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:56.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:56.794+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:57.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:57.057+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:57.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:57.525+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:57.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:57.575+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:57.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:57.834+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:58.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:58.080+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:58.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:58.560+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:58.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:58.571+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:58.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:58.852+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:59.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:34:59.080+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:59.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:34:59.566+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:59.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:34:59.579+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:34:59.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:34:59.822+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:00.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:00.128+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:00.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:00.523+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:00.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:00.629+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:00.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:00.814+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:01.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:01.125+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:01.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:01.516+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:01.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:01.678+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:01.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:01.818+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:02.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:02.081+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:02.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:02.491+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:02.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:02.715+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:02.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:02.813+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:03.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:03.106+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:03.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:03.481+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:03.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:03.746+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:03.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:03.851+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:03.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:35:03.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:35:04.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:04.062+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:04.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:04.531+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:04.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:04.735+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:04.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:04.842+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:05.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:05.040+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:05.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:05.515+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:05.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:05.770+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:05.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:05.884+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:06.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:06.055+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:06.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:06.503+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:06.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:06.820+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:06.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:06.858+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:07.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:07.027+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:07.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:07.496+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:07.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:07.795+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:07.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:07.867+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:08.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:08.066+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:08.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:08.460+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:08.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:08.813+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:08.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:08.843+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:09.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:09.100+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:09.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:09.473+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:09.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:09.831+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:09.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:09.848+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:09.990 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:35:09.988+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:35:10.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:10.108+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:10.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:10.438+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:10.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:10.814+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:10.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:10.866+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:11.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:11.094+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:11.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:11.434+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:11.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:11.835+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:11.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:11.892+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:12.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:12.095+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:12.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:12.463+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:12.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:12.859+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:12.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:12.884+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:13.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:13.084+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:13.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:13.426+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:13.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:13.845+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:13.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:13.919+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:14.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:14.122+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:14.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:14.410+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:14.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:14.799+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:14.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:14.905+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:15.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:15.131+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:15.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:15.413+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:15.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:15.779+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:15.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:15.892+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:16.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:16.149+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:16.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:16.418+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:16.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:16.735+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:16.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:16.865+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:17.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:17.177+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:17.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:17.391+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:17.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:17.691+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:17.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:17.830+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:18.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:18.178+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:18.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:18.358+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:18.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:18.667+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:18.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:18.798+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:19.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:19.158+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:19.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:19.375+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:19.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:19.704+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:19.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:19.843+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:20.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:20.178+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:20.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:20.398+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:20.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:20.714+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:20.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:20.805+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:21.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:21.203+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:21.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:21.419+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:21.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:21.701+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:21.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:21.785+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:22.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:22.240+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:22.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:22.384+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:22.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:22.692+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:22.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:22.764+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:23.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:23.203+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:23.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:23.380+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:23.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:23.694+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:23.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:23.773+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:24.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:24.225+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:24.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:24.339+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:24.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:24.708+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:24.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:24.802+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:25.006 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:35:25.003+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:35:25.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:25.267+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:25.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:25.345+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:25.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:25.672+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:25.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:25.834+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:26.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:26.243+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:26.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:26.296+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:26.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:26.632+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:26.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:26.885+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:27.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:27.254+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:27.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:27.332+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:27.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:27.647+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:27.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:27.908+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:28.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:28.250+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:28.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:28.320+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:28.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:28.603+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:28.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:28.871+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:29.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:29.232+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:29.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:29.284+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:29.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:29.618+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:29.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:29.848+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:30.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:30.216+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:30.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:30.297+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:30.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:30.659+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:30.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:30.847+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:31.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:31.186+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:31.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:31.329+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:31.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:31.699+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:31.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:31.863+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:32.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:32.177+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:32.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:32.296+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:32.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:32.698+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:32.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:32.834+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:33.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:33.162+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:33.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:33.249+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:33.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:33.668+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:33.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:33.859+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:34.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:35:34.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:35:34.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:34.192+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:34.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:34.260+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:34.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:34.712+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:34.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:34.844+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:35.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:35.230+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:35.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:35.255+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:35.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:35.680+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:35.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:35.894+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:36.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:36.196+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:36.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:36.283+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:36.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:36.713+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:36.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:36.847+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:37.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:37.195+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:37.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:37.259+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:37.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:37.729+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:37.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:37.813+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:38.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:38.147+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:38.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:38.277+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:38.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:38.700+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:38.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:38.845+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:39.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:39.152+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:39.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:39.313+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:39.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:39.713+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:39.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:39.886+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:40.022 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:35:40.019+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:35:40.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:40.194+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:40.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:40.358+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:40.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:40.703+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:40.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:40.913+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:41.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:41.169+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:41.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:41.341+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:41.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:41.709+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:41.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:41.878+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:42.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:42.183+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:42.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:42.386+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:42.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:42.689+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:42.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:42.864+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:43.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:43.168+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:43.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:43.423+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:43.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:43.717+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:43.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:43.897+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:44.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:44.155+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:44.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:44.442+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:44.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:44.719+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:44.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:44.934+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:45.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:45.118+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:45.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:45.398+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:45.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:45.719+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:45.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:45.947+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:46.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:46.128+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:46.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:46.377+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:46.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:46.747+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:46.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:46.928+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:47.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:47.143+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:47.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:47.379+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:47.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:47.712+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:47.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:47.925+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:48.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:48.152+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:48.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:48.373+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:48.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:48.694+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:48.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:48.956+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:49.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:49.111+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:49.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:49.412+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:49.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:49.656+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:49.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:49.996+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:50.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:50.109+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:50.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:50.455+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:50.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:50.704+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:50.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:50.961+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:51.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:51.147+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:51.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:51.447+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:51.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:51.702+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:51.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:51.953+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:52.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:52.118+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:52.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:52.437+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:52.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:52.746+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:52.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:52.920+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:53.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:53.130+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:53.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:53.457+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:53.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:53.778+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:53.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:53.901+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:54.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:54.170+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:54.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:54.474+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:54.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:54.790+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:54.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:54.899+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:55.038 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:35:55.036+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:35:55.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:55.155+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:55.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:55.440+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:55.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:55.782+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:55.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:55.917+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:56.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:56.141+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:56.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:56.461+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:56.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:56.782+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:56.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:56.899+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:57.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:57.097+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:57.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:57.467+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:57.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:57.824+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:57.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:57.876+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:58.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:58.110+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:58.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:58.435+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:58.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:58.831+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:58.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:58.838+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:59.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:35:59.067+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:59.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:35:59.406+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:59.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:35:59.784+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:35:59.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:35:59.814+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:00.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:00.040+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:00.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:00.407+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:00.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:00.831+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:00.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:00.854+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:01.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:01.054+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:01.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:01.435+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:01.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:01.860+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:01.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:01.862+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:02.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:02.057+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:02.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:02.430+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:02.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:02.842+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:02.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:02.873+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:03.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:03.085+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:03.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:03.437+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:03.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:03.855+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:03.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:03.874+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:04.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:04.050+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:04.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:36:04.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:36:04.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:04.446+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:04.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:04.816+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:04.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:04.903+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:05.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:05.023+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:05.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:05.405+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:05.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:05.837+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:05.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:05.906+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:06.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:06.007+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:06.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:06.403+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:06.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:06.830+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:06.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:06.940+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:06.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:06.985+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:07.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:07.391+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:07.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:07.809+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:07.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:07.936+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:07.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:07.938+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:08.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:08.425+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:08.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:08.846+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:08.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:08.921+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:08.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:08.969+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:09.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:09.440+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:09.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:09.890+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:09.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:09.950+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:09.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:09.982+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:10.043 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:36:10.040+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:36:10.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:10.466+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:10.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:10.912+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:10.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:10.941+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:10.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:10.978+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:11.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:11.485+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:11.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:11.941+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:11.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:11.965+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:11.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:11.996+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:12.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:12.489+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:12.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:12.929+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:12.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:12.967+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:12.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:12.995+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:13.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:13.440+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:13.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:13.955+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:13.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:13.967+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:14.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:14.010+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:14.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:14.461+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:14.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:14.931+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:14.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:14.941+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:14.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:14.976+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:15.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:15.488+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:15.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:15.921+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:15.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:15.935+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:15.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:15.986+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:16.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:16.521+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:16.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:16.904+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:16.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:16.921+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:17.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:17.010+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:17.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:17.508+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:17.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:17.891+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:17.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:17.924+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:17.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:17.963+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:18.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:18.463+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:18.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:18.876+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:18.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:18.917+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:18.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:18.970+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:19.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:19.499+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:19.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:19.897+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:19.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:19.917+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:19.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:19.922+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:20.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:20.522+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:20.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:20.877+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:20.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:20.926+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:20.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:20.957+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:21.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:21.482+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:21.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:21.847+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:21.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:21.907+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:21.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:21.942+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:22.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:22.530+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:22.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:22.881+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:22.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:22.906+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:22.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:22.933+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:23.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:23.517+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:23.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:23.897+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:23.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:23.936+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:23.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:23.955+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:24.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:24.511+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:24.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:24.851+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:24.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:24.894+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:24.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:24.973+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:25.059 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:36:25.057+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:36:25.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:25.488+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:25.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:25.853+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:25.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:25.867+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:25.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:25.928+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:26.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:26.520+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:26.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:26.828+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:26.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:26.901+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:26.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:26.927+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:27.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:27.530+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:27.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:27.874+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:27.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:27.931+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:27.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:27.969+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:28.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:28.550+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:28.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:28.909+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:28.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:28.947+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:28.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:28.976+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:29.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:29.523+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:29.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:29.914+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:29.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:29.942+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:29.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:29.956+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:30.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:30.518+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:30.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:30.955+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:30.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:30.963+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:30.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:30.989+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:31.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:31.555+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:31.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:31.967+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:31.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:31.997+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:32.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:32.020+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:32.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:32.558+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:32.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:32.990+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:33.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:32.998+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:33.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:33.039+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:33.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:33.571+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:33.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:33.956+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:34.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:34.030+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:34.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:34.058+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:34.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:36:34.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:36:34.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:34.593+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:34.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:34.953+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:35.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:35.010+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:35.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:35.078+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:35.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:35.561+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:35.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:35.964+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:36.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:36.048+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:36.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:36.060+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:36.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:36.542+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:36.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:36.964+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:37.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:37.020+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:37.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:37.038+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:37.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:37.532+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:37.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:37.949+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:37.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:37.972+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:38.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:38.044+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:38.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:38.494+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:38.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:38.936+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:38.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:38.968+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:39.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:39.011+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:39.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:39.517+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:39.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:39.891+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:39.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:39.921+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:40.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:40.053+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:40.062 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:36:40.060+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:36:40.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:40.561+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:40.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:40.871+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:40.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:40.922+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:41.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:41.054+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:41.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:41.580+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:41.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:41.897+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:41.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:41.945+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:42.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:42.037+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:42.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:42.540+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:42.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:42.873+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:42.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:42.960+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:43.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:43.044+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:43.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:43.492+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:43.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:43.922+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:43.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:43.968+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:44.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:44.010+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:44.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:44.527+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:44.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:44.916+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:44.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:44.946+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:45.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:45.039+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:45.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:45.499+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:45.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:45.898+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:45.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:45.927+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:46.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:46.081+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:46.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:46.535+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:46.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:46.908+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:46.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:46.942+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:47.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:47.081+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:47.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:47.562+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:47.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:47.915+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:47.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:47.955+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:48.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:48.043+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:48.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:48.579+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:48.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:48.874+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:48.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:48.974+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:49.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:49.062+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:49.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:49.542+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:49.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:49.910+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:49.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:49.975+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:50.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:50.033+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:50.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:50.527+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:50.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:50.959+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:50.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:50.980+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:51.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:51.058+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:51.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:51.485+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:51.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:51.914+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:51.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:51.971+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:52.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:52.015+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:52.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:52.528+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:52.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:52.900+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:52.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:52.991+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:53.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:53.011+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:53.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:53.567+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:53.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:53.922+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:54.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:54.000+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:54.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:54.049+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:54.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:54.578+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:54.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:54.894+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:55.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:54.999+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:55.078 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:36:55.075+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:36:55.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:55.084+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:55.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:55.595+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:55.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:55.845+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:56.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:56.032+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:56.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:56.093+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:56.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:56.637+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:56.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:56.800+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:57.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:57.050+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:57.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:57.058+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:57.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:57.619+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:57.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:57.839+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:58.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:58.013+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:58.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:58.104+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:58.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:58.657+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:58.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:58.857+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:59.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:36:59.059+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:59.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:36:59.105+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:59.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:36:59.664+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:36:59.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:36:59.868+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:00.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:00.107+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:00.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:00.143+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:00.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:00.696+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:00.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:00.891+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:01.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:01.104+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:01.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:01.112+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:01.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:01.707+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:01.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:01.928+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:02.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:02.060+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:02.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:02.156+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:02.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:02.710+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:02.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:02.940+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:03.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:03.104+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:03.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:03.152+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:03.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:03.712+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:03.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:03.976+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:04.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:04.122+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:04.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:04.125+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:04.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:37:04.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:37:04.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:04.718+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:05.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:05.000+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:05.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:05.119+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:05.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:05.167+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:05.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:05.679+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:05.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:05.975+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:06.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:06.086+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:06.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:06.189+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:06.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:06.724+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:06.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:06.931+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:07.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:07.123+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:07.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:07.190+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:07.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:07.760+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:07.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:07.911+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:08.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:08.128+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:08.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:08.211+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:08.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:08.783+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:08.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:08.884+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:09.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:09.104+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:09.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:09.200+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:09.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:09.826+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:09.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:09.848+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:10.094 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:37:10.091+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:37:10.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:10.146+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:10.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:10.167+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:10.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:10.871+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:10.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:10.881+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:11.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:11.155+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:11.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:11.177+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:11.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:11.858+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:11.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:11.886+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:12.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:12.148+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:12.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:12.176+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:12.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:12.883+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:12.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:12.897+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:13.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:13.148+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:13.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:13.196+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:13.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:13.835+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:13.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:13.926+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:14.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:14.127+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:14.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:14.171+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:14.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:14.815+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:14.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:14.960+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:15.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:15.172+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:15.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:15.181+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:15.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:15.805+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:15.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:15.952+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:16.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:16.149+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:16.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:16.191+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:16.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:16.822+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:16.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:16.974+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:17.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:17.128+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:17.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:17.161+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:17.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:17.775+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:18.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:17.999+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:18.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:18.130+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:18.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:18.154+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:18.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:18.740+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:18.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:18.950+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:19.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:19.113+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:19.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:19.153+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:19.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:19.719+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:19.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:19.929+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:20.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:20.079+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:20.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:20.203+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:20.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:20.700+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:20.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:20.916+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:21.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:21.050+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:21.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:21.227+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:21.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:21.703+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:21.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:21.889+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:22.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:22.030+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:22.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:22.252+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:22.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:22.691+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:22.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:22.888+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:23.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:23.038+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:23.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:23.211+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:23.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:23.726+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:23.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:23.938+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:24.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:24.007+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:24.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:24.194+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:24.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:24.684+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:24.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:24.947+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:25.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:25.021+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:25.110 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:37:25.107+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:37:25.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:25.206+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:25.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:25.635+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:25.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:25.903+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:26.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:26.038+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:26.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:26.175+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:26.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:26.636+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:26.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:26.936+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:27.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:27.051+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:27.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:27.225+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:27.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:27.684+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:27.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:27.915+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:28.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:28.005+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:28.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:28.220+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:28.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:28.729+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:28.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:28.876+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:29.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:29.023+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:29.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:29.194+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:29.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:29.765+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:29.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:29.885+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:30.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:30.008+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:30.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:30.155+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:30.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:30.741+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:30.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:30.866+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:30.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:30.989+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:31.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:31.131+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:31.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:31.775+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:31.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:31.888+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:32.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:32.030+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:32.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:32.091+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:32.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:32.808+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:32.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:32.921+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:32.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:32.997+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:33.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:33.125+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:33.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:33.814+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:33.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:33.944+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:34.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:33.999+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:34.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:34.157+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:34.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:37:34.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:37:34.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:34.830+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:34.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:34.904+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:34.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:34.952+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:35.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:35.173+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:35.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:35.841+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:35.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:35.862+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:35.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:35.954+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:36.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:36.191+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:36.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:36.819+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:36.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:36.849+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:36.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:36.964+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:37.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:37.142+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:37.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:37.810+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:37.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:37.864+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:37.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:37.956+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:38.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:38.158+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:38.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:38.855+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:38.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:38.862+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:38.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:38.935+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:39.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:39.182+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:39.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:39.877+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:39.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:39.898+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:39.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:39.903+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:40.125 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:37:40.124+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:37:40.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:40.174+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:40.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:40.842+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:40.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:40.901+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:40.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:40.914+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:41.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:41.146+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:41.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:41.881+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:41.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:41.881+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:41.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:41.943+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:42.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:42.133+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:42.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:42.852+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:42.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:42.915+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:42.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:42.931+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:43.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:43.182+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:43.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:43.847+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:43.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:43.914+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:43.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:43.945+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:44.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:44.207+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:44.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:44.860+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:44.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:44.900+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:44.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:44.947+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:45.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:45.241+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:45.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:45.909+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:45.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:45.929+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:45.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:45.947+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:46.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:46.242+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:46.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:46.908+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:46.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:46.973+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:46.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:46.986+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:47.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:47.288+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:47.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:47.891+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:47.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:47.948+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:47.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:47.980+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:48.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:48.267+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:48.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:48.865+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:48.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:48.965+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:48.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:48.981+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:49.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:49.293+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:49.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:49.829+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:49.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:49.935+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:49.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:49.969+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:50.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:50.244+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:50.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:50.830+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:50.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:50.949+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:51.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:50.999+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:51.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:51.247+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:51.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:51.799+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:51.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:51.961+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:51.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:51.966+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:52.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:52.223+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:52.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:52.831+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:52.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:52.923+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:53.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:53.005+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:53.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:53.263+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:53.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:53.869+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:53.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:53.939+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:54.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:53.999+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:54.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:54.285+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:54.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:54.855+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:54.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:54.963+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:55.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:55.041+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:55.137 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:37:55.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:37:55.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:55.243+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:55.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:55.818+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:55.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:55.990+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:56.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:56.088+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:56.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:56.255+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:56.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:56.770+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:56.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:56.964+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:57.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:57.132+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:57.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:57.226+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:57.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:57.809+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:57.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:57.955+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:58.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:58.166+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:58.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:58.250+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:58.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:58.813+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:58.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:58.926+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:59.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:37:59.120+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:59.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:37:59.260+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:59.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:37:59.800+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:37:59.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:37:59.888+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:00.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:00.093+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:00.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:00.290+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:00.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:00.760+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:00.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:00.859+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:01.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:01.074+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:01.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:01.275+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:01.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:01.760+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:01.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:01.893+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:02.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:02.061+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:02.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:02.297+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:02.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:02.751+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:02.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:02.860+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:03.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:03.073+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:03.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:03.279+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:03.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:03.723+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:03.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:03.817+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:04.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:04.070+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:04.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:04.250+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:04.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:38:04.648 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:38:04.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:04.756+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:04.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:04.833+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:05.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:05.071+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:05.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:05.279+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:05.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:05.712+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:05.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:05.795+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:06.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:06.059+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:06.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:06.278+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:06.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:06.705+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:06.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:06.763+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:07.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:07.069+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:07.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:07.320+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:07.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:07.695+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:07.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:07.725+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:08.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:08.073+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:08.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:08.288+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:08.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:08.689+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:08.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:08.696+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:09.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:09.064+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:09.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:09.268+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:09.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:09.672+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:09.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:09.739+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:10.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:10.080+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:10.153 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:38:10.150+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:38:10.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:10.254+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:10.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:10.677+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:10.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:10.700+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:11.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:11.110+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:11.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:11.221+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:11.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:11.681+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:11.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:11.746+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:12.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:12.091+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:12.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:12.240+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:12.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:12.674+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:12.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:12.793+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:13.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:13.088+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:13.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:13.269+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:13.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:13.640+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:13.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:13.748+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:14.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:14.127+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:14.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:14.284+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:14.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:14.675+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:14.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:14.788+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:15.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:15.091+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:15.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:15.246+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:15.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:15.697+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:15.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:15.802+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:16.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:16.059+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:16.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:16.284+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:16.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:16.694+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:16.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:16.820+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:17.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:17.039+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:17.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:17.289+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:17.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:17.679+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:17.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:17.830+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:18.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:18.024+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:18.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:18.324+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:18.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:18.653+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:18.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:18.839+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:18.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:18.987+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:19.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:19.325+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:19.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:19.673+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:19.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:19.826+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:19.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:19.980+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:20.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:20.372+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:20.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:20.644+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:20.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:20.826+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:20.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:20.995+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:21.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:21.329+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:21.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:21.603+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:21.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:21.843+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:22.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:21.997+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:22.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:22.300+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:22.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:22.583+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:22.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:22.862+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:22.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:22.993+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:23.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:23.258+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:23.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:23.538+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:23.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:23.887+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:23.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:23.957+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:24.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:24.268+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:24.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:24.504+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:24.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:24.934+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:24.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:24.934+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:25.169 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:38:25.166+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:38:25.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:25.263+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:25.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:25.477+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:25.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:25.921+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:25.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:25.926+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:26.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:26.214+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:26.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:26.479+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:26.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:26.898+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:26.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:26.950+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:27.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:27.256+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:27.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:27.442+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:27.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:27.851+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:27.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:27.915+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:28.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:28.274+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:28.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:28.453+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:28.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:28.858+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:28.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:28.927+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:29.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:29.294+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:29.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:29.451+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:29.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:29.837+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:29.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:29.927+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:30.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:30.277+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:30.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:30.496+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:30.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:30.835+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:30.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:30.936+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:31.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:31.286+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:31.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:31.504+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:31.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:31.813+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:31.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:31.915+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:32.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:32.285+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:32.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:32.542+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:32.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:32.772+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:32.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:32.906+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:33.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:33.288+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:33.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:33.583+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:33.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:33.771+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:33.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:33.908+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:34.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:34.286+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:34.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:34.553+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:34.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:34.763+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:34.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:38:34.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:38:34.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:34.932+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:35.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:35.239+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:35.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:35.518+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:35.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:35.722+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:35.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:35.895+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:36.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:36.194+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:36.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:36.561+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:36.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:36.717+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:36.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:36.884+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:37.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:37.163+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:37.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:37.550+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:37.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:37.742+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:37.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:37.852+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:38.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:38.140+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:38.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:38.586+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:38.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:38.746+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:38.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:38.902+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:39.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:39.100+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:39.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:39.557+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:39.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:39.788+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:39.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:39.925+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:40.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:40.120+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:40.171 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:38:40.168+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:38:40.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:40.573+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:40.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:40.815+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:40.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:40.967+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:41.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:41.123+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:41.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:41.570+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:41.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:41.857+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:41.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:41.983+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:42.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:42.170+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:42.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:42.611+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:42.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:42.816+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:42.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:42.937+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:43.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:43.139+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:43.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:43.609+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:43.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:43.827+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:43.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:43.889+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:44.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:44.095+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:44.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:44.624+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:44.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:44.829+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:44.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:44.931+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:45.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:45.133+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:45.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:45.667+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:45.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:45.854+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:45.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:45.937+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:46.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:46.128+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:46.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:46.669+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:46.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:46.897+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:46.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:46.909+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:47.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:47.137+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:47.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:47.636+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:47.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:47.862+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:47.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:47.867+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:48.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:48.114+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:48.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:48.596+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:48.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:48.902+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:48.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:48.910+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:49.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:49.101+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:49.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:49.564+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:49.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:49.880+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:49.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:49.892+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:50.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:50.086+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:50.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:50.576+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:50.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:50.860+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:50.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:50.863+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:51.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:51.084+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:51.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:51.615+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:51.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:51.816+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:51.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:51.844+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:52.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:52.086+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:52.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:52.608+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:52.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:52.802+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:52.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:52.810+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:53.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:53.071+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:53.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:53.629+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:53.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:53.778+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:53.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:53.814+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:54.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:54.032+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:54.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:54.675+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:54.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:54.787+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:54.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:54.803+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:55.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:55.005+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:55.183 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:38:55.181+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:38:55.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:55.698+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:55.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:55.785+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:55.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:55.788+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:55.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:55.965+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:56.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:56.732+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:56.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:56.789+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:56.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:56.807+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:56.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:56.940+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:57.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:57.782+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:57.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:57.782+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:57.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:57.800+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:57.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:57.985+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:58.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:58.738+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:58.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:58.751+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:58.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:58.780+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:59.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:38:59.015+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:59.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:38:59.741+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:59.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:38:59.780+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:38:59.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:38:59.795+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:00.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:00.058+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:00.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:00.728+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:00.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:00.756+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:00.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:00.829+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:01.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:01.011+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:01.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:01.767+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:01.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:01.783+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:01.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:01.793+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:02.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:02.043+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:02.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:02.767+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:02.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:02.792+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:02.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:02.818+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:02.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:02.994+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:03.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:03.754+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:03.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:03.825+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:03.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:03.865+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:03.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:03.953+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:04.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:04.789+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:04.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:04.798+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:04.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:04.872+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:04.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:39:04.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:39:04.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:04.996+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:05.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:05.777+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:05.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:05.820+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:05.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:05.834+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:05.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:05.964+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:06.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:06.764+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:06.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:06.807+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:06.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:06.848+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:06.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:06.937+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:07.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:07.783+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:07.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:07.822+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:07.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:07.839+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:07.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:07.889+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:08.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:08.799+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:08.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:08.829+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:08.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:08.855+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:08.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:08.862+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:09.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:09.812+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:09.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:09.850+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:09.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:09.871+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:09.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:09.871+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:10.199 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:39:10.196+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:39:10.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:10.805+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:10.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:10.846+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:10.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:10.889+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:10.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:10.911+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:11.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:11.763+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:11.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:11.840+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:11.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:11.889+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:11.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:11.890+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:12.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:12.742+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:12.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:12.805+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:12.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:12.854+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:12.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:12.909+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:13.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:13.792+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:13.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:13.814+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:13.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:13.883+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:13.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:13.935+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:14.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:14.806+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:14.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:14.835+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:14.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:14.903+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:14.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:14.930+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:15.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:15.793+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:15.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:15.819+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:15.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:15.934+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:15.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:15.965+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:16.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:16.801+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:16.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:16.832+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:16.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:16.943+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:16.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:16.968+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:17.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:17.801+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:17.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:17.860+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:17.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:17.988+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:17.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:17.991+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:18.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:18.768+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:18.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:18.906+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:18.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:18.953+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:18.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:18.994+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:19.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:19.780+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:19.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:19.945+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:19.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:19.945+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:19.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:19.956+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:20.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:20.774+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:20.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:20.904+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:20.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:20.920+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:20.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:20.965+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:21.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:21.747+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:21.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:21.856+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:21.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:21.919+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:21.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:21.959+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:22.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:22.784+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:22.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:22.815+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:22.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:22.917+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:22.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:22.954+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:23.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:23.812+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:23.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:23.829+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:23.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:23.908+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:23.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:23.991+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:24.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:24.777+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:24.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:24.864+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:24.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:24.898+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:24.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:24.984+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:25.203 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:39:25.201+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:39:25.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:25.806+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:25.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:25.815+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:25.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:25.860+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:26.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:26.026+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:26.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:26.765+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:26.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:26.783+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:26.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:26.847+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:27.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:27.050+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:27.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:27.733+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:27.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:27.735+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:27.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:27.810+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:28.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:28.044+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:28.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:28.762+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:28.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:28.782+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:28.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:28.809+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:29.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:29.073+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:29.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:29.749+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:29.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:29.784+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:29.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:29.848+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:30.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:30.057+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:30.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:30.756+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:30.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:30.772+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:30.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:30.857+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:31.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:31.026+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:31.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:31.783+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:31.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:31.805+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:31.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:31.899+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:32.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:32.012+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:32.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:32.746+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:32.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:32.828+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:32.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:32.852+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:32.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:32.989+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:33.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:33.778+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:33.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:33.826+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:33.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:33.885+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:33.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:33.960+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:34.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:34.819+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:34.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:34.846+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:34.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:34.911+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:34.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:34.924+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:35.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:39:35.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:39:35.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:35.771+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:35.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:35.876+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:35.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:35.882+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:35.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:35.924+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:36.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:36.779+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:36.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:36.866+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:36.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:36.902+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:36.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:36.911+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:37.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:37.780+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:37.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:37.826+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:37.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:37.917+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:37.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:37.937+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:38.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:38.758+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:38.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:38.863+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:38.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:38.882+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:38.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:38.980+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:39.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:39.770+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:39.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:39.837+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:39.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:39.890+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:39.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:39.959+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:40.219 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:39:40.217+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:39:40.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:40.727+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:40.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:40.852+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:40.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:40.876+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:40.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:40.966+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:41.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:41.697+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:41.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:41.837+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:41.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:41.873+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:42.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:41.999+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:42.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:42.653+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:42.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:42.801+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:42.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:42.902+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:42.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:42.978+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:43.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:43.687+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:43.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:43.795+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:43.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:43.936+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:44.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:44.019+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:44.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:44.704+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:44.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:44.831+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:44.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:44.973+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:45.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:45.012+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:45.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:45.704+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:45.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:45.875+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:45.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:45.928+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:46.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:46.040+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:46.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:46.744+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:46.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:46.856+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:46.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:46.896+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:47.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:47.056+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:47.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:47.755+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:47.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:47.849+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:47.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:47.862+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:48.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:48.036+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:48.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:48.755+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:48.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:48.805+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:48.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:48.841+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:49.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:49.048+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:49.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:49.775+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:49.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:49.797+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:49.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:49.808+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:50.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:50.079+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:50.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:50.800+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:50.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:50.817+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:50.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:50.831+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:51.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:51.039+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:51.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:51.804+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:51.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:51.814+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:51.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:51.814+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:52.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:52.019+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:52.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:52.769+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:52.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:52.773+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:52.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:52.826+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:53.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:53.068+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:53.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:53.790+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:53.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:53.797+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:53.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:53.807+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:54.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:54.086+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:54.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:54.777+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:54.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:54.802+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:54.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:54.815+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:55.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:55.068+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:55.235 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:39:55.233+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:39:55.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:55.760+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:55.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:55.780+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:55.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:55.783+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:56.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:56.065+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:56.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:56.738+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:56.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:56.801+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:56.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:56.801+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:57.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:57.056+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:57.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:57.784+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:57.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:57.816+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:57.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:57.841+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:58.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:58.065+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:58.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:58.831+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:58.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:58.851+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:58.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:58.858+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:59.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:39:59.047+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:59.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:39:59.811+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:59.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:39:59.835+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:39:59.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:39:59.854+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:00.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:00.033+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:00.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:00.811+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:00.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:00.828+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:00.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:00.857+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:01.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:01.066+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:01.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:01.779+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:01.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:01.817+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:01.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:01.836+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:02.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:02.018+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:02.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:02.803+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:02.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:02.821+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:02.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:02.822+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:03.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:03.010+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:03.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:03.768+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:03.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:03.780+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:03.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:03.860+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:04.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:04.022+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:04.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:04.781+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:04.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:04.788+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:04.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:04.885+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:05.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:05.027+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:05.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:40:05.144 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:40:05.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:05.785+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:05.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:05.804+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:05.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:05.914+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:06.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:06.006+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:06.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:06.793+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:06.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:06.812+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:06.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:06.872+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:07.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:07.053+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:07.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:07.819+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:07.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:07.832+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:07.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:07.897+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:08.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:08.083+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:08.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:08.864+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:08.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:08.872+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:08.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:08.878+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:09.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:09.110+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:09.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:09.816+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:09.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:09.905+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:09.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:09.909+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:10.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:10.155+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:10.238 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:40:10.236+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:40:10.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:10.812+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:10.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:10.928+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:10.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:10.935+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:11.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:11.187+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:11.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:11.762+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:11.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:11.901+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:11.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:11.968+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:12.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:12.214+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:12.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:12.715+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:12.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:12.861+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:12.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:12.937+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:13.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:13.220+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:13.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:13.748+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:13.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:13.865+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:13.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:13.922+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:14.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:14.199+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:14.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:14.724+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:14.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:14.907+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:14.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:14.969+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:15.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:15.166+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:15.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:15.760+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:15.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:15.912+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:16.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:16.013+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:16.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:16.185+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:16.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:16.738+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:16.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:16.875+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:17.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:17.017+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:17.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:17.180+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:17.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:17.737+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:17.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:17.836+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:18.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:18.036+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:18.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:18.170+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:18.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:18.745+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:18.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:18.835+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:19.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:19.027+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:19.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:19.198+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:19.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:19.761+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:19.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:19.855+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:20.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:20.045+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:20.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:20.175+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:20.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:20.718+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:20.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:20.853+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:21.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:21.027+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:21.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:21.202+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:21.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:21.755+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:21.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:21.842+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:22.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:22.006+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:22.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:22.234+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:22.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:22.791+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:22.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:22.813+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:22.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:22.971+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:23.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:23.256+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:23.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:23.768+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:23.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:23.801+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:24.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:24.009+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:24.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:24.261+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:24.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:24.745+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:24.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:24.846+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:25.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:25.010+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:25.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:25.225+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:25.254 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:40:25.251+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:40:25.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:25.777+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:25.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:25.868+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:26.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:26.016+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:26.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:26.251+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:26.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:26.785+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:26.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:26.900+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:27.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:27.032+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:27.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:27.274+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:27.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:27.835+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:27.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:27.856+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:28.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:28.023+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:28.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:28.243+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:28.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:28.807+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:28.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:28.832+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:28.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:28.985+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:29.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:29.275+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:29.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:29.783+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:29.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:29.809+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:30.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:30.005+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:30.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:30.314+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:30.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:30.774+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:30.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:30.807+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:30.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:30.965+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:31.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:31.342+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:31.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:31.772+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:31.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:31.812+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:31.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:31.950+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:32.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:32.338+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:32.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:32.746+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:32.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:32.846+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:32.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:32.956+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:33.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:33.349+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:33.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:33.772+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:33.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:33.803+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:34.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:34.004+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:34.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:34.360+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:34.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:34.789+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:34.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:34.803+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:35.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:35.050+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:35.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:40:35.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:40:35.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:35.357+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:35.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:35.781+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:35.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:35.790+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:36.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:36.041+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:36.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:36.318+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:36.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:36.793+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:36.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:36.837+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:37.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:37.063+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:37.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:37.358+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:37.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:37.778+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:37.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:37.854+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:38.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:38.028+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:38.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:38.379+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:38.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:38.749+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:38.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:38.812+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:39.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:39.018+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:39.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:39.361+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:39.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:39.791+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:39.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:39.854+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:40.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:40.023+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:40.270 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:40:40.268+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:40:40.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:40.313+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:40.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:40.790+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:40.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:40.871+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:41.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:41.024+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:41.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:41.301+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:41.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:41.822+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:41.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:41.889+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:42.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:42.068+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:42.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:42.293+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:42.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:42.779+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:42.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:42.936+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:43.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:43.069+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:43.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:43.251+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:43.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:43.740+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:43.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:43.964+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:44.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:44.021+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:44.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:44.285+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:44.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:44.774+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:44.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:44.981+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:45.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:45.025+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:45.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:45.312+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:45.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:45.799+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:45.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:45.955+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:46.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:46.048+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:46.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:46.297+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:46.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:46.783+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:46.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:46.927+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:47.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:47.008+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:47.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:47.336+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:47.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:47.764+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:47.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:47.950+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:48.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:48.012+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:48.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:48.337+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:48.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:48.813+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:48.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:48.956+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:49.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:49.016+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:49.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:49.355+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:49.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:49.862+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:49.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:49.967+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:50.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:50.016+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:50.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:50.401+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:50.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:50.902+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:50.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:50.981+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:50.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:50.983+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:51.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:51.432+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:51.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:51.908+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:51.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:51.985+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:52.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:52.007+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:52.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:52.435+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:52.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:52.913+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:52.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:52.992+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:53.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:53.012+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:53.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:53.468+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:53.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:53.914+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:53.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:53.976+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:54.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:54.008+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:54.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:54.502+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:54.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:54.961+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:54.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:54.966+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:55.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:55.043+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:55.285 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:40:55.283+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:40:55.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:55.479+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:55.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:55.966+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:55.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:55.967+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:56.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:56.052+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:56.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:56.438+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:56.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:56.954+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:56.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:56.984+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:57.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:57.096+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:57.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:57.434+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:57.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:57.962+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:58.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:58.011+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:58.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:58.100+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:58.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:58.401+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:59.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:58.997+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:59.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:40:59.014+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:59.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:40:59.070+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:40:59.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:40:59.404+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:00.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:40:59.998+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:00.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:00.058+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:00.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:00.093+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:00.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:00.442+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:00.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:00.968+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:01.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:01.048+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:01.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:01.067+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:01.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:01.442+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:01.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:01.977+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:02.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:02.004+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:02.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:02.089+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:02.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:02.463+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:02.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:02.943+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:03.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:03.025+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:03.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:03.096+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:03.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:03.503+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:03.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:03.921+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:03.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:03.991+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:04.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:04.061+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:04.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:04.521+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:04.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:04.951+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:05.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:05.012+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:05.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:05.031+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:05.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:41:05.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:41:05.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:05.474+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:05.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:05.909+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:05.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:05.985+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:06.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:06.021+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:06.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:06.511+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:06.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:06.951+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:06.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:06.985+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:07.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:07.004+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:07.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:07.540+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:07.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:07.953+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:07.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:07.976+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:08.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:08.000+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:08.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:08.528+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:08.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:08.924+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:08.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:08.954+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:09.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:09.007+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:09.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:09.497+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:09.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:09.902+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:09.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:09.923+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:10.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:10.058+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:10.295 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:41:10.292+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:41:10.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:10.482+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:10.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:10.883+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:10.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:10.971+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:11.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:11.060+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:11.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:11.500+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:11.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:11.838+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:12.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:12.008+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:12.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:12.040+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:12.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:12.463+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:12.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:12.837+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:13.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:13.009+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:13.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:13.039+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:13.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:13.416+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:13.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:13.803+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:14.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:14.030+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:14.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:14.052+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:14.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:14.450+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:14.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:14.778+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:15.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:15.030+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:15.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:15.088+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:15.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:15.420+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:15.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:15.753+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:15.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:15.993+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:16.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:16.039+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:16.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:16.401+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:16.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:16.708+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:16.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:16.993+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:17.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:17.047+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:17.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:17.391+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:17.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:17.754+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:17.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:17.963+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:18.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:18.065+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:18.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:18.397+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:18.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:18.752+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:19.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:19.002+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:19.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:19.103+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:19.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:19.429+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:19.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:19.707+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:19.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:19.960+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:20.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:20.089+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:20.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:20.416+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:20.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:20.704+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:21.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:21.000+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:21.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:21.073+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:21.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:21.384+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:21.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:21.746+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:22.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:22.029+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:22.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:22.113+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:22.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:22.421+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:22.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:22.702+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:23.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:23.025+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:23.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:23.137+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:23.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:23.441+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:23.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:23.734+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:24.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:24.004+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:24.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:24.117+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:24.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:24.466+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:24.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:24.758+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:25.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:25.036+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:25.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:25.080+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:25.311 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:41:25.308+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:41:25.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:25.453+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:25.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:25.808+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:26.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:26.036+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:26.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:26.112+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:26.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:26.490+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:26.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:26.791+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:27.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:27.055+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:27.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:27.111+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:27.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:27.540+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:27.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:27.768+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:28.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:28.032+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:28.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:28.114+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:28.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:28.585+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:28.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:28.727+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:29.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:29.080+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:29.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:29.116+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:29.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:29.565+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:29.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:29.677+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:30.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:30.076+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:30.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:30.091+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:30.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:30.539+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:30.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:30.687+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:31.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:31.030+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:31.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:31.051+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:31.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:31.524+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:31.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:31.680+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:32.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:32.016+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:32.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:32.029+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:32.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:32.536+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:32.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:32.719+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:33.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:33.058+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:33.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:33.060+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:33.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:33.511+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:33.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:33.754+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:34.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:34.073+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:34.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:34.101+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:34.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:34.514+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:34.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:34.787+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:35.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:35.080+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:35.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:35.133+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:35.457 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:41:35.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:41:35.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:35.524+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:35.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:35.787+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:36.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:36.063+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:36.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:36.155+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:36.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:36.503+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:36.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:36.785+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:37.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:37.062+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:37.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:37.165+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:37.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:37.546+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:37.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:37.744+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:38.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:38.037+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:38.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:38.165+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:38.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:38.564+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:38.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:38.706+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:39.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:39.087+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:39.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:39.139+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:39.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:39.585+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:39.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:39.660+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:40.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:40.064+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:40.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:40.134+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:40.327 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:41:40.324+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:41:40.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:40.575+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:40.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:40.683+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:41.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:41.048+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:41.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:41.093+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:41.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:41.526+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:41.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:41.672+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:42.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:42.032+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:42.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:42.128+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:42.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:42.523+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:42.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:42.680+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:43.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:43.028+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:43.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:43.170+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:43.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:43.567+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:43.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:43.678+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:44.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:44.074+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:44.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:44.134+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:44.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:44.550+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:44.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:44.664+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:45.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:45.091+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:45.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:45.109+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:45.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:45.588+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:45.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:45.629+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:46.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:46.131+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:46.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:46.131+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:46.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:46.604+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:46.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:46.626+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:47.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:47.105+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:47.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:47.164+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:47.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:47.564+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:47.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:47.655+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:48.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:48.149+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:48.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:48.152+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:48.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:48.551+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:48.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:48.629+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:49.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:49.117+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:49.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:49.172+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:49.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:49.537+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:49.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:49.639+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:50.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:50.121+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:50.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:50.189+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:50.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:50.517+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:50.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:50.688+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:51.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:51.160+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:51.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:51.160+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:51.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:51.516+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:51.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:51.666+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:52.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:52.141+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:52.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:52.186+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:52.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:52.557+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:52.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:52.656+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:53.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:53.139+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:53.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:53.185+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:53.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:53.582+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:53.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:53.706+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:54.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:54.129+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:54.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:54.225+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:54.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:54.539+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:54.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:54.700+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:55.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:55.167+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:55.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:55.191+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:55.343 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:41:55.341+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:41:55.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:55.576+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:55.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:55.749+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:56.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:56.159+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:56.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:56.192+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:56.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:56.531+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:56.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:56.778+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:57.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:57.144+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:57.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:57.157+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:57.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:57.508+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:57.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:57.762+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:58.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:58.121+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:58.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:58.172+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:58.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:58.483+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:58.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:58.725+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:59.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:41:59.085+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:59.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:41:59.170+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:59.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:41:59.458+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:41:59.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:41:59.768+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:00.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:00.109+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:00.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:00.151+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:00.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:00.425+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:00.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:00.738+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:01.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:01.111+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:01.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:01.183+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:01.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:01.464+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:01.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:01.732+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:02.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:02.126+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:02.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:02.186+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:02.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:02.509+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:02.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:02.740+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:03.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:03.080+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:03.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:03.156+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:03.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:03.468+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:03.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:03.772+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:04.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:04.115+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:04.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:04.129+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:04.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:04.437+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:04.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:04.736+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:05.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:05.165+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:05.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:05.176+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:05.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:05.470+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:05.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:42:05.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:42:05.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:05.782+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:06.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:06.190+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:06.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:06.218+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:06.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:06.494+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:06.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:06.735+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:07.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:07.145+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:07.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:07.188+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:07.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:07.518+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:07.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:07.744+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:08.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:08.144+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:08.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:08.153+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:08.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:08.521+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:08.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:08.720+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:09.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:09.162+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:09.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:09.193+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:09.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:09.478+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:09.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:09.693+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:10.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:10.168+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:10.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:10.177+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:10.358 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:42:10.356+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:42:10.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:10.442+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:10.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:10.734+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:11.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:11.152+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:11.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:11.157+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:11.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:11.450+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:11.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:11.741+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:12.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:12.113+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:12.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:12.150+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:12.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:12.424+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:12.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:12.769+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:13.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:13.076+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:13.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:13.102+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:13.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:13.441+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:13.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:13.781+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:14.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:14.087+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:14.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:14.129+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:14.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:14.398+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:14.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:14.811+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:15.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:15.093+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:15.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:15.116+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:15.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:15.395+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:15.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:15.840+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:16.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:16.118+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:16.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:16.136+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:16.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:16.416+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:16.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:16.835+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:17.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:17.125+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:17.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:17.138+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:17.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:17.446+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:17.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:17.868+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:18.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:18.137+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:18.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:18.148+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:18.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:18.442+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:18.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:18.850+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:19.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:19.179+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:19.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:19.187+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:19.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:19.395+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:19.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:19.865+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:20.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:20.144+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:20.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:20.172+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:20.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:20.376+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:20.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:20.911+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:21.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:21.113+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:21.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:21.201+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:21.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:21.350+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:21.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:21.945+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:22.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:22.100+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:22.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:22.246+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:22.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:22.392+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:22.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:22.946+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:23.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:23.071+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:23.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:23.212+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:23.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:23.372+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:23.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:23.939+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:24.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:24.112+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:24.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:24.246+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:24.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:24.379+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:24.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:24.985+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:25.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:25.068+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:25.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:25.291+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:25.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:25.353+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:25.374 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:42:25.372+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:42:25.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:25.987+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:26.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:26.020+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:26.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:26.313+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:26.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:26.335+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:27.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:27.013+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:27.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:27.017+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:27.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:27.281+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:27.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:27.314+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:28.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:28.001+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:28.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:28.028+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:28.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:28.268+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:28.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:28.293+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:28.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:28.966+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:29.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:29.060+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:29.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:29.297+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:29.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:29.338+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:29.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:29.944+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:30.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:30.093+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:30.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:30.305+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:30.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:30.374+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:30.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:30.970+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:31.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:31.078+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:31.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:31.302+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:31.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:31.389+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:31.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:31.949+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:32.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:32.121+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:32.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:32.294+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:32.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:32.411+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:32.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:32.959+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:33.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:33.134+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:33.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:33.318+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:33.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:33.436+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:33.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:33.963+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:34.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:34.163+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:34.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:34.321+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:34.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:34.435+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:34.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:34.966+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:35.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:35.128+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:35.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:35.284+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:35.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:35.390+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:35.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:42:35.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:42:35.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:35.990+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:36.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:36.128+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:36.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:36.311+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:36.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:36.407+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:36.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:36.984+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:37.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:37.116+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:37.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:37.267+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:37.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:37.434+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:38.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:38.015+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:38.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:38.149+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:38.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:38.294+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:38.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:38.410+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:38.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:38.992+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:39.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:39.133+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:39.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:39.335+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:39.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:39.443+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:39.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:39.954+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:40.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:40.123+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:40.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:40.373+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:40.390 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:42:40.388+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:42:40.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:40.425+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:40.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:40.919+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:41.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:41.088+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:41.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:41.388+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:41.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:41.455+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:41.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:41.886+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:42.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:42.124+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:42.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:42.387+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:42.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:42.466+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:42.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:42.911+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:43.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:43.110+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:43.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:43.422+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:43.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:43.506+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:43.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:43.948+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:44.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:44.159+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:44.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:44.413+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:44.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:44.491+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:44.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:44.924+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:45.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:45.136+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:45.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:45.452+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:45.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:45.536+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:45.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:45.949+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:46.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:46.112+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:46.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:46.476+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:46.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:46.535+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:46.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:46.910+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:47.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:47.085+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:47.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:47.488+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:47.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:47.497+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:47.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:47.935+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:48.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:48.102+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:48.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:48.473+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:48.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:48.491+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:48.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:48.907+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:49.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:49.107+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:49.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:49.447+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:49.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:49.512+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:49.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:49.944+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:50.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:50.150+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:50.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:50.447+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:50.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:50.469+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:50.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:50.904+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:51.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:51.182+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:51.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:51.410+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:51.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:51.443+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:51.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:51.939+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:52.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:52.218+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:52.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:52.385+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:52.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:52.457+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:52.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:52.900+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:53.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:53.259+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:53.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:53.384+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:53.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:53.472+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:53.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:53.933+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:54.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:54.226+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:54.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:54.345+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:54.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:54.470+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:54.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:54.970+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:55.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:55.249+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:55.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:55.388+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:55.406 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:42:55.404+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:42:55.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:55.472+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:55.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:55.955+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:56.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:56.207+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:56.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:56.372+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:56.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:56.515+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:56.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:56.955+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:57.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:57.255+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:57.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:57.342+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:57.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:57.472+0000 7f6e44c9f700 -1 osd.7 107 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:57.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:57.958+0000 7f389e18e700 -1 osd.4 107 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:58.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:58.282+0000 7f72c425d700 -1 osd.5 107 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:58.289 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:42:58.287+0000 7f69fbf57700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:42:58.304 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T00:42:58.287+0000 7f69fbf57700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:42:58.304 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:42:58.300+0000 7f69fb756700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T00:42:58.326 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T00:42:58.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:58.396+0000 7f596d92c700 -1 osd.6 107 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:58.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:58.491+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:58.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:58.922+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:59.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:42:59.265+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:59.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:42:59.407+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:59.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:42:59.494+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:42:59.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:42:59.877+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:00.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:00.255+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:00.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:00.375+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:00.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:00.459+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:00.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:00.846+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:01.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:01.239+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:01.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:01.391+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:01.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:01.417+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:01.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:01.822+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:02.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:02.209+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:02.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:02.391+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:02.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:02.434+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:02.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:02.860+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:03.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:03.190+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:03.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:03.387+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:03.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:03.441+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:03.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:03.900+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:04.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:04.149+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:04.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:04.416+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:04.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:04.468+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:04.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:04.892+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:05.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:05.193+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:05.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:05.403+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:05.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:05.513+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:05.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:43:05.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:43:05.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:05.878+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:06.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:06.190+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:06.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:06.386+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:06.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:06.507+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:06.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:06.910+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:07.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:07.223+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:07.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:07.356+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:07.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:07.551+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:07.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:07.931+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:08.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:08.191+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:08.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:08.372+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:08.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:08.591+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:08.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:08.970+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:09.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:09.185+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:09.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:09.343+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:09.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:09.552+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:10.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:10.016+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:10.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:10.144+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:10.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:10.366+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:10.420 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:43:10.418+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:43:10.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:10.583+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:10.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:10.969+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:11.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:11.143+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:11.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:11.321+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:11.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:11.587+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:11.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:11.944+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:12.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:12.191+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:12.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:12.319+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:12.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:12.552+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:12.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:12.912+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:13.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:13.188+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:13.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:13.286+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:13.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:13.506+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:13.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:13.907+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:14.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:14.204+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:14.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:14.306+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:14.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:14.540+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:14.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:14.858+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:15.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:15.155+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:15.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:15.266+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:15.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:15.551+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:15.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:15.880+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:16.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:16.178+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:16.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:16.224+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:16.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:16.536+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:16.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:16.836+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:17.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:17.172+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:17.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:17.250+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:17.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:17.533+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:17.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:17.824+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:18.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:18.125+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:18.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:18.236+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:18.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:18.543+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:18.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:18.830+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:19.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:19.082+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:19.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:19.259+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:19.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:19.565+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:19.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:19.849+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:20.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:20.055+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:20.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:20.235+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:20.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:20.556+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:20.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:20.811+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:21.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:21.086+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:21.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:21.263+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:21.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:21.575+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:21.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:21.816+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:22.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:22.058+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:22.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:22.262+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:22.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:22.581+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:22.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:22.791+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:23.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:23.080+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:23.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:23.262+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:23.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:23.607+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:23.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:23.798+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:24.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:24.129+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:24.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:24.222+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:24.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:24.575+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:24.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:24.758+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:25.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:25.142+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:25.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:25.228+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:25.436 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:43:25.433+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:43:25.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:25.536+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:25.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:25.726+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:26.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:26.098+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:26.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:26.225+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:26.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:26.558+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:26.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:26.750+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:27.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:27.060+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:27.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:27.225+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:27.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:27.574+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:27.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:27.704+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:28.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:28.014+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:28.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:28.177+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:28.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:28.551+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:28.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:28.667+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:29.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:29.061+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:29.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:29.151+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:29.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:29.556+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:29.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:29.649+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:30.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:30.023+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:30.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:30.143+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:30.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:30.579+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:30.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:30.691+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:31.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:31.063+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:31.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:31.181+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:31.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:31.613+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:31.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:31.675+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:32.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:32.020+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:32.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:32.221+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:32.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:32.594+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:32.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:32.649+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:32.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:32.982+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:33.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:33.237+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:33.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:33.621+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:33.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:33.642+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:33.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:33.963+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:34.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:34.209+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:34.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:34.657+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:34.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:34.680+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:34.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:34.994+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:35.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:35.178+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:35.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:35.649+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:35.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:35.717+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:35.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:43:35.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:43:35.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:35.977+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:36.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:36.202+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:36.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:36.677+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:36.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:36.695+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:36.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:36.996+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:37.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:37.189+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:37.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:37.664+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:37.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:37.684+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:38.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:38.044+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:38.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:38.237+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:38.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:38.615+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:38.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:38.679+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:39.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:39.016+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:39.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:39.268+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:39.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:39.622+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:39.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:39.634+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:40.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:40.066+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:40.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:40.274+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:40.452 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:43:40.449+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:43:40.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:40.586+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:40.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:40.631+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:41.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:41.020+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:41.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:41.311+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:41.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:41.592+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:41.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:41.609+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:41.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:41.979+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:42.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:42.264+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:42.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:42.616+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:42.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:42.657+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:43.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:43.005+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:43.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:43.220+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:43.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:43.651+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:43.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:43.666+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:44.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:44.041+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:44.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:44.209+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:44.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:44.617+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:44.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:44.684+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:45.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:45.051+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:45.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:45.174+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:45.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:45.642+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:45.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:45.684+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:46.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:46.089+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:46.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:46.128+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:46.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:46.601+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:46.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:46.682+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:47.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:47.097+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:47.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:47.128+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:47.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:47.582+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:47.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:47.727+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:48.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:48.114+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:48.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:48.147+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:48.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:48.624+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:48.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:48.699+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:49.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:49.151+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:49.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:49.158+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:49.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:49.605+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:49.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:49.705+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:50.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:50.155+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:50.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:50.192+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:50.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:50.650+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:50.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:50.696+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:51.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:51.162+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:51.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:51.168+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:51.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:51.669+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:51.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:51.676+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:52.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:52.116+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:52.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:52.178+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:52.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:52.629+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:52.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:52.718+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:53.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:53.076+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:53.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:53.225+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:53.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:53.642+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:53.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:53.737+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:54.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:54.027+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:54.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:54.233+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:54.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:54.612+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:54.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:54.764+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:54.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:54.991+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:55.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:55.208+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:55.467 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:43:55.465+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:43:55.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:55.586+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:55.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:55.752+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:55.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:55.962+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:56.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:56.250+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:56.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:56.601+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:56.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:56.800+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:56.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:56.952+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:57.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:57.213+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:57.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:57.631+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:57.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:57.843+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:57.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:57.928+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:58.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:58.246+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:58.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:58.672+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:58.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:58.827+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:58.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:58.913+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:59.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:43:59.285+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:59.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:43:59.646+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:59.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:43:59.778+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:43:59.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:43:59.880+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:00.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:00.239+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:00.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:00.667+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:00.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:00.806+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:00.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:00.858+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:01.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:01.241+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:01.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:01.664+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:01.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:01.769+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:01.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:01.818+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:02.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:02.217+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:02.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:02.621+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:02.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:02.783+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:02.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:02.862+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:03.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:03.198+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:03.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:03.625+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:03.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:03.799+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:03.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:03.902+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:04.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:04.188+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:04.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:04.640+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:04.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:04.801+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:04.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:04.951+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:05.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:05.206+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:05.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:05.652+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:05.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:05.766+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:05.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:05.994+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:06.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:44:06.034 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:44:06.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:06.241+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:06.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:06.695+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:06.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:06.735+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:06.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:06.977+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:07.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:07.240+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:07.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:07.709+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:07.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:07.741+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:07.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:07.985+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:08.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:08.232+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:08.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:08.740+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:08.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:08.781+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:08.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:08.967+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:09.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:09.267+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:09.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:09.774+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:09.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:09.784+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:10.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:10.013+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:10.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:10.254+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:10.483 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:44:10.481+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:44:10.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:10.784+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:10.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:10.829+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:10.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:10.972+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:11.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:11.229+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:11.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:11.766+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:11.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:11.813+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:11.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:11.961+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:12.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:12.195+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:12.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:12.776+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:12.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:12.784+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:12.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:12.994+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:13.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:13.240+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:13.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:13.756+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:13.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:13.822+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:14.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:14.008+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:14.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:14.217+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:14.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:14.742+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:14.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:14.791+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:15.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:15.049+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:15.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:15.214+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:15.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:15.712+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:15.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:15.836+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:16.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:16.075+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:16.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:16.175+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:16.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:16.735+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:16.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:16.859+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:17.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:17.038+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:17.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:17.187+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:17.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:17.693+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:17.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:17.833+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:18.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:18.032+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:18.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:18.156+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:18.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:18.722+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:18.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:18.829+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:18.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:18.986+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:19.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:19.135+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:19.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:19.710+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:19.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:19.793+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:20.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:20.032+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:20.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:20.086+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:20.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:20.702+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:20.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:20.774+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:21.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:21.040+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:21.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:21.111+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:21.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:21.708+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:21.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:21.782+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:22.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:22.065+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:22.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:22.075+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:22.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:22.740+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:22.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:22.820+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:23.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:23.068+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:23.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:23.088+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:23.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:23.712+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:23.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:23.796+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:24.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:24.043+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:24.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:24.063+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:24.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:24.685+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:24.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:24.759+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:25.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:25.036+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:25.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:25.069+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:25.499 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:44:25.497+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:44:25.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:25.696+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:25.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:25.758+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:26.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:26.010+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:26.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:26.108+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:26.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:26.653+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:26.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:26.799+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:27.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:27.010+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:27.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:27.115+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:27.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:27.697+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:27.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:27.784+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:28.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:28.026+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:28.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:28.143+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:28.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:28.708+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:28.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:28.747+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:29.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:29.043+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:29.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:29.159+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:29.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:29.744+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:29.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:29.753+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:30.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:30.010+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:30.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:30.111+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:30.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:30.730+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:30.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:30.763+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:31.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:31.031+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:31.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:31.106+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:31.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:31.736+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:31.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:31.755+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:32.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:32.024+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:32.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:32.118+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:32.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:32.698+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:32.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:32.768+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:32.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:32.980+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:33.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:33.144+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:33.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:33.697+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:33.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:33.804+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:34.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:34.007+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:34.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:34.106+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:34.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:34.661+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:34.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:34.759+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:35.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:35.056+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:35.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:35.088+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:35.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:35.615+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:35.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:35.788+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:36.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:36.074+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:36.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:36.097+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:36.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:44:36.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:44:36.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:36.590+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:36.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:36.836+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:37.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:37.048+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:37.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:37.056+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:37.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:37.605+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:37.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:37.879+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:38.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:38.092+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:38.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:38.099+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:38.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:38.575+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:38.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:38.887+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:39.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:39.045+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:39.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:39.092+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:39.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:39.590+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:39.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:39.846+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:40.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:40.053+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:40.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:40.055+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:40.515 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:44:40.512+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:44:40.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:40.571+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:40.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:40.802+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:41.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:41.011+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:41.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:41.101+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:41.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:41.592+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:41.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:41.802+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:41.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:41.982+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:42.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:42.077+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:42.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:42.640+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:42.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:42.778+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:42.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:42.986+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:43.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:43.056+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:43.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:43.670+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:43.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:43.827+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:43.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:43.979+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:44.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:44.019+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:44.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:44.680+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:44.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:44.797+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:44.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:44.933+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:45.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:45.031+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:45.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:45.636+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:45.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:45.818+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:45.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:45.976+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:45.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:45.995+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:46.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:46.648+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:46.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:46.812+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:46.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:46.958+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:47.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:47.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:47.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:47.671+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:47.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:47.791+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:47.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:47.972+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:48.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:48.015+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:48.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:48.695+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:48.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:48.806+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:48.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:48.981+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:49.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:48.998+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:49.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:49.706+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:49.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:49.810+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:50.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:50.010+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:50.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:50.041+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:50.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:50.716+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:50.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:50.836+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:51.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:51.058+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:51.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:51.062+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:51.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:51.754+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:51.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:51.818+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:52.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:52.094+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:52.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:52.098+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:52.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:52.716+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:52.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:52.841+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:53.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:53.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:53.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:53.100+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:53.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:53.759+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:53.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:53.811+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:54.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:54.074+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:54.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:54.082+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:54.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:54.776+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:54.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:54.829+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:55.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:55.067+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:55.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:55.119+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:55.531 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:44:55.528+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:44:55.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:55.806+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:55.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:55.876+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:56.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:56.029+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:56.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:56.118+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:56.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:56.789+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:56.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:56.883+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:57.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:57.072+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:57.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:57.097+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:57.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:57.805+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:57.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:57.886+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:58.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:58.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:58.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:58.066+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:58.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:58.829+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:58.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:58.858+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:59.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:44:59.072+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:59.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:44:59.086+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:59.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:44:59.824+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:44:59.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:44:59.893+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:00.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:00.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:00.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:00.115+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:00.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:00.814+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:00.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:00.910+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:01.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:01.087+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:01.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:01.090+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:01.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:01.779+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:01.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:01.925+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:02.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:02.043+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:02.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:02.060+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:02.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:02.763+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:02.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:02.915+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:03.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:03.031+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:03.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:03.084+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:03.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:03.810+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:03.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:03.948+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:04.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:04.072+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:04.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:04.104+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:04.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:04.806+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:04.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:04.900+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:05.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:05.096+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:05.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:05.099+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:05.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:05.789+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:05.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:05.853+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:06.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:06.069+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:06.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:06.141+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:06.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:45:06.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:45:06.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:06.803+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:06.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:06.843+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:07.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:07.048+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:07.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:07.174+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:07.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:07.765+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:07.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:07.889+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:08.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:08.056+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:08.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:08.155+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:08.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:08.727+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:08.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:08.936+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:09.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:09.023+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:09.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:09.134+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:09.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:09.686+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:09.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:09.971+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:09.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:09.991+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:10.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:10.108+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:10.547 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:45:10.544+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:45:10.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:10.725+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:10.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:10.977+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:11.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:11.025+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:11.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:11.105+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:11.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:11.758+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:11.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:11.981+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:12.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:11.999+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:12.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:12.150+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:12.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:12.719+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:12.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:12.982+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:13.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:13.043+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:13.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:13.172+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:13.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:13.761+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:13.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:13.960+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:14.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:14.074+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:14.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:14.147+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:14.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:14.745+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:14.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:14.979+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:15.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:15.105+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:15.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:15.123+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:15.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:15.732+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:15.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:15.946+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:16.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:16.099+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:16.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:16.115+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:16.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:16.726+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:16.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:16.981+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:17.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:17.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:17.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:17.139+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:17.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:17.700+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:17.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:17.992+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:18.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:18.022+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:18.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:18.110+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:18.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:18.739+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:19.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:19.026+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:19.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:19.069+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:19.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:19.083+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:19.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:19.702+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:20.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:20.023+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:20.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:20.056+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:20.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:20.103+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:20.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:20.710+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:21.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:21.015+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:21.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:21.074+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:21.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:21.099+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:21.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:21.681+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:21.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:21.990+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:22.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:22.124+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:22.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:22.136+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:22.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:22.644+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:23.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:23.040+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:23.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:23.134+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:23.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:23.183+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:23.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:23.674+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:24.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:24.003+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:24.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:24.118+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:24.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:24.136+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:24.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:24.713+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:25.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:25.020+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:25.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:25.070+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:25.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:25.159+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:25.563 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:45:25.561+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:45:25.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:25.665+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:25.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:25.973+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:26.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:26.045+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:26.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:26.195+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:26.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:26.671+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:26.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:26.931+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:26.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:26.996+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:27.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:27.153+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:27.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:27.708+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:27.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:27.979+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:28.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:28.044+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:28.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:28.199+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:28.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:28.684+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:28.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:28.932+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:29.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:29.037+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:29.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:29.152+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:29.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:29.697+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:29.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:29.973+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:30.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:30.084+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:30.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:30.165+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:30.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:30.681+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:30.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:30.952+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:31.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:31.055+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:31.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:31.185+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:31.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:31.692+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:32.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:32.001+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:32.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:32.049+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:32.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:32.216+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:32.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:32.676+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:33.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:33.022+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:33.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:33.027+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:33.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:33.246+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:33.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:33.664+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:33.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:33.984+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:34.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:34.040+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:34.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:34.214+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:34.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:34.637+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:35.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:35.019+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:35.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:35.086+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:35.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:35.253+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:35.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:35.602+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:36.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:36.043+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:36.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:36.135+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:36.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:36.296+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:36.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:45:36.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:45:36.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:36.628+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:37.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:37.061+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:37.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:37.087+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:37.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:37.340+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:37.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:37.590+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:38.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:38.038+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:38.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:38.053+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:38.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:38.361+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:38.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:38.556+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:39.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:39.016+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:39.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:39.051+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:39.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:39.377+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:39.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:39.527+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:39.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:39.969+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:40.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:40.073+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:40.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:40.384+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:40.570 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:45:40.567+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:45:40.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:40.568+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:40.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:40.944+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:41.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:41.099+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:41.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:41.372+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:41.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:41.560+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:41.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:41.951+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:42.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:42.063+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:42.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:42.414+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:42.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:42.608+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:42.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:42.968+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:43.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:43.050+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:43.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:43.389+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:43.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:43.559+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:43.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:43.927+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:44.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:44.097+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:44.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:44.340+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:44.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:44.528+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:44.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:44.943+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:45.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:45.086+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:45.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:45.293+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:45.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:45.530+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:45.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:45.963+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:46.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:46.132+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:46.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:46.323+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:46.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:46.491+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:46.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:46.956+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:47.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:47.157+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:47.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:47.298+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:47.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:47.525+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:47.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:47.982+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:48.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:48.126+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:48.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:48.260+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:48.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:48.534+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:48.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:48.982+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:49.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:49.162+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:49.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:49.234+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:49.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:49.501+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:49.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:49.964+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:50.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:50.179+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:50.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:50.284+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:50.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:50.549+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:50.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:50.947+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:51.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:51.144+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:51.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:51.266+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:51.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:51.552+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:51.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:51.962+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:52.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:52.100+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:52.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:52.251+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:52.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:52.602+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:52.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:52.993+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:53.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:53.119+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:53.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:53.236+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:53.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:53.603+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:54.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:53.998+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:54.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:54.090+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:54.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:54.245+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:54.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:54.644+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:54.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:54.949+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:55.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:55.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:55.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:55.288+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:55.586 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:45:55.583+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:45:55.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:55.627+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:55.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:55.938+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:56.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:56.141+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:56.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:56.264+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:56.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:56.627+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:56.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:56.936+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:57.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:57.133+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:57.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:57.217+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:57.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:57.656+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 5 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:57.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:57.906+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:58.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:58.156+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:58.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:58.211+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:58.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:58.648+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:58.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:58.917+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:59.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:45:59.200+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:59.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:45:59.201+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:59.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:45:59.671+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:45:59.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:45:59.883+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:00.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:00.167+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:00.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:00.188+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:00.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:00.658+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:00.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:00.877+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:01.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:01.150+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:01.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:01.189+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:01.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:01.638+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:01.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:01.906+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:02.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:02.145+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:02.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:02.161+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:02.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:02.650+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:02.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:02.943+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:03.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:03.159+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:03.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:03.184+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:03.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:03.635+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:03.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:03.932+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:04.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:04.133+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:04.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:04.199+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:04.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:04.656+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:04.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:04.971+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:05.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:05.087+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:05.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:05.165+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:05.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:05.669+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:05.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:05.984+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:06.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:06.079+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:06.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:06.127+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:06.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:46:06.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:46:06.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:06.656+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:07.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:07.002+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:07.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:07.104+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:07.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:07.152+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:07.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:07.652+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:08.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:08.026+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:08.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:08.122+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:08.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:08.124+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:08.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:08.682+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:09.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:09.065+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:09.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:09.136+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:09.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:09.157+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:09.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:09.670+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:10.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:10.060+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:10.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:10.176+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:10.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:10.179+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:10.602 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:46:10.600+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:46:10.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:10.689+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:11.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:11.072+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:11.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:11.162+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:11.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:11.165+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:11.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:11.709+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:12.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:12.093+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:12.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:12.131+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:12.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:12.171+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:12.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:12.690+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:13.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:13.086+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:13.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:13.092+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:13.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:13.158+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:13.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:13.729+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:14.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:14.090+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:14.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:14.122+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:14.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:14.129+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:14.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:14.775+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:15.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:15.041+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:15.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:15.073+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:15.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:15.122+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:15.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:15.826+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:15.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:15.997+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:16.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:16.054+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:16.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:16.082+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:16.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:16.783+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:16.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:16.967+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:17.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:17.052+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:17.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:17.091+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:17.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:17.759+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:18.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:18.010+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:18.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:18.076+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:18.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:18.124+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:18.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:18.788+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:19.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:19.050+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:19.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:19.070+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:19.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:19.146+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:19.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:19.795+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:20.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:20.034+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:20.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:20.102+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:20.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:20.110+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:20.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:20.747+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:21.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:21.052+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:21.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:21.087+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:21.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:21.155+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:21.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:21.755+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:22.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:22.059+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:22.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:22.078+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:22.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:22.150+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:22.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:22.708+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:23.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:23.078+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:23.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:23.106+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:23.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:23.111+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:23.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:23.692+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:24.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:24.068+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:24.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:24.071+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:24.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:24.132+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:24.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:24.737+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:25.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:25.055+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:25.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:25.115+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:25.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:25.161+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:25.618 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:46:25.615+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:46:25.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:25.722+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:26.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:26.018+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:26.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:26.096+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:26.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:26.116+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:26.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:26.704+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:27.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:27.004+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:27.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:27.074+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:27.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:27.092+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:27.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:27.701+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:27.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:27.976+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:28.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:28.048+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:28.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:28.078+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:28.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:28.737+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:28.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:28.950+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:29.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:29.056+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:29.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:29.122+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:29.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:29.716+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:29.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:29.957+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:30.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:30.073+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:30.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:30.077+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:30.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:30.749+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:30.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:30.966+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:31.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:31.078+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:31.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:31.124+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:31.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:31.766+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:31.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:31.959+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:32.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:32.123+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:32.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:32.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:32.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:32.723+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:32.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:32.913+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:33.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:33.088+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:33.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:33.129+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:33.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:33.687+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:33.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:33.919+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:34.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:34.088+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:34.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:34.101+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:34.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:34.686+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:34.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:34.937+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:35.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:35.084+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:35.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:35.105+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:35.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:35.720+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:35.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:35.897+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:36.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:36.065+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:36.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:36.078+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:36.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:46:36.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:46:36.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:36.759+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:36.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:36.886+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:37.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:37.017+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:37.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:37.091+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:37.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:37.743+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:37.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:37.896+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:37.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:37.981+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:38.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:38.116+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:38.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:38.758+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:38.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:38.852+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:38.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:38.941+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:39.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:39.094+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:39.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:39.797+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:39.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:39.814+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:39.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:39.989+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:40.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:40.104+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:40.633 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:46:40.631+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:46:40.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:40.765+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:40.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:40.820+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:41.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:41.007+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:41.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:41.070+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:41.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:41.752+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:41.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:41.822+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:41.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:41.997+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:42.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:42.031+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:42.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:42.738+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:42.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:42.802+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:43.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:43.027+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:43.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:43.028+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:43.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:43.694+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:43.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:43.833+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:44.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:44.014+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:44.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:44.077+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:44.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:44.650+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:44.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:44.817+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:45.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:45.028+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:45.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:45.068+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:45.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:45.631+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:45.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:45.822+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:46.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:46.011+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:46.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:46.086+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:46.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:46.653+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:46.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:46.808+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:47.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:46.998+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:47.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:47.053+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:47.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:47.643+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:47.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:47.763+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:48.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:48.036+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:48.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:48.056+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:48.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:48.604+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:48.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:48.757+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:49.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:49.083+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:49.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:49.101+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:49.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:49.597+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:49.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:49.782+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:50.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:50.105+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:50.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:50.112+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:50.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:50.646+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:50.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:50.818+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:51.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:51.071+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:51.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:51.113+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:51.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:51.628+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:51.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:51.837+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:52.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:52.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:52.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:52.068+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:52.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:52.616+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:52.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:52.824+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:53.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:53.044+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:53.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:53.071+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:53.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:53.611+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:53.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:53.811+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:54.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:54.046+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:54.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:54.084+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:54.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:54.651+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:54.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:54.822+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:55.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:55.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:55.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:55.077+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:55.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:55.606+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:55.649 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:46:55.647+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:46:55.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:55.806+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:56.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:56.026+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:56.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:56.121+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:56.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:56.566+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:56.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:56.763+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:57.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:57.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:57.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:57.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:57.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:57.573+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:57.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:57.739+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:58.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:58.064+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:58.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:58.132+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:58.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:58.525+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:58.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:58.708+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:59.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:46:59.056+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:59.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:46:59.089+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:59.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:46:59.487+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:46:59.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:46:59.748+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:00.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:00.065+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:00.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:00.096+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:00.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:00.487+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:00.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:00.717+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:01.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:01.105+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:01.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:01.143+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:01.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:01.494+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:01.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:01.697+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:02.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:02.129+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:02.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:02.155+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:02.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:02.448+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:02.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:02.699+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:03.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:03.132+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:03.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:03.158+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:03.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:03.451+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:03.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:03.660+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:04.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:04.117+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:04.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:04.177+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:04.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:04.461+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:04.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:04.640+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:05.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:05.072+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:05.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:05.167+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:05.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:05.509+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:05.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:05.673+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:06.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:06.035+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:06.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:06.131+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:06.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:06.480+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:06.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:47:06.635 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:47:06.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:06.681+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:07.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:07.069+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:07.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:07.135+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:07.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:07.465+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:07.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:07.692+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:08.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:08.031+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:08.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:08.150+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:08.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:08.489+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:08.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:08.735+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:08.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:08.996+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:09.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:09.169+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:09.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:09.527+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:09.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:09.709+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:09.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:09.995+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:10.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:10.201+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:10.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:10.507+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:10.665 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:47:10.663+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:47:10.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:10.693+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:10.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:10.950+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:11.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:11.239+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:11.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:11.465+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:11.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:11.664+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:11.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:11.997+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:12.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:12.266+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:12.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:12.455+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:12.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:12.700+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:13.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:13.043+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:13.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:13.226+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:13.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:13.426+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:13.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:13.699+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:14.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:14.088+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:14.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:14.194+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:14.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:14.401+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:14.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:14.681+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:15.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:15.122+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:15.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:15.242+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:15.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:15.396+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:15.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:15.667+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:16.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:16.074+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:16.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:16.233+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:16.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:16.413+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:16.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:16.702+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:17.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:17.091+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:17.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:17.267+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:17.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:17.438+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:17.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:17.665+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:18.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:18.043+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:18.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:18.225+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:18.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:18.473+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:18.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:18.677+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:19.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:19.003+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:19.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:19.219+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:19.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:19.435+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:19.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:19.702+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:20.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:19.997+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:20.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:20.236+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:20.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:20.396+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:20.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:20.696+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:21.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:21.046+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:21.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:21.240+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:21.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:21.430+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:21.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:21.647+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:22.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:22.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:22.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:22.214+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:22.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:22.448+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:22.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:22.687+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:23.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:23.032+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:23.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:23.260+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:23.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:23.409+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:23.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:23.714+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:24.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:24.004+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:24.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:24.300+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:24.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:24.438+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:24.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:24.730+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:24.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:24.957+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:25.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:25.279+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:25.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:25.446+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:25.681 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:47:25.679+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:47:25.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:25.721+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:26.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:26.006+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:26.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:26.292+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:26.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:26.488+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:26.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:26.768+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:26.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:26.988+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:27.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:27.301+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:27.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:27.464+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:27.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:27.779+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:28.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:28.013+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:28.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:28.337+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:28.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:28.453+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:28.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:28.749+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:29.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:29.053+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:29.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:29.385+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:29.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:29.411+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:29.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:29.701+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:30.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:30.045+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:30.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:30.415+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:30.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:30.452+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:30.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:30.733+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:31.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:31.018+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:31.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:31.377+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:31.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:31.462+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:31.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:31.752+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:32.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:32.005+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:32.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:32.415+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:32.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:32.425+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:32.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:32.765+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:33.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:33.001+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:33.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:33.397+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:33.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:33.438+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:33.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:33.739+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:34.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:34.024+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:34.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:34.436+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:34.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:34.468+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:34.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:34.750+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:35.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:35.005+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:35.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:35.421+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:35.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:35.426+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:35.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:35.783+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:36.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:36.002+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:36.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:36.446+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:36.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:36.448+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:36.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:47:36.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:47:36.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:36.795+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:37.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:37.007+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:37.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:37.434+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:37.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:37.486+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:37.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:37.841+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:38.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:38.015+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:38.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:38.456+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:38.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:38.531+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:38.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:38.792+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:39.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:39.016+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:39.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:39.482+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:39.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:39.511+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:39.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:39.747+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:40.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:40.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:40.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:40.475+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:40.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:40.533+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:40.684 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:47:40.681+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:47:40.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:40.704+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:40.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:40.984+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:41.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:41.490+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:41.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:41.513+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:41.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:41.747+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:41.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:41.965+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:42.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:42.462+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:42.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:42.487+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:42.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:42.703+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:42.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:42.979+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:43.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:43.433+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:43.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:43.505+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:43.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:43.729+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:43.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:43.940+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:44.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:44.398+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:44.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:44.491+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:44.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:44.689+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:44.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:44.969+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:45.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:45.366+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:45.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:45.484+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:45.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:45.650+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:45.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:45.986+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:46.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:46.416+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:46.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:46.515+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:46.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:46.674+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:46.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:46.997+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:47.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:47.457+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:47.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:47.497+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:47.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:47.685+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:47.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:47.993+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:48.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:48.462+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:48.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:48.492+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:48.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:48.665+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:49.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:49.015+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:49.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:49.449+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:49.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:49.475+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:49.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:49.634+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:50.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:50.003+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:50.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:50.446+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:50.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:50.465+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:50.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:50.601+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:51.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:51.012+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:51.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:51.428+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:51.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:51.479+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:51.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:51.565+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:52.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:52.019+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:52.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:52.394+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:52.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:52.528+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:52.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:52.567+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:53.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:53.057+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:53.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:53.380+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:53.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:53.554+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:53.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:53.615+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:54.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:54.066+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:54.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:54.339+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:54.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:54.535+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:54.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:54.633+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:55.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:55.095+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:55.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:55.306+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:55.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:55.498+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:55.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:55.587+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:55.699 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:47:55.697+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:47:56.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:56.084+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:56.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:56.267+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:56.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:56.535+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:56.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:56.621+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:57.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:57.068+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:57.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:57.247+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:57.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:57.502+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:57.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:57.615+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:58.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:58.066+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:58.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:58.252+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:58.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:58.520+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:58.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:58.580+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:59.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:47:59.028+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:59.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:47:59.238+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:59.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:47:59.502+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:47:59.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:47:59.532+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:00.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:00.025+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:00.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:00.251+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:00.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:00.513+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:00.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:00.539+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:01.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:01.005+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:01.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:01.227+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:01.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:01.466+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:01.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:01.545+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:01.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:01.985+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:02.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:02.188+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:02.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:02.451+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:02.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:02.588+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:02.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:02.947+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:03.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:03.224+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:03.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:03.406+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:03.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:03.624+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:03.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:03.901+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:04.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:04.197+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:04.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:04.409+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:04.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:04.663+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:04.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:04.942+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:05.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:05.223+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:05.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:05.405+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:05.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:05.668+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:05.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:05.928+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:06.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:06.176+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:06.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:06.389+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:06.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:06.691+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:06.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:48:06.861 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:48:06.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:06.904+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:07.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:07.195+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:07.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:07.432+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:07.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:07.718+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:07.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:07.855+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:08.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:08.223+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:08.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:08.439+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:08.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:08.769+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:08.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:08.868+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:09.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:09.176+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:09.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:09.410+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:09.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:09.791+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:09.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:09.897+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:10.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:10.141+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:10.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:10.404+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:10.715 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:48:10.712+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:48:10.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:10.754+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:10.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:10.929+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:11.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:11.123+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:11.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:11.420+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:11.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:11.790+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:11.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:11.897+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:12.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:12.110+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:12.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:12.389+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:12.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:12.817+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:12.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:12.913+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:13.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:13.093+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:13.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:13.414+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:13.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:13.866+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:13.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:13.960+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:14.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:14.056+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:14.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:14.441+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:14.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:14.904+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:14.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:14.922+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:15.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:15.058+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:15.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:15.415+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:15.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:15.911+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:15.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:15.938+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:16.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:16.039+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:16.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:16.388+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:16.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:16.895+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:16.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:16.974+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:17.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:16.999+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:17.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:17.426+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:17.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:17.916+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:18.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:18.012+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:18.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:18.013+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:18.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:18.442+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:18.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:18.886+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:18.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:18.976+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:19.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:19.000+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:19.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:19.461+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:19.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:19.848+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:19.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:19.986+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:20.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:19.998+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:20.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:20.417+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:20.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:20.801+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:20.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:20.974+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:21.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:21.046+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:21.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:21.383+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:21.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:21.771+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:22.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:22.012+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:22.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:22.034+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:22.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:22.340+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:22.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:22.777+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:22.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:22.989+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:23.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:23.007+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:23.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:23.314+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:23.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:23.741+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:23.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:23.948+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:24.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:24.057+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:24.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:24.316+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:24.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:24.787+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:24.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:24.915+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:25.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:25.042+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:25.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:25.324+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:25.731 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:48:25.728+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:48:25.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:25.764+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:25.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:25.923+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:26.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:25.997+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:26.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:26.294+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:26.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:26.784+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:26.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:26.966+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:27.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:27.037+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:27.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:27.332+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:27.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:27.741+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:27.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:27.941+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:28.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:28.044+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:28.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:28.346+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:28.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:28.719+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:28.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:28.945+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:29.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:29.085+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:29.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:29.328+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:29.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:29.713+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:29.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:29.983+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:30.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:30.114+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:30.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:30.307+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:30.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:30.734+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:30.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:30.951+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:31.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:31.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:31.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:31.317+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:31.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:31.764+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:31.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:31.946+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:32.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:32.142+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:32.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:32.331+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:32.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:32.808+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:32.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:32.932+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:33.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:33.157+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:33.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:33.379+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:33.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:33.761+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:33.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:33.941+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:34.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:34.120+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:34.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:34.429+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:34.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:34.764+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:34.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:34.957+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:35.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:35.096+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:35.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:35.413+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:35.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:35.798+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:35.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:35.987+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:36.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:36.146+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:36.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:36.365+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:36.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:36.811+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:36.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:36.937+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:37.006 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:48:37.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:48:37.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:37.161+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:37.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:37.321+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:37.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:37.831+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:37.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:37.934+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:38.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:38.198+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:38.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:38.318+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:38.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:38.874+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:38.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:38.969+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:39.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:39.181+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:39.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:39.295+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:39.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:39.867+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:39.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:39.957+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:40.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:40.215+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:40.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:40.307+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:40.747 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:48:40.745+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:48:40.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:40.864+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:40.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:40.948+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:41.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:41.190+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:41.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:41.336+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:41.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:41.876+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:41.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:41.970+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:42.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:42.160+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:42.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:42.300+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:42.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:42.846+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:42.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:42.977+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:43.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:43.159+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:43.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:43.324+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:43.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:43.809+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:43.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:43.963+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:44.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:44.164+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:44.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:44.303+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:44.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:44.797+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:44.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:44.925+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:45.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:45.187+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:45.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:45.309+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:45.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:45.762+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:45.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:45.894+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:46.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:46.181+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:46.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:46.286+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:46.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:46.813+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:46.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:46.906+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:47.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:47.139+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:47.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:47.308+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:47.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:47.823+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:47.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:47.878+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:48.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:48.139+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:48.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:48.351+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:48.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:48.782+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:48.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:48.909+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:49.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:49.119+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:49.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:49.327+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:49.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:49.805+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:49.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:49.940+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:50.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:50.074+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:50.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:50.307+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:50.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:50.837+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:50.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:50.923+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:51.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:51.085+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:51.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:51.324+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:51.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:51.797+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:51.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:51.898+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:52.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:52.051+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:52.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:52.291+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:52.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:52.758+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:52.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:52.859+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:53.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:53.035+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:53.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:53.254+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:53.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:53.781+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:53.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:53.828+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:53.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:53.987+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:54.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:54.250+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:54.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:54.800+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:54.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:54.858+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:55.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:55.017+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:55.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:55.289+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:55.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:55.758+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:55.762 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:48:55.760+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:48:55.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:55.844+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:56.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:56.056+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:56.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:56.251+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:56.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:56.731+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:56.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:56.874+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:57.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:57.094+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:57.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:57.238+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:57.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:57.766+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:57.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:57.907+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:58.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:58.079+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:58.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:58.206+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:58.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:58.752+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:58.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:58.859+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:59.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:48:59.077+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:59.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:48:59.229+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:59.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:48:59.794+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:48:59.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:48:59.825+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:00.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:00.106+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:00.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:00.235+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:00.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:00.796+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:00.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:00.845+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:01.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:01.057+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:01.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:01.221+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:01.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:01.763+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:01.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:01.844+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:02.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:02.029+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:02.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:02.222+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:02.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:02.765+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:02.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:02.877+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:02.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:02.984+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:03.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:03.193+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:03.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:03.780+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:03.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:03.853+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:03.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:03.990+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:04.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:04.145+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:04.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:04.774+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:04.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:04.867+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:04.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:04.990+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:05.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:05.166+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:05.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:05.741+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:05.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:05.909+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:06.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:06.039+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:06.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:06.213+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:06.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:06.735+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:06.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:06.930+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:07.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:07.024+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:07.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:49:07.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:49:07.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:07.259+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:07.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:07.723+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:07.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:07.886+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:08.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:08.001+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:08.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:08.256+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:08.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:08.728+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:08.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:08.860+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:09.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:09.008+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:09.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:09.236+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:09.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:09.687+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:09.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:09.812+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:10.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:10.007+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:10.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:10.226+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:10.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:10.699+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:10.778 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:49:10.776+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:49:10.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:10.845+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:10.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:10.973+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:11.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:11.185+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:11.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:11.741+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:11.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:11.869+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:11.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:11.988+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:12.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:12.173+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:12.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:12.711+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:12.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:12.837+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:13.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:13.002+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:13.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:13.140+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:13.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:13.742+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:13.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:13.877+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:14.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:14.032+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:14.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:14.112+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:14.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:14.789+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:14.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:14.880+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:14.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:14.995+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:15.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:15.082+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:15.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:15.788+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:15.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:15.854+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:16.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:16.025+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:16.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:16.094+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:16.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:16.811+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:16.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:16.877+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:17.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:17.012+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:17.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:17.087+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:17.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:17.835+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:17.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:17.854+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:17.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:17.977+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:18.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:18.091+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:18.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:18.843+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:18.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:18.902+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:18.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:18.953+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:19.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:19.077+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:19.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:19.841+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:19.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:19.892+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:19.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:19.984+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:20.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:20.048+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:20.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:20.842+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:20.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:20.889+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:20.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:20.960+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:21.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:21.029+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:21.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:21.844+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:21.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:21.851+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:21.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:21.997+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:22.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:22.029+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:22.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:22.810+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:22.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:22.813+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:22.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:22.997+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:23.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:23.039+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:23.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:23.810+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:23.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:23.838+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:24.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:24.034+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:24.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:24.034+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:24.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:24.778+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:24.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:24.804+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:25.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:25.028+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:25.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:25.028+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:25.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:25.743+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:25.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:25.771+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:25.794 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:49:25.791+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:49:25.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:25.989+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:26.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:26.075+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:26.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:26.703+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:26.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:26.788+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:27.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:27.022+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:27.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:27.109+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:27.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:27.734+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:27.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:27.782+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:28.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:28.069+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:28.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:28.159+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:28.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:28.750+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:28.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:28.820+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:29.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:29.112+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:29.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:29.184+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:29.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:29.759+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:29.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:29.818+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:30.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:30.124+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:30.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:30.161+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:30.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:30.738+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:30.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:30.830+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:31.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:31.163+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:31.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:31.175+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:31.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:31.760+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:31.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:31.832+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:32.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:32.181+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:32.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:32.225+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:32.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:32.766+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:32.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:32.856+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:33.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:33.210+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:33.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:33.210+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:33.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:33.721+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:33.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:33.824+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:34.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:34.193+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:34.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:34.219+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:34.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:34.737+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:34.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:34.855+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:35.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:35.227+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:35.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:35.232+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:35.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:35.694+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:35.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:35.871+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:36.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:36.204+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:36.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:36.224+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:36.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:36.675+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:36.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:36.857+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:37.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:37.198+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:37.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:37.236+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:37.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:49:37.258 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:49:37.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:37.644+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:37.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:37.890+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:38.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:38.218+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:38.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:38.272+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:38.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:38.686+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:38.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:38.848+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:39.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:39.266+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:39.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:39.273+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:39.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:39.662+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:39.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:39.835+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:40.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:40.290+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:40.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:40.301+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:40.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:40.708+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:40.810 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:49:40.807+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:49:40.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:40.822+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:41.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:41.309+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:41.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:41.340+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:41.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:41.667+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:41.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:41.791+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:42.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:42.269+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:42.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:42.327+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:42.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:42.648+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:42.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:42.815+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:43.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:43.261+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:43.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:43.343+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:43.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:43.617+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:43.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:43.826+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:44.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:44.241+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:44.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:44.385+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:44.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:44.652+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:44.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:44.857+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:45.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:45.266+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:45.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:45.387+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:45.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:45.640+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:45.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:45.870+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:46.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:46.294+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:46.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:46.369+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:46.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:46.593+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:46.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:46.913+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:47.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:47.270+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:47.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:47.341+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:47.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:47.559+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:47.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:47.899+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:48.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:48.272+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:48.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:48.311+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:48.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:48.558+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:48.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:48.937+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:49.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:49.292+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:49.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:49.360+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:49.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:49.533+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:49.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:49.912+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:50.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:50.292+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:50.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:50.347+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:50.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:50.554+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:50.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:50.957+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:51.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:51.295+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:51.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:51.352+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:51.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:51.539+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:51.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:51.909+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:52.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:52.336+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:52.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:52.383+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:52.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:52.523+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:52.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:52.915+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:53.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:53.337+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:53.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:53.363+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:53.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:53.511+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:53.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:53.931+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:54.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:54.332+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:54.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:54.379+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:54.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:54.487+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:54.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:54.971+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:55.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:55.287+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:55.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:55.362+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:55.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:55.449+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:55.826 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:49:55.824+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:49:55.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:55.951+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:56.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:56.291+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:56.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:56.372+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:56.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:56.404+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:57.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:56.999+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:57.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:57.253+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:57.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:57.387+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:57.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:57.409+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:57.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:57.957+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:58.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:58.251+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:58.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:58.377+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:58.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:58.433+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:58.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:58.920+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:59.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:49:59.275+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:59.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:49:59.416+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:59.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:49:59.432+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:49:59.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:49:59.929+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:00.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:00.276+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:00.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:00.372+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:00.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:00.481+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:00.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:00.939+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:01.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:01.318+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:01.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:01.348+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:01.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:01.517+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:01.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:01.897+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:02.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:02.324+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:02.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:02.332+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:02.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:02.552+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:02.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:02.941+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:03.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:03.322+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:03.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:03.332+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:03.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:03.601+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:03.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:03.958+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:04.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:04.347+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:04.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:04.353+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:04.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:04.575+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:04.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:04.981+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:05.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:05.321+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:05.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:05.359+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:05.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:05.603+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:05.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:05.973+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:06.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:06.341+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:06.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:06.365+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:06.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:06.648+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:06.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:06.992+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:07.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:07.354+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:07.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:07.382+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:07.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:50:07.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:50:07.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:07.638+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:08.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:08.040+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:08.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:08.346+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:08.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:08.361+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:08.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:08.594+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:09.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:09.045+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:09.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:09.346+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:09.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:09.392+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:09.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:09.559+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:10.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:10.080+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:10.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:10.338+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:10.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:10.402+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:10.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:10.512+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:10.836 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:50:10.834+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:50:11.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:11.084+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:11.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:11.377+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:11.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:11.433+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:11.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:11.537+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:12.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:12.094+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:12.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:12.401+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:12.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:12.475+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:12.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:12.542+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:13.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:13.136+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:13.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:13.409+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:13.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:13.450+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:13.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:13.588+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:14.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:14.103+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:14.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:14.396+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:14.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:14.426+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:14.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:14.544+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:15.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:15.093+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:15.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:15.402+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:15.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:15.443+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:15.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:15.524+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:16.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:16.044+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:16.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:16.367+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:16.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:16.412+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:16.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:16.540+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:17.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:17.083+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:17.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:17.381+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:17.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:17.441+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:17.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:17.530+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:18.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:18.069+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:18.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:18.398+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:18.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:18.415+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:18.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:18.536+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:19.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:19.092+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:19.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:19.442+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:19.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:19.453+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:19.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:19.576+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:20.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:20.072+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:20.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:20.472+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:20.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:20.477+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:20.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:20.554+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:21.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:21.036+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:21.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:21.472+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:21.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:21.472+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:21.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:21.528+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:22.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:22.055+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:22.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:22.504+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:22.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:22.517+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:22.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:22.547+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:23.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:23.087+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:23.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:23.501+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:23.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:23.501+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:23.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:23.520+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:24.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:24.125+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:24.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:24.490+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:24.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:24.502+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:24.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:24.507+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:25.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:25.082+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:25.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:25.504+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:25.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:25.509+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:25.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:25.534+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:25.852 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:50:25.850+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:50:26.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:26.057+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:26.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:26.488+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:26.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:26.512+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:26.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:26.533+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:27.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:27.021+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:27.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:27.505+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:27.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:27.531+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:27.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:27.576+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:28.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:28.015+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:28.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:28.483+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:28.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:28.485+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:28.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:28.549+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:28.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:28.968+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:29.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:29.478+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:29.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:29.519+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:29.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:29.549+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:30.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:30.003+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:30.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:30.455+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:30.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:30.553+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:30.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:30.588+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:30.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:30.974+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:31.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:31.452+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:31.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:31.576+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:31.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:31.629+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:31.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:31.958+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:32.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:32.463+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:32.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:32.558+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:32.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:32.614+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:32.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:32.985+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:33.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:33.444+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:33.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:33.552+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:33.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:33.639+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:33.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:33.979+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:34.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:34.415+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:34.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:34.544+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:34.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:34.643+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:34.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:34.942+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:35.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:35.423+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:35.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:35.514+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:35.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:35.612+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:35.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:35.930+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:36.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:36.387+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:36.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:36.537+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:36.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:36.622+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:36.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:36.946+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:37.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:37.372+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:37.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:50:37.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:50:37.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:37.516+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:37.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:37.601+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:37.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:37.972+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:38.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:38.371+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:38.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:38.558+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:38.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:38.615+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:39.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:38.998+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:39.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:39.332+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:39.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:39.530+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:39.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:39.580+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:40.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:40.025+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:40.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:40.332+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:40.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:40.577+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:40.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:40.587+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:40.856 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:50:40.853+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:50:40.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:40.986+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:41.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:41.355+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:41.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:41.551+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:41.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:41.552+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:42.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:41.998+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:42.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:42.327+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:42.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:42.569+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:42.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:42.578+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:42.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:42.972+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:43.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:43.305+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:43.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:43.529+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:43.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:43.628+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:43.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:43.934+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:44.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:44.301+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:44.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:44.498+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:44.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:44.619+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:44.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:44.900+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:45.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:45.278+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:45.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:45.489+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:45.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:45.661+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:45.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:45.950+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:46.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:46.275+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:46.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:46.464+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:46.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:46.700+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:46.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:46.903+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:47.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:47.226+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:47.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:47.472+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:47.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:47.721+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:47.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:47.921+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:48.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:48.259+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:48.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:48.434+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:48.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:48.699+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:48.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:48.905+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:49.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:49.250+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:49.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:49.447+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:49.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:49.687+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:49.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:49.945+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:50.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:50.204+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:50.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:50.467+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:50.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:50.727+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:50.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:50.990+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:51.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:51.188+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:51.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:51.488+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:51.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:51.747+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:52.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:52.016+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:52.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:52.227+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:52.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:52.444+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:52.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:52.777+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:53.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:52.998+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:53.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:53.275+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:53.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:53.447+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:53.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:53.819+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:54.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:54.031+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:54.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:54.280+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:54.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:54.433+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:54.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:54.834+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:55.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:55.007+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:55.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:55.277+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:55.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:55.408+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:55.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:55.815+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:55.870 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:50:55.867+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:50:56.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:56.049+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:56.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:56.249+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:56.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:56.435+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:56.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:56.776+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:57.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:57.077+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:57.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:57.221+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:57.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:57.433+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:57.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:57.824+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:58.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:58.121+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:58.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:58.209+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:58.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:58.396+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:58.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:58.846+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:59.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:50:59.123+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:59.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:50:59.256+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:59.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:50:59.386+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:50:59.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:50:59.876+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:00.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:00.141+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:00.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:00.228+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:00.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:00.342+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:00.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:00.853+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:01.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:01.155+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:01.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:01.271+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:01.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:01.325+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:01.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:01.863+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:02.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:02.158+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:02.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:02.289+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:02.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:02.335+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:02.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:02.864+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:03.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:03.192+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:03.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:03.244+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:03.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:03.358+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:03.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:03.900+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:04.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:04.221+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:04.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:04.247+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:04.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:04.314+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:04.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:04.948+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:05.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:05.217+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:05.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:05.270+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:05.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:05.317+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:05.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:05.901+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:06.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:06.219+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:06.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:06.232+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:06.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:06.307+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:06.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:06.903+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:07.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:07.229+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:07.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:07.259+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:07.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:07.285+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:07.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:51:07.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:51:07.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:07.949+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:08.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:08.182+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:08.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:08.248+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:08.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:08.313+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:08.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:08.931+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:09.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:09.149+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:09.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:09.243+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:09.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:09.266+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:09.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:09.900+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:10.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:10.187+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:10.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:10.276+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:10.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:10.314+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:10.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:10.858+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:10.886 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:51:10.883+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:51:11.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:11.212+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:11.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:11.256+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:11.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:11.293+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:11.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:11.822+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:12.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:12.207+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:12.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:12.297+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:12.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:12.316+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:12.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:12.820+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:13.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:13.184+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:13.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:13.284+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:13.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:13.310+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:13.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:13.826+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:14.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:14.140+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:14.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:14.245+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:14.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:14.272+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:14.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:14.856+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:15.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:15.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:15.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:15.200+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:15.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:15.223+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:15.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:15.815+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:16.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:16.088+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:16.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:16.189+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:16.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:16.241+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:16.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:16.819+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:17.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:17.084+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:17.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:17.190+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:17.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:17.215+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:17.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:17.795+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:18.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:18.055+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:18.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:18.185+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:18.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:18.254+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:18.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:18.806+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:19.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:19.065+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:19.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:19.229+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:19.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:19.276+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:19.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:19.807+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:20.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:20.106+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:20.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:20.266+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:20.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:20.279+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:20.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:20.850+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:21.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:21.126+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:21.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:21.233+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:21.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:21.248+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:21.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:21.854+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:22.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:22.124+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:22.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:22.247+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:22.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:22.249+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:22.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:22.823+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:23.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:23.152+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:23.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:23.222+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:23.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:23.282+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:23.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:23.804+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:24.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:24.104+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:24.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:24.237+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:24.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:24.279+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:24.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:24.755+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:25.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:25.101+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:25.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:25.227+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:25.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:25.280+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:25.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:25.768+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:25.900 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:51:25.897+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:51:26.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:26.099+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:26.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:26.278+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:26.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:26.279+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:26.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:26.797+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:27.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:27.081+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:27.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:27.236+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:27.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:27.272+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:27.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:27.786+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:28.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:28.112+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:28.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:28.261+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:28.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:28.265+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:28.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:28.765+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:29.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:29.073+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:29.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:29.227+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:29.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:29.250+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:29.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:29.801+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:30.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:30.066+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:30.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:30.238+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:30.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:30.260+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:30.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:30.787+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:31.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:31.021+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:31.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:31.211+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:31.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:31.248+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:31.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:31.739+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:31.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:31.993+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:32.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:32.183+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:32.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:32.286+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:32.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:32.764+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:33.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:33.039+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:33.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:33.197+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:33.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:33.335+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:33.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:33.747+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:34.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:34.081+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:34.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:34.194+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:34.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:34.364+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:34.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:34.761+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:35.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:35.035+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:35.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:35.153+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:35.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:35.407+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:35.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:35.763+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:36.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:36.010+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:36.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:36.140+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:36.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:36.401+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:36.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:36.735+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:36.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:36.975+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:37.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:37.119+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:37.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:37.402+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:37.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:37.736+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:37.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:51:37.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:51:37.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:37.929+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:38.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:38.117+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:38.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:38.423+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:38.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:38.740+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:38.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:38.965+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:39.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:39.150+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:39.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:39.374+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:39.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:39.757+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:39.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:39.937+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:40.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:40.158+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:40.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:40.333+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:40.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:40.745+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:40.914 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:51:40.913+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:51:40.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:40.934+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:41.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:41.123+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:41.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:41.363+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:41.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:41.775+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:41.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:41.983+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:42.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:42.154+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:42.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:42.400+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:42.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:42.749+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:42.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:42.939+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:43.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:43.201+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:43.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:43.379+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:43.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:43.750+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:43.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:43.978+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:44.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:44.167+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:44.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:44.376+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:44.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:44.748+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:44.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:44.994+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:45.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:45.150+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:45.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:45.404+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:45.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:45.766+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:46.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:46.035+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:46.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:46.124+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:46.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:46.370+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:46.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:46.807+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:47.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:47.084+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:47.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:47.159+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:47.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:47.379+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:47.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:47.815+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:48.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:48.122+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:48.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:48.124+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:48.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:48.337+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:48.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:48.820+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:49.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:49.123+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:49.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:49.171+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:49.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:49.342+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:49.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:49.834+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:50.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:50.135+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:50.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:50.164+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:50.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:50.345+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:50.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:50.851+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:51.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:51.091+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:51.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:51.202+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:51.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:51.323+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:51.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:51.847+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:52.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:52.110+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:52.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:52.233+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:52.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:52.327+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:52.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:52.861+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:53.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:53.136+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:53.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:53.266+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:53.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:53.311+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:53.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:53.856+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:54.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:54.172+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:54.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:54.217+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:54.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:54.283+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:54.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:54.825+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:55.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:55.188+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:55.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:55.244+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:55.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:55.255+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:55.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:55.783+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:55.930 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:51:55.927+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:51:56.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:56.155+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:56.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:56.228+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:56.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:56.300+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:56.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:56.765+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:57.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:57.110+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:57.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:57.227+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:57.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:57.284+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:57.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:57.805+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:58.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:58.069+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:58.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:58.239+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:58.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:58.246+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:58.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:58.782+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:59.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:51:59.045+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:59.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:51:59.233+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:59.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:51:59.240+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:51:59.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:51:59.755+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:00.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:00.096+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:00.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:00.200+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:00.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:00.259+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:00.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:00.792+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:01.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:01.135+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:01.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:01.152+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:01.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:01.263+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:01.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:01.813+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:02.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:02.093+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:02.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:02.149+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:02.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:02.301+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:02.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:02.850+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:03.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:03.090+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:03.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:03.110+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:03.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:03.343+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:03.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:03.803+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:04.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:04.068+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:04.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:04.092+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:04.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:04.369+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:04.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:04.833+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:05.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:05.026+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:05.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:05.080+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:05.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:05.370+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:05.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:05.794+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:06.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:06.041+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:06.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:06.053+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:06.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:06.355+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:06.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:06.750+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:07.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:07.007+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:07.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:07.052+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:07.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:07.336+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:07.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:07.712+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:07.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:52:07.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:52:08.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:08.008+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:08.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:08.020+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:08.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:08.332+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:08.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:08.746+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:08.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:08.967+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:09.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:09.060+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:09.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:09.333+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:09.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:09.776+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:09.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:09.952+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:10.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:10.098+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:10.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:10.336+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:10.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:10.805+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:10.946 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:52:10.943+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:52:10.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:10.952+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:11.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:11.122+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:11.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:11.358+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:11.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:11.761+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:11.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:11.934+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:12.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:12.090+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:12.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:12.377+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:12.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:12.728+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:12.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:12.898+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:13.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:13.126+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:13.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:13.333+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:13.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:13.710+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:13.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:13.912+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:14.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:14.148+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:14.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:14.291+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:14.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:14.667+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:14.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:14.908+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:15.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:15.100+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:15.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:15.316+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:15.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:15.619+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:15.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:15.930+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:16.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:16.078+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:16.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:16.276+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:16.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:16.666+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:16.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:16.968+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:17.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:17.074+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:17.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:17.311+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:17.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:17.677+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:17.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:17.932+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:18.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:18.040+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:18.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:18.338+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:18.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:18.676+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:18.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:18.919+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:19.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:19.045+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:19.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:19.341+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:19.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:19.715+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:19.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:19.944+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:20.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:20.060+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:20.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:20.347+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:20.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:20.756+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:20.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:20.897+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:21.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:21.097+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:21.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:21.335+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:21.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:21.776+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:21.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:21.941+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:22.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:22.121+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:22.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:22.312+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:22.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:22.771+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:22.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:22.929+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:23.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:23.170+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:23.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:23.296+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:23.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:23.736+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:23.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:23.953+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:24.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:24.173+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:24.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:24.303+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:24.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:24.733+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:24.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:24.993+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:25.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:25.224+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:25.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:25.285+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:25.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:25.720+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:25.962 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:52:25.959+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:52:26.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:26.024+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:26.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:26.186+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:26.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:26.248+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:26.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:26.746+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:27.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:27.022+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:27.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:27.177+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:27.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:27.218+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:27.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:27.777+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:28.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:28.016+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:28.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:28.146+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:28.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:28.262+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:28.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:28.772+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:29.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:29.021+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:29.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:29.149+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:29.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:29.291+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:29.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:29.770+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:30.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:30.011+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:30.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:30.129+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:30.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:30.265+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:30.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:30.752+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:31.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:31.009+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:31.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:31.091+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:31.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:31.313+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:31.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:31.802+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:32.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:32.050+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:32.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:32.122+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:32.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:32.357+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:32.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:32.754+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:33.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:33.021+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:33.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:33.123+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:33.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:33.359+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:33.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:33.708+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:34.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:34.066+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:34.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:34.151+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:34.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:34.326+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:34.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:34.758+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:35.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:35.082+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:35.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:35.125+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:35.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:35.289+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:35.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:35.736+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:36.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:36.113+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:36.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:36.150+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:36.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:36.253+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:36.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:36.711+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:37.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:37.106+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:37.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:37.149+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:37.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:37.298+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:37.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:37.706+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:38.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:52:38.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:52:38.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:38.072+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:38.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:38.143+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:38.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:38.316+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:38.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:38.685+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:39.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:39.028+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:39.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:39.108+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:39.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:39.359+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:39.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:39.727+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:40.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:40.000+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:40.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:40.075+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:40.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:40.317+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:40.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:40.744+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:40.977 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:52:40.975+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:52:41.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:40.998+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:41.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:41.095+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:41.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:41.347+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:41.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:41.764+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:42.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:42.027+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:42.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:42.134+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:42.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:42.363+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:42.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:42.774+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:43.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:43.042+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:43.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:43.123+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:43.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:43.379+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:43.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:43.802+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:44.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:44.070+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:44.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:44.077+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:44.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:44.407+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:44.469 DEBUG:teuthology.orchestra.run:got remote process result: 124 2022-04-04T00:52:44.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:44.781+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:45.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:45.050+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:45.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:45.054+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:45.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:45.424+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:45.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:45.831+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:46.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:46.006+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:46.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:46.035+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:46.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:46.404+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:46.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:46.851+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:46.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:46.988+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:47.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:47.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:47.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:47.454+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:47.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:47.846+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:47.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:47.981+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:48.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:48.023+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:48.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:48.410+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:48.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:48.866+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:49.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:49.013+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:49.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:49.015+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:49.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:49.384+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:49.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:49.876+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:50.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:50.001+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:50.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:50.011+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:50.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:50.348+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:50.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:50.851+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:51.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:51.016+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:51.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:51.039+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:51.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:51.329+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:51.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:51.815+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:51.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:51.981+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:52.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:52.016+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:52.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:52.336+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:52.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:52.854+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:52.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:52.973+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:53.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:52.999+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:53.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:53.320+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:53.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:53.809+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:54.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:53.998+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:54.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:54.024+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:54.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:54.324+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:54.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:54.831+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:54.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:54.984+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:55.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:55.035+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:55.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:55.326+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:55.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:55.850+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:55.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:55.989+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:55.993 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:52:55.992+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:52:56.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:56.035+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:56.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:56.296+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:56.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:56.854+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:57.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:57.019+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:57.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:57.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:57.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:57.293+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:57.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:57.859+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:57.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:57.984+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:58.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:58.049+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:58.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:58.328+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:58.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:58.819+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:59.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:52:59.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:59.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:52:59.069+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:59.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:52:59.363+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:52:59.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:52:59.803+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:00.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:00.001+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:00.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:00.098+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:00.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:00.406+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:00.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:00.781+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:01.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:01.020+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:01.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:01.113+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:01.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:01.404+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:01.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:01.749+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:01.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:01.998+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:02.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:02.126+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:02.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:02.413+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:02.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:02.741+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:02.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:02.987+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:03.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:03.132+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:03.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:03.398+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:03.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:03.738+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:04.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:04.004+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:04.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:04.121+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:04.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:04.423+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:04.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:04.707+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:05.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:05.021+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:05.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:05.160+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:05.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:05.384+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:05.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:05.737+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:06.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:06.039+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:06.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:06.190+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:06.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:06.341+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:06.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:06.701+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:07.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:07.082+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:07.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:07.227+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:07.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:07.299+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:07.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:07.716+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:08.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:08.036+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:08.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:53:08.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:53:08.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:08.250+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:08.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:08.278+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:08.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:08.736+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:09.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:09.004+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:09.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:09.250+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:09.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:09.275+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:09.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:09.763+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:10.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:10.049+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:10.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:10.236+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:10.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:10.237+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:10.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:10.722+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:11.002 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:53:10.999+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:53:11.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:11.014+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:11.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:11.201+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:11.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:11.280+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:11.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:11.729+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:11.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:11.982+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:12.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:12.151+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:12.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:12.236+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:12.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:12.711+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:12.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:12.952+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:13.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:13.120+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:13.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:13.200+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:13.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:13.734+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:13.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:13.936+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:14.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:14.157+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:14.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:14.192+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:14.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:14.776+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:14.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:14.916+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:15.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:15.172+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:15.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:15.202+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:15.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:15.799+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:15.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:15.953+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:16.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:16.187+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:16.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:16.243+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:16.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:16.764+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:16.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:16.950+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:17.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:17.213+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:17.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:17.243+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:17.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:17.797+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:17.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:17.949+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:18.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:18.225+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:18.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:18.242+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:18.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:18.843+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:18.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:18.986+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:19.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:19.193+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:19.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:19.206+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:19.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:19.863+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:19.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:19.955+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:20.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:20.158+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:20.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:20.243+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:20.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:20.824+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:20.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:20.944+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:21.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:21.120+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:21.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:21.264+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:21.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:21.844+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:21.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:21.969+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:22.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:22.120+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:22.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:22.314+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:22.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:22.888+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:22.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:22.927+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:23.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:23.134+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:23.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:23.349+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:23.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:23.929+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:23.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:23.945+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:24.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:24.164+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:24.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:24.376+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:24.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:24.902+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:24.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:24.919+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:25.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:25.160+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:25.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:25.361+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:25.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:25.910+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:25.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:25.934+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:26.010 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:53:26.008+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:53:26.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:26.181+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:26.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:26.409+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:26.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:26.917+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:26.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:26.930+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:27.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:27.200+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:27.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:27.396+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:27.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:27.884+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:27.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:27.945+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:28.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:28.165+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:28.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:28.425+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:28.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:28.917+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:28.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:28.963+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:29.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:29.147+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:29.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:29.437+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:29.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:29.906+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:29.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:29.949+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:30.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:30.188+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:30.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:30.473+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:30.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:30.938+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:30.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:30.952+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:31.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:31.141+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:31.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:31.427+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:31.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:31.941+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:31.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:31.974+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:32.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:32.185+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:32.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:32.460+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:32.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:32.984+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:33.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:33.006+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:33.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:33.180+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:33.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:33.499+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:33.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:33.936+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:34.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:34.012+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:34.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:34.137+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:34.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:34.532+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:34.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:34.977+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:34.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:34.978+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:35.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:35.116+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:35.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:35.542+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:35.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:35.985+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:35.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:35.995+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:36.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:36.087+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:36.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:36.518+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:36.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:36.995+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:37.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:37.024+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:37.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:37.078+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:37.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:37.492+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:37.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:37.974+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:38.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:38.042+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:38.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:38.070+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:38.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:53:38.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:53:38.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:38.505+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:38.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:38.971+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:39.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:39.032+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:39.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:39.109+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:39.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:39.472+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:39.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:39.928+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:40.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:40.009+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:40.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:40.076+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:40.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:40.492+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:40.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:40.935+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:41.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:41.003+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:41.011 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:53:41.008+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:53:41.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:41.105+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:41.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:41.464+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:41.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:41.937+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:41.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:41.964+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:42.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:42.068+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:42.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:42.443+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:42.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:42.888+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:42.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:42.918+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:43.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:43.117+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:43.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:43.462+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:43.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:43.890+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:43.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:43.911+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:44.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:44.085+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:44.471 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2022-04-04T00:53:44.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:44.497+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:44.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:44.869+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:44.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:44.928+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:45.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:45.039+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:45.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:45.455+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:45.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:45.823+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:45.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:45.895+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:46.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:46.022+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:46.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:46.458+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:46.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:46.807+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:46.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:46.940+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:47.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:47.052+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:47.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:47.412+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:47.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:47.773+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:47.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:47.978+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:48.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:48.057+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:48.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:48.416+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:48.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:48.806+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:48.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:48.952+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:49.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:49.091+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:49.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:49.388+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:49.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:49.805+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:49.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:49.934+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:50.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:50.096+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:50.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:50.341+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:50.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:50.755+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:50.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:50.969+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:51.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:51.110+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:51.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:51.355+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:51.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:51.758+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:51.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:51.927+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:52.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:52.085+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:52.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:52.383+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:52.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:52.776+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:52.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:52.941+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:53.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:53.060+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:53.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:53.340+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:53.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:53.815+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:53.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:53.905+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:54.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:54.034+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:54.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:54.297+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:54.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:54.771+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:54.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:54.867+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:55.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:55.000+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:55.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:55.333+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:55.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:55.783+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:55.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:55.861+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:56.020 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:53:56.017+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:53:56.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:56.032+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:56.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:56.373+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:56.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:56.767+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:56.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:56.835+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:57.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:57.072+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:57.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:57.351+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:57.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:57.720+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:57.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:57.786+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:58.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:58.095+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:58.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:58.325+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:58.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:58.713+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:58.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:58.738+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:59.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:53:59.141+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:59.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:53:59.368+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:59.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:53:59.703+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:53:59.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:53:59.731+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:00.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:00.100+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:00.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:00.325+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:00.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:00.708+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:00.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:00.739+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:01.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:01.108+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:01.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:01.367+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:01.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:01.738+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:01.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:01.773+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:02.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:02.113+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:02.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:02.323+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:02.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:02.745+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:02.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:02.816+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:03.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:03.120+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:03.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:03.277+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:03.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:03.741+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:03.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:03.811+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:04.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:04.134+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:04.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:04.244+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:04.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:04.719+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:04.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:04.806+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:05.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:05.122+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:05.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:05.274+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:05.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:05.697+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:05.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:05.798+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:06.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:06.086+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:06.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:06.243+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:06.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:06.689+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:06.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:06.768+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:07.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:07.120+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:07.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:07.268+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:07.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:07.731+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:07.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:07.801+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:08.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:08.098+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:08.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:08.244+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:08.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:54:08.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:54:08.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:08.758+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:08.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:08.763+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:09.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:09.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:09.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:09.205+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:09.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:09.759+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:09.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:09.766+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:10.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:10.062+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:10.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:10.176+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:10.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:10.769+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:10.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:10.788+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:11.029 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:54:11.027+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:54:11.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:11.085+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:11.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:11.205+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:11.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:11.755+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:11.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:11.761+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:12.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:12.069+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:12.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:12.225+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:12.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:12.733+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:12.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:12.781+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:13.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:13.095+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:13.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:13.218+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:13.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:13.750+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:13.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:13.763+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:14.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:14.133+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:14.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:14.199+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:14.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:14.717+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:14.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:14.778+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:15.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:15.106+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:15.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:15.164+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:15.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:15.733+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:15.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:15.747+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:16.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:16.147+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:16.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:16.159+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:16.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:16.742+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:16.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:16.761+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:17.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:17.116+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:17.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:17.155+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:17.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:17.705+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:17.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:17.722+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:18.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:18.097+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:18.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:18.194+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:18.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:18.682+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:18.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:18.764+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:19.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:19.051+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:19.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:19.207+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:19.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:19.636+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:19.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:19.741+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:20.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:20.059+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:20.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:20.161+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:20.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:20.606+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:20.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:20.753+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:21.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:21.099+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:21.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:21.202+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:21.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:21.642+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:21.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:21.727+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:22.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:22.082+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:22.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:22.163+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:22.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:22.652+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:22.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:22.735+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:23.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:23.054+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:23.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:23.168+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:23.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:23.695+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:23.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:23.751+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:24.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:24.013+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:24.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:24.198+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:24.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:24.693+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:24.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:24.707+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:24.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:24.984+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:25.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:25.226+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:25.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:25.673+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:25.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:25.692+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:25.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:25.947+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:26.036 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:54:26.033+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:54:26.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:26.234+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:26.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:26.669+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:26.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:26.676+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:26.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:26.967+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:27.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:27.211+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:27.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:27.674+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:27.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:27.691+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:28.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:28.000+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:28.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:28.195+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:28.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:28.679+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:28.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:28.721+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:28.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:28.996+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:29.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:29.216+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:29.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:29.651+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:29.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:29.758+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:29.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:29.957+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:30.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:30.225+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:30.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:30.635+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:30.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:30.805+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:30.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:30.951+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:31.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:31.223+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:31.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:31.637+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:31.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:31.769+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:31.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:31.926+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:32.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:32.262+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:32.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:32.658+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:32.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:32.762+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:32.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:32.914+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:33.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:33.285+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:33.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:33.651+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:33.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:33.749+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:33.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:33.913+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:34.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:34.290+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:34.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:34.614+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:34.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:34.765+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:34.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:34.901+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:35.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:35.268+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:35.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:35.597+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:35.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:35.732+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:35.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:35.925+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:36.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:36.257+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:36.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:36.557+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:36.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:36.694+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:36.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:36.946+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:37.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:37.296+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:37.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:37.520+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:37.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:37.675+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:37.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:37.962+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:38.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:38.337+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:38.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:38.477+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:38.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:54:38.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:54:38.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:38.633+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:38.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:38.925+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:39.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:39.342+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:39.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:39.517+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:39.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:39.642+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:39.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:39.969+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:40.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:40.356+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:40.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:40.480+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:40.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:40.632+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:40.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:40.994+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:41.052 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:54:41.050+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:54:41.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:41.349+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:41.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:41.520+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:41.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:41.629+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:41.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:41.993+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:42.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:42.390+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:42.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:42.520+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:42.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:42.614+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:42.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:42.969+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:43.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:43.362+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:43.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:43.508+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:43.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:43.598+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:43.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:43.965+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:44.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:44.346+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:44.472 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2022-04-04T00:54:44.473 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2022-04-04T00:54:44.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2022-04-04T00:54:44.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:44.493+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:44.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:44.606+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:44.880 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks/workunit.py", line 148, in task cleanup=cleanup) File "/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks/workunit.py", line 298, in _spawn_on_all_clients timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks/workunit.py", line 427, in _run_tests label="workunit test {workunit}".format(workunit=workunit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi049 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2022-04-04T00:54:44.988 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3e5a69aa0f174e1f9499bad7049186b6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks/workunit.py", line 148, in task cleanup=cleanup) File "/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks/workunit.py", line 298, in _spawn_on_all_clients timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_cfb8f943163b374162da0d7b0240f267dd46e4e1/qa/tasks/workunit.py", line 427, in _run_tests label="workunit test {workunit}".format(workunit=workunit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi049 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb8f943163b374162da0d7b0240f267dd46e4e1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2022-04-04T00:54:44.992 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2022-04-04T00:54:45.000 INFO:tasks.kclient:Unmounting kernel clients... 2022-04-04T00:54:45.001 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2022-04-04T00:54:45.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-04T00:54:45.002 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2022-04-04T00:54:45.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:44.966+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:45.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:45.350+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:45.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:45.509+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:45.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:45.600+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:46.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:46.015+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:46.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:46.375+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:46.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:46.469+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:46.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:46.603+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:47.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:47.059+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:47.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:47.405+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:47.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:47.485+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:47.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:47.608+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:48.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:48.050+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:48.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:48.396+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:48.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:48.505+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:48.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:48.587+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:49.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:49.095+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:49.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:49.356+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:49.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:49.544+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:49.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:49.561+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:50.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:50.104+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:50.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:50.380+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:50.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:50.538+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:50.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:50.560+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:51.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:51.066+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:51.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:51.339+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:51.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:51.565+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:51.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:51.570+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:52.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:52.075+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:52.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:52.308+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:52.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:52.547+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:52.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:52.556+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:53.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:53.063+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:53.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:53.279+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:53.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:53.561+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:53.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:53.581+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:54.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:54.017+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:54.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:54.305+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:54.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:54.536+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:54.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:54.615+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:55.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:55.056+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:55.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:55.299+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:55.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:55.537+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:55.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:55.656+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:56.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:56.050+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:56.068 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:54:56.065+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:54:56.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:56.298+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:56.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:56.530+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:56.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:56.658+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:57.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:57.079+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:57.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:57.298+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:57.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:57.506+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:57.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:57.705+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:58.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:58.093+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:58.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:58.266+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:58.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:58.496+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:58.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:58.690+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:59.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:54:59.119+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:59.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:54:59.234+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:59.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:54:59.511+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:54:59.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:54:59.708+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:00.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:00.086+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:00.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:00.232+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:00.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:00.465+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:00.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:00.697+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:01.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:01.121+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:01.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:01.282+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:01.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:01.513+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:01.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:01.677+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:02.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:02.127+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:02.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:02.245+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:02.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:02.480+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:02.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:02.677+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:03.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:03.140+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:03.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:03.282+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:03.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:03.487+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:03.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:03.655+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:04.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:04.091+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:04.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:04.249+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:04.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:04.446+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:04.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:04.619+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:05.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:05.057+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:05.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:05.257+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:05.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:05.415+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:05.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:05.593+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:06.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:06.071+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:06.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:06.235+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:06.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:06.377+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:06.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:06.619+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:07.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:07.082+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:07.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:07.257+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:07.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:07.343+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:07.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:07.663+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:08.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:08.124+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:08.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:08.258+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:08.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:08.383+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:08.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:08.652+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:08.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:55:08.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:55:09.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:09.141+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:09.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:09.231+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:09.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:09.367+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:09.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:09.664+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:10.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:10.098+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:10.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:10.275+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:10.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:10.399+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:10.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:10.669+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:11.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:11.073+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:11.078 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:55:11.075+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:55:11.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:11.240+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:11.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:11.384+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:11.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:11.624+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:12.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:12.081+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:12.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:12.276+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:12.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:12.364+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:12.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:12.664+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:13.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:13.127+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:13.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:13.258+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:13.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:13.352+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:13.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:13.676+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:14.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:14.124+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:14.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:14.230+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:14.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:14.396+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:14.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:14.720+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:15.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:15.101+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:15.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:15.212+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:15.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:15.423+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:15.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:15.677+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:16.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:16.095+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:16.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:16.238+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:16.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:16.417+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:16.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:16.672+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:17.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:17.113+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:17.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:17.219+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:17.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:17.387+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:17.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:17.626+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:18.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:18.105+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:18.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:18.258+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:18.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:18.358+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:18.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:18.610+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:19.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:19.107+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:19.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:19.290+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:19.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:19.343+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:19.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:19.632+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:20.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:20.068+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:20.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:20.279+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:20.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:20.380+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:20.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:20.582+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:21.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:21.098+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:21.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:21.236+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:21.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:21.377+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:21.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:21.591+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:22.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:22.092+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:22.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:22.286+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:22.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:22.356+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:22.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:22.576+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:23.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:23.056+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:23.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:23.258+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:23.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:23.341+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:23.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:23.543+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:24.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:24.035+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:24.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:24.247+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:24.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:24.336+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:24.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:24.578+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:25.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:25.017+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:25.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:25.208+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:25.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:25.299+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:25.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:25.570+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:26.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:26.052+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:26.094 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:55:26.091+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:55:26.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:26.194+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:26.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:26.274+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:26.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:26.604+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:27.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:27.070+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:27.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:27.242+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:27.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:27.250+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:27.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:27.564+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:28.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:28.120+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:28.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:28.229+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:28.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:28.282+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:28.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:28.526+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:29.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:29.103+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:29.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:29.209+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:29.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:29.267+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:29.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:29.569+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:30.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:30.061+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:30.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:30.221+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:30.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:30.249+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:30.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:30.607+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:31.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:31.109+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:31.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:31.190+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:31.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:31.281+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:31.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:31.588+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:32.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:32.146+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:32.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:32.149+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:32.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:32.244+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:32.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:32.621+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:33.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:33.119+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:33.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:33.191+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:33.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:33.198+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:33.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:33.639+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:34.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:34.117+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:34.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:34.167+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:34.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:34.182+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:34.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:34.595+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:35.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:35.106+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:35.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:35.161+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:35.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:35.213+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:35.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:35.618+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:36.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:36.097+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:36.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:36.161+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:36.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:36.231+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:36.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:36.577+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:37.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:37.071+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:37.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:37.209+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:37.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:37.244+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:37.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:37.547+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:38.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:38.022+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:38.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:38.202+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:38.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:38.287+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:38.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:38.563+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:38.742 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:55:38.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:55:38.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:38.980+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:39.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:39.218+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:39.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:39.240+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:39.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:39.604+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:39.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:39.965+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:40.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:40.201+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:40.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:40.208+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:40.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:40.645+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:40.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:40.956+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:41.110 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:55:41.107+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:55:41.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:41.162+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:41.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:41.165+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:41.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:41.618+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:41.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:41.935+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:42.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:42.203+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:42.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:42.211+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:42.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:42.594+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:42.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:42.947+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:43.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:43.163+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:43.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:43.196+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:43.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:43.641+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:43.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:43.989+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:44.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:44.128+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:44.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:44.173+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:44.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:44.609+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:44.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:44.979+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:45.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:45.082+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:45.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:45.150+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:45.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:45.622+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:45.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:45.978+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:46.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:46.052+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:46.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:46.102+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:46.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:46.606+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:47.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:47.014+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:47.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:47.040+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:47.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:47.115+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:47.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:47.574+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:48.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:48.039+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:48.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:48.085+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:48.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:48.133+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:48.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:48.532+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:49.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:49.026+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:49.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:49.064+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:49.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:49.176+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:49.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:49.514+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:49.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:49.997+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:50.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:50.091+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:50.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:50.171+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:50.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:50.537+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:51.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:51.008+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:51.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:51.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:51.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:51.146+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:51.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:51.537+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:52.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:52.027+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:52.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:52.114+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:52.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:52.163+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:52.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:52.554+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:53.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:53.071+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:53.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:53.119+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:53.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:53.150+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:53.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:53.517+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:54.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:54.053+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:54.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:54.103+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:54.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:54.193+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:54.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:54.491+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:55.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:55.045+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:55.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:55.142+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:55.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:55.194+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:55.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:55.540+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:56.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:56.042+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:56.122 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:55:56.121+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:55:56.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:56.132+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:56.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:56.203+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:56.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:56.541+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:57.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:57.017+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:57.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:57.175+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:57.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:57.245+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:57.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:57.507+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:57.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:57.970+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:58.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:58.157+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:58.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:58.224+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:58.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:58.510+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:58.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:58.968+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:59.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:55:59.160+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:59.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:55:59.188+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:59.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:55:59.496+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:55:59.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:55:59.942+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:00.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:00.159+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:00.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:00.176+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:00.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:00.486+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:00.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:00.922+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:01.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:01.156+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:01.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:01.200+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:01.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:01.505+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:01.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:01.944+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:02.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:02.194+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:02.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:02.238+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:02.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:02.504+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:02.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:02.924+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:03.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:03.235+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:03.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:03.268+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:03.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:03.467+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:03.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:03.911+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:04.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:04.263+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:04.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:04.277+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:04.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:04.431+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:04.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:04.862+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:05.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:05.236+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:05.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:05.291+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:05.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:05.434+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:05.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:05.862+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:06.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:06.191+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:06.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:06.328+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:06.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:06.413+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:06.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:06.910+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:07.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:07.172+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:07.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:07.332+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:07.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:07.367+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:07.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:07.950+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:08.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:08.195+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:08.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:08.337+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:08.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:08.377+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:08.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:56:08.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:56:08.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:08.995+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:09.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:09.206+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:09.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:09.355+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:09.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:09.406+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:09.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:09.975+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:10.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:10.207+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:10.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:10.392+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:10.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:10.445+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:10.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:10.945+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:11.138 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:56:11.135+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:56:11.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:11.175+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:11.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:11.354+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:11.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:11.406+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:11.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:11.912+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:12.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:12.168+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:12.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:12.396+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:12.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:12.398+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:12.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:12.925+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:13.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:13.189+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:13.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:13.371+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:13.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:13.441+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:13.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:13.890+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:14.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:14.158+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:14.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:14.382+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:14.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:14.434+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:14.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:14.843+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:15.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:15.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:15.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:15.413+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:15.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:15.416+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:15.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:15.808+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:16.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:16.148+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:16.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:16.427+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:16.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:16.466+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:16.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:16.856+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:17.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:17.127+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:17.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:17.468+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:17.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:17.516+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:17.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:17.845+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:18.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:18.102+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:18.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:18.469+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:18.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:18.539+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:18.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:18.863+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:19.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:19.120+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:19.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:19.453+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:19.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:19.494+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:19.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:19.871+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:20.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:20.113+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:20.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:20.437+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:20.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:20.479+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:20.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:20.908+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:21.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:21.116+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:21.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:21.408+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:21.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:21.500+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:21.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:21.900+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:22.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:22.134+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:22.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:22.375+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:22.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:22.543+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:22.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:22.882+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:23.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:23.095+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:23.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:23.396+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:23.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:23.500+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:23.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:23.836+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:24.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:24.125+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:24.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:24.379+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:24.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:24.473+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:24.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:24.809+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:25.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:25.129+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:25.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:25.424+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:25.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:25.462+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:25.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:25.815+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:26.154 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:56:26.151+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:56:26.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:26.168+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:26.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:26.411+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:26.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:26.489+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:26.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:26.823+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:27.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:27.183+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:27.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:27.412+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:27.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:27.474+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:27.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:27.859+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:28.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:28.167+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:28.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:28.452+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:28.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:28.460+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:28.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:28.860+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:29.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:29.126+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:29.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:29.428+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:29.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:29.497+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:29.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:29.903+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:30.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:30.112+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:30.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:30.433+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:30.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:30.506+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:30.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:30.866+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:31.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:31.127+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:31.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:31.438+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:31.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:31.543+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:31.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:31.828+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:32.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:32.175+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:32.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:32.449+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:32.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:32.553+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:32.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:32.832+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:33.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:33.181+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:33.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:33.413+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:33.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:33.534+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:33.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:33.838+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:34.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:34.145+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:34.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:34.433+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:34.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:34.579+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:34.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:34.857+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:35.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:35.117+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:35.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:35.473+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:35.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:35.622+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:35.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:35.859+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:36.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:36.155+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:36.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:36.497+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:36.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:36.613+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:36.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:36.839+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:37.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:37.143+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:37.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:37.450+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:37.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:37.624+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:37.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:37.809+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:38.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:38.127+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:38.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:38.463+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:38.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:38.583+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:38.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:38.811+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:39.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:56:39.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:56:39.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:39.173+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:39.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:39.440+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:39.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:39.608+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:39.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:39.802+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:40.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:40.131+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:40.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:40.401+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:40.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:40.645+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:40.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:40.837+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:41.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:41.155+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:41.170 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:56:41.167+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:56:41.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:41.383+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:41.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:41.686+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:41.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:41.803+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:42.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:42.158+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:42.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:42.394+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:42.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:42.696+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:42.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:42.783+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:43.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:43.177+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:43.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:43.405+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:43.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:43.718+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:43.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:43.779+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:44.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:44.153+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:44.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:44.424+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:44.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:44.732+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:44.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:44.782+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:45.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:45.192+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:45.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:45.445+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:45.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:45.747+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:45.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:45.766+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:46.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:46.189+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:46.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:46.431+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:46.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:46.747+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:46.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:46.776+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:47.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:47.228+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:47.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:47.382+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:47.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:47.704+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:47.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:47.796+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:48.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:48.233+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:48.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:48.352+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:48.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:48.696+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:48.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:48.808+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:49.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:49.283+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:49.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:49.311+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:49.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:49.690+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:49.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:49.796+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:50.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:50.301+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:50.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:50.338+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:50.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:50.671+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:50.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:50.841+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:51.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:51.268+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:51.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:51.308+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:51.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:51.663+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:51.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:51.806+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:52.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:52.295+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:52.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:52.354+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:52.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:52.711+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:52.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:52.819+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:53.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:53.264+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:53.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:53.369+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:53.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:53.690+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:53.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:53.829+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:54.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:54.227+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:54.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:54.353+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:54.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:54.694+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:54.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:54.807+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:55.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:55.267+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:55.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:55.347+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:55.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:55.695+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:55.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:55.807+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:56.186 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:56:56.183+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:56:56.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:56.254+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:56.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:56.335+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:56.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:56.658+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:56.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:56.809+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:57.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:57.232+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:57.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:57.304+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:57.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:57.683+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:57.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:57.823+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:58.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:58.269+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:58.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:58.281+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:58.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:58.668+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:58.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:58.867+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:59.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:56:59.241+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:59.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:56:59.311+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:59.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:56:59.707+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:56:59.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:56:59.862+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:00.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:00.209+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:00.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:00.293+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:00.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:00.693+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:00.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:00.841+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:01.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:01.194+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:01.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:01.278+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:01.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:01.683+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:01.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:01.828+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:02.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:02.151+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:02.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:02.316+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:02.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:02.635+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:02.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:02.846+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:03.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:03.159+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:03.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:03.274+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:03.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:03.643+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:03.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:03.877+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:04.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:04.182+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:04.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:04.233+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:04.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:04.681+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:04.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:04.878+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:05.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:05.188+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:05.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:05.192+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:05.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:05.723+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:05.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:05.904+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:06.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:06.197+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:06.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:06.203+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:06.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:06.743+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:06.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:06.915+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:07.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:07.163+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:07.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:07.187+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:07.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:07.722+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:07.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:07.917+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:08.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:08.155+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:08.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:08.206+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:08.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:08.691+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:08.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:08.940+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:09.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:09.141+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:09.172 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:57:09.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:57:09.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:09.232+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:09.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:09.718+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:09.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:09.910+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:10.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:10.117+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:10.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:10.271+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:10.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:10.696+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:10.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:10.862+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:11.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:11.131+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:11.203 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:57:11.200+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:57:11.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:11.234+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:11.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:11.670+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:11.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:11.833+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:12.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:12.090+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:12.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:12.283+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:12.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:12.677+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:12.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:12.813+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:13.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:13.123+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:13.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:13.286+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:13.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:13.681+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:13.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:13.776+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:14.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:14.097+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:14.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:14.282+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:14.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:14.654+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:14.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:14.806+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:15.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:15.114+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:15.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:15.320+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:15.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:15.684+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:15.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:15.841+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:16.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:16.131+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:16.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:16.371+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:16.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:16.700+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:16.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:16.830+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:17.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:17.171+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:17.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:17.371+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:17.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:17.710+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:17.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:17.861+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:18.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:18.155+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:18.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:18.375+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:18.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:18.661+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:18.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:18.843+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:19.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:19.187+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:19.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:19.327+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:19.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:19.645+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:19.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:19.811+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:20.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:20.207+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:20.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:20.315+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:20.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:20.656+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:20.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:20.843+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:21.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:21.237+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:21.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:21.291+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:21.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:21.624+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:21.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:21.868+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:22.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:22.243+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:22.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:22.270+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:22.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:22.641+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:22.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:22.873+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:23.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:23.227+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:23.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:23.269+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:23.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:23.633+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:23.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:23.920+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:24.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:24.209+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:24.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:24.308+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:24.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:24.610+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:24.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:24.896+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:25.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:25.167+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:25.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:25.293+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:25.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:25.637+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:25.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:25.916+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:26.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:26.213+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:26.217 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:57:26.215+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:57:26.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:26.300+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:26.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:26.634+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:26.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:26.906+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:27.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:27.230+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:27.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:27.330+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:27.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:27.668+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:27.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:27.915+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:28.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:28.277+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:28.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:28.289+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:28.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:28.635+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:28.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:28.959+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:29.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:29.244+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:29.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:29.269+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:29.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:29.668+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:29.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:29.966+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:30.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:30.234+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:30.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:30.311+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:30.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:30.632+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:30.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:30.924+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:31.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:31.241+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:31.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:31.297+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:31.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:31.608+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:31.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:31.955+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:32.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:32.206+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:32.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:32.314+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:32.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:32.626+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:32.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:32.909+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:33.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:33.240+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:33.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:33.267+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:33.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:33.637+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:33.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:33.959+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:34.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:34.210+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:34.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:34.258+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:34.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:34.630+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:34.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:34.965+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:35.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:35.258+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:35.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:35.295+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:35.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:35.607+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:36.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:35.998+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:36.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:36.273+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:36.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:36.316+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:36.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:36.614+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:36.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:36.982+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:37.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:37.229+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:37.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:37.335+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:37.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:37.596+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:37.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:37.960+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:38.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:38.225+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:38.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:38.345+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:38.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:38.566+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:38.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:38.946+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:39.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:39.228+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:39.242 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:57:39.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:57:39.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:39.342+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:39.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:39.611+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:39.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:39.982+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:40.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:40.218+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:40.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:40.389+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:40.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:40.562+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:40.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:40.942+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:41.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:41.228+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:41.233 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:57:41.231+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:57:41.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:41.398+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:41.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:41.534+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:41.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:41.984+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:42.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:42.179+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:42.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:42.416+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:42.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:42.536+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:42.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:42.955+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:43.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:43.149+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:43.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:43.420+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:43.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:43.495+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:43.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:43.926+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:44.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:44.190+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:44.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:44.377+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:44.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:44.526+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:44.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:44.956+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:45.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:45.191+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:45.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:45.403+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:45.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:45.501+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:45.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:45.992+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:46.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:46.209+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:46.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:46.372+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:46.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:46.473+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:47.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:47.021+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:47.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:47.253+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:47.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:47.417+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:47.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:47.482+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:48.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:48.059+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:48.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:48.236+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:48.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:48.401+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:48.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:48.470+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:49.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:49.020+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:49.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:49.272+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:49.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:49.371+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:49.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:49.489+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:50.052 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:50.049+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:50.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:50.303+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:50.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:50.394+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:50.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:50.482+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:51.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:51.003+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:51.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:51.327+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:51.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:51.432+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:51.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:51.501+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:51.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:51.991+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:52.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:52.296+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:52.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:52.454+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:52.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:52.483+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:52.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:52.951+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:53.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:53.288+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:53.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:53.479+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:53.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:53.496+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:53.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:53.903+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:54.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:54.269+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:54.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:54.457+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:54.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:54.501+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:54.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:54.900+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:55.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:55.258+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:55.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:55.488+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:55.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:55.515+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:55.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:55.922+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:56.249 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:57:56.246+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:57:56.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:56.259+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:56.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:56.483+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:56.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:56.509+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:56.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:56.937+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:57.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:57.246+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:57.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:57.495+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:57.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:57.504+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:57.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:57.953+0000 7f6e44c9f700 -1 osd.7 108 get_health_metrics reporting 45 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:58.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:58.209+0000 7f596d92c700 -1 osd.6 108 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:58.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:58.448+0000 7f72c425d700 -1 osd.5 108 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:58.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:58.474+0000 7f389e18e700 -1 osd.4 108 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:58.515 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:57:58.513+0000 7fe1ed819700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:57:58.530 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T00:57:58.513+0000 7fe1ed819700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T00:57:58.531 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T00:57:58.526+0000 7fe1ed018700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T00:57:58.553 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T00:57:58.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:58.940+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:59.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:57:59.192+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:59.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:57:59.423+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:59.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:57:59.508+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:57:59.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:57:59.941+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:00.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:00.219+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:00.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:00.415+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:00.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:00.472+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:00.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:00.938+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:01.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:01.215+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:01.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:01.436+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:01.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:01.520+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:01.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:01.955+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:02.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:02.201+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:02.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:02.457+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:02.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:02.570+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:02.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:02.980+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:03.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:03.169+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:03.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:03.443+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:03.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:03.560+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:03.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:03.980+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:04.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:04.207+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:04.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:04.450+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:04.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:04.561+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:04.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:04.933+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:05.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:05.216+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:05.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:05.422+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:05.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:05.519+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:05.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:05.919+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:06.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:06.242+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:06.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:06.416+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:06.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:06.567+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:06.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:06.939+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:07.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:07.212+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:07.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:07.384+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:07.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:07.571+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:07.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:07.941+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:08.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:08.190+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:08.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:08.409+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:08.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:08.544+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:08.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:08.927+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:09.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:09.214+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:09.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:58:09.399 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:58:09.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:09.434+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:09.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:09.535+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:09.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:09.957+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:10.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:10.207+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:10.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:10.429+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:10.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:10.564+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:10.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:10.953+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:11.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:11.254+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:11.259 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:58:11.256+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:58:11.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:11.475+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:11.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:11.599+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:11.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:11.912+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:12.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:12.287+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:12.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:12.503+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:12.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:12.561+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:12.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:12.960+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:13.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:13.240+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:13.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:13.490+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:13.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:13.585+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:13.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:13.942+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:14.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:14.285+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:14.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:14.458+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:14.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:14.597+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:14.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:14.938+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:15.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:15.261+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:15.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:15.456+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:15.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:15.635+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:15.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:15.953+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:16.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:16.233+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:16.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:16.475+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:16.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:16.623+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:16.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:16.957+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:17.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:17.236+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:17.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:17.469+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:17.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:17.667+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:17.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:17.933+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:18.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:18.279+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:18.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:18.435+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:18.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:18.636+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:18.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:18.947+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:19.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:19.317+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:19.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:19.433+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:19.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:19.589+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:19.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:19.977+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:20.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:20.359+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:20.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:20.415+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:20.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:20.540+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:20.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:20.987+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:21.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:21.398+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:21.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:21.413+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:21.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:21.493+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:21.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:21.938+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:22.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:22.361+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:22.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:22.458+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:22.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:22.524+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:22.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:22.938+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:23.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:23.360+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:23.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:23.493+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:23.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:23.543+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:23.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:23.948+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:24.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:24.327+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:24.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:24.515+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:24.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:24.586+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:24.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:24.958+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:25.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:25.365+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:25.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:25.546+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:25.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:25.557+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:25.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:25.996+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:26.275 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:58:26.273+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:58:26.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:26.377+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:26.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:26.537+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:26.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:26.590+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:27.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:27.006+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:27.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:27.362+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:27.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:27.492+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:27.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:27.623+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:27.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:27.978+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:28.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:28.407+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:28.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:28.447+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:28.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:28.665+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:28.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:28.980+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:29.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:29.456+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:29.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:29.496+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:29.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:29.651+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:29.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:29.958+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:30.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:30.412+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:30.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:30.511+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:30.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:30.606+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:30.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:30.961+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:31.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:31.413+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:31.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:31.472+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:31.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:31.649+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:31.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:31.935+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:32.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:32.409+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:32.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:32.501+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:32.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:32.694+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:32.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:32.930+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:33.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:33.417+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:33.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:33.526+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:33.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:33.713+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:33.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:33.889+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:34.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:34.443+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:34.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:34.524+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:34.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:34.747+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:34.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:34.900+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:35.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:35.417+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:35.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:35.556+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:35.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:35.710+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:35.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:35.927+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:36.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:36.411+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:36.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:36.518+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:36.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:36.703+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:36.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:36.973+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:37.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:37.427+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:37.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:37.560+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:37.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:37.716+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:37.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:37.988+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:38.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:38.411+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:38.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:38.511+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:38.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:38.744+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:39.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:39.006+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:39.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:39.365+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:39.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:39.532+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:39.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:58:39.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:58:39.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:39.728+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:39.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:39.992+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:40.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:40.393+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:40.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:40.559+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:40.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:40.737+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:40.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:40.969+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:41.285 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:58:41.282+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:58:41.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:41.423+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:41.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:41.537+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:41.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:41.764+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:41.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:41.950+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:42.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:42.409+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:42.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:42.508+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:42.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:42.762+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:42.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:42.987+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:43.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:43.375+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:43.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:43.524+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:43.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:43.773+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:44.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:44.020+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:44.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:44.370+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:44.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:44.494+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:44.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:44.803+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:45.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:45.069+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:45.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:45.378+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:45.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:45.541+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:45.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:45.833+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:46.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:46.096+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:46.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:46.411+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:46.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:46.523+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:46.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:46.852+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:47.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:47.111+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:47.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:47.462+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:47.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:47.525+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:47.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:47.857+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:48.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:48.139+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:48.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:48.498+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:48.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:48.573+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:48.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:48.869+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:49.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:49.160+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:49.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:49.465+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:49.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:49.547+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:49.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:49.882+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:50.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:50.127+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:50.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:50.469+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:50.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:50.512+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:50.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:50.842+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:51.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:51.139+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:51.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:51.435+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:51.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:51.559+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:51.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:51.854+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:52.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:52.099+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:52.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:52.465+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:52.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:52.534+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:52.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:52.863+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:53.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:53.122+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:53.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:53.473+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:53.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:53.504+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:53.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:53.874+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:54.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:54.154+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:54.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:54.508+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:54.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:54.531+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:54.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:54.852+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:55.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:55.114+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:55.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:55.469+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:55.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:55.558+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:55.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:55.868+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:56.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:56.105+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:56.301 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:58:56.299+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:58:56.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:56.500+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:56.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:56.552+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:56.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:56.917+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:57.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:57.131+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:57.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:57.493+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:57.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:57.599+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:57.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:57.913+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:58.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:58.122+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:58.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:58.447+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:58.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:58.570+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:58.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:58.913+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:59.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:58:59.169+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:59.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:58:59.496+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:59.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:58:59.556+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:58:59.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:58:59.894+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:00.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:00.196+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:00.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:00.459+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:00.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:00.560+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:00.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:00.935+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:01.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:01.238+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:01.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:01.428+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:01.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:01.540+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:01.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:01.950+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:02.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:02.257+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:02.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:02.442+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:02.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:02.540+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:02.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:02.977+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:03.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:03.275+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:03.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:03.450+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:03.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:03.576+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:03.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:03.982+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:04.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:04.300+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:04.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:04.452+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:04.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:04.550+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:04.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:04.983+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:05.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:05.344+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:05.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:05.465+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:05.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:05.590+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:06.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:06.018+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:06.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:06.389+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:06.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:06.434+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:06.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:06.544+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:07.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:07.006+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:07.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:07.379+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:07.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:07.450+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:07.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:07.583+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:07.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:07.992+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:08.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:08.417+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:08.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:08.425+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:08.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:08.579+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:08.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:08.970+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:09.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:09.427+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:09.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:09.439+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:09.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:09.610+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:09.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:59:09.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:59:09.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:09.947+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:10.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:10.446+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:10.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:10.481+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:10.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:10.614+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:10.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:10.936+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:11.317 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:59:11.314+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:59:11.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:11.450+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:11.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:11.494+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:11.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:11.615+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:11.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:11.887+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:12.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:12.421+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:12.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:12.515+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:12.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:12.610+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:12.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:12.870+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:13.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:13.468+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:13.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:13.509+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:13.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:13.653+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:13.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:13.896+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:14.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:14.438+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:14.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:14.509+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:14.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:14.692+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:14.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:14.943+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:15.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:15.391+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:15.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:15.548+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:15.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:15.706+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:15.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:15.951+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:16.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:16.410+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:16.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:16.598+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:16.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:16.706+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:16.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:16.974+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:17.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:17.429+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:17.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:17.603+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:17.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:17.690+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:18.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:18.022+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:18.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:18.469+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:18.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:18.652+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:18.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:18.675+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:19.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:19.024+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:19.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:19.486+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:19.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:19.668+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:19.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:19.696+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:19.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:19.985+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:20.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:20.474+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:20.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:20.649+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:20.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:20.654+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:20.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:20.956+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:21.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:21.486+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:21.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:21.638+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:21.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:21.645+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:21.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:21.932+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:22.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:22.504+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:22.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:22.628+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:22.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:22.638+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:22.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:22.963+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:23.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:23.531+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:23.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:23.610+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:23.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:23.621+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:23.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:23.915+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:24.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:24.539+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:24.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:24.643+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:24.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:24.665+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:24.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:24.911+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:25.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:25.564+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:25.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:25.629+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:25.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:25.696+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:25.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:25.948+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:26.333 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:59:26.330+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:59:26.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:26.539+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:26.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:26.589+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:26.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:26.660+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:26.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:26.958+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:27.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:27.516+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:27.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:27.555+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:27.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:27.662+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:27.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:27.936+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:28.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:28.516+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:28.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:28.547+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:28.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:28.702+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:28.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:28.982+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:29.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:29.511+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:29.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:29.513+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:29.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:29.693+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:29.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:29.966+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:30.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:30.481+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:30.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:30.504+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:30.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:30.738+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:31.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:31.013+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:31.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:31.449+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:31.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:31.501+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:31.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:31.788+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:31.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:31.967+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:32.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:32.406+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:32.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:32.501+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:32.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:32.764+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:33.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:33.008+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:33.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:33.372+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:33.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:33.542+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:33.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:33.723+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:34.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:34.057+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:34.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:34.384+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:34.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:34.587+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:34.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:34.764+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:35.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:35.054+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:35.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:35.403+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:35.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:35.546+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:35.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:35.756+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:36.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:36.049+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:36.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:36.359+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:36.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:36.593+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:36.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:36.723+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:37.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:37.096+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:37.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:37.357+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:37.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:37.589+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:37.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:37.713+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:38.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:38.073+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:38.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:38.324+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:38.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:38.556+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:38.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:38.737+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:39.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:39.088+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:39.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:39.301+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:39.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:39.593+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:39.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:39.721+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:39.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:59:39.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T00:59:40.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:40.125+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:40.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:40.349+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:40.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:40.565+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:40.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:40.740+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:41.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:41.157+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:41.348 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:59:41.346+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:59:41.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:41.347+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:41.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:41.587+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:41.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:41.708+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:42.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:42.165+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:42.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:42.379+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:42.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:42.564+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:42.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:42.725+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:43.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:43.185+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:43.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:43.401+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:43.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:43.539+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:43.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:43.712+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:44.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:44.150+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:44.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:44.374+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:44.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:44.541+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:44.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:44.743+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:45.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:45.109+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:45.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:45.384+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:45.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:45.543+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:45.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:45.792+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:46.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:46.120+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:46.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:46.365+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:46.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:46.523+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:46.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:46.750+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:47.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:47.111+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:47.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:47.372+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:47.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:47.557+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:47.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:47.733+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:48.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:48.150+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:48.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:48.413+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:48.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:48.552+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:48.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:48.731+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:49.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:49.124+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:49.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:49.395+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:49.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:49.504+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:49.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:49.700+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:50.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:50.134+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:50.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:50.351+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:50.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:50.518+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:50.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:50.678+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:51.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:51.087+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:51.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:51.357+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:51.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:51.545+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:51.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:51.683+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:52.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:52.089+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:52.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:52.333+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:52.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:52.574+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:52.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:52.665+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:53.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:53.110+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:53.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:53.323+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:53.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:53.527+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:53.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:53.668+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:54.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:54.079+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:54.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:54.371+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:54.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:54.515+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:54.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:54.702+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:55.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:55.036+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:55.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:55.410+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:55.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:55.488+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:55.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:55.677+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:56.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:56.017+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:56.365 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T00:59:56.362+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T00:59:56.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:56.381+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:56.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:56.515+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:56.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:56.675+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:56.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:56.968+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:57.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:57.342+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:57.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:57.549+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:57.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:57.635+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:57.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:57.950+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:58.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:58.339+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:58.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:58.524+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:58.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:58.634+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:58.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:58.978+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:59.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T00:59:59.300+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:59.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T00:59:59.513+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:59.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T00:59:59.592+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T00:59:59.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T00:59:59.944+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:00.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:00.267+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:00.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:00.510+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:00.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:00.603+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:00.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:00.952+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:01.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:01.263+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:01.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:01.556+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:01.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:01.642+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:01.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:01.980+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:02.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:02.268+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:02.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:02.582+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:02.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:02.645+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:03.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:03.013+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:03.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:03.291+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:03.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:03.577+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:03.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:03.687+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:04.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:04.044+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:04.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:04.274+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:04.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:04.609+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:04.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:04.694+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:05.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:05.078+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:05.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:05.248+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:05.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:05.599+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:05.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:05.732+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:06.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:06.041+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:06.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:06.295+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:06.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:06.598+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:06.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:06.752+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:07.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:07.072+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:07.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:07.307+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:07.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:07.592+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:07.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:07.790+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:08.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:08.029+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:08.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:08.295+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:08.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:08.626+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:08.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:08.745+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:08.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:08.982+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:09.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:09.306+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:09.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:09.624+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:09.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:09.756+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:09.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:00:09.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:00:09.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:09.977+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:10.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:10.322+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:10.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:10.654+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:10.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:10.744+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:10.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:10.931+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:11.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:11.305+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:11.381 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:00:11.379+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:00:11.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:11.663+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:11.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:11.754+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:11.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:11.892+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:12.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:12.333+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:12.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:12.620+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:12.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:12.786+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:12.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:12.922+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:13.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:13.344+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:13.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:13.627+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:13.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:13.759+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:13.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:13.874+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:14.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:14.300+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:14.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:14.584+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:14.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:14.780+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:14.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:14.912+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:15.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:15.326+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:15.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:15.580+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:15.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:15.807+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:15.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:15.944+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:16.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:16.321+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:16.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:16.549+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:16.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:16.842+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:16.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:16.958+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:17.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:17.299+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:17.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:17.572+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:17.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:17.794+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:17.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:17.939+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:18.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:18.286+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:18.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:18.621+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:18.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:18.766+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:18.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:18.914+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:19.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:19.247+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:19.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:19.648+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:19.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:19.720+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:19.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:19.915+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:20.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:20.284+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:20.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:20.643+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:20.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:20.729+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:20.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:20.918+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:21.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:21.281+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:21.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:21.622+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:21.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:21.680+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:21.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:21.955+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:22.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:22.290+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:22.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:22.646+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:22.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:22.683+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:22.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:22.909+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:23.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:23.280+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:23.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:23.636+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:23.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:23.643+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:23.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:23.881+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:24.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:24.254+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:24.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:24.626+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:24.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:24.681+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:24.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:24.871+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:25.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:25.298+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:25.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:25.652+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:25.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:25.716+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:25.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:25.823+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:26.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:26.266+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:26.397 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:00:26.394+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:00:26.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:26.603+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:26.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:26.721+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:26.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:26.792+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:27.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:27.311+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:27.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:27.581+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:27.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:27.764+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:27.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:27.796+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:28.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:28.355+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:28.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:28.578+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:28.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:28.738+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:28.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:28.797+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:29.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:29.405+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:29.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:29.563+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:29.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:29.739+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:29.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:29.843+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:30.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:30.366+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:30.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:30.597+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:30.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:30.714+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:30.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:30.800+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:31.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:31.333+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:31.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:31.566+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:31.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:31.752+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:31.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:31.760+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:32.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:32.308+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:32.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:32.558+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:32.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:32.714+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:32.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:32.788+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:33.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:33.356+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:33.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:33.561+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:33.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:33.724+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:33.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:33.778+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:34.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:34.371+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:34.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:34.557+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:34.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:34.720+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:34.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:34.810+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:35.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:35.388+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:35.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:35.531+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:35.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:35.715+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:35.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:35.793+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:36.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:36.373+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:36.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:36.532+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:36.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:36.706+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:36.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:36.838+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:37.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:37.377+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:37.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:37.527+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:37.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:37.686+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:37.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:37.847+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:38.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:38.408+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:38.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:38.564+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:38.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:38.672+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:38.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:38.871+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:39.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:39.438+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:39.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:39.523+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:39.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:39.632+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:39.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:39.885+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:40.078 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:00:40.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:00:40.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:40.472+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:40.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:40.532+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:40.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:40.656+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:40.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:40.924+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:41.412 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:00:41.410+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:00:41.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:41.431+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:41.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:41.501+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:41.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:41.647+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:41.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:41.904+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:42.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:42.438+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:42.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:42.545+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:42.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:42.668+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:42.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:42.942+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:43.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:43.484+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:43.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:43.505+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:43.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:43.623+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:43.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:43.902+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:44.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:44.456+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:44.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:44.544+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:44.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:44.647+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:44.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:44.904+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:45.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:45.425+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:45.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:45.534+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:45.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:45.666+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:45.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:45.881+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:46.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:46.438+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:46.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:46.538+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:46.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:46.688+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:46.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:46.854+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:47.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:47.464+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:47.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:47.529+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:47.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:47.718+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:47.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:47.853+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:48.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:48.480+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:48.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:48.538+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:48.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:48.737+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:48.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:48.833+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:49.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:49.505+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:49.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:49.549+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:49.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:49.727+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:49.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:49.832+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:50.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:50.487+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:50.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:50.535+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:50.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:50.759+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:50.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:50.861+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:51.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:51.482+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:51.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:51.530+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:51.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:51.808+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:51.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:51.874+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:52.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:52.507+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:52.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:52.512+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:52.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:52.811+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:52.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:52.865+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:53.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:53.492+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:53.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:53.541+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:53.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:53.818+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:53.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:53.845+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:54.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:54.523+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:54.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:54.550+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:54.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:54.778+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:54.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:54.882+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:55.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:55.550+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:55.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:55.571+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:55.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:55.740+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:55.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:55.835+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:56.428 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:00:56.425+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:00:56.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:56.550+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:56.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:56.581+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:56.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:56.724+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:56.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:56.871+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:57.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:57.557+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:57.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:57.631+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:57.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:57.766+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:57.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:57.910+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 16 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:58.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:58.603+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:58.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:58.611+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:58.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:58.798+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:58.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:58.902+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:59.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:00:59.574+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:59.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:00:59.660+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:59.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:00:59.764+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:00:59.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:00:59.854+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:00.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:00.557+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:00.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:00.672+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:00.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:00.739+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:00.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:00.825+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:01.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:01.519+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:01.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:01.676+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:01.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:01.770+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:01.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:01.854+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:02.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:02.487+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:02.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:02.699+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:02.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:02.766+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:02.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:02.807+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:03.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:03.457+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:03.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:03.673+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:03.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:03.728+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:03.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:03.785+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:04.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:04.478+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:04.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:04.667+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:04.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:04.755+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:04.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:04.816+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:05.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:05.450+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:05.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:05.650+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:05.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:05.705+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:05.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:05.838+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:06.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:06.420+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:06.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:06.616+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:06.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:06.730+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:06.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:06.837+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:07.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:07.420+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:07.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:07.598+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:07.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:07.747+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:07.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:07.851+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:08.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:08.406+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:08.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:08.618+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:08.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:08.750+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:08.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:08.804+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:09.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:09.405+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:09.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:09.601+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:09.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:09.781+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:09.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:09.799+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:10.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:01:10.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:01:10.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:10.438+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:10.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:10.625+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:10.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:10.773+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:10.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:10.843+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:11.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:11.414+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:11.444 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:01:11.442+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:01:11.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:11.604+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:11.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:11.795+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:11.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:11.854+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:12.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:12.448+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:12.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:12.632+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:12.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:12.800+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:12.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:12.836+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:13.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:13.482+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:13.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:13.670+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:13.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:13.759+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:13.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:13.864+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:14.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:14.518+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:14.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:14.705+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:14.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:14.724+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:14.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:14.846+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:15.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:15.511+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:15.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:15.699+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:15.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:15.708+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:15.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:15.870+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:16.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:16.553+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:16.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:16.678+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:16.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:16.705+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:16.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:16.842+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:17.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:17.590+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:17.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:17.727+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:17.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:17.734+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:17.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:17.880+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:18.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:18.604+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:18.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:18.692+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:18.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:18.767+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:18.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:18.846+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:19.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:19.635+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:19.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:19.720+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:19.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:19.790+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:19.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:19.828+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:20.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:20.592+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:20.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:20.678+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:20.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:20.785+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:20.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:20.800+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:21.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:21.542+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:21.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:21.716+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:21.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:21.754+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:21.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:21.783+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:22.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:22.577+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:22.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:22.758+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:22.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:22.776+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:22.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:22.834+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:23.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:23.571+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:23.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:23.749+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:23.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:23.796+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:23.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:23.877+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:24.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:24.539+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:24.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:24.749+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:24.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:24.787+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:24.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:24.922+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:25.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:25.498+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:25.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:25.789+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:25.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:25.790+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:25.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:25.883+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:26.460 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:01:26.459+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:01:26.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:26.538+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:26.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:26.751+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:26.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:26.798+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:26.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:26.914+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:27.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:27.496+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:27.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:27.732+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:27.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:27.846+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:27.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:27.896+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:28.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:28.514+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:28.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:28.739+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:28.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:28.875+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:28.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:28.903+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:29.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:29.465+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:29.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:29.761+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:29.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:29.855+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:29.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:29.937+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:30.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:30.454+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:30.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:30.758+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:30.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:30.863+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:30.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:30.940+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:31.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:31.495+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:31.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:31.716+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:31.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:31.840+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:31.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:31.894+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:32.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:32.474+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:32.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:32.720+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:32.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:32.856+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:32.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:32.898+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:33.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:33.474+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:33.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:33.740+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:33.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:33.863+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:33.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:33.911+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:34.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:34.436+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:34.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:34.729+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:34.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:34.912+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:34.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:34.950+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:35.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:35.387+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:35.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:35.692+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:35.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:35.928+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:35.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:35.970+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:36.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:36.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:36.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:36.718+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:36.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:36.945+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:36.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:36.968+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:37.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:37.321+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:37.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:37.705+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:37.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:37.938+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:37.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:37.986+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:38.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:38.336+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:38.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:38.683+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:38.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:38.923+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:38.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:38.971+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:39.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:39.341+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:39.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:39.635+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:39.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:39.916+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:39.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:39.930+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:40.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:40.312+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:40.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:01:40.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:01:40.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:40.610+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:40.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:40.883+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:40.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:40.923+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:41.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:41.294+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:41.476 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:01:41.474+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:01:41.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:41.617+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:41.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:41.843+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:41.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:41.936+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:42.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:42.322+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:42.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:42.656+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:42.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:42.822+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:42.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:42.923+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:43.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:43.300+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:43.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:43.635+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:43.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:43.825+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:43.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:43.928+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:44.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:44.331+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:44.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:44.591+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:44.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:44.865+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:44.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:44.971+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:45.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:45.334+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:45.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:45.641+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:45.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:45.831+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:46.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:46.010+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:46.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:46.324+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:46.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:46.606+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:46.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:46.828+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:47.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:47.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:47.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:47.297+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:47.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:47.598+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:47.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:47.839+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:48.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:48.028+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:48.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:48.328+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:48.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:48.643+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:48.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:48.835+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:49.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:49.074+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:49.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:49.302+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:49.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:49.643+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:49.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:49.787+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:50.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:50.055+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:50.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:50.283+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:50.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:50.608+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:50.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:50.754+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:51.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:51.101+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:51.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:51.315+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:51.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:51.586+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:51.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:51.751+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:52.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:52.080+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:52.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:52.315+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:52.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:52.591+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:52.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:52.727+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:53.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:53.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:53.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:53.328+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:53.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:53.628+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:53.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:53.751+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:54.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:54.019+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:54.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:54.341+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:54.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:54.621+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:54.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:54.781+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:55.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:55.023+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:55.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:55.341+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:55.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:55.650+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:55.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:55.812+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:56.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:56.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:56.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:56.365+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:56.492 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:01:56.490+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:01:56.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:56.619+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:56.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:56.861+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:57.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:57.001+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:57.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:57.354+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:57.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:57.616+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:57.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:57.907+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:58.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:58.014+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:58.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:58.358+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:58.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:58.618+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:58.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:58.897+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:58.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:58.979+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:59.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:01:59.327+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:59.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:01:59.640+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:59.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:01:59.894+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:01:59.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:01:59.939+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:00.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:00.344+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:00.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:00.679+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:00.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:00.918+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:00.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:00.922+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:01.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:01.377+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:01.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:01.692+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:01.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:01.914+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:01.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:01.956+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:02.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:02.379+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:02.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:02.646+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:02.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:02.899+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:02.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:02.929+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:03.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:03.427+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:03.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:03.696+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:03.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:03.881+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:03.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:03.889+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:04.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:04.424+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:04.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:04.677+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:04.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:04.839+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:04.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:04.868+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:05.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:05.445+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:05.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:05.635+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:05.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:05.850+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:05.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:05.874+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:06.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:06.411+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:06.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:06.633+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:06.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:06.804+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:06.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:06.859+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:07.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:07.365+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:07.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:07.606+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:07.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:07.785+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:07.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:07.878+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:08.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:08.334+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:08.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:08.653+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:08.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:08.801+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:08.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:08.915+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:09.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:09.329+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:09.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:09.659+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:09.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:09.833+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:09.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:09.961+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:10.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:10.344+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:10.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:02:10.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:02:10.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:10.656+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:10.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:10.794+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:11.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:11.008+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:11.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:11.301+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:11.500 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:02:11.498+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:02:11.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:11.635+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:11.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:11.771+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:12.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:12.057+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:12.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:12.323+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:12.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:12.622+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:12.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:12.770+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:13.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:13.040+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:13.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:13.307+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:13.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:13.578+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:13.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:13.791+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:14.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:14.079+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:14.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:14.333+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:14.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:14.541+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:14.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:14.809+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:15.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:15.054+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:15.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:15.291+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:15.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:15.585+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:15.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:15.836+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:16.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:16.076+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:16.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:16.263+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:16.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:16.619+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:16.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:16.878+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:17.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:17.052+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:17.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:17.310+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:17.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:17.646+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:17.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:17.838+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:18.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:18.031+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:18.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:18.319+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:18.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:18.690+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:18.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:18.799+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:19.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:19.028+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:19.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:19.304+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:19.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:19.667+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:19.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:19.813+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:19.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:19.996+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:20.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:20.346+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:20.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:20.646+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:20.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:20.818+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:21.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:21.011+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:21.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:21.325+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:21.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:21.656+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:21.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:21.781+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:22.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:22.044+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:22.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:22.313+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:22.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:22.666+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:22.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:22.786+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:23.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:23.079+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:23.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:23.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:23.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:23.641+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:23.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:23.796+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:24.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:24.047+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:24.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:24.333+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:24.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:24.612+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:24.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:24.845+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:25.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:25.052+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:25.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:25.372+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:25.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:25.607+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:25.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:25.895+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:26.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:26.026+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:26.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:26.349+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:26.516 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:02:26.513+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:02:26.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:26.604+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:26.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:26.867+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:27.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:27.017+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:27.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:27.339+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:27.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:27.653+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:27.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:27.824+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:28.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:28.021+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:28.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:28.374+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:28.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:28.658+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:28.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:28.839+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:29.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:29.027+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:29.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:29.406+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:29.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:29.671+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:29.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:29.823+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:30.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:30.018+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:30.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:30.399+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:30.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:30.684+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:30.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:30.799+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:30.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:30.976+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:31.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:31.407+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:31.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:31.646+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:31.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:31.818+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:31.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:31.993+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:32.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:32.433+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:32.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:32.659+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:32.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:32.819+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:32.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:32.986+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:33.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:33.387+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:33.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:33.657+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:33.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:33.831+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:33.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:33.960+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:34.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:34.392+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:34.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:34.688+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:34.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:34.840+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:34.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:34.997+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:35.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:35.412+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:35.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:35.665+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:35.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:35.852+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:36.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:36.010+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:36.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:36.411+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:36.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:36.698+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:36.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:36.874+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:37.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:37.053+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:37.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:37.385+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:37.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:37.688+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:37.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:37.826+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:38.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:38.021+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:38.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:38.386+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:38.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:38.714+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:38.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:38.808+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:39.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:39.007+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:39.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:39.369+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:39.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:39.741+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:39.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:39.787+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:40.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:40.017+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:40.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:40.420+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:40.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:02:40.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:02:40.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:40.702+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:40.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:40.754+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:41.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:41.026+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:41.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:41.375+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:41.532 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:02:41.530+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:02:41.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:41.724+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:41.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:41.747+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:42.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:42.004+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:42.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:42.376+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:42.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:42.679+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:42.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:42.708+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:43.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:43.002+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:43.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:43.386+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:43.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:43.654+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:43.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:43.684+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:44.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:44.008+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:44.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:44.350+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:44.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:44.701+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:44.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:44.735+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:44.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:44.967+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:45.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:45.330+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:45.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:45.672+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:45.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:45.697+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:45.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:45.962+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:46.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:46.348+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:46.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:46.688+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:46.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:46.742+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:46.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:46.931+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:47.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:47.386+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:47.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:47.692+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:47.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:47.707+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:47.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:47.918+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:48.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:48.349+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:48.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:48.737+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:48.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:48.745+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:48.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:48.884+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:49.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:49.395+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:49.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:49.768+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:49.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:49.778+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:49.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:49.850+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:50.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:50.347+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:50.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:50.751+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:50.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:50.760+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:50.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:50.832+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:51.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:51.302+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:51.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:51.764+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:51.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:51.778+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:51.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:51.787+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:52.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:52.274+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:52.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:52.754+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:52.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:52.781+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:52.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:52.821+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:53.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:53.274+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:53.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:53.754+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:53.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:53.786+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:53.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:53.827+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:54.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:54.281+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:54.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:54.768+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:54.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:54.797+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:54.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:54.821+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:55.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:55.258+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:55.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:55.775+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:55.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:55.817+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:55.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:55.819+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:56.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:56.247+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:56.547 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:02:56.545+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:02:56.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:56.795+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:56.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:56.809+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:56.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:56.813+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:57.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:57.208+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:57.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:57.796+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:57.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:57.802+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:57.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:57.854+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:58.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:58.202+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:58.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:58.775+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:58.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:58.796+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:58.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:58.823+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:59.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:02:59.202+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:59.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:02:59.781+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:59.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:02:59.787+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:02:59.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:02:59.871+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:00.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:00.169+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:00.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:00.780+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:00.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:00.824+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:00.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:00.863+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:01.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:01.169+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:01.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:01.815+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:01.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:01.835+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:01.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:01.872+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:02.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:02.211+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:02.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:02.834+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:02.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:02.845+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:02.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:02.876+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:03.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:03.213+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:03.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:03.786+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:03.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:03.848+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:03.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:03.915+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:04.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:04.176+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:04.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:04.826+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:04.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:04.835+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:04.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:04.883+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:05.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:05.140+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:05.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:05.824+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:05.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:05.829+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:05.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:05.903+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:06.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:06.129+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:06.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:06.783+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:06.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:06.844+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:06.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:06.909+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:07.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:07.096+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:07.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:07.782+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:07.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:07.858+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:07.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:07.949+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:08.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:08.081+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:08.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:08.757+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:08.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:08.831+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:08.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:08.947+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:09.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:09.100+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:09.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:09.793+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:09.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:09.799+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:09.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:09.948+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:10.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:10.070+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:10.643 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:03:10.647 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:03:10.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:10.775+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:10.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:10.804+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:10.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:10.908+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:11.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:11.110+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:11.563 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:03:11.562+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:03:11.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:11.741+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:11.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:11.827+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:11.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:11.877+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:12.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:12.157+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:12.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:12.763+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:12.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:12.819+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:12.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:12.865+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:13.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:13.162+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:13.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:13.727+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:13.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:13.826+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:13.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:13.857+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:14.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:14.126+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:14.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:14.696+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:14.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:14.874+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:14.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:14.906+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:15.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:15.166+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:15.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:15.742+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:15.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:15.920+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:15.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:15.939+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:16.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:16.133+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:16.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:16.755+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:16.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:16.909+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:16.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:16.989+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:17.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:17.163+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:17.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:17.766+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:17.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:17.923+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:18.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:18.023+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:18.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:18.145+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:18.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:18.727+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:18.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:18.972+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:19.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:19.037+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:19.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:19.166+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:19.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:19.738+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:19.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:19.938+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:20.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:20.016+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:20.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:20.188+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:20.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:20.713+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:20.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:20.987+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:20.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:20.994+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:21.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:21.236+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:21.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:21.694+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:21.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:21.980+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:22.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:22.003+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:22.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:22.195+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:22.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:22.656+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:23.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:22.999+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:23.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:23.002+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:23.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:23.190+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:23.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:23.635+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:23.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:23.979+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:24.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:24.013+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:24.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:24.160+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:24.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:24.654+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:24.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:24.987+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:25.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:25.035+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:25.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:25.159+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:25.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:25.641+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:25.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:25.990+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:26.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:26.066+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:26.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:26.166+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:26.575 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:03:26.573+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:03:26.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:26.638+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:26.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:26.969+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:27.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:27.028+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:27.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:27.141+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:27.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:27.679+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:27.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:27.954+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:28.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:28.027+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:28.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:28.180+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:28.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:28.695+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:28.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:28.907+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:29.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:29.022+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:29.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:29.196+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:29.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:29.732+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:29.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:29.933+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:30.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:30.051+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:30.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:30.202+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:30.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:30.720+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:30.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:30.925+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:31.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:31.047+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:31.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:31.236+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:31.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:31.740+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:31.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:31.932+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:32.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:32.038+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:32.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:32.238+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:32.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:32.781+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:32.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:32.891+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:33.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:33.006+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:33.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:33.228+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:33.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:33.829+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:33.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:33.873+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:33.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:33.957+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:34.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:34.196+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:34.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:34.843+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:34.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:34.864+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:34.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:34.949+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:35.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:35.183+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:35.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:35.840+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:35.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:35.909+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:35.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:35.980+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:36.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:36.198+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:36.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:36.799+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:36.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:36.933+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:36.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:36.997+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:37.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:37.187+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:37.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:37.792+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:37.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:37.965+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:38.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:38.029+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:38.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:38.222+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:38.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:38.785+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:38.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:38.977+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:39.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:39.042+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:39.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:39.270+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:39.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:39.753+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:40.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:40.007+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:40.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:40.036+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:40.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:40.294+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:40.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:03:40.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:03:40.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:40.755+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:40.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:40.993+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:41.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:40.998+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:41.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:41.320+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:41.591 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:03:41.589+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:03:41.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:41.796+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:41.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:41.995+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:42.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:41.999+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:42.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:42.347+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:42.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:42.781+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:42.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:42.982+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:42.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:42.994+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:43.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:43.305+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:43.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:43.753+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:43.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:43.991+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:44.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:44.039+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:44.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:44.259+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:44.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:44.748+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:44.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:44.996+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:45.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:45.014+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:45.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:45.282+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:45.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:45.722+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:45.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:45.970+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:45.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:45.993+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:46.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:46.264+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:46.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:46.744+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:47.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:47.016+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:47.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:47.019+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:47.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:47.253+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:47.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:47.755+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:47.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:47.987+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:48.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:48.019+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:48.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:48.212+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:48.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:48.791+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:49.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:49.003+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:49.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:49.069+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:49.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:49.210+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:49.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:49.803+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:50.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:50.027+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:50.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:50.115+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:50.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:50.235+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:50.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:50.817+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:51.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:51.019+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:51.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:51.149+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:51.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:51.251+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:51.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:51.817+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:51.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:51.992+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:52.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:52.184+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:52.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:52.248+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:52.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:52.840+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:52.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:52.997+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:53.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:53.138+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:53.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:53.228+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:53.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:53.831+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:53.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:53.981+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:54.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:54.162+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:54.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:54.181+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:54.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:54.789+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:55.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:55.019+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:55.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:55.179+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:55.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:55.180+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:55.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:55.824+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:56.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:56.022+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:56.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:56.149+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:56.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:56.206+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:56.607 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:03:56.604+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:03:56.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:56.840+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:57.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:57.036+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:57.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:57.163+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:57.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:57.218+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:57.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:57.890+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:58.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:58.008+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:58.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:58.122+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:58.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:58.237+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:58.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:58.850+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:59.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:03:59.052+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:59.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:03:59.114+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:59.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:03:59.243+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:03:59.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:03:59.873+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:00.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:00.021+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:00.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:00.122+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:00.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:00.207+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:00.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:00.852+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:01.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:01.022+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:01.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:01.107+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:01.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:01.208+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:01.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:01.878+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:02.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:02.063+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:02.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:02.150+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:02.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:02.216+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:02.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:02.834+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:03.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:03.050+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:03.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:03.102+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:03.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:03.220+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:03.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:03.799+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:04.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:04.088+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:04.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:04.094+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:04.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:04.264+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:04.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:04.836+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:05.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:05.077+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:05.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:05.090+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:05.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:05.256+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:05.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:05.853+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:06.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:06.029+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:06.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:06.131+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:06.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:06.252+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:06.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:06.816+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:07.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:06.999+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:07.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:07.090+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:07.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:07.226+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:07.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:07.788+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:07.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:07.953+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:08.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:08.071+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:08.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:08.258+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:08.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:08.823+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:08.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:08.943+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:09.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:09.068+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:09.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:09.210+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:09.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:09.803+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:09.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:09.982+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:10.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:10.100+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:10.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:10.209+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:10.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:10.785+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:10.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:04:10.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:04:10.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:10.951+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:11.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:11.059+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:11.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:11.243+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:11.610 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:04:11.608+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:04:11.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:11.746+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:11.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:11.994+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:12.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:12.101+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:12.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:12.279+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:12.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:12.749+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:12.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:12.980+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:13.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:13.125+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:13.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:13.279+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:13.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:13.746+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:13.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:13.989+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:14.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:14.142+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:14.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:14.327+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:14.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:14.753+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:14.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:14.984+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:15.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:15.134+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:15.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:15.278+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:15.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:15.762+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:15.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:15.953+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:16.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:16.133+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:16.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:16.289+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:16.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:16.759+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:16.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:16.989+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:17.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:17.156+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:17.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:17.253+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:17.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:17.758+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:18.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:18.038+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:18.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:18.190+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:18.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:18.272+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:18.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:18.789+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:19.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:19.025+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:19.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:19.212+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:19.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:19.288+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:19.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:19.785+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:20.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:20.008+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:20.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:20.198+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:20.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:20.300+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:20.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:20.800+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:21.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:21.019+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:21.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:21.193+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:21.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:21.297+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:21.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:21.815+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:22.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:22.055+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:22.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:22.188+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:22.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:22.290+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:22.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:22.768+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:23.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:23.069+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:23.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:23.209+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:23.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:23.243+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:23.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:23.813+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:24.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:24.050+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:24.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:24.189+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:24.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:24.282+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:24.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:24.788+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:25.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:25.079+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:25.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:25.184+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:25.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:25.259+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:25.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:25.817+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:26.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:26.056+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:26.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:26.193+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:26.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:26.282+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:26.614 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:04:26.613+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:04:26.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:26.848+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:27.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:27.008+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:27.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:27.186+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:27.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:27.251+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:27.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:27.884+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:28.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:28.015+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:28.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:28.221+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:28.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:28.260+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:28.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:28.900+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:28.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:28.970+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:29.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:29.179+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:29.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:29.212+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:29.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:29.876+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:30.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:29.998+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:30.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:30.215+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:30.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:30.216+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:30.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:30.888+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:30.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:30.967+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:31.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:31.189+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:31.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:31.228+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:31.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:31.909+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:32.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:32.008+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:32.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:32.212+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:32.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:32.227+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:32.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:32.860+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:33.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:33.054+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:33.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:33.168+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:33.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:33.245+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:33.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:33.899+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:34.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:34.026+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:34.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:34.179+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:34.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:34.225+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:34.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:34.943+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:35.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:35.002+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:35.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:35.190+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:35.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:35.213+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:35.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:35.991+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:36.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:36.015+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:36.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:36.234+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:36.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:36.254+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:36.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:36.944+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:37.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:37.028+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:37.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:37.211+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:37.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:37.216+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:37.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:37.989+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:38.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:38.026+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:38.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:38.168+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:38.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:38.248+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:39.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:39.011+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:39.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:39.068+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:39.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:39.141+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:39.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:39.215+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:40.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:40.038+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:40.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:40.073+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:40.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:40.110+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:40.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:40.252+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:41.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:04:41.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:04:41.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:41.075+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:41.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:41.094+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:41.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:41.124+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:41.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:41.281+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:41.630 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:04:41.627+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:04:42.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:42.043+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:42.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:42.125+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:42.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:42.133+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:42.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:42.317+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:43.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:43.020+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:43.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:43.107+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:43.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:43.154+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:43.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:43.269+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:43.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:43.991+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:44.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:44.063+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:44.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:44.165+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:44.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:44.318+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:44.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:44.961+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:45.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:45.105+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:45.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:45.163+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:45.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:45.363+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:46.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:46.002+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:46.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:46.120+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:46.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:46.187+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:46.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:46.342+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:47.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:47.009+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:47.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:47.123+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:47.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:47.148+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:47.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:47.367+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:47.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:47.973+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:48.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:48.151+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:48.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:48.169+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:48.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:48.355+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:48.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:48.968+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:49.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:49.108+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:49.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:49.178+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:49.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:49.388+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:50.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:50.005+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:50.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:50.062+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:50.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:50.219+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:50.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:50.410+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:51.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:51.013+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:51.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:51.069+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:51.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:51.189+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:51.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:51.406+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:52.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:52.024+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:52.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:52.068+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:52.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:52.145+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:52.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:52.384+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:53.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:53.030+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:53.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:53.065+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:53.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:53.157+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:53.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:53.357+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:54.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:54.013+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:54.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:54.020+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:54.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:54.163+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:54.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:54.341+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:54.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:54.991+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:55.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:55.022+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:55.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:55.135+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:55.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:55.341+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:55.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:55.967+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:55.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:55.982+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:56.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:56.173+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:56.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:56.374+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:56.633 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:04:56.631+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:04:56.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:56.920+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:57.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:57.022+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:57.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:57.208+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:57.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:57.386+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:57.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:57.894+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:58.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:58.024+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:58.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:58.212+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:58.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:58.431+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:58.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:58.925+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:59.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:04:59.049+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:59.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:04:59.246+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:59.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:04:59.439+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:04:59.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:04:59.934+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:00.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:00.097+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:00.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:00.244+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:00.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:00.440+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:00.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:00.983+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:01.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:01.074+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:01.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:01.252+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:01.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:01.448+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:01.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:01.936+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:02.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:02.056+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:02.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:02.298+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:02.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:02.415+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:02.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:02.975+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:03.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:03.057+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:03.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:03.249+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:03.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:03.410+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:03.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:03.928+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:04.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:04.053+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:04.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:04.222+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:04.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:04.415+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:04.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:04.969+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:05.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:05.051+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:05.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:05.245+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:05.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:05.422+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:05.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:05.997+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:06.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:06.061+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:06.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:06.256+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:06.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:06.396+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:07.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:07.037+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:07.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:07.073+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:07.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:07.280+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:07.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:07.413+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:08.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:08.044+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:08.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:08.075+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:08.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:08.310+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:08.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:08.374+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:08.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:08.997+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:09.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:09.042+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:09.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:09.304+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:09.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:09.376+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:09.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:09.985+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:10.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:10.077+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:10.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:10.299+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:10.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:10.335+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:11.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:11.013+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:11.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:11.041+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:11.113 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:05:11.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:05:11.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:11.290+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:11.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:11.338+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:11.648 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:05:11.646+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:05:12.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:12.017+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:12.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:12.070+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:12.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:12.294+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:12.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:12.305+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:13.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:13.041+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:13.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:13.042+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:13.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:13.295+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:13.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:13.311+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:14.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:14.026+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:14.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:14.066+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:14.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:14.273+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:14.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:14.321+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:15.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:15.033+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:15.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:15.084+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:15.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:15.306+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:15.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:15.311+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:16.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:16.069+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:16.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:16.134+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:16.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:16.284+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:16.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:16.343+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:17.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:17.020+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:17.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:17.160+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:17.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:17.238+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:17.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:17.346+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:18.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:18.024+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:18.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:18.193+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:18.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:18.283+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:18.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:18.393+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:19.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:19.025+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:19.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:19.163+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:19.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:19.326+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:19.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:19.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:20.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:20.019+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:20.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:20.194+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:20.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:20.343+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:20.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:20.350+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:21.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:21.021+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:21.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:21.147+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:21.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:21.315+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:21.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:21.316+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:22.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:22.045+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:22.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:22.191+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:22.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:22.296+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:22.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:22.319+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:23.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:23.084+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:23.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:23.190+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:23.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:23.305+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:23.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:23.309+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:24.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:24.051+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:24.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:24.227+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:24.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:24.342+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:24.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:24.344+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:25.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:25.047+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:25.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:25.214+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:25.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:25.326+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:25.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:25.375+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:26.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:26.091+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:26.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:26.173+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:26.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:26.364+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:26.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:26.367+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:26.664 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:05:26.662+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:05:27.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:27.118+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:27.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:27.139+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:27.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:27.365+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:27.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:27.371+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:28.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:28.138+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:28.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:28.142+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:28.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:28.353+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:28.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:28.384+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:29.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:29.142+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:29.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:29.161+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:29.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:29.372+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:29.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:29.398+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:30.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:30.126+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:30.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:30.180+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:30.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:30.378+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:30.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:30.398+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:31.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:31.102+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:31.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:31.155+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:31.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:31.400+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:31.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:31.409+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:32.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:32.107+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:32.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:32.113+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:32.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:32.380+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:32.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:32.420+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:33.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:33.071+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:33.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:33.072+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:33.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:33.388+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:33.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:33.420+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:34.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:34.060+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:34.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:34.060+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:34.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:34.365+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:34.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:34.377+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:35.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:35.054+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:35.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:35.076+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:35.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:35.401+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:35.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:35.409+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:36.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:36.047+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:36.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:36.117+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:36.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:36.386+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:36.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:36.447+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:37.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:37.051+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:37.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:37.113+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:37.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:37.368+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:37.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:37.448+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:38.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:38.088+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:38.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:38.155+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:38.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:38.415+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:38.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:38.447+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:39.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:39.088+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:39.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:39.137+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:39.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:39.366+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:39.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:39.425+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:40.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:40.062+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:40.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:40.102+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:40.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:40.395+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:40.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:40.405+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:41.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:41.080+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:41.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:41.101+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:41.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:05:41.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:05:41.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:41.404+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:41.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:41.444+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:41.680 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:05:41.679+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:05:42.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:42.075+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:42.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:42.084+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:42.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:42.395+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:42.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:42.443+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:43.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:43.096+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:43.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:43.125+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:43.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:43.351+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:43.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:43.408+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:44.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:44.055+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:44.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:44.139+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:44.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:44.307+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:44.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:44.427+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:45.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:45.047+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:45.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:45.098+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:45.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:45.311+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:45.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:45.407+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:46.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:46.070+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:46.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:46.127+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:46.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:46.265+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:46.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:46.394+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:47.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:47.085+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:47.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:47.105+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:47.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:47.246+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:47.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:47.397+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:48.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:48.111+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:48.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:48.133+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:48.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:48.239+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:48.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:48.439+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:49.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:49.075+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:49.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:49.164+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:49.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:49.259+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:49.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:49.441+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:50.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:50.059+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:50.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:50.130+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:50.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:50.280+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:50.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:50.473+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:51.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:51.034+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:51.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:51.122+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:51.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:51.233+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:51.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:51.424+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:52.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:52.016+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:52.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:52.169+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:52.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:52.263+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:52.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:52.426+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:53.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:53.011+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:53.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:53.217+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:53.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:53.256+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:53.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:53.379+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:54.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:54.004+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:54.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:54.211+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:54.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:54.246+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:54.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:54.401+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:54.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:54.978+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:55.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:55.244+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:55.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:55.251+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:55.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:55.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:55.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:55.955+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:56.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:56.216+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:56.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:56.234+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:56.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:56.327+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:56.696 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:05:56.694+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:05:56.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:56.945+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:57.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:57.237+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:57.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:57.239+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:57.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:57.326+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:57.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:57.901+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:58.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:58.224+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:58.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:58.280+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:58.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:58.329+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:58.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:58.892+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:59.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:05:59.213+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:59.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:05:59.253+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:59.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:05:59.352+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:05:59.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:05:59.870+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:00.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:00.213+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:00.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:00.276+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:00.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:00.306+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:00.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:00.888+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:01.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:01.184+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:01.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:01.240+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:01.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:01.328+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:01.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:01.872+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:02.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:02.212+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:02.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:02.242+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:02.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:02.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:02.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:02.830+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:03.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:03.256+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:03.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:03.256+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:03.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:03.379+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:03.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:03.822+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:04.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:04.262+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:04.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:04.292+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:04.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:04.346+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:04.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:04.860+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:05.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:05.265+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:05.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:05.294+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:05.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:05.376+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:05.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:05.883+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:06.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:06.224+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:06.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:06.291+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:06.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:06.400+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:06.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:06.909+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:07.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:07.272+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:07.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:07.336+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:07.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:07.376+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:07.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:07.912+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:08.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:08.287+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:08.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:08.317+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:08.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:08.403+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:08.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:08.901+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:09.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:09.321+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:09.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:09.352+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:09.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:09.402+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:09.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:09.942+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:10.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:10.343+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:10.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:10.382+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:10.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:10.417+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:10.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:10.942+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:11.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:06:11.316 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:06:11.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:11.317+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:11.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:11.411+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:11.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:11.438+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:11.712 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:06:11.710+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:06:11.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:11.928+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:12.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:12.284+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:12.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:12.401+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:12.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:12.428+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:12.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:12.935+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:13.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:13.293+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:13.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:13.374+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:13.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:13.418+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:13.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:13.914+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:14.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:14.322+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:14.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:14.349+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:14.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:14.411+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:14.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:14.931+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:15.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:15.282+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:15.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:15.363+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:15.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:15.393+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:15.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:15.896+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:16.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:16.309+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:16.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:16.361+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:16.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:16.370+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:16.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:16.894+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:17.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:17.290+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:17.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:17.358+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:17.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:17.395+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:17.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:17.899+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:18.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:18.278+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:18.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:18.374+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:18.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:18.382+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:18.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:18.867+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:19.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:19.276+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:19.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:19.339+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:19.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:19.401+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:19.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:19.872+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:20.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:20.259+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:20.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:20.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:20.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:20.405+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:20.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:20.885+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:21.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:21.264+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:21.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:21.381+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:21.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:21.385+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:21.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:21.883+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:22.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:22.258+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:22.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:22.408+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:22.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:22.413+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:22.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:22.842+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:23.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:23.214+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:23.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:23.410+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:23.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:23.420+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:23.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:23.812+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:24.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:24.191+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:24.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:24.378+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:24.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:24.425+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:24.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:24.799+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:25.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:25.228+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:25.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:25.404+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:25.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:25.440+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:25.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:25.766+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:26.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:26.186+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:26.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:26.403+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:26.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:26.476+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:26.724 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:06:26.721+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:06:26.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:26.747+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:27.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:27.193+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:27.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:27.381+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:27.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:27.448+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:27.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:27.774+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:28.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:28.144+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:28.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:28.359+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:28.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:28.407+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:28.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:28.752+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:29.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:29.192+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:29.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:29.367+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:29.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:29.370+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:29.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:29.752+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:30.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:30.230+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:30.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:30.346+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:30.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:30.370+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:30.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:30.756+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:31.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:31.247+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:31.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:31.324+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:31.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:31.416+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:31.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:31.758+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:32.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:32.208+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:32.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:32.323+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:32.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:32.411+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:32.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:32.807+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:33.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:33.161+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:33.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:33.319+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:33.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:33.434+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:33.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:33.835+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:34.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:34.171+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:34.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:34.349+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:34.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:34.418+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:34.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:34.821+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:35.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:35.168+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:35.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:35.373+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:35.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:35.391+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:35.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:35.831+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:36.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:36.216+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:36.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:36.367+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:36.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:36.378+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:36.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:36.789+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:37.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:37.207+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:37.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:37.360+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:37.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:37.429+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:37.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:37.808+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:38.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:38.225+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:38.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:38.330+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:38.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:38.466+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:38.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:38.842+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:39.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:39.195+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:39.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:39.299+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:39.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:39.471+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:39.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:39.824+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:40.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:40.177+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:40.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:40.279+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:40.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:40.464+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:40.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:40.812+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:41.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:41.189+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:41.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:41.238+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:41.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:06:41.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:06:41.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:41.437+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:41.739 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:06:41.737+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:06:41.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:41.862+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:42.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:42.142+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:42.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:42.218+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:42.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:42.453+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:42.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:42.832+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:43.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:43.173+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:43.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:43.209+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:43.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:43.412+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:43.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:43.811+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:44.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:44.189+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:44.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:44.210+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:44.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:44.371+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:44.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:44.796+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:45.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:45.179+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:45.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:45.236+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:45.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:45.343+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:45.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:45.758+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:46.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:46.176+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:46.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:46.264+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:46.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:46.329+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:46.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:46.780+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:47.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:47.181+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:47.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:47.261+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:47.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:47.374+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:47.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:47.826+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:48.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:48.158+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:48.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:48.296+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:48.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:48.380+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:48.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:48.862+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:49.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:49.206+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:49.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:49.284+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:49.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:49.406+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:49.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:49.856+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:50.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:50.253+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:50.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:50.277+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:50.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:50.445+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:50.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:50.836+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:51.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:51.280+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:51.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:51.283+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:51.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:51.493+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:51.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:51.816+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:52.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:52.314+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:52.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:52.316+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:52.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:52.506+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:52.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:52.855+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:53.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:53.316+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:53.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:53.359+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:53.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:53.506+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:53.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:53.897+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:54.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:54.310+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:54.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:54.325+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:54.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:54.556+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:54.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:54.897+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:55.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:55.353+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:55.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:55.363+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:55.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:55.553+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:55.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:55.883+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:56.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:56.326+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:56.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:56.385+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:56.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:56.602+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:56.755 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:06:56.754+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:06:56.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:56.850+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:57.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:57.370+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:57.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:57.392+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:57.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:57.615+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:57.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:57.885+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:58.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:58.411+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:58.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:58.414+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:58.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:58.572+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:58.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:58.860+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:59.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:06:59.446+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:59.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:06:59.457+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:59.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:06:59.596+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:06:59.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:06:59.821+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:00.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:00.433+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:00.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:00.472+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:00.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:00.552+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:00.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:00.855+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:01.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:01.464+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:01.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:01.520+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:01.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:01.539+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:01.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:01.890+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:02.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:02.507+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:02.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:02.510+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:02.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:02.520+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:02.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:02.870+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:03.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:03.479+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:03.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:03.492+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:03.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:03.519+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:03.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:03.908+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:04.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:04.489+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:04.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:04.492+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:04.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:04.530+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:04.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:04.940+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:05.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:05.518+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:05.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:05.521+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:05.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:05.533+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:05.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:05.905+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:06.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:06.519+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:06.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:06.521+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:06.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:06.554+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:06.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:06.930+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:07.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:07.498+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:07.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:07.502+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:07.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:07.577+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:07.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:07.891+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:08.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:08.459+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:08.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:08.484+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:08.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:08.533+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:08.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:08.866+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:09.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:09.459+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:09.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:09.493+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:09.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:09.562+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:09.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:09.852+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:10.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:10.457+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:10.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:10.471+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:10.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:10.596+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:10.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:10.839+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:11.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:11.411+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:11.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:11.457+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:11.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:07:11.529 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:07:11.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:11.548+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:11.771 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:07:11.769+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:07:11.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:11.815+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:12.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:12.413+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:12.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:12.441+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:12.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:12.574+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:12.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:12.831+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:13.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:13.442+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:13.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:13.455+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:13.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:13.543+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:13.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:13.800+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:14.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:14.447+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:14.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:14.451+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:14.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:14.575+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:14.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:14.788+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:15.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:15.430+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:15.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:15.455+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:15.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:15.570+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:15.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:15.806+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:16.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:16.400+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:16.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:16.420+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:16.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:16.536+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:16.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:16.844+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:17.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:17.423+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:17.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:17.445+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:17.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:17.561+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:17.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:17.807+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:18.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:18.401+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:18.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:18.441+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:18.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:18.582+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:18.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:18.769+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:19.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:19.401+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:19.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:19.474+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:19.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:19.536+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:19.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:19.720+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:20.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:20.429+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:20.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:20.446+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:20.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:20.519+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:20.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:20.767+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:21.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:21.417+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:21.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:21.459+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:21.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:21.496+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:21.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:21.764+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:22.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:22.432+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:22.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:22.452+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:22.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:22.523+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:22.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:22.740+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:23.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:23.399+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:23.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:23.431+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:23.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:23.484+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:23.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:23.751+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:24.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:24.395+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:24.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:24.461+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:24.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:24.502+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:24.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:24.782+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:25.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:25.381+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:25.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:25.482+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:25.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:25.530+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:25.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:25.742+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:26.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:26.347+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:26.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:26.470+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:26.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:26.509+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:26.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:26.699+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:26.778 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:07:26.776+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:07:27.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:27.372+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:27.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:27.423+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:27.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:27.505+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:27.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:27.744+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:28.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:28.375+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:28.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:28.414+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:28.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:28.516+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:28.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:28.712+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:29.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:29.335+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:29.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:29.372+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:29.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:29.525+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:29.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:29.681+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:30.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:30.299+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:30.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:30.361+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:30.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:30.559+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:30.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:30.654+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:31.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:31.309+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:31.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:31.397+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:31.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:31.573+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:31.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:31.694+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:32.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:32.328+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:32.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:32.367+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:32.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:32.527+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:32.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:32.676+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:33.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:33.350+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:33.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:33.404+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:33.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:33.552+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:33.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:33.683+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:34.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:34.335+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:34.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:34.392+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:34.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:34.504+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:34.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:34.659+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:35.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:35.322+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:35.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:35.401+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:35.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:35.525+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:35.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:35.629+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:36.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:36.296+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:36.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:36.357+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:36.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:36.532+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:36.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:36.591+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:37.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:37.311+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:37.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:37.329+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:37.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:37.567+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:37.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:37.576+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:38.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:38.263+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:38.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:38.374+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:38.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:38.552+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:38.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:38.605+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:39.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:39.272+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:39.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:39.366+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:39.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:39.556+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:39.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:39.642+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:40.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:40.275+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:40.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:40.326+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:40.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:40.558+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:40.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:40.635+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:41.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:41.232+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:41.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:41.326+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:41.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:41.533+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:41.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:41.649+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:41.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:07:41.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:07:41.794 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:07:41.791+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:07:42.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:42.234+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:42.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:42.311+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:42.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:42.557+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:42.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:42.665+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:43.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:43.269+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:43.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:43.342+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:43.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:43.557+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:43.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:43.627+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:44.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:44.300+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:44.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:44.347+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:44.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:44.557+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:44.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:44.665+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:45.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:45.257+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:45.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:45.349+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:45.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:45.535+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:45.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:45.698+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:46.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:46.244+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:46.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:46.341+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:46.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:46.541+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:46.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:46.730+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:47.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:47.289+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:47.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:47.345+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:47.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:47.586+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:47.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:47.744+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:48.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:48.303+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:48.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:48.324+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:48.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:48.546+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:48.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:48.703+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:49.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:49.312+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:49.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:49.351+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:49.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:49.502+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:49.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:49.689+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:50.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:50.321+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:50.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:50.367+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:50.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:50.520+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:50.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:50.711+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:51.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:51.287+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:51.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:51.361+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:51.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:51.497+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:51.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:51.697+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:52.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:52.278+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:52.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:52.320+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:52.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:52.478+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:52.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:52.742+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:53.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:53.229+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:53.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:53.279+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:53.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:53.492+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:53.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:53.786+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:54.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:54.211+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:54.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:54.318+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:54.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:54.531+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:54.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:54.738+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:55.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:55.203+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:55.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:55.292+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:55.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:55.489+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:55.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:55.722+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:56.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:56.159+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:56.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:56.259+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:56.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:56.480+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:56.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:56.771+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:56.809 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:07:56.807+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:07:57.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:57.182+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:57.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:57.228+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:57.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:57.458+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:57.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:57.774+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:58.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:58.193+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:58.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:58.213+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:58.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:58.416+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:58.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:58.776+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:59.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:07:59.196+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:59.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:07:59.227+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:59.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:07:59.409+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:07:59.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:07:59.727+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:00.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:00.210+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:00.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:00.212+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:00.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:00.428+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:00.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:00.685+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:01.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:01.200+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:01.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:01.250+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:01.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:01.475+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:01.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:01.675+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:02.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:02.173+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:02.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:02.224+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:02.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:02.488+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:02.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:02.701+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:03.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:03.181+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:03.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:03.268+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:03.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:03.519+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:03.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:03.705+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:04.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:04.194+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:04.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:04.317+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:04.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:04.552+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:04.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:04.702+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:05.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:05.197+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:05.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:05.307+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:05.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:05.548+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:05.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:05.677+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:06.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:06.161+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:06.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:06.329+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:06.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:06.591+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:06.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:06.703+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:07.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:07.209+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:07.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:07.370+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:07.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:07.602+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:07.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:07.707+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:08.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:08.166+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:08.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:08.344+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:08.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:08.645+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:08.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:08.748+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:09.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:09.164+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:09.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:09.386+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:09.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:09.613+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:09.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:09.789+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:10.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:10.157+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:10.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:10.370+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:10.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:10.623+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:10.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:10.796+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:11.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:11.193+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:11.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:11.415+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:11.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:11.648+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:11.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:08:11.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:08:11.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:11.770+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:11.825 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:08:11.823+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:08:12.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:12.158+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:12.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:12.459+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:12.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:12.649+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:12.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:12.750+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:13.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:13.196+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:13.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:13.449+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:13.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:13.666+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:13.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:13.789+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:14.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:14.179+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:14.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:14.428+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:14.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:14.664+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:14.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:14.828+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:15.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:15.169+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:15.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:15.422+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:15.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:15.667+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:15.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:15.813+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:16.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:16.184+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:16.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:16.424+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:16.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:16.694+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:16.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:16.784+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:17.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:17.215+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:17.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:17.407+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:17.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:17.676+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:17.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:17.783+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:18.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:18.208+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:18.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:18.432+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:18.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:18.672+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:18.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:18.803+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:19.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:19.162+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:19.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:19.458+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:19.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:19.714+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:19.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:19.781+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:20.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:20.171+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:20.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:20.493+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:20.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:20.680+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:20.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:20.793+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:21.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:21.219+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:21.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:21.489+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:21.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:21.699+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:21.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:21.762+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:22.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:22.244+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:22.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:22.448+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:22.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:22.677+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:22.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:22.750+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:23.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:23.289+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:23.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:23.405+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:23.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:23.650+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:23.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:23.752+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:24.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:24.273+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:24.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:24.375+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:24.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:24.696+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:24.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:24.725+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:25.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:25.299+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:25.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:25.335+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:25.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:25.724+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:25.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:25.745+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:26.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:26.282+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:26.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:26.331+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:26.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:26.705+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:26.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:26.752+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:26.840 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:08:26.838+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:08:27.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:27.278+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:27.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:27.301+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:27.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:27.733+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:27.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:27.787+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:28.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:28.271+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:28.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:28.306+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:28.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:28.758+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:28.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:28.794+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:29.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:29.224+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:29.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:29.324+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:29.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:29.752+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:29.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:29.801+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:30.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:30.213+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:30.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:30.312+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:30.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:30.792+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:30.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:30.840+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:31.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:31.212+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:31.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:31.321+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:31.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:31.765+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:31.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:31.813+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:32.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:32.257+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:32.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:32.272+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:32.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:32.729+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:32.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:32.853+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:33.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:33.276+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:33.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:33.305+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:33.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:33.727+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:33.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:33.831+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:34.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:34.246+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:34.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:34.319+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:34.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:34.755+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:34.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:34.802+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:35.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:35.217+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:35.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:35.293+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:35.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:35.778+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:35.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:35.796+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:36.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:36.249+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:36.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:36.316+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:36.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:36.789+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:36.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:36.818+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:37.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:37.201+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:37.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:37.359+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:37.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:37.756+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:37.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:37.838+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:38.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:38.162+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:38.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:38.405+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:38.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:38.720+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:38.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:38.881+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:39.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:39.140+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:39.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:39.383+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:39.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:39.761+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:39.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:39.918+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:40.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:40.095+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:40.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:40.338+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:40.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:40.751+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:40.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:40.932+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:41.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:41.054+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:41.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:41.302+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:41.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:41.711+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:41.847 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:08:41.846+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:08:41.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:08:41.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:08:41.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:41.956+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:42.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:42.058+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:42.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:42.350+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:42.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:42.695+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:42.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:42.952+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:43.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:43.091+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:43.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:43.371+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:43.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:43.691+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:44.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:43.997+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:44.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:44.076+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:44.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:44.395+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:44.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:44.642+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:45.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:45.017+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:45.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:45.112+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:45.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:45.399+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:45.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:45.644+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:45.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:45.971+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:46.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:46.138+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:46.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:46.376+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:46.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:46.608+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:46.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:46.990+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:47.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:47.167+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:47.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:47.369+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:47.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:47.572+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:47.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:47.987+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:48.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:48.200+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:48.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:48.416+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:48.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:48.585+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:48.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:48.942+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:49.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:49.238+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:49.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:49.464+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:49.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:49.599+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:49.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:49.968+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:50.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:50.284+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:50.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:50.503+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:50.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:50.619+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:50.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:50.960+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:51.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:51.320+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:51.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:51.525+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:51.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:51.612+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:51.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:51.934+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:52.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:52.319+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:52.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:52.508+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:52.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:52.616+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:52.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:52.933+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:53.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:53.285+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:53.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:53.492+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:53.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:53.629+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:53.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:53.896+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:54.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:54.256+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:54.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:54.463+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:54.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:54.609+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:54.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:54.906+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:55.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:55.277+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:55.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:55.505+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:55.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:55.655+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:55.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:55.947+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:56.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:56.290+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:56.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:56.459+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:56.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:56.662+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:56.863 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:08:56.861+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:08:56.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:56.967+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:57.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:57.334+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:57.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:57.443+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:57.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:57.654+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:57.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:57.931+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:58.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:58.314+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:58.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:58.472+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:58.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:58.684+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:58.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:58.932+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:59.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:08:59.287+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:59.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:08:59.482+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:59.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:08:59.650+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:08:59.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:08:59.948+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:00.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:00.328+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:00.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:00.493+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:00.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:00.618+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:00.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:00.987+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:01.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:01.357+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:01.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:01.539+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:01.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:01.622+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:01.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:01.993+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:02.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:02.402+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:02.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:02.567+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:02.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:02.624+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:03.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:03.034+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:03.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:03.359+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:03.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:03.563+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:03.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:03.617+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:04.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:04.057+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:04.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:04.382+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:04.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:04.573+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:04.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:04.573+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:05.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:05.058+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:05.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:05.380+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:05.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:05.566+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:05.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:05.603+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:06.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:06.087+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:06.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:06.340+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:06.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:06.554+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:06.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:06.625+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:07.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:07.129+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:07.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:07.367+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:07.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:07.512+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:07.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:07.611+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:08.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:08.086+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:08.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:08.344+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:08.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:08.555+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:08.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:08.611+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:09.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:09.039+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:09.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:09.362+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:09.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:09.552+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:09.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:09.640+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:10.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:10.063+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:10.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:10.321+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:10.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:10.583+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:10.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:10.615+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:11.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:11.017+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:11.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:11.342+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:11.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:11.565+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:11.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:11.615+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:11.879 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:09:11.877+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:09:11.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:09:11.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:09:12.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:12.042+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:12.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:12.343+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:12.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:12.602+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:12.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:12.661+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:13.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:13.014+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:13.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:13.314+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:13.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:13.594+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:13.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:13.671+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:14.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:14.026+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:14.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:14.301+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:14.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:14.590+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:14.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:14.637+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:15.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:15.023+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:15.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:15.340+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:15.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:15.596+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:15.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:15.624+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:15.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:15.980+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:16.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:16.343+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:16.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:16.582+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:16.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:16.589+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:16.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:16.943+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:17.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:17.359+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:17.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:17.560+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:17.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:17.584+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:17.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:17.988+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:18.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:18.321+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:18.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:18.514+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:18.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:18.617+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:18.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:18.978+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:19.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:19.334+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:19.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:19.492+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:19.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:19.664+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:19.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:19.983+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:20.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:20.309+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:20.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:20.508+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:20.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:20.682+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:21.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:20.999+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:21.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:21.313+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:21.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:21.473+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:21.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:21.638+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:22.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:22.022+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:22.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:22.278+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:22.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:22.506+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:22.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:22.685+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:23.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:23.016+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:23.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:23.275+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:23.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:23.535+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:23.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:23.685+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:24.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:24.036+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:24.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:24.319+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:24.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:24.577+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:24.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:24.697+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:25.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:25.000+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:25.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:25.293+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:25.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:25.604+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:25.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:25.701+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:25.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:25.959+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:26.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:26.301+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:26.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:26.573+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:26.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:26.746+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:26.895 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:09:26.892+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:09:27.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:27.004+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:27.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:27.296+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:27.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:27.599+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:27.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:27.781+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:27.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:27.967+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:28.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:28.317+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:28.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:28.618+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:28.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:28.779+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:28.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:28.946+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:29.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:29.331+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:29.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:29.663+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:29.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:29.756+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:29.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:29.912+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:30.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:30.364+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:30.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:30.676+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:30.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:30.770+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:30.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:30.949+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:31.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:31.351+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:31.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:31.670+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:31.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:31.788+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:31.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:31.974+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:32.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:32.321+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:32.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:32.702+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:32.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:32.818+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:32.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:32.954+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:33.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:33.337+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:33.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:33.746+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:33.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:33.846+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:33.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:33.989+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:34.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:34.296+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:34.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:34.768+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:34.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:34.878+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:35.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:35.034+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:35.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:35.247+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:35.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:35.813+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:35.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:35.859+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:36.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:36.020+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:36.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:36.225+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:36.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:36.836+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:36.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:36.898+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:37.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:37.059+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:37.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:37.182+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:37.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:37.840+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:37.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:37.917+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:38.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:38.056+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:38.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:38.173+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:38.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:38.855+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:38.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:38.894+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:39.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:39.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:39.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:39.167+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:39.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:39.866+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:39.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:39.886+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:40.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:40.050+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:40.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:40.185+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:40.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:40.867+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:40.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:40.901+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:41.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:41.009+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:41.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:41.211+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:41.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:41.900+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:41.908 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:09:41.905+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:09:41.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:41.909+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:41.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:41.974+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:42.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:09:42.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:09:42.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:42.213+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:42.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:42.870+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:42.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:42.916+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:42.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:42.964+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:43.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:43.227+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:43.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:43.888+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:43.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:43.933+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:44.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:43.998+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:44.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:44.224+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:44.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:44.846+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:44.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:44.966+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:44.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:44.974+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:45.021 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-04-04T01:09:45.036 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-04-04T01:09:45.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:45.213+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:45.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:45.858+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:45.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:45.960+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:45.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:45.986+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:46.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:46.195+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:46.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:46.837+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:46.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:46.991+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:47.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:46.999+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:47.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:47.198+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:47.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:47.799+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:47.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:47.967+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:48.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:48.020+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:48.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:48.233+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:48.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:48.823+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:48.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:48.973+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:49.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:49.002+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:49.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:49.239+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:49.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:49.815+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:49.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:49.981+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:50.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:50.000+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:50.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:50.197+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:50.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:50.789+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:50.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:50.932+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:50.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:50.996+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:51.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:51.194+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:51.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:51.829+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:51.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:51.979+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:52.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:52.044+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:52.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:52.204+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:52.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:52.850+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:52.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:52.996+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:53.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:53.091+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:53.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:53.157+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:53.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:53.814+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:53.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:53.985+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:54.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:54.062+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:54.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:54.184+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:54.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:54.775+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:55.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:55.003+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:55.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:55.080+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:55.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:55.199+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:55.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:55.756+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:56.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:56.042+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:56.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:56.109+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:56.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:56.177+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:56.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:56.762+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:56.918 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:09:56.917+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:09:57.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:57.001+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:57.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:57.097+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:57.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:57.197+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:57.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:57.793+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:57.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:57.983+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:58.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:58.070+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:58.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:58.169+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:58.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:58.843+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:59.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:09:59.012+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:59.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:09:59.044+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:59.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:09:59.137+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:09:59.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:09:59.844+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:00.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:00.017+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:00.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:00.056+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:00.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:00.126+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:00.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:00.842+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:01.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:01.018+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:01.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:01.018+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:01.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:01.171+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:01.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:01.831+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:02.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:02.011+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:02.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:02.017+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:02.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:02.213+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:02.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:02.870+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:02.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:02.987+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:02.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:02.994+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:03.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:03.182+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:03.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:03.899+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:04.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:04.002+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:04.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:04.021+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:04.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:04.146+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:04.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:04.916+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:05.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:05.025+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:05.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:05.061+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:05.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:05.142+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:05.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:05.955+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:06.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:06.038+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:06.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:06.053+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:06.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:06.145+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:06.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:06.956+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:06.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:06.996+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:07.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:07.080+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:07.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:07.115+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:07.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:07.953+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:07.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:07.983+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:08.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:08.057+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:08.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:08.110+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:08.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:08.968+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:08.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:08.995+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:09.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:09.046+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:09.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:09.088+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:09.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:09.972+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:10.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:10.018+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:10.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:10.040+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:10.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:10.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:10.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:10.950+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:11.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:11.017+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:11.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:11.041+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:11.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:11.055+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:11.934 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:10:11.932+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:10:11.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:11.962+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:12.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:12.003+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:12.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:12.009+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:12.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:12.042+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:12.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:10:12.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:10:12.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:12.969+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:13.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:13.008+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:13.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:13.012+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:13.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:13.090+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:13.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:13.966+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:13.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:13.980+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:14.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:14.026+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:14.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:14.137+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:14.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:14.938+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:14.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:14.980+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:15.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:15.028+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:15.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:15.095+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:15.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:15.926+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:16.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:16.008+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:16.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:16.058+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:16.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:16.110+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:16.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:16.883+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:17.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:17.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:17.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:17.060+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:17.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:17.154+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:17.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:17.891+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:18.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:18.007+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:18.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:18.042+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:18.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:18.159+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:18.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:18.858+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:19.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:19.031+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:19.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:19.041+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:19.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:19.203+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:19.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:19.900+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:20.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:20.031+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:20.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:20.041+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:20.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:20.186+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:20.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:20.878+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:20.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:20.996+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:21.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:21.064+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:21.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:21.160+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:21.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:21.860+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:21.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:21.991+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:22.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:22.019+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:22.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:22.183+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:22.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:22.895+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:23.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:23.029+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:23.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:23.042+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:23.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:23.176+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:23.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:23.856+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:24.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:24.028+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:24.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:24.037+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:24.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:24.148+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:24.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:24.820+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:25.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:24.999+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:25.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:25.012+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:25.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:25.192+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:25.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:25.783+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:25.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:25.960+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:26.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:26.027+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:26.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:26.225+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:26.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:26.790+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:26.950 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:10:26.948+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:10:26.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:26.987+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:26.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:26.995+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:27.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:27.180+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:27.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:27.763+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:27.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:27.967+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:27.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:27.981+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:28.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:28.206+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:28.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:28.796+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:28.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:28.931+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:28.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:28.960+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:29.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:29.244+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:29.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:29.766+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:29.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:29.890+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:29.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:29.915+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:30.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:30.246+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:30.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:30.721+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:30.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:30.866+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:30.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:30.946+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:31.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:31.271+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:31.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:31.732+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:31.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:31.833+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:31.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:31.931+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:32.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:32.290+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:32.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:32.772+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:32.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:32.850+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:32.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:32.908+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:33.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:33.285+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:33.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:33.748+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:33.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:33.861+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:33.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:33.917+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:34.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:34.255+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:34.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:34.789+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:34.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:34.812+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:34.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:34.928+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:35.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:35.287+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:35.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:35.816+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:35.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:35.846+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:35.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:35.975+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:36.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:36.286+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:36.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:36.847+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:36.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:36.848+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:36.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:36.941+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:37.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:37.244+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:37.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:37.857+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:37.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:37.892+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:37.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:37.987+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:38.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:38.211+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:38.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:38.879+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:38.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:38.941+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:38.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:38.990+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:39.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:39.172+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:39.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:39.903+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:39.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:39.979+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:40.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:40.013+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:40.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:40.134+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:40.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:40.877+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:40.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:40.978+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:41.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:41.026+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:41.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:41.164+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:41.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:41.902+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:41.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:41.935+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:41.966 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:10:41.963+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:10:42.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:42.012+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:42.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:42.188+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:42.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:10:42.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:10:42.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:42.893+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:42.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:42.916+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:43.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:43.015+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:43.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:43.175+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:43.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:43.890+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:43.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:43.934+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:43.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:43.974+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:44.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:44.176+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:44.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:44.902+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:44.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:44.932+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:44.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:44.984+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:45.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:45.139+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:45.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:45.887+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:45.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:45.896+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:45.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:45.943+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:46.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:46.093+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:46.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:46.907+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:46.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:46.924+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:46.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:46.973+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:47.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:47.052+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:47.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:47.906+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:47.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:47.947+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:48.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:48.003+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:48.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:48.010+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:48.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:48.891+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:48.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:48.899+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:48.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:48.973+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:48.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:48.992+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:49.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:49.881+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:49.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:49.892+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:49.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:49.970+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:49.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:49.987+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:50.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:50.855+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:50.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:50.864+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:50.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:50.933+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:51.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:51.031+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:51.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:51.843+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:51.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:51.880+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:51.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:51.917+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:52.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:52.026+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:52.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:52.872+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:52.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:52.873+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:52.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:52.905+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:53.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:53.047+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:53.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:53.867+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:53.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:53.886+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:53.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:53.890+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:54.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:53.999+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:54.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:54.857+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:54.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:54.882+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:54.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:54.895+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:55.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:55.043+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:55.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:55.814+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:55.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:55.907+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:55.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:55.916+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:56.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:56.091+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:56.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:56.779+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:56.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:56.936+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:56.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:56.951+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:56.982 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:10:56.979+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:10:57.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:57.073+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:57.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:57.754+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:57.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:57.954+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:57.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:57.972+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:58.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:58.043+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:58.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:58.778+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:58.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:58.931+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:58.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:58.967+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:59.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:10:59.047+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:59.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:10:59.788+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:59.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:10:59.935+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:10:59.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:10:59.949+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:00.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:00.073+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:00.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:00.792+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:00.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:00.908+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:00.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:00.924+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:01.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:01.110+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:01.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:01.762+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:01.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:01.886+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:01.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:01.895+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:02.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:02.122+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:02.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:02.742+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:02.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:02.882+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:02.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:02.899+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:03.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:03.110+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:03.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:03.748+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:03.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:03.853+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:03.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:03.874+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:04.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:04.083+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:04.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:04.793+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:04.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:04.826+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:04.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:04.899+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:05.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:05.057+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:05.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:05.779+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:05.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:05.812+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:05.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:05.907+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:06.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:06.048+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:06.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:06.782+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:06.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:06.804+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:06.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:06.876+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:07.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:07.066+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:07.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:07.781+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:07.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:07.798+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:07.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:07.918+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:08.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:08.058+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:08.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:08.767+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:08.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:08.801+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:08.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:08.955+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:09.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:09.062+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:09.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:09.738+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:09.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:09.841+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:09.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:09.969+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:10.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:10.061+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:10.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:10.777+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:10.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:10.888+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:10.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:10.994+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:11.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:11.080+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:11.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:11.770+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:11.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:11.901+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:11.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:11.967+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:11.997 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:11:11.996+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:11:12.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:12.063+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:12.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:11:12.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:11:12.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:12.787+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:12.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:12.870+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:12.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:12.962+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:13.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:13.017+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:13.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:13.806+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:13.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:13.873+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:13.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:13.940+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:13.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:13.996+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:14.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:14.840+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:14.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:14.880+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:14.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:14.990+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:14.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:14.994+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:15.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:15.825+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:15.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:15.890+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:15.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:15.950+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:16.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:16.034+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:16.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:16.809+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:16.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:16.903+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:16.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:16.926+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:17.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:17.013+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:17.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:17.830+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:17.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:17.892+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:17.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:17.928+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:17.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:17.988+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:18.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:18.823+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:18.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:18.903+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:18.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:18.903+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:18.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:18.961+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:19.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:19.806+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:19.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:19.915+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:19.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:19.937+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:19.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:19.947+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:20.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:20.816+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:20.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:20.904+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:20.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:20.924+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:20.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:20.943+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:21.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:21.798+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:21.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:21.897+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:21.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:21.925+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:21.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:21.973+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:22.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:22.751+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:22.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:22.899+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:22.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:22.907+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:22.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:22.962+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:23.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:23.725+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:23.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:23.890+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:23.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:23.927+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:23.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:23.954+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:24.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:24.713+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:24.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:24.868+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:24.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:24.877+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:24.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:24.912+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:25.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:25.664+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:25.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:25.874+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:25.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:25.875+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:25.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:25.907+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:26.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:26.622+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:26.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:26.849+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:26.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:26.875+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:26.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:26.894+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:27.014 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:11:27.011+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:11:27.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:27.644+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:27.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:27.814+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:27.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:27.880+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:27.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:27.916+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:28.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:28.633+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:28.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:28.823+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:28.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:28.923+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:28.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:28.956+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:29.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:29.592+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:29.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:29.816+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:29.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:29.882+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:30.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:30.000+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:30.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:30.592+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:30.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:30.768+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:30.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:30.914+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:30.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:30.974+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:31.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:31.631+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:31.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:31.725+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:31.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:31.942+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:31.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:31.949+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:32.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:32.607+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:32.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:32.708+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:32.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:32.926+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:32.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:32.964+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:33.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:33.594+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:33.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:33.746+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:33.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:33.908+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:33.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:33.985+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:34.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:34.592+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:34.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:34.731+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:34.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:34.892+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:34.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:34.949+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:35.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:35.565+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:35.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:35.746+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:35.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:35.906+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:35.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:35.937+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:36.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:36.561+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:36.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:36.733+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:36.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:36.921+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:36.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:36.980+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:37.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:37.593+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:37.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:37.752+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:37.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:37.881+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:37.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:37.986+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:38.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:38.635+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:38.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:38.798+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:38.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:38.853+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:38.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:38.946+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:39.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:39.593+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:39.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:39.793+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:39.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:39.805+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:39.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:39.932+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:40.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:40.595+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:40.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:40.763+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:40.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:40.783+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:40.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:40.917+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:41.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:41.574+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:41.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:41.734+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:41.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:41.780+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:41.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:41.911+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:42.029 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:11:42.027+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:11:42.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:42.614+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:42.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:11:42.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:11:42.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:42.733+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:42.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:42.743+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:42.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:42.909+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:43.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:43.624+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:43.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:43.701+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:43.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:43.780+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:43.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:43.929+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:44.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:44.643+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:44.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:44.722+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:44.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:44.790+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:44.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:44.929+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:45.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:45.664+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:45.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:45.745+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:45.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:45.823+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:45.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:45.926+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:46.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:46.664+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:46.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:46.734+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:46.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:46.835+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:46.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:46.958+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:47.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:47.676+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:47.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:47.767+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:47.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:47.843+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:47.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:47.961+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:48.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:48.641+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:48.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:48.768+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:48.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:48.796+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:48.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:48.982+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:49.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:49.640+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:49.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:49.765+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:49.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:49.804+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:49.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:49.946+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:50.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:50.610+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:50.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:50.766+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:50.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:50.798+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:50.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:50.898+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:51.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:51.650+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:51.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:51.809+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:51.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:51.824+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:51.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:51.904+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:52.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:52.617+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:52.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:52.808+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:52.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:52.851+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:52.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:52.893+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:53.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:53.633+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:53.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:53.796+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:53.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:53.858+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:53.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:53.926+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:54.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:54.641+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:54.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:54.842+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:54.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:54.901+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:54.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:54.906+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:55.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:55.597+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:55.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:55.838+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:55.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:55.857+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:55.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:55.918+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:56.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:56.562+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:56.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:56.847+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:56.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:56.882+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:56.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:56.936+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:57.045 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:11:57.043+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:11:57.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:57.606+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:57.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:57.830+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:57.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:57.843+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:57.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:57.955+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:58.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:58.606+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:58.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:58.820+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:58.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:58.824+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:58.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:58.926+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:59.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:11:59.618+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:59.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:11:59.810+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:59.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:11:59.872+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:11:59.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:11:59.914+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:00.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:00.662+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:00.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:00.833+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:00.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:00.893+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:00.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:00.941+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:01.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:01.664+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:01.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:01.794+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:01.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:01.912+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:01.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:01.925+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:02.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:02.693+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:02.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:02.781+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:02.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:02.953+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:02.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:02.956+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:03.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:03.649+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:03.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:03.788+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:03.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:03.949+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:03.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:03.977+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:04.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:04.649+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:04.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:04.788+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:04.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:04.912+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:04.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:04.982+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:05.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:05.676+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:05.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:05.764+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:05.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:05.915+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:05.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:05.954+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:06.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:06.688+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:06.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:06.773+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:06.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:06.929+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:06.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:06.979+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:07.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:07.639+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:07.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:07.724+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:07.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:07.901+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:08.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:07.944+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:08.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:08.602+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:08.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:08.735+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:08.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:08.869+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:08.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:08.961+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:09.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:09.623+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:09.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:09.758+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:09.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:09.902+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:09.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:09.983+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:10.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:10.592+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:10.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:10.768+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:10.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:10.906+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:10.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:10.961+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:11.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:11.618+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:11.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:11.755+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:11.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:11.872+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:11.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:11.959+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:12.061 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:12:12.058+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:12:12.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:12.657+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:12.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:12.709+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:12.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:12:12.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:12:12.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:12.900+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:12.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:12.954+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:13.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:13.680+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:13.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:13.705+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:13.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:13.911+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:13.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:13.913+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:14.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:14.725+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:14.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:14.727+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:14.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:14.863+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:14.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:14.888+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:15.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:15.730+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:15.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:15.739+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:15.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:15.848+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:15.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:15.927+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:16.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:16.739+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:16.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:16.744+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:16.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:16.839+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:16.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:16.916+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:17.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:17.771+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:17.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:17.778+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:17.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:17.889+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:17.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:17.929+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:18.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:18.786+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:18.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:18.814+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:18.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:18.888+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:18.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:18.898+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:19.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:19.752+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:19.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:19.777+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:19.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:19.891+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:19.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:19.907+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:20.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:20.747+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:20.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:20.782+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:20.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:20.858+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:20.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:20.910+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:21.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:21.702+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:21.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:21.775+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:21.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:21.822+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:21.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:21.946+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:22.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:22.675+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:22.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:22.806+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:22.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:22.822+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:22.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:22.947+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:23.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:23.670+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:23.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:23.792+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:23.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:23.802+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:23.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:23.991+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:24.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:24.708+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:24.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:24.822+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:24.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:24.833+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:25.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:25.037+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:25.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:25.687+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:25.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:25.788+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:25.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:25.878+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:26.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:26.058+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:26.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:26.646+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:26.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:26.832+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:26.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:26.852+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:27.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:27.024+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:27.077 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:12:27.075+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:12:27.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:27.620+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:27.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:27.802+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:27.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:27.870+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:28.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:28.003+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:28.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:28.637+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:28.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:28.795+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:28.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:28.915+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:28.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:28.974+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:29.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:29.625+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:29.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:29.838+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:29.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:29.880+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:29.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:29.971+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:30.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:30.631+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:30.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:30.868+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:30.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:30.872+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:30.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:30.974+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:31.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:31.605+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:31.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:31.828+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:31.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:31.903+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:31.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:31.966+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:32.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:32.559+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:32.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:32.849+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:32.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:32.860+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:32.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:32.942+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:33.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:33.510+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:33.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:33.863+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:33.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:33.903+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:33.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:33.980+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:34.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:34.554+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:34.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:34.898+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:34.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:34.913+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:34.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:34.977+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:35.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:35.533+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:35.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:35.877+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:35.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:35.896+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:35.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:35.982+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:36.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:36.532+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:36.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:36.907+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:36.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:36.918+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:36.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:36.973+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:37.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:37.525+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:37.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:37.949+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:37.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:37.953+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:38.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:38.003+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:38.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:38.535+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:38.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:38.916+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:38.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:38.945+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:38.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:38.962+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:39.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:39.576+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:39.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:39.930+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:39.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:39.960+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:39.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:39.979+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:40.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:40.567+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:40.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:40.956+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:40.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:40.968+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:40.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:40.976+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:41.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:41.573+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:41.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:41.938+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:41.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:41.951+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:41.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:41.997+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:42.078 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:12:42.076+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:12:42.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:42.568+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:42.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:42.910+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:42.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:12:42.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:12:42.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:42.954+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:42.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:42.959+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:43.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:43.566+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:43.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:43.918+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:43.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:43.932+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:43.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:43.989+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:44.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:44.604+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:44.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:44.872+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:44.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:44.898+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:45.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:45.024+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:45.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:45.580+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:45.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:45.843+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:45.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:45.916+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:46.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:46.019+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:46.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:46.616+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:46.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:46.819+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:46.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:46.905+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:46.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:46.995+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:47.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:47.614+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:47.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:47.863+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:47.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:47.902+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:47.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:47.993+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:48.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:48.601+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:48.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:48.870+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:48.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:48.878+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:48.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:48.960+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:49.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:49.569+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:49.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:49.867+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:49.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:49.908+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:49.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:49.988+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:50.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:50.583+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:50.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:50.903+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:50.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:50.906+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:50.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:50.950+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:51.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:51.631+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:51.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:51.883+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:51.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:51.901+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:51.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:51.908+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:52.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:52.658+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:52.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:52.867+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:52.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:52.902+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:52.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:52.911+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:53.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:53.619+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:53.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:53.863+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:53.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:53.869+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:53.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:53.882+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:54.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:54.601+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:54.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:54.845+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:54.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:54.882+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:54.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:54.925+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:55.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:55.575+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:55.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:55.815+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:55.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:55.834+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:55.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:55.960+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:56.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:56.591+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:56.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:56.782+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:56.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:56.829+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:56.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:56.914+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:57.092 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:12:57.091+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:12:57.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:57.586+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:57.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:57.817+0000 7f72c425d700 -1 osd.5 109 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:57.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:57.821+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:57.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:57.951+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:58.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:58.556+0000 7f6e44c9f700 -1 osd.7 109 get_health_metrics reporting 46 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:58.753 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T01:12:58.751+0000 7f6206e6a700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:12:58.768 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T01:12:58.751+0000 7f6206e6a700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:12:58.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:58.782+0000 7f389e18e700 -1 osd.4 109 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:58.790 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T01:12:58.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:58.871+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:58.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:58.907+0000 7f596d92c700 -1 osd.6 109 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:59.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:12:59.529+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:59.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:12:59.813+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:59.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:12:59.877+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:12:59.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:12:59.949+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:00.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:00.525+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:00.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:00.835+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:00.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:00.839+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:00.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:00.941+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:01.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:01.488+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:01.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:01.792+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:01.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:01.816+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:01.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:01.944+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:02.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:02.485+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:02.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:02.770+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:02.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:02.830+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:02.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:02.932+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:03.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:03.441+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:03.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:03.775+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:03.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:03.792+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:03.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:03.924+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:04.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:04.433+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:04.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:04.737+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:04.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:04.801+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:04.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:04.949+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:05.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:05.387+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:05.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:05.731+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:05.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:05.780+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:05.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:05.938+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:06.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:06.407+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:06.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:06.764+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:06.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:06.810+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:06.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:06.958+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:07.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:07.405+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:07.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:07.808+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:07.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:07.818+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:07.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:07.918+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:08.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:08.439+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:08.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:08.778+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:08.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:08.828+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:08.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:08.900+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:09.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:09.461+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:09.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:09.746+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:09.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:09.812+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:09.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:09.948+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:10.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:10.488+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:10.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:10.787+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:10.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:10.855+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:10.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:10.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:11.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:11.537+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:11.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:11.760+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:11.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:11.818+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:12.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:12.019+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:12.097 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:13:12.095+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:13:12.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:12.572+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:12.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:12.768+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:12.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:12.793+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:13.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:13.051+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:13.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:13:13.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:13:13.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:13.568+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:13.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:13.733+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:13.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:13.792+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:14.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:14.010+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:14.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:14.600+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:14.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:14.720+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:14.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:14.835+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:15.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:15.030+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:15.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:15.566+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:15.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:15.677+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:15.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:15.870+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:16.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:16.000+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:16.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:16.554+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:16.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:16.679+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:16.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:16.824+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:16.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:16.960+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:17.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:17.507+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:17.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:17.703+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:17.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:17.872+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:17.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:17.965+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:18.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:18.494+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:18.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:18.704+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:18.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:18.904+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:18.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:18.974+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:19.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:19.451+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:19.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:19.718+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:19.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:19.899+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:19.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:19.957+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:20.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:20.411+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:20.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:20.745+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:20.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:20.864+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:20.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:20.929+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:21.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:21.403+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:21.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:21.759+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:21.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:21.826+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:21.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:21.964+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:22.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:22.400+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:22.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:22.750+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:22.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:22.862+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:22.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:22.946+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:23.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:23.424+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:23.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:23.764+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:23.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:23.898+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:23.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:23.922+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:24.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:24.453+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:24.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:24.807+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:24.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:24.855+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:24.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:24.921+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:25.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:25.422+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:25.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:25.837+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:25.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:25.844+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:25.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:25.955+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:26.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:26.384+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:26.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:26.795+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:26.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:26.842+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:26.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:26.992+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:27.113 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:13:27.111+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:13:27.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:27.429+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:27.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:27.778+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:27.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:27.858+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:27.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:27.959+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:28.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:28.457+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:28.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:28.742+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:28.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:28.886+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:28.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:28.919+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:29.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:29.465+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:29.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:29.695+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:29.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:29.905+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:29.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:29.937+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:30.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:30.463+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:30.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:30.705+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:30.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:30.887+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:30.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:30.906+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:31.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:31.493+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:31.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:31.702+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:31.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:31.925+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:31.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:31.950+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:32.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:32.446+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:32.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:32.678+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:32.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:32.949+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:32.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:32.996+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:33.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:33.415+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:33.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:33.645+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:33.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:33.955+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:34.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:34.028+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:34.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:34.414+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:34.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:34.659+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:34.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:34.980+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:34.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:34.989+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:35.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:35.388+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:35.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:35.703+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:35.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:35.935+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:35.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:35.992+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:36.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:36.375+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:36.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:36.683+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:36.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:36.932+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:37.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:37.021+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:37.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:37.344+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:37.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:37.727+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:37.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:37.969+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:38.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:38.016+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:38.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:38.329+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:38.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:38.719+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:38.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:38.924+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:38.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:38.998+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:39.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:39.367+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:39.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:39.728+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:39.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:39.885+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:39.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:39.970+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:40.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:40.328+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:40.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:40.766+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:40.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:40.910+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:40.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:40.978+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:41.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:41.287+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:41.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:41.724+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:41.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:41.875+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:41.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:41.970+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:42.129 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:13:42.127+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:13:42.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:42.259+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:42.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:42.713+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:42.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:42.867+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:42.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:42.943+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:43.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:43.234+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:43.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:13:43.247 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:13:43.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:43.716+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:43.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:43.886+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:43.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:43.908+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:44.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:44.202+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:44.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:44.671+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:44.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:44.869+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:44.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:44.879+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:45.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:45.163+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:45.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:45.712+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:45.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:45.851+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:45.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:45.863+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:46.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:46.116+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:46.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:46.749+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:46.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:46.807+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:46.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:46.838+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:47.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:47.105+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:47.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:47.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:47.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:47.809+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:47.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:47.880+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:48.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:48.101+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:48.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:48.776+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:48.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:48.819+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:48.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:48.902+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:49.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:49.148+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:49.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:49.776+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:49.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:49.781+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:49.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:49.886+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:50.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:50.192+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:50.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:50.758+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:50.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:50.759+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:50.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:50.860+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:51.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:51.239+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:51.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:51.758+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:51.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:51.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:51.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:51.842+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:52.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:52.279+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:52.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:52.777+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:52.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:52.785+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:52.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:52.846+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:53.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:53.265+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:53.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:53.735+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:53.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:53.740+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:53.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:53.797+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:54.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:54.299+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:54.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:54.704+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:54.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:54.764+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:54.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:54.799+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:55.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:55.295+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:55.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:55.699+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:55.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:55.722+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:55.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:55.786+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:56.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:56.271+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:56.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:56.659+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:56.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:56.676+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:56.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:56.793+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:57.145 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:13:57.143+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:13:57.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:57.231+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:57.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:57.641+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:57.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:57.693+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:57.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:57.768+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:58.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:58.223+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:58.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:58.659+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:58.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:58.713+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:58.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:58.745+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:59.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:13:59.228+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:59.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:13:59.651+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:59.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:13:59.708+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:13:59.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:13:59.796+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:00.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:00.251+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:00.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:00.697+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:00.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:00.749+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:00.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:00.802+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:01.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:01.275+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:01.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:01.701+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:01.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:01.789+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:01.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:01.796+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:02.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:02.258+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:02.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:02.687+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:02.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:02.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:02.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:02.772+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:03.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:03.235+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:03.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:03.721+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:03.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:03.759+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:03.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:03.803+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:04.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:04.202+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:04.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:04.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:04.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:04.717+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:04.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:04.831+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:05.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:05.156+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:05.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:05.677+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:05.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:05.701+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:05.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:05.856+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:06.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:06.151+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:06.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:06.651+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:06.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:06.656+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:06.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:06.819+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:07.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:07.181+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:07.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:07.609+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:07.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:07.698+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:07.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:07.869+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:08.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:08.160+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:08.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:08.599+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:08.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:08.671+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:08.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:08.837+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:09.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:09.195+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:09.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:09.578+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:09.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:09.718+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:09.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:09.804+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:10.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:10.208+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:10.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:10.608+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:10.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:10.754+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:10.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:10.832+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:11.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:11.241+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:11.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:11.643+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:11.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:11.782+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:11.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:11.828+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:12.161 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:14:12.160+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:14:12.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:12.244+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:12.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:12.631+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:12.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:12.751+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:12.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:12.843+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:13.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:13.237+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:13.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:14:13.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:14:13.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:13.666+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:13.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:13.751+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:13.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:13.810+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:14.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:14.259+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:14.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:14.688+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:14.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:14.780+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:14.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:14.830+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:15.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:15.264+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:15.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:15.678+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:15.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:15.811+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:15.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:15.836+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:16.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:16.263+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:16.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:16.672+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:16.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:16.778+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:16.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:16.876+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:17.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:17.240+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:17.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:17.645+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:17.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:17.767+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:17.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:17.849+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:18.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:18.239+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:18.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:18.639+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:18.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:18.748+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:18.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:18.880+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:19.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:19.260+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:19.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:19.592+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:19.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:19.770+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:19.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:19.843+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:20.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:20.251+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:20.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:20.635+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:20.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:20.763+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:20.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:20.847+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:21.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:21.242+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:21.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:21.623+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:21.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:21.744+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:21.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:21.833+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:22.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:22.266+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:22.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:22.604+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:22.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:22.778+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:22.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:22.839+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:23.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:23.287+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:23.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:23.612+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:23.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:23.823+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:23.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:23.825+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:24.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:24.283+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:24.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:24.634+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:24.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:24.789+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:24.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:24.865+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:25.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:25.292+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:25.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:25.666+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:25.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:25.829+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:25.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:25.844+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:26.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:26.274+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:26.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:26.706+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:26.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:26.833+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:26.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:26.858+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:27.177 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:14:27.174+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:14:27.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:27.245+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:27.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:27.716+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:27.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:27.794+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:27.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:27.878+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:28.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:28.260+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:28.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:28.757+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:28.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:28.807+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:28.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:28.842+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:29.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:29.213+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:29.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:29.771+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:29.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:29.815+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:29.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:29.842+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:30.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:30.180+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:30.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:30.791+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:30.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:30.792+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:30.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:30.816+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:31.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:31.192+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:31.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:31.745+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:31.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:31.760+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:31.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:31.831+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:32.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:32.234+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:32.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:32.723+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:32.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:32.735+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:32.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:32.858+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:33.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:33.244+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:33.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:33.766+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:33.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:33.767+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:33.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:33.895+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:34.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:34.221+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:34.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:34.766+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:34.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:34.773+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:34.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:34.872+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:35.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:35.228+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:35.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:35.734+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:35.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:35.776+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:35.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:35.917+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:36.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:36.201+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:36.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:36.700+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:36.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:36.808+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:36.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:36.948+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:37.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:37.155+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:37.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:37.717+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:37.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:37.766+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:37.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:37.927+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:38.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:38.137+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:38.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:38.705+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:38.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:38.812+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:38.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:38.921+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:39.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:39.187+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:39.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:39.750+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:39.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:39.814+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:39.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:39.970+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:40.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:40.152+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:40.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:40.762+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:40.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:40.765+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:40.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:40.971+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:41.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:41.106+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:41.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:41.735+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:41.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:41.802+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:41.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:41.980+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:42.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:42.126+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:42.193 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:14:42.190+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:14:42.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:42.734+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:42.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:42.817+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:43.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:42.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:43.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:43.152+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:43.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:14:43.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:14:43.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:43.707+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:43.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:43.783+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:44.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:44.007+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:44.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:44.192+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:44.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:44.711+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:44.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:44.739+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:45.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:45.046+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:45.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:45.209+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:45.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:45.690+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:45.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:45.704+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:46.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:45.999+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:46.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:46.234+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:46.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:46.663+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:46.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:46.697+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:47.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:46.999+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:47.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:47.188+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:47.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:47.654+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:47.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:47.691+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:47.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:47.978+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:48.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:48.174+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:48.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:48.608+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:48.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:48.694+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:48.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:48.963+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:49.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:49.168+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:49.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:49.616+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:49.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:49.742+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:49.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:49.958+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:50.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:50.135+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:50.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:50.667+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:50.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:50.766+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:50.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:50.948+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:51.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:51.156+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:51.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:51.696+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:51.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:51.799+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:51.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:51.920+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:52.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:52.184+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:52.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:52.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:52.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:52.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:52.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:52.897+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:53.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:53.224+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:53.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:53.638+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:53.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:53.719+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:53.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:53.914+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:54.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:54.208+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:54.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:54.624+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:54.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:54.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:54.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:54.893+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:55.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:55.250+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:55.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:55.671+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:55.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:55.728+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:55.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:55.905+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:56.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:56.291+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:56.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:56.682+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:56.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:56.696+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:56.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:56.884+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:57.199 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:14:57.196+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:14:57.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:57.269+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:57.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:57.648+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:57.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:57.734+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:57.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:57.876+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:58.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:58.277+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:58.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:58.661+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:58.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:58.688+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:58.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:58.852+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:59.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:14:59.263+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:59.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:14:59.651+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:59.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:14:59.682+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:14:59.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:14:59.887+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:00.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:00.281+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:00.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:00.655+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:00.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:00.697+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:00.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:00.925+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:01.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:01.304+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:01.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:01.605+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:01.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:01.717+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:01.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:01.974+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:02.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:02.266+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:02.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:02.610+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:02.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:02.685+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:03.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:03.020+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:03.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:03.226+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:03.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:03.647+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:03.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:03.652+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:04.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:04.061+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:04.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:04.220+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:04.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:04.640+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:04.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:04.679+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:05.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:05.044+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:05.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:05.218+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:05.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:05.631+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:05.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:05.691+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:06.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:06.079+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:06.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:06.180+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:06.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:06.612+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:06.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:06.721+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:07.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:07.088+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:07.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:07.200+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:07.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:07.660+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:07.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:07.766+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:08.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:08.131+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:08.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:08.180+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:08.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:08.684+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:08.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:08.785+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:09.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:09.112+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:09.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:09.176+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:09.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:09.722+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:09.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:09.786+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:10.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:10.135+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:10.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:10.167+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:10.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:10.761+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:10.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:10.778+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:11.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:11.119+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:11.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:11.192+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:11.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:11.720+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:11.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:11.784+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:12.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:12.102+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:12.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:12.206+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:12.214 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:15:12.212+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:15:12.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:12.744+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:12.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:12.751+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:13.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:13.072+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:13.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:13.218+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:13.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:15:13.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:15:13.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:13.778+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:13.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:13.792+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:14.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:14.023+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:14.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:14.180+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:14.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:14.772+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:14.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:14.774+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:15.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:15.005+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:15.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:15.137+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:15.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:15.734+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:15.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:15.796+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:16.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:16.026+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:16.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:16.125+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:16.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:16.738+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:16.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:16.845+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:17.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:17.012+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:17.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:17.142+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:17.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:17.717+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:17.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:17.796+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:18.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:18.048+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:18.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:18.151+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:18.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:18.716+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:18.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:18.771+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:19.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:19.069+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:19.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:19.130+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:19.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:19.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:19.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:19.784+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:20.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:20.052+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:20.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:20.082+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:20.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:20.809+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:20.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:20.827+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:21.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:21.069+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:21.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:21.098+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:21.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:21.775+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:21.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:21.865+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:22.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:22.054+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:22.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:22.142+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:22.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:22.778+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:22.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:22.888+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:23.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:23.025+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:23.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:23.125+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:23.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:23.826+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:23.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:23.843+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:24.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:24.043+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:24.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:24.118+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:24.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:24.805+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:24.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:24.852+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:25.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:25.027+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:25.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:25.100+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:25.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:25.846+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:25.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:25.864+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:26.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:26.036+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:26.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:26.105+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:26.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:26.859+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:26.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:26.865+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:27.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:27.001+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:27.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:27.147+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:27.230 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:15:27.229+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:15:27.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:27.815+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:27.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:27.886+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:28.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:28.050+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:28.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:28.127+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:28.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:28.804+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:28.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:28.838+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:29.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:29.025+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:29.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:29.140+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:29.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:29.845+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:29.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:29.860+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:30.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:30.009+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:30.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:30.139+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:30.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:30.821+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:30.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:30.877+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:30.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:30.979+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:31.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:31.158+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:31.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:31.842+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:31.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:31.923+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:31.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:31.949+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:32.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:32.191+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:32.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:32.836+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:32.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:32.879+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:32.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:32.905+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:33.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:33.187+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:33.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:33.843+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:33.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:33.871+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:33.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:33.912+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:34.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:34.176+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:34.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:34.827+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:34.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:34.873+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:34.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:34.907+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:35.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:35.208+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:35.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:35.860+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:35.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:35.869+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:35.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:35.889+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:36.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:36.222+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:36.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:36.909+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:36.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:36.918+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:36.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:36.925+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:37.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:37.201+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:37.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:37.882+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:37.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:37.918+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:37.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:37.930+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:38.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:38.228+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:38.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:38.875+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:38.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:38.880+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:38.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:38.885+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:39.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:39.263+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:39.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:39.845+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:39.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:39.866+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:39.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:39.898+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:40.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:40.244+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:40.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:40.850+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:40.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:40.886+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:40.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:40.931+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:41.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:41.268+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:41.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:41.837+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:41.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:41.921+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:41.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:41.960+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:42.246 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:15:42.244+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:15:42.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:42.303+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:42.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:42.879+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:42.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:42.886+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:42.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:42.959+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:43.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:43.312+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:43.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:15:43.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:15:43.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:43.850+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:43.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:43.908+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:43.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:43.967+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:44.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:44.362+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:44.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:44.806+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:44.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:44.878+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:44.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:44.967+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:45.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:45.363+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:45.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:45.799+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:45.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:45.866+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:45.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:45.924+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:46.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:46.372+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:46.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:46.763+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:46.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:46.836+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:46.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:46.914+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:47.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:47.416+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:47.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:47.767+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:47.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:47.877+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:47.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:47.886+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:48.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:48.406+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:48.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:48.804+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:48.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:48.876+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:48.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:48.883+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:49.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:49.399+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:49.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:49.837+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:49.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:49.853+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:49.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:49.910+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:50.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:50.410+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:50.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:50.814+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:50.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:50.866+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:50.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:50.867+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:51.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:51.384+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:51.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:51.794+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:51.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:51.855+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:51.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:51.881+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:52.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:52.350+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:52.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:52.793+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:52.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:52.899+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:52.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:52.906+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:53.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:53.330+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:53.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:53.766+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:53.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:53.874+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:53.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:53.895+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:54.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:54.378+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:54.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:54.771+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:54.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:54.828+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:54.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:54.848+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:55.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:55.419+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:55.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:55.734+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:55.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:55.787+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:55.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:55.819+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:56.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:56.375+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:56.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:56.735+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:56.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:56.766+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:56.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:56.869+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:57.262 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:15:57.260+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:15:57.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:57.365+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:57.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:57.694+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:57.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:57.813+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:57.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:57.860+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:58.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:58.355+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:58.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:58.678+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:58.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:58.798+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 24 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:58.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:58.857+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:59.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:15:59.360+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:59.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:15:59.708+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:59.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:15:59.829+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:15:59.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:15:59.830+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:00.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:00.334+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:00.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:00.722+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:00.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:00.837+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:00.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:00.867+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:01.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:01.373+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:01.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:01.682+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:01.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:01.852+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:01.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:01.864+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:02.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:02.327+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:02.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:02.724+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:02.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:02.861+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:02.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:02.880+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:03.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:03.291+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:03.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:03.736+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:03.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:03.886+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:03.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:03.898+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:04.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:04.341+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:04.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:04.749+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:04.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:04.882+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:04.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:04.883+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:05.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:05.359+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:05.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:05.782+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:05.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:05.857+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:05.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:05.857+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:06.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:06.360+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:06.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:06.764+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:06.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:06.812+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:06.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:06.907+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:07.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:07.321+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:07.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:07.721+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:07.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:07.826+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:07.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:07.877+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:08.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:08.347+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:08.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:08.681+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:08.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:08.778+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:08.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:08.927+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:09.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:09.301+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:09.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:09.731+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:09.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:09.753+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:09.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:09.889+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:10.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:10.335+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:10.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:10.767+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:10.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:10.782+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:10.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:10.939+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:11.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:11.304+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:11.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:11.735+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:11.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:11.782+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:11.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:11.910+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:12.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:12.258+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:12.277 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:16:12.275+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:16:12.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:12.721+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:12.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:12.743+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:12.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:12.881+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:13.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:13.247+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:13.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:13.686+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:13.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:13.699+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:13.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:13.834+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:13.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:16:13.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:16:14.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:14.274+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:14.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:14.678+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:14.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:14.742+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:14.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:14.822+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:15.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:15.301+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:15.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:15.675+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:15.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:15.726+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:15.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:15.872+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:16.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:16.284+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:16.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:16.635+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:16.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:16.735+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:16.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:16.908+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:17.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:17.237+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:17.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:17.659+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:17.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:17.741+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:17.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:17.910+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:18.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:18.221+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:18.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:18.637+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:18.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:18.745+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:18.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:18.879+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:19.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:19.263+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:19.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:19.653+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:19.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:19.724+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:19.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:19.837+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:20.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:20.264+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:20.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:20.702+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:20.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:20.762+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:20.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:20.853+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:21.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:21.218+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:21.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:21.715+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:21.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:21.777+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:21.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:21.869+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:22.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:22.247+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:22.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:22.738+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:22.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:22.757+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:22.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:22.916+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:23.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:23.255+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:23.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:23.754+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:23.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:23.773+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:23.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:23.872+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:24.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:24.257+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:24.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:24.738+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:24.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:24.780+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:24.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:24.831+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:25.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:25.213+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:25.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:25.761+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:25.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:25.826+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:25.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:25.860+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:26.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:26.166+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:26.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:26.767+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:26.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:26.830+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:26.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:26.849+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:27.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:27.180+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:27.293 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:16:27.291+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:16:27.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:27.797+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:27.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:27.802+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:27.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:27.813+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:28.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:28.164+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:28.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:28.787+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:28.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:28.816+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:28.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:28.825+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:29.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:29.118+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:29.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:29.789+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:29.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:29.803+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:29.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:29.839+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:30.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:30.143+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:30.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:30.773+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:30.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:30.797+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:30.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:30.865+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:31.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:31.155+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:31.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:31.786+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:31.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:31.841+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:31.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:31.842+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:32.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:32.176+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:32.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:32.802+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:32.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:32.816+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:32.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:32.870+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:33.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:33.133+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:33.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:33.771+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:33.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:33.838+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:33.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:33.851+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:34.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:34.174+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:34.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:34.796+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:34.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:34.861+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:34.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:34.880+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:35.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:35.202+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:35.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:35.750+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:35.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:35.816+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:35.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:35.849+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:36.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:36.206+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:36.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:36.741+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:36.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:36.811+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:36.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:36.851+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:37.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:37.229+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:37.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:37.771+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:37.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:37.804+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:37.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:37.825+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:38.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:38.272+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:38.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:38.756+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:38.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:38.783+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:38.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:38.788+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:39.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:39.231+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:39.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:39.734+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:39.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:39.768+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:39.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:39.833+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:40.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:40.196+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:40.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:40.688+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:40.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:40.785+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:40.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:40.866+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:41.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:41.244+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:41.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:41.667+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:41.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:41.822+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:41.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:41.909+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:42.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:42.288+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:42.309 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:16:42.308+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:16:42.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:42.703+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:42.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:42.842+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:42.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:42.863+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:43.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:43.287+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:43.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:43.699+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:43.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:43.814+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:43.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:43.841+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:44.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:16:44.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:16:44.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:44.319+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:44.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:44.730+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:44.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:44.790+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:44.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:44.840+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:45.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:45.282+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:45.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:45.700+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:45.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:45.773+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:45.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:45.837+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:46.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:46.260+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:46.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:46.721+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:46.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:46.755+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:46.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:46.822+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:47.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:47.235+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:47.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:47.727+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:47.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:47.768+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:47.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:47.789+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:48.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:48.259+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:48.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:48.727+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:48.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:48.768+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:48.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:48.814+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:49.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:49.248+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:49.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:49.682+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:49.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:49.750+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:49.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:49.799+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:50.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:50.296+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:50.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:50.685+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:50.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:50.710+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:50.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:50.848+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:51.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:51.246+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:51.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:51.638+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:51.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:51.686+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:51.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:51.889+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:52.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:52.248+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:52.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:52.631+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:52.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:52.660+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:52.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:52.934+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:53.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:53.264+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:53.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:53.611+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:53.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:53.612+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:53.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:53.890+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:54.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:54.257+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:54.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:54.639+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:54.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:54.648+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:54.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:54.851+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:55.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:55.216+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:55.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:55.604+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:55.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:55.637+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:55.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:55.895+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:56.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:56.188+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:56.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:56.591+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:56.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:56.608+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:56.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:56.940+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:57.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:57.172+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:57.325 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:16:57.323+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:16:57.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:57.576+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:57.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:57.585+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:57.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:57.903+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:58.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:58.203+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:58.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:58.599+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:58.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:58.614+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:58.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:58.871+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:59.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:16:59.181+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:59.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:16:59.598+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:59.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:16:59.613+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:16:59.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:16:59.894+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:00.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:00.173+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:00.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:00.591+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:00.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:00.598+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:00.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:00.899+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:01.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:01.157+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:01.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:01.596+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:01.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:01.628+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:01.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:01.851+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:02.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:02.176+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:02.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:02.596+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:02.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:02.614+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:02.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:02.818+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:03.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:03.178+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:03.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:03.552+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:03.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:03.569+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:03.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:03.828+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:04.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:04.170+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:04.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:04.584+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:04.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:04.611+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:04.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:04.783+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:05.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:05.125+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:05.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:05.574+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:05.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:05.632+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:05.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:05.825+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:06.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:06.171+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:06.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:06.555+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:06.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:06.676+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:06.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:06.864+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:07.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:07.154+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:07.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:07.596+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:07.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:07.654+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:07.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:07.911+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:08.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:08.157+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:08.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:08.643+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:08.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:08.695+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:08.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:08.898+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:09.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:09.166+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:09.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:09.621+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:09.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:09.718+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:09.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:09.883+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:10.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:10.200+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:10.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:10.580+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:10.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:10.676+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:10.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:10.913+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:11.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:11.215+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:11.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:11.577+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:11.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:11.701+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:11.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:11.918+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:12.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:12.198+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:12.341 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:17:12.340+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:17:12.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:12.564+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:12.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:12.703+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:12.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:12.894+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:13.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:13.185+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:13.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:13.586+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:13.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:13.690+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:13.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:13.906+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:14.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:14.149+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:14.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:17:14.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:17:14.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:14.550+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:14.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:14.719+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:14.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:14.901+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:15.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:15.150+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:15.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:15.572+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:15.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:15.763+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:15.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:15.927+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:16.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:16.113+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:16.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:16.536+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:16.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:16.787+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:16.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:16.952+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:17.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:17.083+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:17.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:17.584+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:17.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:17.749+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:17.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:17.905+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:18.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:18.070+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:18.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:18.611+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:18.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:18.710+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:18.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:18.904+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:19.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:19.052+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:19.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:19.657+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:19.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:19.699+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:19.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:19.915+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:20.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:20.054+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:20.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:20.610+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:20.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:20.702+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:20.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:20.964+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:21.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:21.100+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:21.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:21.577+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:21.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:21.747+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:21.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:21.941+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:22.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:22.106+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:22.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:22.596+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:22.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:22.715+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:22.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:22.970+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:23.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:23.061+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:23.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:23.571+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:23.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:23.680+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:24.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:24.017+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:24.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:24.033+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:24.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:24.590+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:24.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:24.702+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:24.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:24.971+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:25.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:25.057+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:25.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:25.599+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:25.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:25.668+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:26.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:26.013+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:26.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:26.058+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:26.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:26.637+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:26.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:26.654+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:26.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:26.971+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:27.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:27.101+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:27.357 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:17:27.355+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:17:27.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:27.603+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:27.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:27.624+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:27.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:27.939+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:28.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:28.061+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:28.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:28.556+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:28.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:28.644+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:28.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:28.924+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:29.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:29.106+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:29.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:29.550+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:29.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:29.655+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:29.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:29.927+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:30.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:30.067+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:30.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:30.503+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:30.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:30.634+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:30.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:30.904+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:31.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:31.091+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:31.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:31.478+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:31.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:31.644+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:31.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:31.926+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:32.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:32.048+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:32.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:32.483+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:32.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:32.602+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:32.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:32.925+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:33.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:33.000+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:33.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:33.474+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:33.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:33.554+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:33.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:33.970+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:34.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:34.018+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:34.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:34.525+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:34.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:34.537+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:34.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:34.954+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:35.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:35.055+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:35.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:35.493+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:35.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:35.570+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:35.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:35.925+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:36.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:36.096+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:36.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:36.523+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:36.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:36.525+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:36.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:36.962+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:37.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:37.061+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:37.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:37.486+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:37.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:37.493+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:38.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:37.999+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:38.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:38.013+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:38.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:38.456+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:38.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:38.529+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:38.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:38.987+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:39.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:39.005+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:39.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:39.422+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:39.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:39.541+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:39.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:39.989+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:40.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:40.049+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:40.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:40.421+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:40.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:40.584+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:40.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:40.950+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:41.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:41.075+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:41.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:41.421+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:41.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:41.591+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:41.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:41.981+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:42.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:42.098+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:42.373 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:17:42.371+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:17:42.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:42.374+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:42.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:42.605+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:42.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:42.937+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:43.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:43.081+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:43.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:43.389+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:43.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:43.645+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:43.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:43.972+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:44.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:44.061+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:44.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:17:44.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:17:44.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:44.406+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:44.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:44.692+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:44.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:44.981+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:45.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:45.025+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:45.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:45.376+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:45.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:45.739+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:45.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:45.937+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:46.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:46.061+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:46.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:46.387+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:46.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:46.786+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:46.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:46.890+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:47.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:47.066+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:47.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:47.349+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:47.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:47.779+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:47.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:47.940+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:48.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:48.034+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:48.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:48.392+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:48.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:48.759+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:48.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:48.930+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:49.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:49.049+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:49.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:49.418+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:49.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:49.762+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:49.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:49.968+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:50.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:50.036+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:50.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:50.378+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:50.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:50.715+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:50.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:50.972+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:51.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:51.049+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:51.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:51.412+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:51.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:51.761+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:51.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:51.956+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:52.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:52.045+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:52.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:52.367+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:52.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:52.770+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:52.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:52.948+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:53.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:53.028+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:53.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:53.410+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:53.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:53.748+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:53.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:53.981+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:54.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:54.063+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:54.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:54.372+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:54.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:54.720+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:55.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:55.029+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:55.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:55.081+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:55.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:55.409+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:55.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:55.699+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:56.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:56.078+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:56.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:56.096+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:56.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:56.420+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:56.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:56.682+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:57.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:57.040+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:57.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:57.077+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:57.389 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:17:57.386+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:17:57.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:57.398+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:57.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:57.710+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:58.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:58.053+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:58.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:58.070+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:58.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:58.445+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:58.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:58.703+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:59.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:17:59.057+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:59.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:17:59.068+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:59.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:17:59.480+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:17:59.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:17:59.744+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:00.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:00.069+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:00.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:00.072+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:00.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:00.515+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:00.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:00.735+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:01.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:01.100+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:01.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:01.100+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:01.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:01.530+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:01.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:01.724+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:02.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:02.058+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:02.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:02.145+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:02.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:02.514+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:02.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:02.739+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:03.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:03.037+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:03.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:03.136+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:03.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:03.497+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:03.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:03.786+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:04.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:04.016+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:04.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:04.145+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:04.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:04.495+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:04.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:04.770+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:04.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:04.983+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:05.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:05.155+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:05.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:05.453+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:05.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:05.723+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:05.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:05.984+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:06.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:06.201+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:06.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:06.463+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:06.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:06.730+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:07.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:07.014+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:07.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:07.155+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:07.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:07.506+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:07.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:07.779+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:08.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:08.005+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:08.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:08.174+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:08.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:08.486+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:08.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:08.765+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:08.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:08.963+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:09.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:09.205+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:09.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:09.484+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:09.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:09.807+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:09.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:09.929+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:10.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:10.174+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:10.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:10.437+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:10.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:10.798+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:10.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:10.946+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:11.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:11.135+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:11.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:11.423+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:11.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:11.817+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:11.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:11.954+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:12.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:12.170+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:12.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:12.375+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:12.404 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:18:12.402+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:18:12.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:12.787+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:12.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:12.961+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:13.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:13.200+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:13.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:13.419+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:13.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:13.827+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:13.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:13.957+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:14.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:14.215+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:14.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:14.416+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:14.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:18:14.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:18:14.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:14.841+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:14.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:14.964+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:15.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:15.168+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:15.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:15.437+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:15.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:15.818+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:15.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:15.924+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:16.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:16.158+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:16.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:16.448+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:16.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:16.781+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:16.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:16.881+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:17.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:17.114+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:17.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:17.419+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:17.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:17.778+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:17.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:17.918+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:18.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:18.135+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:18.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:18.446+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:18.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:18.764+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:18.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:18.884+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:19.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:19.142+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:19.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:19.433+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:19.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:19.793+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:19.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:19.875+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:20.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:20.182+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:20.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:20.386+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:20.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:20.827+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:20.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:20.862+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:21.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:21.170+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:21.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:21.406+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:21.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:21.822+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:21.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:21.894+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:22.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:22.186+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:22.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:22.362+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:22.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:22.858+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:22.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:22.861+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:23.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:23.160+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:23.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:23.373+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:23.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:23.882+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:23.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:23.901+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:24.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:24.202+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:24.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:24.401+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:24.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:24.853+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:24.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:24.910+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:25.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:25.208+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:25.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:25.415+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:25.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:25.881+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:25.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:25.957+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:26.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:26.232+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:26.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:26.384+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:26.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:26.878+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:26.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:26.909+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:27.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:27.196+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:27.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:27.384+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:27.420 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:18:27.419+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:18:27.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:27.889+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:27.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:27.923+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:28.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:28.178+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:28.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:28.405+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:28.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:28.868+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:28.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:28.932+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:29.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:29.171+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:29.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:29.424+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:29.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:29.821+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:29.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:29.965+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:30.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:30.146+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:30.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:30.395+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:30.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:30.828+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:30.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:30.935+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:31.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:31.187+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:31.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:31.388+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:31.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:31.877+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:31.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:31.960+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:32.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:32.231+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:32.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:32.344+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:32.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:32.842+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:32.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:32.956+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:33.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:33.259+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:33.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:33.344+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:33.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:33.822+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:33.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:33.978+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:34.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:34.233+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:34.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:34.295+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:34.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:34.784+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:34.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:34.931+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:35.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:35.194+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:35.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:35.302+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:35.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:35.790+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:35.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:35.939+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:36.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:36.241+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:36.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:36.348+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:36.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:36.792+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:36.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:36.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:37.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:37.215+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:37.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:37.331+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:37.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:37.794+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:37.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:37.943+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:38.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:38.209+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:38.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:38.305+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:38.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:38.777+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:38.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:38.926+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:39.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:39.249+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:39.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:39.292+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:39.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:39.796+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:39.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:39.932+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:40.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:40.260+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:40.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:40.316+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:40.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:40.762+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:40.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:40.956+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:41.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:41.285+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:41.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:41.323+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:41.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:41.804+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:41.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:41.998+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:42.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:42.308+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:42.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:42.317+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:42.436 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:18:42.434+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:18:42.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:42.817+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:42.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:42.958+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:43.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:43.317+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:43.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:43.319+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:43.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:43.855+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:43.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:43.947+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:44.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:44.312+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:44.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:44.360+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:44.562 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:18:44.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:18:44.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:44.872+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:44.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:44.970+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:45.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:45.283+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:45.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:45.318+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:45.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:45.847+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:45.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:45.966+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:46.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:46.305+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:46.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:46.306+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:46.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:46.888+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:46.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:46.977+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:47.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:47.310+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:47.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:47.347+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:47.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:47.891+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:48.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:48.009+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:48.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:48.284+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:48.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:48.346+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:48.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:48.873+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:49.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:49.005+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:49.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:49.247+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:49.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:49.357+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:49.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:49.836+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:49.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:49.974+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:50.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:50.242+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:50.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:50.338+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:50.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:50.787+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:51.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:51.017+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:51.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:51.205+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:51.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:51.347+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:51.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:51.819+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:51.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:51.970+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:52.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:52.205+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:52.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:52.329+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:52.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:52.799+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:52.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:52.939+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:53.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:53.251+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:53.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:53.283+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:53.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:53.847+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:53.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:53.952+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:54.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:54.248+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:54.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:54.288+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:54.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:54.861+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:54.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:54.934+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:55.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:55.212+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:55.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:55.282+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:55.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:55.821+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:55.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:55.982+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:56.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:56.215+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:56.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:56.252+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:56.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:56.804+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:56.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:56.982+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:57.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:57.252+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:57.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:57.271+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:57.445 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:18:57.442+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:18:57.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:57.826+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:57.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:57.958+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:58.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:58.283+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:58.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:58.310+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:58.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:58.847+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:58.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:58.921+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:59.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:18:59.280+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:59.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:18:59.283+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:59.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:18:59.867+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:18:59.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:18:59.900+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:00.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:00.268+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:00.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:00.302+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:00.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:00.839+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:00.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:00.937+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:01.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:01.267+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:01.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:01.314+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:01.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:01.876+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:01.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:01.930+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:02.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:02.235+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:02.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:02.329+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:02.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:02.912+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:02.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:02.936+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:03.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:03.237+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:03.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:03.344+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:03.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:03.950+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:03.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:03.983+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:04.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:04.195+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:04.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:04.331+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:04.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:04.984+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:05.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:05.025+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:05.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:05.167+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:05.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:05.313+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:05.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:05.967+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:06.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:06.024+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:06.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:06.199+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:06.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:06.321+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:06.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:06.978+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:07.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:07.031+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:07.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:07.162+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:07.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:07.371+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:07.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:07.955+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:08.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:08.057+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:08.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:08.162+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:08.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:08.413+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:09.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:09.000+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:09.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:09.061+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:09.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:09.209+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:09.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:09.455+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:09.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:09.973+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:10.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:10.059+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:10.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:10.181+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:10.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:10.472+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:10.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:10.988+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:11.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:11.019+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:11.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:11.157+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:11.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:11.515+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:12.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:12.000+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:12.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:12.006+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:12.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:12.110+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:12.461 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:19:12.458+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:19:12.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:12.549+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:12.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:12.957+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:12.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:12.970+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:13.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:13.119+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:13.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:13.594+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:13.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:13.965+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:13.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:13.968+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:14.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:14.146+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:14.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:14.568+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:14.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:19:14.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:19:14.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:14.978+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:14.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:14.986+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:15.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:15.184+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:15.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:15.535+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:15.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:15.958+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:16.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:16.008+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:16.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:16.147+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:16.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:16.579+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:16.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:16.975+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:16.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:16.989+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:17.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:17.186+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:17.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:17.546+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:17.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:17.936+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:17.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:17.988+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:18.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:18.176+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:18.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:18.568+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:18.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:18.947+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:18.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:18.986+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:19.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:19.152+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:19.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:19.579+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:19.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:19.922+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:20.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:20.007+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:20.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:20.178+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:20.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:20.623+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:20.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:20.887+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:20.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:20.973+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:21.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:21.206+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:21.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:21.658+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:21.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:21.849+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:21.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:21.934+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:22.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:22.255+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:22.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:22.651+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:22.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:22.800+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:22.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:22.895+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:23.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:23.273+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:23.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:23.646+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:23.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:23.832+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:23.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:23.923+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:24.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:24.243+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:24.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:24.667+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:24.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:24.856+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:24.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:24.901+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:25.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:25.269+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:25.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:25.625+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:25.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:25.828+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:25.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:25.936+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:26.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:26.276+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:26.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:26.606+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:26.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:26.781+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:26.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:26.951+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:27.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:27.256+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:27.465 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:19:27.463+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:19:27.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:27.569+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:27.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:27.824+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:27.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:27.918+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:28.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:28.258+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:28.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:28.592+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:28.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:28.841+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:28.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:28.947+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:29.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:29.232+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:29.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:29.581+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:29.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:29.884+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:29.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:29.925+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:30.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:30.219+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:30.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:30.627+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:30.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:30.920+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:30.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:30.938+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:31.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:31.200+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:31.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:31.638+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:31.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:31.888+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:31.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:31.962+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:32.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:32.187+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:32.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:32.631+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:32.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:32.908+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:33.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:33.003+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:33.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:33.236+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:33.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:33.616+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:33.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:33.885+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:33.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:33.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:34.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:34.210+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:34.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:34.619+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:34.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:34.929+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:34.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:34.995+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:35.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:35.242+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:35.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:35.588+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:35.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:35.909+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:36.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:36.000+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:36.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:36.220+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:36.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:36.580+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:36.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:36.903+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:37.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:36.999+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:37.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:37.235+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:37.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:37.588+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:37.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:37.909+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:37.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:37.995+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:38.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:38.264+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:38.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:38.611+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:38.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:38.873+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:39.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:39.021+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:39.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:39.272+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:39.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:39.602+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:39.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:39.909+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:40.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:40.019+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:40.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:40.287+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:40.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:40.633+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:40.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:40.866+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:41.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:41.068+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:41.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:41.245+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:41.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:41.613+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:41.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:41.861+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:42.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:42.103+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:42.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:42.276+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:42.481 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:19:42.480+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:19:42.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:42.625+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:42.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:42.891+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:43.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:43.065+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:43.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:43.249+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:43.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:43.632+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:43.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:43.899+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:44.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:44.034+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:44.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:44.233+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:44.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:44.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:44.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:19:44.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:19:44.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:44.915+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:45.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:45.011+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:45.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:45.267+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:45.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:45.726+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:45.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:45.872+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:45.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:45.988+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:46.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:46.223+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:46.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:46.759+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:46.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:46.837+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:47.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:47.019+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:47.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:47.242+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:47.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:47.745+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:47.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:47.822+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:48.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:48.043+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:48.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:48.289+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:48.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:48.770+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:48.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:48.782+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:49.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:49.040+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:49.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:49.257+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:49.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:49.739+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:49.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:49.779+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:50.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:50.078+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:50.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:50.299+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:50.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:50.762+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:50.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:50.821+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:51.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:51.066+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:51.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:51.265+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:51.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:51.730+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:51.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:51.826+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:52.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:52.097+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:52.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:52.278+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:52.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:52.749+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:52.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:52.848+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:53.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:53.084+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:53.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:53.272+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:53.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:53.719+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:53.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:53.896+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:54.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:54.057+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:54.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:54.314+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:54.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:54.729+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:54.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:54.870+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:55.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:55.085+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:55.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:55.326+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:55.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:55.778+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:55.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:55.897+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:56.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:56.051+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:56.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:56.350+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:56.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:56.762+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:56.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:56.899+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:57.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:57.006+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:57.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:57.301+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:57.497 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:19:57.494+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:19:57.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:57.762+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:57.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:57.927+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:57.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:57.971+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:58.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:58.273+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:58.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:58.731+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:58.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:58.934+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:58.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:58.944+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:59.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:19:59.305+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:59.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:19:59.747+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:59.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:19:59.914+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:19:59.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:19:59.978+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:00.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:00.277+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:00.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:00.795+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:00.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:00.909+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:00.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:00.948+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:01.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:01.266+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:01.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:01.821+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:01.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:01.936+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:01.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:01.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:02.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:02.229+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:02.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:02.855+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:02.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:02.912+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:02.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:02.995+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:03.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:03.227+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:03.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:03.827+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:03.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:03.874+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:04.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:04.016+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:04.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:04.189+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:04.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:04.791+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:04.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:04.851+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:05.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:05.031+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:05.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:05.190+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:05.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:05.819+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:05.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:05.828+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:06.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:06.061+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:06.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:06.238+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:06.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:06.788+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:06.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:06.854+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:07.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:07.024+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:07.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:07.274+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:07.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:07.740+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:07.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:07.890+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:08.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:08.066+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:08.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:08.249+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:08.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:08.701+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:08.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:08.894+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:09.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:09.107+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:09.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:09.289+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:09.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:09.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:09.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:09.874+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:10.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:10.134+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:10.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:10.259+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:10.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:10.699+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:10.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:10.918+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:11.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:11.128+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:11.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:11.246+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:11.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:11.702+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:11.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:11.908+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:12.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:12.100+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:12.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:12.263+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:12.513 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:20:12.511+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:20:12.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:12.722+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:12.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:12.891+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:13.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:13.131+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:13.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:13.283+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:13.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:13.689+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:13.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:13.844+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:14.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:14.129+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:14.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:14.308+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:14.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:14.693+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:14.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:20:14.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:20:14.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:14.890+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:15.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:15.158+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:15.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:15.268+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:15.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:15.652+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:15.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:15.889+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:16.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:16.208+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:16.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:16.285+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:16.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:16.621+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:16.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:16.920+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:17.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:17.180+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:17.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:17.294+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:17.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:17.630+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:17.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:17.888+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:18.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:18.178+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:18.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:18.263+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:18.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:18.608+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:18.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:18.865+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:19.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:19.196+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:19.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:19.311+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:19.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:19.613+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:19.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:19.878+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:20.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:20.205+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:20.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:20.340+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:20.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:20.656+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:20.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:20.920+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:21.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:21.187+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:21.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:21.325+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:21.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:21.668+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:21.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:21.908+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:22.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:22.210+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:22.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:22.375+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:22.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:22.641+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:22.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:22.933+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:23.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:23.256+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:23.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:23.419+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:23.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:23.685+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:23.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:23.953+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:24.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:24.248+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:24.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:24.416+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:24.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:24.699+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:24.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:24.921+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:25.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:25.247+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:25.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:25.432+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:25.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:25.693+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:25.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:25.873+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:26.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:26.265+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:26.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:26.438+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:26.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:26.652+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:26.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:26.914+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:27.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:27.260+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:27.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:27.486+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:27.528 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:20:27.526+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:20:27.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:27.637+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:27.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:27.929+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:28.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:28.267+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:28.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:28.480+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:28.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:28.622+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:28.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:28.963+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:29.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:29.261+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:29.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:29.518+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:29.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:29.573+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:29.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:29.915+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:30.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:30.278+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:30.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:30.524+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:30.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:30.546+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:30.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:30.874+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:31.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:31.270+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:31.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:31.555+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:31.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:31.578+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:31.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:31.844+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:32.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:32.309+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:32.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:32.563+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:32.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:32.613+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:32.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:32.809+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:33.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:33.275+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:33.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:33.592+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:33.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:33.602+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:33.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:33.759+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:34.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:34.226+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:34.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:34.595+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:34.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:34.636+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:34.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:34.737+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:35.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:35.198+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:35.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:35.580+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:35.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:35.634+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:35.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:35.750+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:36.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:36.202+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:36.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:36.562+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:36.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:36.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:36.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:36.773+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:37.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:37.241+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:37.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:37.541+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:37.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:37.673+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:37.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:37.818+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:38.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:38.201+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:38.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:38.513+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:38.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:38.722+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:38.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:38.803+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:39.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:39.181+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:39.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:39.547+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:39.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:39.742+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:39.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:39.758+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:40.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:40.162+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:40.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:40.598+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:40.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:40.723+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:40.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:40.775+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:41.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:41.134+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:41.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:41.605+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:41.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:41.751+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:41.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:41.772+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:42.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:42.131+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:42.530 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:20:42.528+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:20:42.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:42.632+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:42.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:42.743+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:42.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:42.787+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:43.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:43.118+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:43.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:43.622+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:43.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:43.716+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:43.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:43.834+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:44.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:44.099+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:44.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:44.657+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:44.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:44.693+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:44.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:44.848+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:44.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:20:44.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:20:45.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:45.145+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:45.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:45.695+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:45.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:45.743+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:45.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:45.831+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:46.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:46.129+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:46.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:46.719+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:46.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:46.773+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:46.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:46.794+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:47.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:47.125+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:47.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:47.727+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:47.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:47.730+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:47.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:47.760+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:48.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:48.078+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:48.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:48.702+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:48.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:48.751+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:48.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:48.784+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:49.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:49.125+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:49.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:49.715+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:49.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:49.744+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:49.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:49.800+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:50.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:50.129+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:50.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:50.705+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:50.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:50.776+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:50.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:50.790+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:51.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:51.156+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:51.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:51.667+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:51.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:51.813+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:51.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:51.815+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:52.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:52.174+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:52.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:52.714+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:52.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:52.828+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:52.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:52.856+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:53.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:53.131+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:53.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:53.682+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:53.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:53.831+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:53.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:53.846+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:54.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:54.114+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:54.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:54.688+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:54.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:54.867+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:54.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:54.882+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:55.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:55.103+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:55.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:55.694+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:55.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:55.871+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:55.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:55.898+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:56.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:56.110+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:56.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:56.732+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:56.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:56.877+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:56.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:56.882+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:57.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:57.155+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:57.546 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:20:57.545+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:20:57.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:57.729+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:57.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:57.919+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:57.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:57.926+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:58.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:58.185+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:58.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:58.762+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:58.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:58.877+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:58.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:58.954+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:59.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:20:59.173+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:59.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:20:59.744+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:59.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:20:59.831+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:20:59.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:20:59.958+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:00.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:00.174+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:00.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:00.696+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:00.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:00.842+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:00.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:00.975+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:01.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:01.166+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:01.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:01.743+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:01.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:01.859+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:01.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:01.961+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:02.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:02.137+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:02.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:02.701+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:02.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:02.867+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:02.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:02.966+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:03.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:03.088+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:03.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:03.732+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:03.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:03.836+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:04.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:04.012+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:04.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:04.048+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:04.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:04.740+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:04.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:04.837+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:04.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:04.986+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:05.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:05.074+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:05.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:05.781+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:05.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:05.843+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:05.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:05.948+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:06.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:06.066+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:06.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:06.803+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:06.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:06.854+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:06.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:06.971+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:07.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:07.070+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:07.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:07.836+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:07.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:07.900+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:07.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:07.926+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:08.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:08.105+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:08.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:08.844+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:08.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:08.878+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:08.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:08.898+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:09.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:09.093+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:09.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:09.817+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:09.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:09.852+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:09.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:09.911+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:10.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:10.116+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:10.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:10.831+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:10.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:10.839+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:10.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:10.869+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:11.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:11.095+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:11.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:11.802+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:11.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:11.815+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:11.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:11.867+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:12.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:12.059+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:12.562 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:21:12.560+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:21:12.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:12.758+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:12.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:12.851+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:12.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:12.873+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:13.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:13.091+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:13.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:13.716+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:13.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:13.824+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:13.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:13.892+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:14.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:14.069+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:14.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:14.676+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:14.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:14.828+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:14.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:14.871+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:15.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:15.108+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:15.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:21:15.125 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:21:15.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:15.645+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:15.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:15.816+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:15.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:15.906+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:16.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:16.132+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:16.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:16.664+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:16.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:16.855+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:16.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:16.879+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:17.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:17.155+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:17.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:17.623+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:17.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:17.815+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:17.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:17.859+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:18.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:18.173+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:18.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:18.657+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:18.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:18.794+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:18.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:18.905+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:19.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:19.193+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:19.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:19.647+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:19.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:19.764+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:19.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:19.889+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:20.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:20.173+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:20.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:20.604+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:20.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:20.727+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:20.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:20.933+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:21.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:21.177+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:21.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:21.595+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:21.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:21.727+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:21.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:21.885+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:22.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:22.225+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:22.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:22.631+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:22.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:22.715+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:22.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:22.903+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:23.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:23.233+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:23.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:23.599+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:23.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:23.698+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:23.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:23.873+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:24.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:24.244+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:24.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:24.556+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:24.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:24.673+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:24.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:24.856+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:25.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:25.213+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:25.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:25.559+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:25.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:25.633+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:25.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:25.896+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:26.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:26.183+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:26.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:26.515+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:26.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:26.593+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:26.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:26.869+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:27.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:27.201+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:27.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:27.536+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:27.574 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:21:27.572+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:21:27.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:27.627+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:27.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:27.850+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:28.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:28.201+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:28.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:28.552+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:28.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:28.622+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:28.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:28.868+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:29.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:29.170+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:29.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:29.582+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:29.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:29.586+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:29.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:29.903+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:30.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:30.176+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:30.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:30.622+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:30.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:30.624+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:30.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:30.929+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:31.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:31.180+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:31.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:31.611+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:31.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:31.642+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:31.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:31.886+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:32.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:32.220+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:32.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:32.568+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:32.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:32.659+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:32.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:32.928+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:33.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:33.247+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:33.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:33.536+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:33.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:33.650+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:33.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:33.928+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:34.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:34.200+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:34.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:34.510+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:34.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:34.677+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:34.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:34.926+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:35.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:35.160+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:35.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:35.510+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:35.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:35.709+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:35.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:35.879+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:36.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:36.113+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:36.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:36.502+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:36.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:36.678+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:36.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:36.926+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:37.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:37.107+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:37.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:37.485+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:37.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:37.654+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:37.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:37.933+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:38.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:38.097+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:38.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:38.505+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:38.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:38.681+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:38.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:38.927+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:39.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:39.134+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:39.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:39.462+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:39.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:39.675+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:39.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:39.963+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:40.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:40.176+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:40.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:40.504+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:40.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:40.669+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:40.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:40.983+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:41.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:41.149+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:41.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:41.519+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:41.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:41.684+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:41.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:41.967+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:42.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:42.122+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:42.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:42.530+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:42.584 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:21:42.582+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:21:42.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:42.686+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:42.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:42.919+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:43.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:43.112+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:43.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:43.565+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:43.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:43.655+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:43.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:43.916+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:44.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:44.128+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:44.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:44.544+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:44.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:44.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:44.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:44.916+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:45.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:45.100+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:45.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:21:45.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:21:45.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:45.551+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:45.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:45.640+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:45.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:45.865+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:46.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:46.081+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:46.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:46.502+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:46.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:46.671+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:46.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:46.864+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:47.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:47.045+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:47.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:47.501+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:47.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:47.655+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:47.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:47.814+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:48.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:47.998+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:48.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:48.519+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:48.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:48.665+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:48.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:48.795+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:48.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:48.949+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:49.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:49.507+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:49.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:49.637+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:49.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:49.810+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:49.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:49.935+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:50.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:50.548+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:50.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:50.671+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:50.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:50.844+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:50.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:50.918+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:51.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:51.515+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:51.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:51.662+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:51.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:51.850+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:51.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:51.947+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:52.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:52.486+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:52.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:52.693+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:52.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:52.876+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:52.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:52.957+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:53.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:53.464+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:53.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:53.738+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:53.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:53.884+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:53.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:53.915+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:54.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:54.488+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:54.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:54.717+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:54.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:54.914+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:54.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:54.941+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:55.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:55.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:55.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:55.704+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:55.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:55.935+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:55.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:55.968+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:56.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:56.485+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:56.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:56.657+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:56.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:56.922+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:57.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:57.001+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:57.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:57.498+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:57.600 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:21:57.598+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:21:57.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:57.629+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:57.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:57.906+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:58.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:58.037+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:58.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:58.474+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:58.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:58.615+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:58.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:58.927+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:59.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:59.001+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:59.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:21:59.443+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:59.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:21:59.581+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:59.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:21:59.925+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:21:59.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:21:59.969+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:00.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:00.397+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:00.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:00.600+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:00.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:00.966+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:00.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:00.971+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:01.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:01.380+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:01.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:01.575+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:01.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:01.933+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:01.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:01.939+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:02.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:02.413+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:02.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:02.616+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:02.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:02.912+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:02.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:02.982+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:03.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:03.388+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:03.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:03.606+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:03.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:03.890+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:03.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:03.986+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:04.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:04.361+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:04.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:04.656+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:04.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:04.902+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:04.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:04.977+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:05.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:05.409+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:05.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:05.644+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:05.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:05.886+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:06.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:06.027+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:06.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:06.384+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:06.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:06.596+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:06.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:06.869+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:07.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:07.052+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:07.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:07.382+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:07.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:07.561+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:07.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:07.849+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:08.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:08.102+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:08.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:08.369+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:08.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:08.542+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:08.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:08.899+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:09.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:09.128+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:09.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:09.334+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:09.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:09.503+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:09.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:09.868+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:10.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:10.110+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:10.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:10.340+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:10.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:10.477+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:10.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:10.832+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:11.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:11.061+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:11.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:11.388+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:11.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:11.495+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:11.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:11.862+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:12.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:12.038+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:12.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:12.396+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:12.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:12.470+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:12.616 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:22:12.614+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:22:12.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:12.836+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:13.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:13.013+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:13.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:13.398+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:13.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:13.487+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:13.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:13.858+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:14.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:14.003+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:14.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:14.402+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:14.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:14.495+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:14.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:14.875+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:14.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:14.983+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:15.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:22:15.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:22:15.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:15.427+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:15.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:15.450+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:15.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:15.900+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:15.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:15.948+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:16.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:16.433+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:16.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:16.458+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:16.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:16.880+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:16.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:16.900+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:17.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:17.454+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:17.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:17.469+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:17.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:17.871+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:17.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:17.923+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:18.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:18.412+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:18.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:18.442+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:18.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:18.828+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:18.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:18.904+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:19.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:19.427+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:19.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:19.442+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:19.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:19.836+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:19.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:19.894+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:20.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:20.416+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:20.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:20.435+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:20.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:20.885+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:20.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:20.908+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:21.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:21.391+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:21.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:21.406+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:21.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:21.871+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:21.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:21.893+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:22.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:22.434+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:22.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:22.442+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:22.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:22.874+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:22.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:22.906+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:23.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:23.409+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:23.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:23.472+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:23.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:23.827+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:23.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:23.930+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:24.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:24.410+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:24.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:24.474+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:24.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:24.850+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:24.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:24.981+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:25.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:25.373+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:25.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:25.484+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:25.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:25.884+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:26.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:26.025+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:26.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:26.353+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:26.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:26.514+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:26.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:26.899+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:27.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:27.038+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:27.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:27.382+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:27.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:27.527+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:27.632 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:22:27.629+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:22:27.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:27.947+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:28.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:28.027+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:28.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:28.368+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:28.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:28.565+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:28.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:28.986+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:29.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:28.997+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:29.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:29.375+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:29.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:29.592+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:29.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:29.995+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:30.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:30.024+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:30.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:30.355+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:30.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:30.612+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:30.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:30.992+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:30.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:30.995+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:31.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:31.322+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:31.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:31.590+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:31.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:31.962+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:31.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:31.966+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:32.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:32.276+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:32.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:32.620+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:32.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:32.970+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:33.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:33.009+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:33.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:33.307+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:33.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:33.657+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:34.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:33.999+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:34.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:34.001+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:34.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:34.314+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:34.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:34.644+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:34.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:34.965+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:35.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:35.014+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:35.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:35.304+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:35.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:35.667+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:35.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:35.949+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:36.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:36.003+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:36.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:36.259+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:36.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:36.649+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:36.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:36.930+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:36.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:36.964+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:37.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:37.210+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:37.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:37.609+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:37.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:37.900+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:37.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:37.913+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:38.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:38.201+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:38.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:38.572+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:38.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:38.908+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:38.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:38.922+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:39.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:39.206+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:39.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:39.594+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:39.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:39.905+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:39.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:39.923+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:40.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:40.191+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:40.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:40.623+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:40.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:40.877+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:40.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:40.892+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:41.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:41.219+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:41.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:41.662+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:41.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:41.865+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:41.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:41.910+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:42.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:42.189+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:42.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:42.629+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:42.647 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:22:42.645+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:22:42.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:42.880+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:42.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:42.957+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:43.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:43.236+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:43.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:43.631+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:43.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:43.877+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:43.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:43.984+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:44.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:44.228+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:44.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:44.610+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:44.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:44.858+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:45.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:45.005+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:45.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:45.258+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:45.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:22:45.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:22:45.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:45.659+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:45.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:45.900+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:45.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:45.978+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:46.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:46.291+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:46.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:46.704+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:46.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:46.878+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:46.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:46.982+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:47.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:47.321+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:47.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:47.696+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:47.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:47.919+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:47.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:47.961+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:48.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:48.371+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:48.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:48.710+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:48.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:48.915+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:48.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:48.923+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:49.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:49.384+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:49.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:49.666+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:49.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:49.930+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:49.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:49.941+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:50.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:50.427+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:50.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:50.687+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:50.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:50.955+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:50.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:50.977+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:51.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:51.449+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:51.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:51.698+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:51.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:51.954+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:52.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:52.000+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:52.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:52.446+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:52.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:52.702+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:52.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:52.980+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:53.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:53.050+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:53.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:53.406+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:53.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:53.702+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:53.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:53.969+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:54.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:54.049+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:54.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:54.390+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:54.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:54.715+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:54.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:54.969+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:55.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:55.087+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:55.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:55.438+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:55.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:55.750+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:56.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:56.019+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:56.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:56.064+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:56.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:56.396+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:56.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:56.711+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:57.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:57.019+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:57.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:57.025+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:57.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:57.406+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:57.658 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:22:57.655+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:22:57.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:57.716+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:57.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:57.980+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:58.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:58.067+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:58.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:58.408+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:58.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:58.733+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:59.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:22:59.001+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:59.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:22:59.073+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:59.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:22:59.383+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:22:59.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:22:59.722+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:00.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:00.036+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:00.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:00.096+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:00.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:00.396+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:00.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:00.709+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:01.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:01.045+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:01.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:01.060+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:01.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:01.433+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:01.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:01.670+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:02.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:02.002+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:02.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:02.013+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:02.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:02.409+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:02.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:02.657+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:02.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:02.987+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:03.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:03.044+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:03.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:03.424+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:03.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:03.695+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:03.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:03.981+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:04.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:04.060+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:04.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:04.448+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:04.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:04.650+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:05.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:05.008+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:05.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:05.090+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:05.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:05.461+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:05.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:05.625+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:06.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:06.017+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:06.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:06.042+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:06.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:06.415+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:06.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:06.607+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:07.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:07.007+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:07.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:07.039+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:07.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:07.409+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:07.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:07.591+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:07.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:07.976+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:08.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:08.088+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:08.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:08.360+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:08.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:08.631+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:09.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:08.999+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:09.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:09.078+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:09.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:09.329+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:09.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:09.585+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:09.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:09.968+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:10.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:10.098+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:10.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:10.374+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:10.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:10.613+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:10.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:10.935+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:11.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:11.102+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:11.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:11.360+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:11.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:11.565+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:11.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:11.934+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:12.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:12.095+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:12.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:12.358+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:12.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:12.602+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:12.674 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:23:12.671+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:23:12.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:12.903+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:13.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:13.103+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:13.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:13.396+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:13.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:13.626+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:13.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:13.907+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:14.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:14.129+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:14.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:14.418+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:14.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:14.674+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:14.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:14.911+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:15.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:15.110+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:15.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:15.402+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:15.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:23:15.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:23:15.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:15.717+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:15.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:15.942+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:16.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:16.128+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:16.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:16.431+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:16.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:16.689+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:16.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:16.988+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:17.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:17.150+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:17.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:17.445+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:17.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:17.702+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:18.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:18.036+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:18.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:18.107+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:18.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:18.494+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:18.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:18.742+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:19.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:19.011+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:19.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:19.079+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:19.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:19.539+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:19.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:19.757+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:19.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:19.981+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:20.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:20.051+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:20.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:20.563+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:20.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:20.737+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:21.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:21.018+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:21.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:21.025+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:21.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:21.591+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:21.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:21.721+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:21.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:21.991+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:22.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:22.052+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:22.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:22.596+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:22.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:22.747+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:23.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:23.013+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:23.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:23.091+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:23.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:23.615+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:23.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:23.772+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:24.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:24.004+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:24.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:24.092+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:24.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:24.603+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:24.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:24.753+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:25.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:25.048+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:25.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:25.123+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:25.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:25.566+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:25.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:25.743+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:26.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:26.091+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:26.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:26.111+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:26.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:26.575+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:26.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:26.729+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:27.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:27.077+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:27.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:27.118+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:27.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:27.529+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:27.683 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:23:27.681+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:23:27.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:27.720+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:28.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:28.095+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:28.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:28.148+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:28.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:28.538+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:28.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:28.672+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:29.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:29.100+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:29.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:29.123+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:29.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:29.532+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:29.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:29.657+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:30.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:30.098+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:30.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:30.120+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:30.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:30.493+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:30.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:30.660+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:31.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:31.050+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:31.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:31.106+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:31.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:31.522+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:31.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:31.623+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:32.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:32.040+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:32.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:32.084+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:32.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:32.485+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:32.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:32.593+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:33.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:33.046+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:33.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:33.074+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:33.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:33.454+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:33.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:33.583+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:34.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:34.033+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:34.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:34.071+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:34.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:34.458+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:34.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:34.622+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:35.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:35.022+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:35.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:35.042+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:35.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:35.471+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:35.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:35.660+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:35.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:35.996+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:36.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:36.073+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:36.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:36.492+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:36.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:36.703+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:36.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:36.978+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:37.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:37.054+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:37.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:37.491+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:37.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:37.662+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:37.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:37.971+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:38.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:38.032+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:38.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:38.507+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:38.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:38.662+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:39.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:39.008+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:39.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:39.062+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:39.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:39.547+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:39.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:39.644+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:39.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:39.968+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:40.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:40.062+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:40.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:40.503+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:40.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:40.663+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:41.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:41.008+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:41.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:41.106+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:41.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:41.541+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:41.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:41.656+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:41.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:41.964+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:42.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:42.078+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:42.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:42.494+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:42.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:42.632+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:42.691 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:23:42.689+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:23:42.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:42.932+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:43.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:43.085+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:43.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:43.466+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:43.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:43.610+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:43.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:43.981+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:44.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:44.042+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:44.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:44.419+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:44.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:44.653+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:44.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:44.954+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:45.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:45.053+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:45.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:45.424+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:45.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:45.624+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:45.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:23:45.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:23:45.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:45.906+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:46.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:46.100+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:46.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:46.397+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:46.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:46.625+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:46.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:46.939+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:47.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:47.081+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:47.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:47.357+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:47.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:47.669+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:47.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:47.922+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:48.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:48.092+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:48.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:48.397+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:48.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:48.663+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:48.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:48.947+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:49.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:49.058+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:49.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:49.370+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:49.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:49.621+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:49.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:49.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:50.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:50.065+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:50.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:50.371+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:50.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:50.671+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:50.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:50.934+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:51.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:51.114+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:51.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:51.409+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:51.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:51.633+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:51.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:51.921+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:52.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:52.154+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:52.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:52.370+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:52.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:52.613+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:52.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:52.899+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:53.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:53.175+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:53.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:53.338+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:53.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:53.644+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:53.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:53.925+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:54.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:54.212+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:54.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:54.343+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:54.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:54.622+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:54.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:54.890+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:55.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:55.199+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:55.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:55.356+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:55.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:55.668+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:55.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:55.937+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:56.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:56.162+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:56.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:56.357+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:56.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:56.671+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:56.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:56.973+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:57.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:57.171+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:57.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:57.324+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:57.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:57.623+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:57.706 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:23:57.705+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:23:57.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:57.956+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:58.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:58.142+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:58.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:58.324+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:58.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:58.603+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:59.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:23:59.002+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:59.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:23:59.157+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:59.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:23:59.348+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:23:59.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:23:59.572+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:00.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:00.004+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:00.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:00.153+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:00.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:00.387+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:00.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:00.594+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:01.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:01.017+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:01.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:01.136+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:01.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:01.349+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:01.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:01.546+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:01.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:01.980+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:02.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:02.176+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:02.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:02.395+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:02.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:02.565+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:02.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:02.972+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:03.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:03.151+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:03.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:03.404+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:03.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:03.578+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:03.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:03.978+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:04.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:04.169+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:04.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:04.400+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:04.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:04.532+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:05.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:05.015+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:05.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:05.158+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:05.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:05.356+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:05.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:05.544+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:05.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:05.982+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:06.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:06.153+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:06.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:06.379+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:06.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:06.574+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:06.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:06.942+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:07.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:07.187+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:07.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:07.404+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:07.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:07.536+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:07.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:07.975+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:08.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:08.223+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:08.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:08.447+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:08.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:08.506+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:08.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:08.989+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:09.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:09.204+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:09.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:09.421+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:09.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:09.555+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:10.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:10.004+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:10.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:10.249+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:10.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:10.443+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:10.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:10.577+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:11.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:11.011+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:11.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:11.233+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:11.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:11.478+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:11.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:11.578+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:12.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:12.003+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:12.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:12.256+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:12.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:12.525+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:12.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:12.541+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:12.716 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:24:12.713+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:24:12.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:12.983+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:13.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:13.257+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:13.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:13.496+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:13.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:13.517+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:13.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:13.959+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:14.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:14.212+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:14.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:14.541+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:14.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:14.559+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:14.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:14.972+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:15.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:15.200+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:15.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:15.499+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:15.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:15.513+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:15.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:24:15.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:24:16.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:16.016+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:16.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:16.162+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:16.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:16.515+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:16.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:16.544+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:17.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:17.029+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:17.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:17.205+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:17.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:17.500+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:17.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:17.553+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:18.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:18.057+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:18.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:18.239+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:18.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:18.465+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:18.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:18.552+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:19.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:19.105+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:19.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:19.265+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:19.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:19.454+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:19.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:19.529+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:20.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:20.156+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:20.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:20.276+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:20.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:20.482+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:20.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:20.537+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:21.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:21.175+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:21.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:21.239+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:21.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:21.472+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:21.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:21.508+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:22.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:22.211+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:22.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:22.247+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:22.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:22.476+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:22.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:22.524+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:23.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:23.206+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:23.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:23.222+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:23.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:23.511+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:23.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:23.572+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:24.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:24.169+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:24.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:24.206+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:24.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:24.517+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:24.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:24.599+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:25.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:25.209+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:25.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:25.211+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:25.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:25.527+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:25.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:25.574+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:26.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:26.190+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:26.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:26.212+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:26.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:26.535+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:26.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:26.610+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:27.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:27.170+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:27.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:27.256+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:27.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:27.518+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:27.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:27.656+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:27.717 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:24:27.714+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:24:28.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:28.190+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:28.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:28.264+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:28.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:28.533+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:28.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:28.675+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:29.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:29.183+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:29.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:29.286+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:29.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:29.488+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:29.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:29.716+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:30.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:30.196+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:30.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:30.286+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:30.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:30.529+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:30.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:30.727+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:31.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:31.190+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:31.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:31.315+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:31.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:31.506+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:31.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:31.739+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:32.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:32.177+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:32.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:32.365+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:32.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:32.501+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:32.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:32.717+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:33.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:33.214+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:33.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:33.333+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:33.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:33.498+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:33.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:33.732+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:34.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:34.201+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:34.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:34.383+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:34.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:34.517+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:34.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:34.782+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:35.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:35.181+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:35.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:35.400+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:35.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:35.517+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:35.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:35.826+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:36.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:36.146+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:36.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:36.351+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:36.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:36.554+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:36.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:36.808+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:37.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:37.105+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:37.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:37.324+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:37.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:37.582+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:37.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:37.773+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:38.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:38.064+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:38.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:38.338+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:38.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:38.575+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:38.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:38.781+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:39.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:39.038+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:39.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:39.335+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:39.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:39.544+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:39.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:39.786+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:40.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:40.070+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:40.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:40.355+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:40.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:40.579+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:40.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:40.766+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:41.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:41.038+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:41.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:41.331+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:41.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:41.615+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:41.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:41.774+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:42.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:42.009+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:42.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:42.371+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:42.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:42.600+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:42.720 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:24:42.718+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:24:42.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:42.743+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:43.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:43.023+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:43.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:43.322+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:43.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:43.587+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:43.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:43.780+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:44.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:44.047+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:44.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:44.365+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:44.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:44.553+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:44.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:44.808+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:45.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:45.044+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:45.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:45.342+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:45.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:45.553+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:45.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:45.834+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:46.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:24:46.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:24:46.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:46.058+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:46.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:46.325+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:46.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:46.581+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:46.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:46.883+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:47.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:47.043+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:47.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:47.374+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:47.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:47.599+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:47.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:47.888+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:48.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:48.058+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:48.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:48.379+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:48.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:48.636+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:48.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:48.899+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:49.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:49.031+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:49.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:49.359+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:49.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:49.595+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:49.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:49.915+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:50.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:50.077+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:50.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:50.364+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:50.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:50.621+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:50.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:50.875+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:51.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:51.066+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:51.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:51.355+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:51.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:51.664+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:51.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:51.887+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:52.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:52.109+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:52.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:52.325+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:52.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:52.643+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:52.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:52.839+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:53.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:53.064+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:53.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:53.343+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:53.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:53.666+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:53.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:53.794+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:54.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:54.067+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:54.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:54.361+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:54.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:54.664+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:54.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:54.788+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:55.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:55.105+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:55.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:55.410+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:55.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:55.637+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:55.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:55.749+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:56.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:56.071+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:56.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:56.366+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:56.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:56.606+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:56.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:56.772+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:57.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:57.075+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:57.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:57.405+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:57.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:57.564+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:57.736 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:24:57.734+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:24:57.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:57.751+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:58.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:58.095+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:58.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:58.401+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:58.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:58.591+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:58.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:58.792+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:59.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:24:59.067+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:59.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:24:59.383+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:59.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:24:59.585+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:24:59.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:24:59.746+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:00.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:00.029+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:00.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:00.354+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:00.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:00.589+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:00.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:00.697+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:01.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:01.059+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:01.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:01.360+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:01.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:01.570+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:01.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:01.663+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:02.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:02.062+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:02.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:02.330+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:02.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:02.531+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:02.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:02.619+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:03.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:03.057+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:03.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:03.379+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:03.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:03.507+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:03.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:03.573+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:04.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:04.092+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:04.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:04.363+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:04.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:04.520+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:04.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:04.621+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:05.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:05.072+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:05.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:05.379+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:05.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:05.524+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:05.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:05.589+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:06.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:06.040+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:06.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:06.368+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:06.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:06.516+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:06.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:06.623+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:07.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:07.059+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:07.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:07.347+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:07.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:07.526+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:07.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:07.655+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:08.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:08.034+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:08.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:08.353+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:08.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:08.484+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:08.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:08.615+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:09.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:09.060+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:09.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:09.374+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:09.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:09.488+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:09.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:09.604+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:10.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:10.103+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:10.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:10.399+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:10.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:10.480+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:10.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:10.633+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:11.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:11.069+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:11.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:11.397+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:11.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:11.519+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:11.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:11.643+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:12.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:12.041+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:12.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:12.409+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:12.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:12.561+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:12.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:12.630+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:12.752 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:25:12.751+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:25:13.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:13.081+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:13.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:13.442+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:13.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:13.594+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:13.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:13.621+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:14.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:14.073+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:14.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:14.459+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:14.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:14.591+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:14.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:14.593+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:15.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:15.074+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:15.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:15.430+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:15.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:15.555+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:15.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:15.562+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:16.088 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:25:16.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:16.088+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:16.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:25:16.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:16.478+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:16.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:16.598+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:16.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:16.604+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:17.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:17.119+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:17.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:17.434+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:17.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:17.567+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:17.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:17.568+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:18.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:18.163+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:18.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:18.427+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:18.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:18.548+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:18.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:18.580+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:19.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:19.208+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:19.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:19.441+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:19.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:19.557+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:19.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:19.575+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:20.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:20.167+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:20.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:20.462+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:20.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:20.548+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:20.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:20.552+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:21.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:21.158+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:21.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:21.453+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:21.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:21.542+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:21.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:21.555+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:22.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:22.200+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:22.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:22.465+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:22.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:22.515+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:22.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:22.544+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:23.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:23.163+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:23.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:23.503+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:23.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:23.512+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:23.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:23.546+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:24.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:24.211+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:24.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:24.489+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:24.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:24.513+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:24.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:24.517+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:25.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:25.172+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:25.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:25.482+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:25.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:25.483+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:25.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:25.514+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:26.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:26.182+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:26.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:26.441+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:26.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:26.453+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:26.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:26.509+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:27.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:27.186+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:27.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:27.446+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:27.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:27.479+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:27.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:27.547+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:27.768 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:25:27.765+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:25:28.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:28.197+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:28.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:28.431+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:28.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:28.473+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:28.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:28.543+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:29.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:29.209+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:29.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:29.425+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:29.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:29.442+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:29.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:29.594+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:30.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:30.161+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:30.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:30.409+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:30.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:30.479+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:30.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:30.626+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:31.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:31.210+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:31.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:31.390+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:31.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:31.484+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:31.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:31.589+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:32.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:32.241+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:32.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:32.370+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:32.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:32.507+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:32.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:32.555+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:33.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:33.211+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:33.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:33.364+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:33.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:33.499+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:33.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:33.527+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:34.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:34.237+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:34.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:34.397+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:34.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:34.492+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:34.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:34.524+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:35.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:35.219+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:35.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:35.442+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:35.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:35.485+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:35.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:35.503+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:36.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:36.181+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:36.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:36.468+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:36.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:36.479+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:36.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:36.502+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:37.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:37.215+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:37.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:37.436+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:37.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:37.443+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:37.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:37.546+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:38.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:38.253+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:38.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:38.412+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:38.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:38.432+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:38.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:38.512+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:39.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:39.273+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:39.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:39.390+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:39.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:39.422+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:39.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:39.514+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:40.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:40.245+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:40.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:40.341+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:40.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:40.394+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:40.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:40.517+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:41.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:41.202+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:41.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:41.306+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:41.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:41.405+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:41.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:41.547+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:42.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:42.223+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:42.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:42.312+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:42.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:42.452+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:42.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:42.555+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:42.784 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:25:42.782+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:25:43.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:43.230+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:43.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:43.313+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:43.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:43.478+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:43.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:43.578+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:44.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:44.226+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:44.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:44.269+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:44.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:44.438+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:44.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:44.564+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:45.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:45.219+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:45.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:45.281+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:45.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:45.415+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:45.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:45.613+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:46.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:46.192+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:46.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:25:46.228 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:25:46.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:46.275+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:46.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:46.457+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:46.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:46.650+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:47.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:47.193+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:47.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:47.312+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:47.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:47.408+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:47.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:47.657+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:48.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:48.240+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:48.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:48.310+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:48.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:48.459+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:48.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:48.681+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:49.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:49.204+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:49.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:49.339+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:49.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:49.428+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:49.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:49.631+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:50.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:50.182+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:50.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:50.348+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:50.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:50.431+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:50.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:50.615+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:51.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:51.190+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:51.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:51.333+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:51.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:51.465+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:51.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:51.626+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:52.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:52.206+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:52.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:52.335+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:52.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:52.461+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:52.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:52.662+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:53.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:53.225+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:53.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:53.365+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:53.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:53.437+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:53.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:53.666+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:54.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:54.238+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:54.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:54.372+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:54.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:54.438+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:54.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:54.617+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:55.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:55.261+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:55.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:55.336+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:55.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:55.484+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:55.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:55.646+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:56.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:56.260+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:56.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:56.329+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:56.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:56.437+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:56.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:56.599+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:57.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:57.230+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:57.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:57.323+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:57.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:57.470+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:57.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:57.649+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:57.799 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:25:57.797+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:25:58.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:58.185+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:58.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:58.344+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:58.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:58.492+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:58.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:58.668+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:59.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:25:59.202+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:59.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:25:59.379+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:59.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:25:59.536+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:25:59.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:25:59.691+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:00.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:00.212+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:00.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:00.418+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:00.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:00.555+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:00.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:00.667+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:01.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:01.177+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:01.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:01.410+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:01.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:01.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:01.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:01.681+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:02.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:02.203+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:02.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:02.399+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:02.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:02.474+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:02.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:02.675+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:03.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:03.178+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:03.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:03.413+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:03.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:03.461+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:03.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:03.687+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:04.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:04.190+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:04.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:04.464+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:04.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:04.499+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:04.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:04.679+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:05.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:05.174+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:05.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:05.449+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:05.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:05.475+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:05.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:05.652+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:06.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:06.221+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:06.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:06.441+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:06.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:06.475+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:06.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:06.609+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:07.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:07.200+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:07.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:07.422+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:07.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:07.518+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:07.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:07.591+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:08.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:08.167+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:08.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:08.448+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:08.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:08.495+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:08.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:08.542+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:09.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:09.120+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:09.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:09.448+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:09.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:09.449+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:09.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:09.532+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:10.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:10.082+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:10.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:10.446+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:10.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:10.495+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:10.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:10.575+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:11.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:11.055+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:11.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:11.474+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:11.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:11.509+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:11.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:11.569+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:12.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:12.071+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:12.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:12.500+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:12.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:12.523+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:12.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:12.537+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:12.815 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:26:12.813+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:26:13.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:13.041+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:13.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:13.523+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:13.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:13.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:13.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:13.571+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:14.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:14.070+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:14.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:14.490+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:14.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:14.521+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:14.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:14.588+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:15.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:15.082+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:15.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:15.489+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:15.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:15.506+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:15.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:15.624+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:16.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:16.104+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:16.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:26:16.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:26:16.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:16.474+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:16.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:16.496+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:16.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:16.588+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:17.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:17.143+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:17.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:17.494+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:17.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:17.518+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:17.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:17.580+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:18.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:18.139+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:18.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:18.499+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:18.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:18.550+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:18.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:18.588+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:19.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:19.178+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:19.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:19.513+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:19.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:19.567+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:19.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:19.594+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:20.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:20.214+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:20.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:20.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:20.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:20.554+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:20.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:20.570+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:21.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:21.198+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:21.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:21.484+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:21.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:21.553+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:21.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:21.590+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:22.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:22.155+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:22.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:22.443+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:22.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:22.559+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:22.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:22.582+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:23.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:23.107+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:23.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:23.492+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:23.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:23.563+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:23.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:23.584+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:24.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:24.074+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:24.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:24.491+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:24.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:24.570+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:24.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:24.613+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:25.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:25.069+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:25.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:25.474+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:25.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:25.548+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:25.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:25.623+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:26.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:26.037+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:26.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:26.482+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:26.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:26.572+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:26.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:26.621+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:27.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:27.036+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:27.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:27.500+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:27.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:27.571+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:27.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:27.618+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:27.831 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:26:27.829+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:26:28.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:28.060+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:28.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:28.495+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:28.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:28.599+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:28.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:28.619+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:29.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:29.067+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:29.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:29.509+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:29.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:29.614+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:29.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:29.620+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:30.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:30.086+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:30.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:30.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:30.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:30.594+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:30.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:30.610+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:31.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:31.065+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:31.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:31.522+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:31.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:31.553+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:31.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:31.617+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:32.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:32.088+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:32.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:32.524+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:32.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:32.536+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:32.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:32.638+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:33.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:33.096+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:33.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:33.475+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:33.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:33.541+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:33.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:33.596+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:34.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:34.124+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:34.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:34.455+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:34.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:34.558+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:34.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:34.585+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:35.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:35.120+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:35.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:35.448+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:35.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:35.542+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:35.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:35.545+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:36.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:36.101+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:36.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:36.473+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:36.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:36.562+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:36.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:36.562+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:37.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:37.061+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:37.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:37.444+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:37.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:37.542+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:37.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:37.544+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:38.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:38.034+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:38.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:38.483+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:38.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:38.517+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:38.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:38.557+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:39.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:39.030+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:39.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:39.463+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:39.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:39.504+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:39.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:39.565+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:39.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:39.981+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:40.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:40.440+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:40.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:40.539+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:40.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:40.566+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:41.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:41.008+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:41.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:41.459+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:41.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:41.537+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:41.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:41.603+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:41.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:41.991+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:42.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:42.413+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:42.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:42.547+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:42.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:42.615+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:42.847 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:26:42.845+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:26:42.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:42.951+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:43.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:43.377+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:43.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:43.524+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:43.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:43.605+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:43.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:43.974+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:44.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:44.410+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:44.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:44.549+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:44.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:44.613+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:44.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:44.955+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:45.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:45.426+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:45.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:45.509+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:45.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:45.575+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:45.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:45.972+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:46.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:46.450+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:46.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:46.479+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:46.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:26:46.491 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:26:46.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:46.604+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:46.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:46.960+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:47.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:47.479+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:47.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:47.493+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:47.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:47.636+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:47.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:47.935+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:48.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:48.504+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:48.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:48.539+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:48.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:48.613+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:48.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:48.905+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:49.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:49.498+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:49.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:49.573+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:49.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:49.629+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:49.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:49.908+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:50.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:50.468+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:50.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:50.546+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:50.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:50.582+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:50.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:50.876+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:51.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:51.451+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:51.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:51.586+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:51.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:51.593+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:51.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:51.866+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:52.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:52.479+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:52.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:52.578+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:52.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:52.607+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:52.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:52.890+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:53.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:53.513+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:53.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:53.576+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:53.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:53.598+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:53.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:53.853+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:54.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:54.491+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:54.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:54.617+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:54.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:54.647+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:54.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:54.840+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:55.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:55.445+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:55.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:55.585+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:55.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:55.686+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:55.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:55.874+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:56.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:56.458+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:56.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:56.541+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:56.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:56.690+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:56.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:56.864+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:57.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:57.472+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:57.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:57.589+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:57.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:57.727+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:57.863 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:26:57.861+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:26:57.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:57.884+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:58.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:58.482+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:58.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:58.585+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:58.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:58.759+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:58.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:58.897+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:59.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:26:59.504+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:59.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:26:59.553+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:59.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:26:59.767+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:26:59.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:26:59.854+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:00.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:00.496+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:00.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:00.593+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:00.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:00.772+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:00.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:00.827+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:01.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:01.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:01.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:01.600+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:01.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:01.777+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:01.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:01.855+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:02.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:02.559+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:02.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:02.573+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:02.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:02.791+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:02.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:02.811+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:03.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:03.523+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:03.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:03.608+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:03.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:03.808+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:03.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:03.828+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:04.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:04.487+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:04.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:04.611+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:04.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:04.779+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:04.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:04.816+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:05.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:05.469+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:05.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:05.646+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:05.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:05.803+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:05.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:05.812+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:06.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:06.478+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:06.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:06.664+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:06.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:06.787+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:06.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:06.823+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:07.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:07.465+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:07.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:07.668+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:07.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:07.752+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:07.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:07.812+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:08.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:08.499+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:08.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:08.635+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:08.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:08.747+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:08.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:08.767+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:09.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:09.465+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:09.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:09.671+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:09.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:09.711+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:09.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:09.739+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:10.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:10.429+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:10.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:10.672+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:10.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:10.713+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:10.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:10.714+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:11.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:11.395+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:11.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:11.638+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:11.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:11.666+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:11.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:11.712+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:12.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:12.433+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:12.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:12.619+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:12.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:12.656+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:12.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:12.670+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:12.879 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:27:12.876+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:27:13.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:13.395+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:13.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:13.620+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:13.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:13.645+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:13.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:13.667+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:14.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:14.403+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:14.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:14.590+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:14.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:14.614+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:14.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:14.679+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:15.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:15.446+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:15.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:15.588+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:15.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:15.594+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:15.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:15.635+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:16.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:16.408+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:16.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:16.558+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:16.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:16.588+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:16.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:16.600+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:16.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:27:16.645 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:27:17.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:17.386+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:17.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:17.545+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:17.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:17.554+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:17.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:17.618+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:18.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:18.353+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:18.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:18.523+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:18.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:18.563+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:18.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:18.660+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:19.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:19.304+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:19.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:19.538+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:19.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:19.563+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:19.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:19.620+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:20.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:20.321+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:20.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:20.573+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:20.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:20.594+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:20.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:20.611+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:21.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:21.370+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:21.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:21.583+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:21.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:21.584+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:21.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:21.653+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:22.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:22.328+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:22.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:22.550+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:22.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:22.570+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:22.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:22.630+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:23.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:23.305+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:23.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:23.551+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:23.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:23.557+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:23.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:23.582+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:24.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:24.286+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:24.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:24.561+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:24.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:24.565+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:24.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:24.612+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:25.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:25.260+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:25.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:25.606+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:25.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:25.610+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:25.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:25.619+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:26.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:26.259+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:26.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:26.610+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:26.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:26.617+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:26.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:26.623+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:27.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:27.252+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:27.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:27.584+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:27.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:27.655+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:27.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:27.662+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:27.894 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:27:27.892+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:27:28.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:28.226+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:28.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:28.601+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:28.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:28.620+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:28.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:28.624+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:29.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:29.188+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:29.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:29.576+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:29.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:29.580+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:29.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:29.640+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:30.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:30.197+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:30.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:30.607+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:30.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:30.625+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:30.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:30.630+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:31.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:31.222+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:31.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:31.560+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:31.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:31.620+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:31.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:31.670+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:32.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:32.234+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:32.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:32.519+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:32.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:32.669+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:32.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:32.718+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:33.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:33.248+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:33.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:33.511+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:33.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:33.672+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:33.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:33.674+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:34.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:34.270+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:34.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:34.488+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:34.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:34.666+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:34.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:34.723+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:35.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:35.267+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:35.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:35.446+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:35.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:35.666+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:35.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:35.772+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:36.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:36.275+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:36.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:36.432+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:36.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:36.620+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:36.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:36.802+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:37.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:37.231+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:37.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:37.482+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:37.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:37.648+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:37.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:37.771+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:38.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:38.249+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:38.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:38.520+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:38.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:38.640+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:38.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:38.805+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:39.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:39.272+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:39.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:39.510+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:39.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:39.592+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:39.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:39.774+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:40.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:40.301+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:40.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:40.552+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:40.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:40.616+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:40.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:40.812+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:41.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:41.284+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:41.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:41.562+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:41.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:41.657+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:41.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:41.857+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:42.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:42.269+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:42.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:42.569+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:42.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:42.687+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:42.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:42.900+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:42.910 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:27:42.908+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:27:43.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:43.260+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:43.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:43.572+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:43.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:43.703+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:43.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:43.871+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:44.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:44.253+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:44.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:44.599+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:44.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:44.719+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:44.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:44.860+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:45.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:45.254+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:45.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:45.562+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:45.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:45.715+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:45.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:45.865+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:46.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:46.224+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:46.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:46.564+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:46.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:46.734+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:46.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:27:46.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:27:46.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:46.899+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:47.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:47.219+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:47.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:47.577+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:47.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:47.739+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:47.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:47.881+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:48.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:48.232+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:48.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:48.624+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:48.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:48.723+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:48.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:48.863+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:49.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:49.205+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:49.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:49.621+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:49.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:49.748+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:49.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:49.835+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:50.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:50.240+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:50.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:50.646+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:50.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:50.766+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:50.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:50.839+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:51.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:51.191+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:51.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:51.688+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:51.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:51.766+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:51.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:51.848+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:52.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:52.205+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:52.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:52.692+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:52.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:52.786+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:52.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:52.894+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:53.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:53.184+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:53.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:53.671+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:53.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:53.820+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:53.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:53.943+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:54.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:54.232+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:54.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:54.694+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:54.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:54.825+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:54.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:54.943+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:55.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:55.244+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:55.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:55.653+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:55.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:55.863+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:55.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:55.896+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:56.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:56.275+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:56.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:56.668+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:56.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:56.815+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:56.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:56.894+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:57.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:57.313+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:57.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:57.680+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:57.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:57.783+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:57.926 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:27:57.924+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:27:57.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:57.940+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:58.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:58.296+0000 7f72c425d700 -1 osd.5 110 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:58.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:58.655+0000 7f389e18e700 -1 osd.4 110 get_health_metrics reporting 59 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:58.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:58.808+0000 7f596d92c700 -1 osd.6 110 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:58.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:58.923+0000 7f6e44c9f700 -1 osd.7 110 get_health_metrics reporting 47 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:58.945 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T01:27:58.943+0000 7fc564239700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:27:58.960 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T01:27:58.943+0000 7fc564239700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:27:58.982 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T01:27:59.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:27:59.277+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:59.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:27:59.699+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:59.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:27:59.789+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:27:59.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:27:59.909+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:00.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:00.284+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:00.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:00.652+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:00.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:00.837+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:00.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:00.952+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:01.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:01.269+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:01.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:01.661+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:01.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:01.837+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:01.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:01.943+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:02.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:02.252+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:02.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:02.643+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:02.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:02.881+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:02.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:02.987+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:03.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:03.267+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:03.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:03.593+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:03.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:03.905+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:03.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:03.992+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:04.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:04.246+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:04.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:04.638+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:04.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:04.939+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:04.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:04.998+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:05.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:05.205+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:05.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:05.675+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:05.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:05.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:06.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:06.020+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:06.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:06.194+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:06.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:06.701+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:06.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:06.934+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:07.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:07.025+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:07.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:07.184+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:07.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:07.676+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:07.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:07.891+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:07.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:07.998+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:08.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:08.179+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:08.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:08.662+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:08.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:08.874+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:08.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:08.997+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:09.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:09.227+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:09.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:09.696+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:09.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:09.918+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:10.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:10.010+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:10.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:10.189+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:10.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:10.690+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:10.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:10.877+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:10.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:10.969+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:11.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:11.146+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:11.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:11.723+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:11.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:11.899+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:11.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:11.964+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:12.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:12.153+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:12.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:12.727+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:12.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:12.927+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:12.940 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:28:12.939+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:28:12.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:12.960+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:13.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:13.158+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:13.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:13.748+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:13.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:13.930+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:13.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:13.946+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:14.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:14.116+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:14.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:14.786+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:14.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:14.929+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:14.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:14.929+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:15.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:15.129+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:15.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:15.797+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:15.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:15.912+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:15.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:15.954+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:16.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:16.140+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:16.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:16.798+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:16.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:28:16.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:28:16.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:16.886+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:16.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:16.967+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:17.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:17.100+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:17.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:17.773+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:17.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:17.877+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:18.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:18.003+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:18.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:18.129+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:18.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:18.730+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:18.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:18.890+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:19.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:19.026+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:19.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:19.126+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:19.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:19.694+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:19.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:19.857+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:20.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:20.046+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:20.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:20.114+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:20.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:20.739+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:20.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:20.856+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:21.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:21.011+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:21.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:21.087+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:21.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:21.748+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:21.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:21.828+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:22.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:22.002+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:22.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:22.098+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:22.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:22.730+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:22.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:22.875+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:23.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:23.051+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:23.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:23.105+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:23.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:23.730+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:23.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:23.904+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:24.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:24.042+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:24.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:24.093+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:24.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:24.762+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:24.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:24.950+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:25.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:25.057+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:25.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:25.062+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:25.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:25.765+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:25.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:25.953+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:26.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:26.010+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:26.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:26.064+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:26.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:26.727+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:27.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:27.000+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:27.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:27.048+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:27.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:27.077+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:27.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:27.694+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:27.957 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:28:27.954+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:28:28.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:28.028+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:28.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:28.032+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:28.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:28.104+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:28.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:28.741+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:29.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:29.030+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:29.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:29.057+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:29.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:29.104+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:29.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:29.729+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:30.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:30.049+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:30.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:30.051+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:30.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:30.079+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:30.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:30.744+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:31.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:31.003+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:31.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:31.084+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:31.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:31.087+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:31.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:31.773+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:32.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:31.998+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:32.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:32.059+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:32.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:32.082+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:32.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:32.782+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:32.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:32.994+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:33.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:33.052+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:33.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:33.098+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:33.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:33.805+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:33.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:33.969+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:34.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:34.060+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:34.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:34.090+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:34.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:34.766+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:34.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:34.988+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:35.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:35.028+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:35.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:35.055+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:35.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:35.744+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:36.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:36.015+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:36.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:36.073+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:36.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:36.078+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:36.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:36.744+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:37.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:37.011+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:37.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:37.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:37.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:37.039+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:37.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:37.704+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:37.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:37.988+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:38.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:38.012+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:38.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:38.020+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:38.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:38.752+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:38.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:38.976+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:38.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:38.984+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:39.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:39.020+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:39.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:39.776+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:40.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:40.008+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:40.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:40.025+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:40.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:40.068+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:40.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:40.786+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:41.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:41.021+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:41.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:41.030+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:41.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:41.033+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:41.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:41.739+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:41.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:41.994+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:42.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:42.008+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:42.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:42.014+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:42.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:42.720+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:42.973 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:28:42.971+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:28:43.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:43.010+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:43.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:43.010+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:43.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:43.027+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:43.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:43.719+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:43.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:43.987+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:43.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:43.996+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:44.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:44.025+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:44.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:44.739+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:44.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:44.989+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:44.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:44.993+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:44.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:44.994+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:45.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:45.779+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:46.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:45.999+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:46.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:46.019+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:46.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:46.028+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:46.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:46.796+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:46.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:46.990+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:28:47.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:28:47.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:47.016+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:47.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:47.045+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:47.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:47.774+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:47.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:47.980+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:48.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:48.011+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:48.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:48.033+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:48.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:48.777+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:49.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:49.017+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:49.028 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:49.026+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:49.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:49.048+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:49.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:49.792+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:49.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:49.987+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:50.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:50.001+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:50.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:50.042+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:50.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:50.771+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:50.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:50.972+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:51.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:50.999+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:51.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:51.017+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:51.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:51.781+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:51.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:51.953+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:51.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:51.959+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:52.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:52.019+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:52.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:52.763+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:52.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:52.905+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:52.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:52.974+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:52.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:52.981+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:53.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:53.767+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:53.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:53.928+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:53.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:53.974+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:54.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:54.007+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:54.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:54.770+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:54.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:54.943+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:54.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:54.952+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:55.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:55.012+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:55.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:55.815+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:55.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:55.905+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:55.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:55.975+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:55.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:55.976+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:56.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:56.787+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:56.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:56.929+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:56.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:56.956+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:57.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:57.004+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:57.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:57.742+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:57.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:57.925+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:57.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:57.933+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:57.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:57.961+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:57.989 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:28:57.986+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:28:58.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:58.696+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:58.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:58.899+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:58.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:58.954+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:58.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:28:58.991+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:59.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:28:59.701+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:59.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:28:59.903+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:28:59.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:28:59.962+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:00.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:00.025+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:00.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:00.681+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:00.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:00.928+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:00.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:00.992+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:00.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:00.994+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:01.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:01.728+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:01.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:01.899+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:01.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:01.980+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:01.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:01.989+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:02.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:02.752+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:02.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:02.901+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:02.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:02.957+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:02.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:02.957+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:03.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:03.710+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:03.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:03.898+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:03.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:03.927+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:03.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:03.993+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:04.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:04.663+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:04.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:04.860+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:04.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:04.940+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:04.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:04.990+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:05.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:05.621+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:05.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:05.852+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:05.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:05.947+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:06.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:05.997+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:06.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:06.648+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:06.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:06.850+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:06.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:06.959+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:06.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:06.988+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:07.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:07.637+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:07.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:07.856+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:07.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:07.924+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:07.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:07.964+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:08.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:08.684+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:08.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:08.858+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:08.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:08.938+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:08.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:08.971+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:09.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:09.695+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:09.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:09.818+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:09.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:09.952+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:09.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:09.986+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:10.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:10.715+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:10.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:10.848+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:10.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:10.920+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:10.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:10.980+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:11.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:11.698+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:11.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:11.801+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:11.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:11.917+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:11.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:11.943+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:12.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:12.738+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:12.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:12.777+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:12.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:12.900+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:12.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:12.949+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:13.004 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:29:13.002+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:29:13.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:13.736+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:13.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:13.783+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:13.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:13.928+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:13.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:13.992+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:14.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:14.711+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:14.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:14.829+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:14.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:14.929+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:14.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:14.960+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:15.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:15.686+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:15.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:15.816+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:15.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:15.944+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:16.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:16.010+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:16.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:16.645+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:16.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:16.773+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:16.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:16.937+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:17.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:17.029+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:17.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:29:17.165 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:29:17.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:17.680+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:17.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:17.766+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:17.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:17.912+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:18.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:18.016+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:18.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:18.726+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:18.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:18.796+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:18.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:18.940+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:18.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:18.970+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:19.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:19.760+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:19.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:19.805+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:19.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:19.916+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:19.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:19.966+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:20.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:20.803+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:20.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:20.825+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:20.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:20.905+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:20.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:20.992+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:21.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:21.797+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:21.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:21.829+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:21.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:21.888+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:22.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:22.038+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:22.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:22.753+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:22.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:22.790+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:22.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:22.866+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:23.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:23.043+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:23.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:23.754+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:23.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:23.764+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:23.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:23.822+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:24.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:24.033+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:24.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:24.745+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:24.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:24.738+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:24.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:24.832+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:25.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:25.041+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:25.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:25.740+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:25.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:25.749+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:25.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:25.816+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:26.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:26.047+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:26.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:26.727+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:26.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:26.770+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:26.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:26.851+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:27.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:27.060+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:27.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:27.695+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:27.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:27.749+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:27.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:27.818+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:28.020 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:29:28.017+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:29:28.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:28.078+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:28.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:28.708+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:28.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:28.716+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:28.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:28.793+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:29.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:29.113+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:29.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:29.687+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:29.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:29.729+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:29.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:29.765+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:30.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:30.131+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:30.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:30.654+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:30.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:30.712+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:30.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:30.780+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:31.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:31.170+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:31.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:31.626+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:31.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:31.729+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:31.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:31.753+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:32.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:32.187+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:32.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:32.600+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:32.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:32.699+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:32.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:32.749+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:33.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:33.212+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:33.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:33.615+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:33.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:33.707+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:33.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:33.715+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:34.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:34.206+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:34.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:34.593+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:34.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:34.698+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:34.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:34.736+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:35.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:35.211+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:35.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:35.557+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:35.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:35.689+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:35.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:35.729+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:36.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:36.251+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:36.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:36.511+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:36.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:36.670+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:36.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:36.758+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:37.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:37.234+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:37.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:37.465+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:37.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:37.692+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:37.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:37.787+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:38.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:38.255+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:38.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:38.498+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:38.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:38.709+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:38.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:38.788+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:39.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:39.224+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:39.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:39.463+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:39.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:39.700+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:39.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:39.740+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:40.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:40.201+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:40.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:40.465+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:40.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:40.718+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:40.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:40.726+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:41.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:41.159+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:41.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:41.501+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:41.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:41.730+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:41.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:41.764+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:42.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:42.209+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:42.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:42.523+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:42.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:42.694+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:42.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:42.741+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:43.028 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:29:43.026+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:29:43.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:43.216+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:43.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:43.525+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:43.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:43.709+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:43.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:43.781+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:44.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:44.167+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:44.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:44.508+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:44.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:44.677+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:44.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:44.749+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:45.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:45.121+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:45.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:45.470+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:45.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:45.715+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:45.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:45.731+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:46.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:46.102+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:46.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:46.494+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:46.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:46.756+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:46.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:46.759+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:47.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:47.112+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:47.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:29:47.260 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:29:47.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:47.483+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:47.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:47.716+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:47.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:47.740+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:48.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:48.111+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:48.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:48.499+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:48.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:48.752+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:48.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:48.774+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:49.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:49.154+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:49.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:49.457+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:49.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:49.751+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:49.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:49.782+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:50.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:50.191+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:50.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:50.421+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:50.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:50.716+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:50.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:50.758+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:51.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:51.200+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:51.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:51.393+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:51.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:51.727+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:51.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:51.744+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:52.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:52.182+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:52.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:52.385+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:52.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:52.710+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:52.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:52.728+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:53.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:53.155+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:53.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:53.348+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:53.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:53.712+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:53.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:53.761+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:54.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:54.195+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:54.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:54.308+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:54.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:54.721+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:54.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:54.807+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:55.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:55.243+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:55.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:55.297+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:55.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:55.735+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:55.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:55.812+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:56.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:56.251+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:56.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:56.271+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:56.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:56.772+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:56.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:56.852+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:57.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:57.246+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:57.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:57.286+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:57.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:57.811+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:57.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:57.865+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:58.044 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:29:58.042+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:29:58.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:58.228+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:58.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:58.246+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:58.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:58.800+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:58.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:58.837+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:59.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:29:59.242+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:59.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:29:59.263+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:59.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:29:59.790+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:29:59.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:29:59.861+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:00.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:00.216+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:00.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:00.302+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:00.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:00.770+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:00.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:00.868+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:01.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:01.183+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:01.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:01.336+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:01.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:01.793+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:01.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:01.841+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:02.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:02.197+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:02.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:02.364+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:02.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:02.807+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:02.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:02.861+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:03.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:03.201+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:03.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:03.346+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:03.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:03.796+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:03.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:03.870+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:04.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:04.211+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:04.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:04.342+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:04.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:04.785+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:04.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:04.847+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:05.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:05.223+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:05.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:05.317+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:05.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:05.756+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:05.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:05.832+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:06.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:06.269+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:06.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:06.269+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:06.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:06.762+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:06.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:06.818+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:07.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:07.276+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:07.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:07.282+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:07.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:07.786+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:07.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:07.806+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:08.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:08.251+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:08.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:08.302+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:08.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:08.789+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:08.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:08.795+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:09.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:09.221+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:09.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:09.271+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:09.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:09.802+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:09.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:09.825+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:10.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:10.181+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:10.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:10.300+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:10.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:10.829+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:10.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:10.847+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:11.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:11.164+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:11.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:11.262+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:11.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:11.803+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:11.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:11.832+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:12.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:12.128+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:12.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:12.285+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:12.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:12.760+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:12.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:12.825+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:13.059 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:30:13.056+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:30:13.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:13.126+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:13.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:13.333+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:13.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:13.741+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:13.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:13.776+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:14.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:14.117+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:14.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:14.369+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:14.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:14.733+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:14.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:14.735+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:15.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:15.138+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:15.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:15.344+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:15.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:15.736+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:15.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:15.749+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:16.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:16.166+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:16.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:16.366+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:16.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:16.724+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:16.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:16.733+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:17.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:17.152+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:17.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:17.407+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:17.409 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:30:17.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:30:17.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:17.716+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:17.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:17.748+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:18.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:18.114+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:18.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:18.441+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:18.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:18.708+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:18.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:18.762+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:19.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:19.161+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:19.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:19.402+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:19.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:19.705+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:19.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:19.779+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:20.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:20.156+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:20.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:20.394+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:20.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:20.665+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:20.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:20.763+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:21.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:21.195+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:21.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:21.370+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:21.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:21.648+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:21.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:21.776+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:22.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:22.195+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:22.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:22.411+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:22.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:22.633+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:22.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:22.827+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:23.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:23.228+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:23.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:23.435+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:23.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:23.624+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:23.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:23.829+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:24.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:24.231+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:24.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:24.392+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:24.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:24.660+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:24.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:24.855+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:25.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:25.215+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:25.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:25.408+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:25.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:25.698+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:25.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:25.812+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:26.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:26.244+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:26.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:26.455+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:26.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:26.664+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:26.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:26.854+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:27.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:27.278+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:27.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:27.437+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:27.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:27.661+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:27.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:27.810+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:28.062 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:30:28.059+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:30:28.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:28.272+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:28.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:28.397+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:28.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:28.666+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:28.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:28.816+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:29.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:29.229+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:29.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:29.447+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:29.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:29.650+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:29.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:29.794+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:30.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:30.211+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:30.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:30.447+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:30.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:30.635+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:30.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:30.818+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:31.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:31.199+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:31.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:31.475+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:31.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:31.625+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:31.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:31.853+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:32.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:32.219+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:32.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:32.437+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:32.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:32.577+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:32.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:32.867+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:33.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:33.202+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:33.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:33.470+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:33.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:33.546+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:33.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:33.862+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:34.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:34.231+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:34.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:34.497+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:34.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:34.561+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:34.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:34.898+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:35.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:35.278+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:35.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:35.523+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:35.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:35.546+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:35.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:35.876+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:36.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:36.279+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:36.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:36.491+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:36.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:36.569+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:36.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:36.867+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:37.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:37.251+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:37.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:37.450+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:37.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:37.556+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:37.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:37.840+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:38.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:38.220+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:38.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:38.454+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:38.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:38.510+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:38.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:38.807+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:39.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:39.246+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:39.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:39.423+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:39.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:39.544+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:39.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:39.855+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:40.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:40.222+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:40.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:40.430+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:40.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:40.527+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:40.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:40.903+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:41.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:41.272+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:41.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:41.477+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:41.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:41.513+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:41.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:41.860+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:42.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:42.295+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:42.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:42.427+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:42.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:42.553+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:42.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:42.850+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:43.077 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:30:43.075+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:30:43.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:43.276+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:43.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:43.444+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:43.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:43.510+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:43.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:43.836+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:44.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:44.286+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:44.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:44.428+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:44.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:44.551+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:44.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:44.882+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:45.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:45.245+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:45.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:45.450+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:45.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:45.580+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:45.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:45.871+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:46.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:46.266+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:46.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:46.438+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:46.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:46.618+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:46.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:46.895+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:47.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:47.313+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:47.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:47.414+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:47.562 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:30:47.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:30:47.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:47.635+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:47.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:47.916+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:48.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:48.309+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:48.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:48.370+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:48.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:48.645+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:48.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:48.963+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:49.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:49.337+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:49.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:49.411+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:49.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:49.605+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:49.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:49.915+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:50.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:50.384+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:50.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:50.446+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:50.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:50.614+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:50.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:50.931+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:51.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:51.341+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:51.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:51.448+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:51.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:51.647+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:51.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:51.951+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:52.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:52.353+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:52.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:52.479+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:52.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:52.698+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:52.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:52.972+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:53.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:53.331+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:53.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:53.498+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:53.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:53.739+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:53.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:53.991+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:54.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:54.362+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:54.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:54.513+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:54.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:54.706+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:54.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:54.995+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:55.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:55.360+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:55.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:55.481+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:55.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:55.705+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:55.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:55.967+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:56.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:56.316+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:56.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:56.520+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:56.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:56.754+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:56.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:56.923+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:57.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:57.309+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:57.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:57.542+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:57.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:57.733+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:57.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:57.967+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:58.093 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:30:58.091+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:30:58.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:58.355+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:58.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:58.563+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:58.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:58.733+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 31 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:58.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:58.930+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:59.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:30:59.401+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:59.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:30:59.538+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:59.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:30:59.747+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:30:59.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:30:59.960+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:00.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:00.405+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:00.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:00.489+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:00.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:00.706+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:00.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:00.940+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:01.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:01.411+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:01.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:01.500+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:01.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:01.736+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:01.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:01.930+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:02.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:02.411+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:02.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:02.512+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:02.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:02.774+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:02.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:02.943+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:03.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:03.408+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:03.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:03.493+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:03.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:03.763+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:03.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:03.953+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:04.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:04.380+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:04.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:04.513+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:04.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:04.745+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:04.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:04.972+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:05.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:05.352+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:05.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:05.551+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:05.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:05.709+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:05.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:05.931+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:06.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:06.352+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:06.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:06.589+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:06.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:06.708+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:06.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:06.954+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:07.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:07.395+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:07.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:07.576+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:07.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:07.750+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:07.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:07.977+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:08.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:08.421+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:08.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:08.610+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:08.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:08.711+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:08.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:08.976+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:09.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:09.449+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:09.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:09.658+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:09.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:09.702+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:09.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:09.926+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:10.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:10.470+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:10.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:10.609+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:10.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:10.729+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:10.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:10.947+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:11.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:11.501+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:11.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:11.588+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:11.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:11.709+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:11.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:11.944+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:12.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:12.470+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:12.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:12.542+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:12.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:12.725+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:12.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:12.941+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:13.109 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:31:13.108+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:31:13.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:13.473+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:13.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:13.539+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:13.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:13.722+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:13.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:13.923+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:14.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:14.505+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:14.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:14.588+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:14.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:14.713+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:14.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:14.940+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:15.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:15.528+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:15.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:15.579+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:15.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:15.755+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:15.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:15.927+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:16.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:16.529+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:16.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:16.572+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:16.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:16.783+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:16.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:16.899+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:17.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:17.550+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:17.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:17.614+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:17.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:31:17.649 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:31:17.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:17.832+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:17.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:17.878+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:18.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:18.586+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:18.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:18.626+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:18.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:18.792+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:18.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:18.914+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:19.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:19.619+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:19.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:19.671+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:19.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:19.761+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:19.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:19.874+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:20.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:20.620+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:20.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:20.681+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:20.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:20.811+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:20.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:20.895+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:21.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:21.664+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:21.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:21.665+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:21.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:21.796+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:21.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:21.932+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:22.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:22.617+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:22.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:22.683+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:22.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:22.809+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:22.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:22.924+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:23.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:23.651+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:23.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:23.657+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:23.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:23.772+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:23.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:23.894+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:24.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:24.649+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:24.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:24.677+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:24.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:24.793+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:24.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:24.870+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:25.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:25.666+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:25.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:25.694+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:25.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:25.820+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:25.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:25.884+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:26.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:26.649+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:26.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:26.672+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:26.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:26.838+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:26.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:26.909+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:27.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:27.668+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:27.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:27.690+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:27.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:27.865+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:27.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:27.912+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:28.125 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:31:28.123+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:31:28.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:28.637+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:28.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:28.681+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:28.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:28.907+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:28.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:28.913+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:29.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:29.681+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:29.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:29.684+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:29.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:29.911+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:29.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:29.935+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:30.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:30.639+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:30.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:30.730+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:30.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:30.934+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:30.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:30.984+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:31.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:31.671+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:31.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:31.771+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:31.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:31.922+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:31.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:31.981+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:32.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:32.658+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:32.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:32.819+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:32.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:32.938+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:32.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:32.968+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:33.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:33.612+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:33.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:33.842+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:33.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:33.939+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:33.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:33.995+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:34.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:34.638+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:34.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:34.800+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:34.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:34.941+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:35.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:35.044+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:35.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:35.630+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:35.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:35.793+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:35.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:35.915+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:36.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:36.004+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:36.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:36.669+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:36.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:36.766+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:36.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:36.945+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:37.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:37.005+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:37.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:37.714+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:37.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:37.726+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:37.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:37.912+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:37.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:37.978+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:38.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:38.724+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:38.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:38.738+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:38.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:38.884+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:38.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:38.993+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:39.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:39.723+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:39.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:39.769+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:39.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:39.850+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:40.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:40.016+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:40.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:40.678+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:40.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:40.725+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:40.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:40.844+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:41.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:41.037+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:41.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:41.702+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:41.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:41.720+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:41.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:41.850+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:42.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:42.036+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:42.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:42.710+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:42.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:42.764+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:42.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:42.846+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:43.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:43.034+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:43.141 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:31:43.139+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:31:43.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:43.696+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:43.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:43.784+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:43.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:43.875+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:43.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:43.996+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:44.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:44.666+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:44.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:44.787+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:44.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:44.834+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:44.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:44.949+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:45.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:45.658+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:45.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:45.783+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:45.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:45.847+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:45.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:45.917+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:46.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:46.631+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:46.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:46.817+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:46.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:46.818+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:46.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:46.930+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:47.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:47.600+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:47.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:31:47.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:31:47.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:47.832+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:47.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:47.855+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:47.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:47.891+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:48.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:48.612+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:48.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:48.831+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:48.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:48.868+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:48.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:48.883+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:49.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:49.654+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:49.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:49.849+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:49.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:49.891+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:49.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:49.905+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:50.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:50.646+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:50.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:50.820+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:50.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:50.900+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:50.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:50.916+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:51.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:51.655+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:51.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:51.830+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:51.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:51.883+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:51.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:51.944+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:52.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:52.703+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:52.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:52.858+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:52.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:52.888+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:52.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:52.927+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:53.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:53.745+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:53.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:53.818+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:53.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:53.934+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:53.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:53.969+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:54.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:54.784+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:54.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:54.842+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:54.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:54.915+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:54.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:54.982+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:55.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:55.816+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:55.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:55.875+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:55.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:55.918+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:55.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:55.982+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:56.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:56.842+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:56.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:56.892+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:56.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:56.921+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:57.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:57.005+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:57.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:57.819+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:57.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:57.879+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:57.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:57.915+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:58.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:58.006+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:58.157 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:31:58.154+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:31:58.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:58.809+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:58.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:58.878+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:58.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:58.954+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:59.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:59.022+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:59.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:31:59.840+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:59.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:31:59.904+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:59.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:31:59.969+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:31:59.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:31:59.983+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:00.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:00.874+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:00.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:00.936+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:00.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:00.969+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:00.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:00.975+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:01.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:01.839+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:01.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:01.923+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:01.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:01.943+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:01.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:01.955+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:02.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:02.837+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:02.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:02.968+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:02.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:02.991+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:02.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:02.997+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:03.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:03.869+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:03.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:03.954+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:03.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:03.966+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:04.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:04.001+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:04.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:04.831+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:04.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:04.927+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:04.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:04.946+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:05.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:05.042+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:05.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:05.854+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:05.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:05.933+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:05.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:05.989+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:06.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:06.037+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:06.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:06.813+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:06.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:06.972+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:07.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:07.020+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:07.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:07.062+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:07.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:07.768+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:07.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:07.952+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:07.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:07.985+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:08.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:08.052+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:08.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:08.790+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:08.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:08.973+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:08.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:08.993+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:09.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:09.085+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:09.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:09.787+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:09.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:09.983+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:10.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:10.041+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:10.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:10.058+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:10.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:10.771+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:10.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:10.940+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:11.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:11.016+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:11.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:11.059+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:11.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:11.774+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:11.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:11.974+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:11.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:11.975+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:12.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:12.011+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:12.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:12.744+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:12.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:12.932+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:12.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:12.943+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:13.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:13.011+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:13.162 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:32:13.159+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:32:13.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:13.783+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:13.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:13.886+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:13.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:13.965+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:13.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:13.994+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:14.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:14.755+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:14.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:14.912+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:14.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:14.941+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:14.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:14.993+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:15.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:15.719+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:15.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:15.864+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:15.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:15.944+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:16.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:16.004+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:16.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:16.691+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:16.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:16.852+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:16.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:16.941+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:17.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:17.008+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:17.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:17.730+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:17.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:17.832+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:17.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:32:17.874 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:32:17.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:17.899+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:18.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:18.000+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:18.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:18.687+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:18.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:18.797+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:18.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:18.948+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:18.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:18.952+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:19.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:19.668+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:19.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:19.809+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:19.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:19.925+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:20.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:20.000+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:20.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:20.654+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:20.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:20.793+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:20.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:20.932+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:21.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:21.048+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:21.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:21.670+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:21.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:21.771+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:21.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:21.933+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:22.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:22.025+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:22.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:22.705+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:22.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:22.786+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:22.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:22.904+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:23.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:23.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:23.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:23.744+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:23.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:23.788+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:23.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:23.927+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:23.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:23.992+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:24.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:24.700+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:24.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:24.751+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:24.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:24.932+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:25.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:25.015+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:25.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:25.655+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:25.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:25.733+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:25.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:25.881+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:26.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:26.043+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:26.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:26.653+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:26.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:26.771+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:26.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:26.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:27.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:27.035+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:27.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:27.650+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:27.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:27.733+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:27.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:27.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:28.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:28.077+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:28.166 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:32:28.164+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:32:28.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:28.636+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:28.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:28.768+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:28.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:28.910+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:29.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:29.068+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:29.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:29.664+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:29.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:29.751+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:29.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:29.916+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:30.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:30.038+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:30.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:30.698+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:30.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:30.779+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:30.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:30.890+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:31.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:31.045+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:31.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:31.695+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:31.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:31.788+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:31.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:31.936+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:32.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:32.091+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:32.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:32.685+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:32.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:32.821+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:32.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:32.963+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:33.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:33.045+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:33.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:33.694+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:33.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:33.822+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:33.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:33.975+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:34.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:34.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:34.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:34.645+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:34.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:34.838+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:34.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:34.969+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:35.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:35.052+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:35.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:35.690+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:35.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:35.800+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:35.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:35.939+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:36.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:36.042+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:36.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:36.645+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:36.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:36.767+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:36.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:36.911+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:37.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:37.064+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:37.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:37.664+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:37.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:37.751+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:37.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:37.948+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:38.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:38.016+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:38.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:38.656+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:38.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:38.781+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:38.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:38.923+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:39.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:39.003+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:39.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:39.693+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:39.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:39.755+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:39.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:39.927+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:39.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:39.991+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:40.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:40.653+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:40.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:40.769+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:40.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:40.909+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:41.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:41.037+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:41.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:41.690+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:41.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:41.770+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:41.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:41.937+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:42.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:42.062+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:42.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:42.653+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:42.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:42.743+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:42.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:42.985+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:43.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:43.047+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:43.182 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:32:43.180+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:32:43.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:43.696+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:43.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:43.739+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:44.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:44.011+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:44.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:44.031+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:44.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:44.698+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:44.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:44.700+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:44.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:44.962+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:44.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:44.989+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:45.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:45.694+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:45.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:45.720+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:45.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:45.988+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:45.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:45.996+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:46.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:46.702+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:46.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:46.767+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:46.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:46.968+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:47.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:47.007+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:47.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:47.725+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:47.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:47.733+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:47.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:47.952+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:48.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:32:48.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:32:48.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:48.046+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:48.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:48.699+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:48.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:48.772+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:48.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:48.988+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:49.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:49.041+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:49.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:49.725+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:49.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:49.780+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:49.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:49.987+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:50.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:50.058+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:50.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:50.690+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:50.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:50.737+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:51.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:51.019+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:51.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:51.030+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:51.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:51.728+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:51.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:51.738+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:52.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:52.004+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:52.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:52.016+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:52.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:52.687+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:52.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:52.741+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:53.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:53.041+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:53.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:53.044+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:53.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:53.700+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:53.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:53.720+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:54.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:54.014+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:54.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:54.025+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:54.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:54.678+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:54.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:54.745+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:54.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:54.974+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:55.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:55.041+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:55.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:55.693+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:55.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:55.775+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:55.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:55.955+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:56.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:56.034+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:56.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:56.649+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:56.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:56.751+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:56.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:56.920+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:57.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:57.073+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:57.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:57.638+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:57.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:57.758+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:57.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:57.919+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:58.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:58.080+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:58.198 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:32:58.197+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:32:58.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:58.671+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:58.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:58.790+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:58.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:58.933+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:59.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:32:59.119+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:59.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:32:59.715+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:59.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:32:59.835+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:32:59.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:32:59.959+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:00.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:00.111+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:00.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:00.732+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:00.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:00.876+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:00.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:00.958+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:01.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:01.123+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:01.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:01.742+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:01.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:01.875+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:01.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:01.938+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:02.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:02.122+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:02.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:02.751+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:02.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:02.840+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:02.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:02.952+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:03.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:03.140+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:03.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:03.760+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:03.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:03.791+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:03.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:03.989+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:04.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:04.135+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:04.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:04.769+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:04.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:04.780+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:04.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:04.959+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:05.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:05.153+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:05.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:05.753+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:05.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:05.756+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:05.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:05.988+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:06.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:06.149+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:06.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:06.748+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:06.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:06.776+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:07.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:07.034+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:07.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:07.150+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:07.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:07.746+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:07.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:07.766+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:08.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:08.024+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:08.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:08.151+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:08.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:08.716+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:08.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:08.756+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:09.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:09.043+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:09.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:09.142+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:09.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:09.695+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:09.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:09.757+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:10.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:10.037+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:10.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:10.121+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:10.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:10.684+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:10.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:10.772+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:11.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:11.040+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:11.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:11.110+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:11.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:11.643+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:11.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:11.743+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:11.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:11.992+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:12.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:12.095+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:12.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:12.691+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:12.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:12.755+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:13.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:13.018+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:13.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:13.092+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:13.214 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:33:13.212+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:33:13.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:13.703+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:13.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:13.796+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:13.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:13.983+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:14.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:14.110+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:14.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:14.747+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:14.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:14.799+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:14.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:14.993+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:15.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:15.106+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:15.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:15.736+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:15.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:15.759+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:15.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:15.984+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:16.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:16.104+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:16.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:16.725+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:16.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:16.763+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:16.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:16.991+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:17.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:17.129+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:17.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:17.698+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:17.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:17.806+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:17.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:17.969+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:18.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:18.148+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:18.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:33:18.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:33:18.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:18.682+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:18.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:18.783+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:18.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:18.974+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:19.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:19.174+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:19.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:19.634+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:19.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:19.768+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:20.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:20.021+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:20.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:20.189+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:20.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:20.621+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:20.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:20.788+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:21.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:21.053+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:21.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:21.164+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:21.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:21.623+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:21.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:21.803+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:22.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:22.017+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:22.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:22.156+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:22.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:22.615+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:22.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:22.765+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:23.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:23.008+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:23.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:23.140+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:23.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:23.640+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:23.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:23.771+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:24.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:24.053+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:24.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:24.132+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:24.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:24.655+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:24.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:24.745+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:25.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:25.018+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:25.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:25.103+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:25.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:25.652+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:25.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:25.725+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:26.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:26.009+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:26.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:26.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:26.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:26.695+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:26.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:26.765+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:27.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:27.041+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:27.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:27.052+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:27.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:27.719+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:27.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:27.764+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:28.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:27.998+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:28.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:28.043+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:28.230 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:33:28.228+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:33:28.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:28.708+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:28.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:28.774+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:29.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:29.028+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:29.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:29.039+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:29.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:29.668+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:29.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:29.783+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:30.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:30.030+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:30.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:30.051+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:30.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:30.626+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:30.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:30.801+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:31.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:31.011+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:31.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:31.046+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:31.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:31.646+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:31.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:31.755+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:32.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:32.009+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:32.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:32.038+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:32.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:32.666+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:32.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:32.715+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:32.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:32.975+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:33.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:33.000+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:33.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:33.653+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:33.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:33.707+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:33.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:33.936+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:34.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:34.024+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:34.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:34.678+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:34.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:34.703+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:34.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:34.922+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:35.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:35.029+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:35.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:35.662+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:35.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:35.677+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:35.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:35.897+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:36.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:36.036+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:36.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:36.624+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:36.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:36.713+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:36.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:36.876+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:37.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:37.030+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:37.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:37.643+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:37.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:37.701+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:37.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:37.902+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:38.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:38.037+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:38.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:38.680+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:38.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:38.734+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:38.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:38.876+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:39.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:39.086+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:39.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:39.658+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:39.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:39.695+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:39.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:39.916+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:40.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:40.064+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:40.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:40.628+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:40.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:40.742+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:40.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:40.882+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:41.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:41.112+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:41.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:41.646+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:41.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:41.714+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:41.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:41.892+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:42.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:42.145+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:42.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:42.668+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:42.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:42.683+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:42.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:42.921+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:43.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:43.189+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:43.245 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:33:43.243+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:33:43.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:43.630+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:43.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:43.694+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:43.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:43.941+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:44.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:44.205+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:44.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:44.593+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:44.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:44.646+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:44.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:44.978+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:45.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:45.161+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:45.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:45.559+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:45.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:45.616+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:45.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:45.972+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:46.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:46.194+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:46.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:46.579+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:46.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:46.651+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:47.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:47.009+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:47.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:47.190+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:47.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:47.606+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:47.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:47.682+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:47.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:47.961+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:48.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:48.192+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:48.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:33:48.335 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:33:48.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:48.633+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:48.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:48.712+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:48.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:48.972+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:49.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:49.201+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:49.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:49.622+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:49.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:49.705+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:50.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:50.017+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:50.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:50.174+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:50.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:50.574+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:50.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:50.675+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:51.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:51.050+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:51.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:51.215+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:51.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:51.564+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:51.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:51.643+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:52.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:52.062+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:52.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:52.243+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:52.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:52.552+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:52.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:52.622+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:53.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:53.105+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:53.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:53.201+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:53.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:53.536+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:53.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:53.665+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:54.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:54.138+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:54.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:54.191+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:54.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:54.543+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:54.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:54.617+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:55.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:55.158+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:55.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:55.209+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:55.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:55.576+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:55.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:55.598+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:56.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:56.134+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:56.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:56.247+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:56.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:56.548+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:56.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:56.555+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:57.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:57.088+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:57.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:57.245+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:57.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:57.571+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:57.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:57.602+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:58.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:58.051+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:58.261 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:33:58.259+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:33:58.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:58.288+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:58.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:58.600+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:58.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:58.633+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:59.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:33:59.029+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:59.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:33:59.317+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:59.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:33:59.563+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:33:59.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:33:59.648+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:00.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:00.062+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:00.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:00.356+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:00.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:00.582+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:00.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:00.664+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:01.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:01.095+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:01.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:01.338+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:01.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:01.605+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:01.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:01.620+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:02.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:02.079+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:02.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:02.386+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:02.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:02.649+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:02.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:02.668+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:03.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:03.093+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:03.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:03.373+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:03.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:03.648+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:03.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:03.650+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:04.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:04.084+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:04.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:04.380+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:04.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:04.680+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:04.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:04.698+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:05.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:05.081+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:05.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:05.358+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:05.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:05.641+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:05.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:05.655+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:06.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:06.080+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:06.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:06.389+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:06.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:06.625+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:06.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:06.678+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:07.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:07.033+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:07.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:07.394+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:07.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:07.629+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:07.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:07.665+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:08.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:08.070+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:08.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:08.388+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:08.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:08.593+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:08.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:08.647+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:09.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:09.040+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:09.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:09.371+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:09.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:09.558+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:09.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:09.598+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:10.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:10.015+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:10.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:10.348+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:10.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:10.608+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:10.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:10.617+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:10.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:10.990+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:11.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:11.346+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:11.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:11.572+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:11.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:11.642+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:12.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:11.999+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:12.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:12.377+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:12.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:12.572+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:12.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:12.623+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:12.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:12.989+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:13.277 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:34:13.276+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:34:13.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:13.356+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:13.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:13.590+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:13.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:13.593+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:13.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:13.954+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:14.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:14.355+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:14.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:14.583+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:14.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:14.614+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:14.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:14.937+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:15.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:15.403+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:15.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:15.625+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:15.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:15.630+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:15.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:15.933+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:16.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:16.364+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:16.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:16.625+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:16.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:16.661+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:16.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:16.972+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:17.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:17.351+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:17.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:17.612+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:17.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:17.618+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:18.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:18.015+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:18.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:18.400+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:18.475 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:34:18.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:34:18.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:18.610+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:18.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:18.624+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:19.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:19.039+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:19.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:19.377+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:19.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:19.580+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:19.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:19.632+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:20.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:20.065+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:20.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:20.378+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:20.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:20.558+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:20.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:20.585+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:21.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:21.058+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:21.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:21.375+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:21.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:21.531+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:21.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:21.583+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:22.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:22.097+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:22.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:22.387+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:22.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:22.527+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:22.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:22.613+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:23.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:23.052+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:23.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:23.342+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:23.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:23.543+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:23.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:23.642+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:24.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:24.063+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:24.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:24.341+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:24.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:24.549+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:24.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:24.604+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:25.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:25.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:25.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:25.346+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:25.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:25.577+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:25.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:25.586+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:26.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:26.112+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:26.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:26.352+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:26.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:26.535+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:26.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:26.591+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:27.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:27.083+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:27.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:27.397+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:27.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:27.500+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:27.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:27.576+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:28.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:28.063+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:28.293 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:34:28.291+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:34:28.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:28.380+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:28.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:28.509+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:28.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:28.533+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:29.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:29.064+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:29.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:29.399+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:29.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:29.477+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:29.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:29.489+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:30.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:30.098+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:30.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:30.429+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:30.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:30.452+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:30.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:30.468+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:31.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:31.115+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:31.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:31.419+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:31.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:31.446+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:31.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:31.455+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:32.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:32.110+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:32.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:32.455+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:32.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:32.461+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:32.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:32.476+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:33.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:33.067+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:33.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:33.436+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:33.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:33.447+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:33.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:33.472+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:34.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:34.109+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:34.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:34.411+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:34.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:34.459+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:34.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:34.490+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:35.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:35.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:35.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:35.438+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:35.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:35.445+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:35.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:35.478+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:36.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:36.083+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:36.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:36.407+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:36.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:36.471+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:36.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:36.519+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:37.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:37.077+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:37.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:37.441+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:37.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:37.461+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:37.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:37.475+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:38.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:38.118+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:38.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:38.397+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:38.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:38.447+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:38.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:38.494+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:39.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:39.137+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:39.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:39.351+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:39.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:39.411+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:39.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:39.534+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:40.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:40.166+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:40.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:40.383+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:40.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:40.396+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:40.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:40.515+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:41.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:41.188+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:41.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:41.401+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:41.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:41.429+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:41.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:41.564+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:42.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:42.223+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:42.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:42.384+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:42.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:42.416+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:42.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:42.533+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:43.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:43.221+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:43.309 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:34:43.307+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:34:43.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:43.374+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:43.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:43.382+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:43.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:43.561+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:44.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:44.259+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:44.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:44.341+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:44.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:44.351+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:44.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:44.570+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:45.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:45.309+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:45.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:45.333+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:45.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:45.339+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:45.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:45.566+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:46.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:46.263+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:46.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:46.335+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:46.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:46.369+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:46.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:46.601+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:47.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:47.219+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:47.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:47.330+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:47.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:47.365+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:47.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:47.597+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:48.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:48.181+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:48.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:48.378+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:48.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:48.411+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:48.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:34:48.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:34:48.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:48.634+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:49.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:49.201+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:49.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:49.362+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:49.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:49.363+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:49.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:49.643+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:50.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:50.177+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:50.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:50.362+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:50.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:50.375+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:50.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:50.624+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:51.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:51.222+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:51.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:51.364+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:51.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:51.377+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:51.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:51.671+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:52.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:52.213+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:52.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:52.362+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:52.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:52.378+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:52.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:52.676+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:53.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:53.227+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:53.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:53.383+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:53.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:53.401+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:53.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:53.668+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:54.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:54.274+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:54.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:54.427+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:54.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:54.446+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:54.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:54.697+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:55.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:55.265+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:55.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:55.389+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:55.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:55.428+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:55.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:55.659+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:56.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:56.283+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:56.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:56.346+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:56.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:56.467+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:56.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:56.692+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:57.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:57.260+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:57.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:57.367+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:57.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:57.432+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:57.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:57.654+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:58.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:58.296+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:58.325 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:34:58.322+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:34:58.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:58.337+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:58.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:58.429+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:58.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:58.697+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:59.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:34:59.306+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:59.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:34:59.332+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:59.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:34:59.443+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:34:59.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:34:59.717+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:00.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:00.312+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:00.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:00.312+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:00.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:00.493+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:00.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:00.694+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:01.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:01.354+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:01.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:01.361+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:01.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:01.516+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:01.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:01.678+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:02.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:02.342+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:02.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:02.353+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:02.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:02.534+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:02.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:02.639+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:03.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:03.322+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:03.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:03.327+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:03.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:03.575+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:03.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:03.650+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:04.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:04.296+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:04.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:04.347+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:04.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:04.622+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:04.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:04.690+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:05.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:05.286+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:05.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:05.370+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:05.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:05.648+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:05.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:05.721+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:06.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:06.237+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:06.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:06.370+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:06.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:06.613+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:06.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:06.741+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:07.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:07.259+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:07.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:07.396+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:07.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:07.657+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:07.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:07.786+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:08.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:08.292+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:08.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:08.405+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:08.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:08.696+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:08.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:08.747+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:09.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:09.279+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:09.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:09.365+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:09.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:09.704+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:09.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:09.725+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:10.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:10.311+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:10.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:10.326+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:10.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:10.706+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:10.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:10.732+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:11.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:11.279+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:11.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:11.297+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:11.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:11.689+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:11.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:11.723+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:12.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:12.230+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:12.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:12.294+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:12.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:12.674+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:12.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:12.711+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:13.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:13.197+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:13.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:13.294+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:13.341 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:35:13.338+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:35:13.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:13.700+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:13.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:13.736+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:14.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:14.206+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:14.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:14.274+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:14.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:14.733+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:14.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:14.735+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:15.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:15.196+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:15.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:15.276+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:15.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:15.761+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:15.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:15.770+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:16.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:16.228+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:16.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:16.230+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:16.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:16.726+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:16.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:16.817+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:17.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:17.264+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:17.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:17.273+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:17.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:17.720+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:17.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:17.785+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:18.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:18.244+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:18.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:18.318+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:18.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:18.693+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:18.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:35:18.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:35:18.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:18.815+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:19.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:19.287+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:19.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:19.351+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:19.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:19.680+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:19.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:19.855+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:20.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:20.257+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:20.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:20.346+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:20.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:20.721+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:20.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:20.851+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:21.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:21.233+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:21.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:21.325+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:21.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:21.701+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:21.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:21.854+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:22.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:22.195+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:22.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:22.300+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:22.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:22.692+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:22.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:22.805+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:23.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:23.155+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:23.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:23.266+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:23.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:23.708+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:23.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:23.850+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:24.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:24.146+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:24.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:24.269+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:24.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:24.682+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:24.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:24.830+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:25.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:25.171+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:25.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:25.301+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:25.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:25.689+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:25.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:25.878+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:26.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:26.143+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:26.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:26.314+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:26.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:26.726+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:26.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:26.911+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:27.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:27.160+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:27.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:27.269+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:27.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:27.682+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:27.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:27.951+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:28.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:28.182+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:28.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:28.313+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:28.357 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:35:28.355+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:35:28.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:28.706+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:28.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:28.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:29.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:29.164+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:29.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:29.352+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:29.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:29.720+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:29.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:29.887+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:30.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:30.117+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:30.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:30.364+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:30.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:30.716+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:30.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:30.861+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:31.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:31.105+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:31.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:31.344+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:31.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:31.718+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:31.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:31.865+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:32.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:32.080+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:32.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:32.386+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:32.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:32.743+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:32.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:32.822+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:33.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:33.095+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:33.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:33.428+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:33.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:33.770+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:33.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:33.801+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:34.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:34.117+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:34.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:34.442+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:34.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:34.756+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:34.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:34.787+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:35.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:35.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:35.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:35.445+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:35.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:35.734+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:35.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:35.761+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:36.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:36.126+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:36.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:36.452+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:36.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:36.745+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:36.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:36.784+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:37.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:37.150+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:37.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:37.427+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:37.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:37.731+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:37.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:37.802+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:38.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:38.128+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:38.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:38.470+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:38.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:38.698+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:38.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:38.814+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:39.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:39.128+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:39.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:39.453+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:39.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:39.656+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:39.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:39.775+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:40.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:40.172+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:40.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:40.406+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:40.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:40.663+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:40.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:40.799+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:41.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:41.133+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:41.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:41.432+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:41.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:41.637+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:41.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:41.759+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:42.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:42.132+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:42.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:42.457+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:42.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:42.639+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:42.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:42.710+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:43.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:43.153+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:43.373 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:35:43.370+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:35:43.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:43.417+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:43.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:43.689+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:43.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:43.701+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:44.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:44.172+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:44.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:44.466+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:44.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:44.659+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:44.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:44.660+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:45.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:45.128+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:45.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:45.484+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:45.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:45.647+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:45.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:45.647+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:46.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:46.176+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:46.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:46.462+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:46.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:46.645+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:46.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:46.649+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:47.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:47.206+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:47.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:47.460+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:47.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:47.638+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:47.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:47.650+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:48.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:48.179+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:48.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:48.473+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:48.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:48.617+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:48.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:48.661+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:48.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:35:48.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:35:49.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:49.171+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:49.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:49.480+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:49.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:49.576+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:49.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:49.628+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:50.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:50.132+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:50.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:50.460+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:50.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:50.554+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:50.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:50.650+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:51.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:51.098+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:51.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:51.423+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:51.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:51.524+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:51.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:51.607+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:52.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:52.093+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:52.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:52.374+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:52.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:52.480+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:52.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:52.579+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:53.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:53.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:53.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:53.395+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:53.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:53.472+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:53.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:53.549+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:54.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:54.101+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:54.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:54.380+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:54.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:54.468+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:54.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:54.535+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:55.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:55.068+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:55.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:55.406+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:55.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:55.493+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:55.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:55.548+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:56.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:56.041+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:56.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:56.422+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:56.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:56.482+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:56.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:56.543+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:57.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:57.083+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:57.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:57.417+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:57.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:57.494+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:57.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:57.549+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:58.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:58.035+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:58.388 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:35:58.386+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:35:58.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:58.463+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:58.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:58.503+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:58.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:58.538+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:59.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:35:59.063+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:59.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:35:59.458+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:59.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:35:59.492+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:35:59.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:35:59.588+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:00.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:00.101+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:00.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:00.443+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:00.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:00.451+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:00.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:00.634+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:01.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:01.110+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:01.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:01.434+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:01.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:01.476+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:01.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:01.598+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:02.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:02.126+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:02.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:02.454+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:02.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:02.458+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:02.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:02.611+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:03.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:03.133+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:03.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:03.461+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:03.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:03.464+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:03.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:03.658+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:04.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:04.084+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:04.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:04.434+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:04.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:04.455+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:04.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:04.630+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:05.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:05.096+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:05.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:05.454+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:05.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:05.480+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:05.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:05.585+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:06.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:06.137+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:06.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:06.438+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:06.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:06.451+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:06.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:06.632+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:07.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:07.090+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:07.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:07.399+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:07.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:07.408+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:07.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:07.640+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:08.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:08.131+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:08.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:08.380+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:08.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:08.431+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:08.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:08.604+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:09.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:09.104+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:09.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:09.403+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:09.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:09.434+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:09.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:09.585+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:10.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:10.114+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:10.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:10.381+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:10.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:10.482+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:10.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:10.606+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:11.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:11.072+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:11.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:11.389+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:11.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:11.462+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:11.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:11.565+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:12.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:12.081+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:12.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:12.385+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:12.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:12.496+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:12.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:12.523+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:13.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:13.086+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:13.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:13.342+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:13.404 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:36:13.402+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:36:13.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:13.479+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:13.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:13.514+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:14.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:14.125+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:14.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:14.316+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:14.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:14.433+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:14.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:14.548+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:15.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:15.164+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:15.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:15.275+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:15.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:15.414+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:15.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:15.572+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:16.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:16.206+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:16.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:16.297+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:16.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:16.391+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:16.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:16.527+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:17.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:17.195+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:17.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:17.296+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:17.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:17.365+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:17.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:17.544+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:18.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:18.209+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:18.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:18.288+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:18.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:18.396+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:18.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:18.536+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:18.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:36:18.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:36:19.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:19.246+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:19.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:19.322+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:19.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:19.371+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:19.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:19.539+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:20.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:20.233+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:20.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:20.351+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:20.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:20.377+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:20.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:20.567+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:21.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:21.233+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:21.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:21.314+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:21.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:21.412+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:21.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:21.615+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:22.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:22.226+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:22.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:22.361+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:22.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:22.446+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:22.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:22.664+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:23.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:23.253+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:23.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:23.323+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:23.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:23.457+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:23.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:23.629+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:24.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:24.289+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:24.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:24.300+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:24.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:24.449+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:24.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:24.663+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:25.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:25.333+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:25.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:25.339+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:25.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:25.480+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:25.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:25.637+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:26.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:26.288+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:26.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:26.315+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:26.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:26.506+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:26.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:26.649+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:27.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:27.272+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:27.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:27.308+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:27.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:27.512+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:27.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:27.611+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:28.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:28.297+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:28.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:28.331+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:28.420 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:36:28.418+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:36:28.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:28.466+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:28.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:28.575+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:29.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:29.295+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:29.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:29.312+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:29.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:29.463+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:29.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:29.534+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:30.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:30.260+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:30.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:30.335+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:30.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:30.462+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:30.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:30.520+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:31.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:31.259+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:31.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:31.304+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:31.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:31.486+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:31.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:31.509+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:32.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:32.256+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:32.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:32.272+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:32.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:32.438+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:32.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:32.487+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:33.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:33.231+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:33.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:33.296+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:33.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:33.434+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:33.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:33.465+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:34.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:34.259+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:34.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:34.262+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:34.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:34.474+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:34.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:34.510+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:35.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:35.229+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:35.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:35.251+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:35.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:35.451+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:35.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:35.468+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:36.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:36.245+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:36.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:36.291+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:36.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:36.437+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:36.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:36.443+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:37.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:37.207+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:37.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:37.285+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:37.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:37.392+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:37.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:37.479+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:38.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:38.232+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:38.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:38.304+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:38.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:38.418+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:38.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:38.442+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:39.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:39.190+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:39.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:39.276+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:39.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:39.374+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:39.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:39.492+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:40.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:40.154+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:40.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:40.287+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:40.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:40.405+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:40.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:40.477+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:41.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:41.182+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:41.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:41.260+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:41.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:41.402+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:41.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:41.479+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:42.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:42.158+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:42.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:42.298+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:42.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:42.372+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:42.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:42.464+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:43.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:43.112+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:43.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:43.259+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:43.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:43.334+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:43.436 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:36:43.434+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:36:43.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:43.458+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:44.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:44.098+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:44.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:44.243+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:44.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:44.368+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:44.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:44.507+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:45.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:45.057+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:45.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:45.277+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:45.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:45.402+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:45.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:45.531+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:46.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:46.092+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:46.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:46.263+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:46.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:46.433+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:46.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:46.500+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:47.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:47.142+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:47.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:47.217+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:47.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:47.401+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:47.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:47.453+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:48.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:48.094+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:48.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:48.241+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:48.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:48.422+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:48.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:48.491+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:49.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:49.059+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:49.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:36:49.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:36:49.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:49.290+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:49.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:49.470+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:49.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:49.519+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:50.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:50.027+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:50.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:50.254+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:50.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:50.490+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:50.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:50.513+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:51.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:51.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:51.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:51.293+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:51.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:51.484+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:51.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:51.487+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:52.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:52.075+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:52.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:52.307+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:52.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:52.477+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:52.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:52.479+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:53.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:53.056+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:53.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:53.284+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:53.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:53.433+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:53.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:53.523+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:54.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:54.007+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:54.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:54.303+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:54.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:54.469+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:54.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:54.522+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:55.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:55.017+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:55.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:55.257+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:55.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:55.480+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:55.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:55.527+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:56.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:56.003+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:56.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:56.215+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:56.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:56.526+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:56.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:56.526+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:56.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:56.971+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:57.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:57.213+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:57.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:57.520+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:57.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:57.570+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:57.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:57.955+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:58.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:58.234+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:58.452 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:36:58.450+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:36:58.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:58.542+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:58.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:58.564+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:58.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:36:58.988+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:59.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:36:59.216+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:59.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:36:59.549+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:36:59.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:36:59.580+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:00.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:00.037+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:00.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:00.192+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:00.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:00.535+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:00.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:00.540+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:01.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:01.078+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:01.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:01.145+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:01.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:01.518+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:01.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:01.546+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:02.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:02.105+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:02.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:02.172+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:02.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:02.520+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:02.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:02.529+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:03.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:03.121+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:03.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:03.148+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:03.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:03.481+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:03.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:03.553+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:04.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:04.080+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:04.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:04.150+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:04.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:04.501+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:04.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:04.504+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:05.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:05.101+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:05.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:05.128+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:05.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:05.501+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:05.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:05.545+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:06.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:06.091+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:06.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:06.095+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:06.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:06.519+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:06.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:06.579+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:07.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:07.098+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:07.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:07.119+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:07.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:07.473+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:07.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:07.603+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:08.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:08.084+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:08.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:08.104+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:08.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:08.472+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:08.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:08.618+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:09.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:09.104+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:09.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:09.107+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:09.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:09.433+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:09.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:09.601+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:10.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:10.070+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:10.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:10.155+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:10.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:10.453+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:10.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:10.569+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:11.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:11.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:11.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:11.135+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:11.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:11.488+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:11.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:11.611+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:12.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:12.087+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:12.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:12.150+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:12.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:12.532+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:12.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:12.640+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:13.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:13.056+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:13.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:13.116+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:13.456 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:37:13.454+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:37:13.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:13.512+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:13.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:13.688+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:14.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:14.106+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:14.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:14.117+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:14.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:14.516+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:14.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:14.658+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:15.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:15.127+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:15.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:15.142+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:15.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:15.469+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:15.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:15.704+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:16.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:16.134+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:16.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:16.157+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:16.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:16.433+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:16.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:16.728+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:17.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:17.112+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:17.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:17.140+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:17.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:17.466+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:17.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:17.725+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:18.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:18.087+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:18.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:18.100+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:18.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:18.446+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:18.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:18.770+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:19.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:19.049+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:19.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:19.062+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:19.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:37:19.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:37:19.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:19.492+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:19.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:19.797+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:20.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:20.037+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:20.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:20.049+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:20.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:20.464+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:20.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:20.827+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:21.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:21.018+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:21.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:21.020+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:21.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:21.451+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:21.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:21.868+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:21.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:21.997+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:22.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:22.042+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:22.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:22.421+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:22.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:22.867+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:23.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:23.032+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:23.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:23.083+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:23.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:23.463+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:23.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:23.843+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:24.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:24.037+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:24.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:24.103+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:24.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:24.504+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:24.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:24.889+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:25.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:25.032+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:25.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:25.098+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:25.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:25.464+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:25.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:25.923+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:26.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:26.040+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:26.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:26.141+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:26.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:26.513+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:26.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:26.903+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:27.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:27.001+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:27.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:27.139+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:27.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:27.507+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:27.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:27.889+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:28.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:28.038+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:28.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:28.160+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:28.472 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:37:28.469+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:37:28.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:28.523+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:28.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:28.927+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:29.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:29.019+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:29.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:29.119+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:29.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:29.549+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:29.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:29.914+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:30.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:30.031+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:30.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:30.097+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:30.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:30.527+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:30.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:30.954+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:31.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:31.081+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:31.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:31.113+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:31.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:31.557+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:31.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:31.912+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:32.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:32.039+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:32.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:32.143+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:32.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:32.577+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:32.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:32.902+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:33.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:33.078+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:33.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:33.136+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:33.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:33.536+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:33.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:33.861+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:34.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:34.098+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:34.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:34.174+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:34.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:34.549+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:34.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:34.821+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:35.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:35.094+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:35.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:35.149+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:35.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:35.541+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:35.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:35.783+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:36.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:36.053+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:36.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:36.182+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:36.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:36.554+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:36.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:36.824+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:37.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:37.081+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:37.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:37.220+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:37.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:37.531+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:37.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:37.843+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:38.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:38.099+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:38.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:38.252+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:38.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:38.550+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:38.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:38.854+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:39.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:39.055+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:39.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:39.300+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:39.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:39.579+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:39.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:39.898+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:40.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:40.050+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:40.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:40.290+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:40.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:40.588+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:40.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:40.944+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:41.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:41.019+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:41.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:41.288+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:41.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:41.624+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:41.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:41.923+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:42.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:42.061+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:42.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:42.311+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:42.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:42.671+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:42.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:42.945+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:43.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:43.018+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:43.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:43.339+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:43.475 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:37:43.472+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:37:43.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:43.717+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:43.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:43.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:44.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:44.007+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:44.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:44.370+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:44.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:44.718+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:44.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:44.859+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:45.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:45.049+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:45.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:45.354+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:45.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:45.682+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:45.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:45.812+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:46.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:46.016+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:46.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:46.347+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:46.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:46.699+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:46.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:46.820+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:47.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:47.059+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:47.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:47.327+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:47.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:47.650+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:47.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:47.860+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:48.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:48.102+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:48.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:48.296+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:48.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:48.698+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:48.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:48.880+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:49.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:49.074+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:49.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:49.276+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:49.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:37:49.295 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:37:49.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:49.680+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:49.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:49.860+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:50.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:50.083+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:50.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:50.273+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:50.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:50.720+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:50.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:50.865+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:51.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:51.042+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:51.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:51.256+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:51.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:51.719+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:51.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:51.828+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:52.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:52.009+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:52.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:52.235+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:52.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:52.670+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:52.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:52.805+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:52.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:52.991+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:53.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:53.203+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:53.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:53.621+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:53.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:53.762+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:53.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:53.997+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:54.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:54.202+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:54.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:54.665+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:54.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:54.788+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:55.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:55.027+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:55.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:55.213+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:55.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:55.708+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:55.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:55.833+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:56.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:56.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:56.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:56.225+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:56.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:56.719+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:56.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:56.878+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:57.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:57.065+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:57.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:57.270+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:57.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:57.699+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:57.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:57.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:58.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:58.114+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:58.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:58.291+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:58.491 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:37:58.488+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:37:58.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:58.696+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:58.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:58.909+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:59.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:37:59.149+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:59.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:37:59.308+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:59.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:37:59.667+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:37:59.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:37:59.883+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:00.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:00.108+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:00.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:00.311+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:00.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:00.638+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:00.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:00.887+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:01.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:01.067+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:01.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:01.337+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:01.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:01.616+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:01.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:01.892+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:02.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:02.107+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:02.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:02.353+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:02.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:02.616+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:02.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:02.891+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:03.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:03.103+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:03.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:03.373+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:03.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:03.591+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:03.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:03.845+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:04.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:04.118+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:04.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:04.412+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:04.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:04.589+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:04.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:04.856+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:05.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:05.164+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:05.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:05.400+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:05.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:05.546+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:05.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:05.849+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:06.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:06.180+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:06.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:06.403+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:06.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:06.576+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:06.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:06.873+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:07.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:07.170+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:07.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:07.411+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:07.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:07.571+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:07.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:07.906+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:08.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:08.140+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:08.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:08.459+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:08.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:08.620+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:08.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:08.911+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:09.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:09.129+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:09.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:09.489+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:09.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:09.605+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:09.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:09.866+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:10.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:10.139+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:10.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:10.480+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:10.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:10.560+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:10.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:10.912+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:11.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:11.124+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:11.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:11.450+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:11.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:11.568+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:11.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:11.892+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:12.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:12.103+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:12.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:12.431+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:12.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:12.558+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:12.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:12.938+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:13.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:13.110+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:13.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:13.444+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:13.506 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:38:13.504+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:38:13.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:13.533+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:13.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:13.920+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:14.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:14.120+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:14.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:14.492+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:14.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:14.525+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:14.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:14.964+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:15.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:15.110+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:15.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:15.478+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:15.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:15.525+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:15.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:15.955+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:16.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:16.121+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:16.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:16.477+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:16.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:16.486+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:16.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:16.966+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:17.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:17.106+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:17.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:17.469+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:17.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:17.494+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:17.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:17.990+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:18.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:18.089+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:18.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:18.496+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:18.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:18.502+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:18.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:18.946+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:19.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:19.138+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:19.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:38:19.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:38:19.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:19.462+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:19.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:19.544+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:19.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:19.981+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:20.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:20.115+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:20.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:20.496+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:20.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:20.504+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:20.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:20.990+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:21.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:21.129+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:21.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:21.539+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:21.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:21.540+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:21.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:21.946+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:22.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:22.084+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:22.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:22.542+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:22.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:22.574+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:22.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:22.933+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:23.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:23.077+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:23.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:23.502+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:23.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:23.545+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:23.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:23.928+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:24.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:24.076+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:24.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:24.477+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:24.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:24.550+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:24.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:24.910+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:25.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:25.070+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:25.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:25.479+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:25.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:25.564+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:25.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:25.922+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:26.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:26.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:26.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:26.529+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:26.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:26.591+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:26.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:26.950+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:27.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:27.008+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:27.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:27.564+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:27.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:27.627+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:27.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:27.982+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:28.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:28.038+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:28.522 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:38:28.521+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:38:28.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:28.583+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:28.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:28.590+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:28.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:28.984+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:29.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:29.008+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:29.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:29.557+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:29.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:29.621+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:29.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:29.973+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:30.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:30.015+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:30.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:30.574+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:30.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:30.595+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:30.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:30.963+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:30.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:30.992+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:31.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:31.582+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:31.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:31.614+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:31.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:31.979+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:32.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:32.036+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:32.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:32.610+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:32.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:32.614+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:32.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:32.956+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:33.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:33.016+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:33.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:33.628+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:33.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:33.659+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:33.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:33.949+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:33.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:33.977+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:34.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:34.613+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:34.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:34.698+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:34.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:34.976+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:35.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:35.001+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:35.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:35.658+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:35.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:35.711+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:35.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:35.975+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:35.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:35.997+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:36.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:36.653+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:36.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:36.684+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:36.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:36.948+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:37.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:37.006+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:37.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:37.647+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:37.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:37.650+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:37.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:37.955+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:38.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:38.038+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:38.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:38.639+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:38.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:38.641+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:38.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:38.987+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:39.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:39.045+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:39.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:39.604+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:39.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:39.622+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:40.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:39.997+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:40.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:40.048+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:40.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:40.644+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:40.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:40.671+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:40.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:40.993+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:41.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:41.081+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:41.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:41.654+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:41.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:41.701+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:42.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:42.028+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:42.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:42.058+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:42.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:42.612+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:42.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:42.704+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:43.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:43.014+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:43.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:43.092+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:43.538 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:38:43.536+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:38:43.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:43.661+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:43.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:43.736+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:44.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:44.043+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:44.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:44.071+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:44.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:44.627+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:44.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:44.688+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:45.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:45.026+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:45.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:45.087+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:45.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:45.641+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:45.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:45.707+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:46.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:46.057+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:46.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:46.127+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:46.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:46.636+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:46.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:46.662+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:47.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:47.043+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:47.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:47.176+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:47.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:47.656+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:47.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:47.675+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:48.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:48.011+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:48.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:48.200+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:48.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:48.629+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:48.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:48.642+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:49.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:49.056+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:49.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:49.190+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:49.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:38:49.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:38:49.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:49.652+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:49.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:49.679+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:50.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:50.082+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:50.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:50.182+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:50.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:50.685+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:50.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:50.694+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:51.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:51.120+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:51.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:51.212+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:51.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:51.670+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:51.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:51.731+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:52.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:52.155+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:52.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:52.234+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:52.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:52.630+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:52.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:52.727+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:53.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:53.119+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:53.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:53.250+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:53.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:53.617+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:53.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:53.735+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:54.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:54.146+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:54.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:54.210+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:54.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:54.638+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:54.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:54.765+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:55.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:55.174+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:55.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:55.202+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:55.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:55.666+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:55.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:55.805+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:56.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:56.152+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:56.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:56.234+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:56.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:56.658+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:56.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:56.798+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:57.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:57.149+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:57.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:57.193+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:57.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:57.658+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:57.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:57.754+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:58.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:58.170+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:58.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:58.183+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:58.550 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:38:58.547+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:38:58.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:58.639+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:58.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:58.742+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:59.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:38:59.180+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:59.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:38:59.191+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:59.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:38:59.607+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:38:59.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:38:59.782+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:00.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:00.167+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:00.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:00.210+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:00.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:00.636+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:00.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:00.830+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:01.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:01.197+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:01.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:01.213+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:01.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:01.670+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:01.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:01.869+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:02.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:02.166+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:02.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:02.236+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:02.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:02.719+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:02.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:02.901+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:03.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:03.129+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:03.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:03.203+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:03.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:03.732+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:03.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:03.873+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:04.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:04.112+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:04.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:04.220+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:04.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:04.687+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:04.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:04.855+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:05.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:05.074+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:05.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:05.254+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:05.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:05.727+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:05.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:05.818+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:06.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:06.093+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:06.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:06.259+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:06.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:06.719+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:06.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:06.845+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:07.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:07.115+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:07.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:07.275+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:07.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:07.761+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:07.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:07.869+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:08.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:08.102+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:08.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:08.285+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:08.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:08.774+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:08.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:08.904+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:09.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:09.081+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:09.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:09.246+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:09.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:09.773+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:09.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:09.886+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:10.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:10.044+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:10.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:10.252+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:10.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:10.819+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:10.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:10.895+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:11.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:11.063+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:11.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:11.236+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:11.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:11.856+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:11.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:11.891+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:12.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:12.085+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:12.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:12.215+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:12.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:12.845+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:12.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:12.889+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:13.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:13.087+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:13.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:13.252+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:13.565 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:39:13.563+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:39:13.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:13.829+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:13.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:13.917+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:14.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:14.117+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:14.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:14.252+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:14.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:14.786+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:14.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:14.958+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:15.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:15.143+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:15.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:15.245+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:15.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:15.797+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:15.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:15.916+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:16.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:16.107+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:16.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:16.199+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:16.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:16.790+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:16.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:16.946+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:17.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:17.075+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:17.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:17.244+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:17.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:17.769+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:17.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:17.918+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:18.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:18.071+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:18.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:18.249+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:18.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:18.744+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:18.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:18.928+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:19.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:19.032+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:19.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:19.281+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:19.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:39:19.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:39:19.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:19.709+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:19.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:19.977+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:20.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:20.065+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:20.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:20.317+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:20.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:20.688+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:21.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:21.005+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:21.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:21.027+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:21.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:21.268+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:21.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:21.709+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:21.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:21.996+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:22.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:22.023+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:22.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:22.287+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:22.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:22.752+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:23.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:23.004+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:23.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:23.032+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:23.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:23.306+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:23.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:23.755+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:23.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:23.956+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:24.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:24.008+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:24.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:24.297+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:24.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:24.747+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:24.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:24.981+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:24.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:24.987+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:25.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:25.314+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:25.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:25.769+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:25.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:25.956+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:26.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:26.028+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:26.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:26.306+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:26.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:26.787+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:26.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:26.909+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:27.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:27.014+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:27.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:27.310+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:27.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:27.761+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:27.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:27.936+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:27.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:27.967+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:28.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:28.311+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:28.581 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:39:28.579+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:39:28.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:28.778+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:28.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:28.892+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:28.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:28.926+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:29.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:29.361+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:29.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:29.790+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:29.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:29.880+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:29.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:29.939+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:30.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:30.378+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:30.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:30.747+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:30.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:30.852+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:30.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:30.984+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:31.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:31.393+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:31.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:31.756+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:31.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:31.887+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:32.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:32.021+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:32.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:32.398+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:32.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:32.735+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:32.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:32.881+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:33.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:33.007+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:33.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:33.389+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:33.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:33.720+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:33.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:33.884+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:33.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:33.986+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:34.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:34.408+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:34.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:34.752+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:34.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:34.932+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:34.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:34.968+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:35.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:35.391+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:35.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:35.787+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:35.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:35.978+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:35.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:35.981+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:36.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:36.376+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:36.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:36.767+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:36.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:36.929+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:36.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:36.941+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:37.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:37.389+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:37.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:37.809+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:37.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:37.940+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:37.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:37.946+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:38.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:38.344+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:38.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:38.848+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:38.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:38.898+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:38.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:38.976+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:39.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:39.364+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:39.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:39.820+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:39.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:39.911+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:40.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:40.001+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:40.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:40.338+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:40.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:40.863+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:40.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:40.868+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:40.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:40.983+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:41.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:41.334+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:41.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:41.893+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:41.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:41.914+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:42.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:42.001+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:42.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:42.288+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:42.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:42.891+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:42.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:42.915+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:42.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:42.982+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:43.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:43.267+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:43.597 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:39:43.596+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:39:43.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:43.935+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:43.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:43.935+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:43.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:43.980+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:44.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:44.277+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:44.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:44.904+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:44.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:44.950+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:44.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:44.955+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:45.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:45.253+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:45.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:45.876+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:45.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:45.959+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:45.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:45.996+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:46.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:46.295+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:46.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:46.879+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:46.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:46.962+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:47.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:47.017+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:47.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:47.261+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:47.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:47.924+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:47.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:47.957+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:48.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:48.027+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:48.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:48.224+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:48.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:48.967+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:48.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:48.975+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:49.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:49.056+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:49.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:49.231+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:49.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:39:49.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:39:49.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:49.939+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:49.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:49.989+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:50.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:50.046+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:50.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:50.277+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:50.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:50.891+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:51.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:51.025+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:51.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:51.035+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:51.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:51.252+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:51.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:51.923+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:52.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:52.035+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:52.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:52.039+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:52.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:52.209+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:52.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:52.907+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:52.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:52.998+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:53.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:53.011+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:53.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:53.211+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:53.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:53.909+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:54.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:54.000+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:54.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:54.020+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:54.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:54.176+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:54.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:54.933+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:54.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:54.954+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:55.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:55.069+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:55.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:55.180+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:55.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:55.944+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:55.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:55.947+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:56.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:56.071+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:56.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:56.224+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:56.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:56.954+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:56.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:56.972+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:57.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:57.111+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:57.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:57.230+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:57.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:57.932+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:57.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:57.974+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:58.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:58.150+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:58.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:58.269+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:58.613 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:39:58.611+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:39:58.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:58.887+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:59.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:59.016+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:59.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:39:59.128+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:59.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:39:59.266+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:59.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:39:59.923+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:39:59.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:39:59.984+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:00.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:00.110+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:00.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:00.218+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:00.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:00.938+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:00.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:00.954+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:01.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:01.133+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:01.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:01.245+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:01.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:01.915+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:01.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:01.954+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:02.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:02.171+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:02.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:02.264+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:02.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:02.916+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:02.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:02.926+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:03.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:03.128+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:03.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:03.255+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:03.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:03.951+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:03.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:03.961+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:04.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:04.103+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:04.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:04.221+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:04.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:04.932+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:04.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:04.943+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:05.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:05.131+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:05.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:05.173+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:05.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:05.921+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:05.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:05.989+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:06.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:06.157+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:06.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:06.181+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:06.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:06.920+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:07.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:07.036+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:07.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:07.132+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:07.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:07.186+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:07.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:07.926+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:08.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:08.057+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:08.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:08.161+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:08.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:08.216+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:08.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:08.931+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:09.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:09.095+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:09.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:09.197+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:09.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:09.258+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:09.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:09.919+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:10.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:10.080+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:10.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:10.206+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:10.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:10.252+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:10.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:10.962+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:11.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:11.090+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:11.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:11.225+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:11.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:11.235+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:11.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:11.967+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:12.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:12.134+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:12.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:12.228+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:12.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:12.241+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:12.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:12.984+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:13.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:13.115+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:13.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:13.237+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:13.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:13.276+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:13.629 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:40:13.628+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:40:14.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:14.006+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:14.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:14.071+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:14.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:14.228+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:14.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:14.255+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:15.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:15.056+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:15.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:15.107+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:15.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:15.239+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:15.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:15.299+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:16.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:16.038+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:16.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:16.065+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:16.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:16.219+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:16.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:16.294+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:17.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:17.005+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:17.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:17.029+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:17.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:17.246+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:17.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:17.325+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:18.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:18.048+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:18.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:18.075+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:18.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:18.239+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:18.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:18.312+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:19.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:19.014+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:19.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:19.059+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:19.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:19.223+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:19.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:19.328+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:19.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:40:19.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:40:20.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:20.038+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:20.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:20.061+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:20.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:20.207+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:20.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:20.366+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:21.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:20.997+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:21.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:21.063+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:21.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:21.248+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:21.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:21.344+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:21.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:21.996+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:22.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:22.052+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:22.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:22.205+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:22.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:22.361+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:22.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:22.948+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:23.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:23.008+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:23.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:23.225+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:23.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:23.374+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:23.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:23.911+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:23.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:23.978+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:24.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:24.271+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:24.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:24.377+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:24.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:24.882+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:25.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:25.028+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:25.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:25.321+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:25.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:25.407+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:25.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:25.851+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:26.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:26.017+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:26.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:26.335+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:26.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:26.380+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:26.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:26.806+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:26.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:26.988+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:27.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:27.362+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:27.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:27.409+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:27.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:27.853+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:27.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:27.989+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:28.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:28.379+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:28.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:28.424+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:28.645 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:40:28.642+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:40:28.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:28.814+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:29.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:29.000+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:29.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:29.417+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:29.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:29.435+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:29.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:29.822+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:29.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:29.981+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:30.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:30.442+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:30.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:30.459+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:30.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:30.830+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:30.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:30.944+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:31.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:31.442+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:31.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:31.492+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:31.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:31.817+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:31.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:31.957+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:32.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:32.485+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:32.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:32.511+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:32.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:32.867+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:33.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:33.006+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:33.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:33.493+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:33.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:33.527+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:33.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:33.823+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:33.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:33.968+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:34.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:34.512+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:34.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:34.536+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:34.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:34.819+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:34.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:34.975+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:35.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:35.497+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:35.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:35.506+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:35.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:35.824+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:35.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:35.937+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:36.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:36.486+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:36.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:36.495+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:36.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:36.852+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:36.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:36.891+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:37.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:37.488+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:37.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:37.532+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:37.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:37.827+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:37.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:37.936+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:38.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:38.447+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:38.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:38.541+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:38.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:38.794+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:38.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:38.947+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:39.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:39.445+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:39.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:39.565+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:39.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:39.802+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:39.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:39.959+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:40.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:40.437+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:40.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:40.555+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:40.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:40.839+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:40.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:40.965+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:41.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:41.450+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:41.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:41.515+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:41.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:41.856+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:42.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:42.015+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:42.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:42.430+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:42.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:42.547+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:42.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:42.822+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:42.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:42.986+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:43.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:43.470+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:43.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:43.534+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:43.652 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:40:43.649+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:40:43.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:43.796+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:44.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:44.009+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:44.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:44.488+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:44.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:44.525+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:44.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:44.775+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:45.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:45.053+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:45.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:45.456+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:45.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:45.493+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:45.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:45.758+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:46.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:46.086+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:46.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:46.431+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:46.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:46.452+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:46.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:46.787+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:47.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:47.114+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:47.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:47.424+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:47.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:47.448+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:47.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:47.770+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:48.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:48.095+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:48.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:48.386+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:48.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:48.430+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:48.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:48.778+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:49.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:49.067+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:49.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:49.386+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:49.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:49.393+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:49.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:49.738+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:50.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:50.087+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:50.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:40:50.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:40:50.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:50.362+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:50.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:50.396+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:50.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:50.739+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:51.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:51.107+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:51.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:51.363+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:51.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:51.363+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:51.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:51.717+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:52.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:52.063+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:52.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:52.333+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:52.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:52.373+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:52.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:52.753+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:53.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:53.075+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:53.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:53.352+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:53.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:53.353+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:53.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:53.721+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:54.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:54.095+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:54.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:54.307+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:54.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:54.325+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:54.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:54.680+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:55.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:55.134+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:55.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:55.314+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:55.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:55.340+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:55.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:55.686+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:56.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:56.145+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:56.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:56.298+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:56.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:56.381+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:56.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:56.686+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:57.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:57.132+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:57.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:57.272+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:57.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:57.341+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:57.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:57.711+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:58.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:58.108+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:58.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:58.235+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:58.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:58.343+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:58.668 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:40:58.665+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:40:58.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:58.734+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:59.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:40:59.118+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:59.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:40:59.251+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:59.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:40:59.341+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:40:59.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:40:59.752+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:00.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:00.096+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:00.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:00.219+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:00.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:00.353+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:00.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:00.731+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:01.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:01.138+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:01.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:01.243+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:01.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:01.399+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:01.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:01.710+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:02.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:02.092+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:02.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:02.207+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:02.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:02.436+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:02.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:02.697+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:03.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:03.098+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:03.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:03.170+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:03.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:03.395+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:03.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:03.648+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:04.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:04.123+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:04.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:04.135+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:04.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:04.365+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:04.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:04.686+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:05.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:05.101+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:05.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:05.141+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:05.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:05.404+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:05.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:05.658+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:06.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:06.145+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:06.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:06.153+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:06.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:06.427+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:06.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:06.638+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:07.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:07.152+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:07.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:07.190+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:07.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:07.413+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:07.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:07.660+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:08.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:08.189+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:08.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:08.197+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:08.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:08.426+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:08.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:08.671+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:09.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:09.160+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:09.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:09.219+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:09.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:09.441+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:09.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:09.656+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:10.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:10.176+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:10.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:10.221+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:10.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:10.473+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:10.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:10.620+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:11.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:11.185+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:11.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:11.223+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:11.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:11.428+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:11.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:11.572+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:12.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:12.156+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:12.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:12.246+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:12.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:12.451+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:12.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:12.539+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:13.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:13.169+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:13.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:13.248+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:13.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:13.446+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:13.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:13.571+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:13.683 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:41:13.681+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:41:14.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:14.170+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:14.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:14.211+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:14.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:14.492+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:14.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:14.603+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:15.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:15.174+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:15.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:15.227+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:15.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:15.472+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:15.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:15.572+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:16.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:16.145+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:16.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:16.204+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:16.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:16.515+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:16.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:16.528+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:17.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:17.134+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:17.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:17.171+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:17.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:17.486+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:17.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:17.498+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:18.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:18.109+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:18.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:18.169+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:18.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:18.472+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:18.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:18.477+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:19.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:19.134+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:19.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:19.213+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:19.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:19.440+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:19.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:19.489+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:20.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:20.104+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:20.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:20.182+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:20.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:41:20.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:41:20.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:20.463+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:20.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:20.500+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:21.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:21.150+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:21.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:21.150+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:21.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:21.426+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:21.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:21.549+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:22.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:22.139+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:22.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:22.184+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:22.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:22.393+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:22.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:22.525+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:23.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:23.179+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:23.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:23.231+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:23.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:23.416+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:23.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:23.551+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:24.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:24.204+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:24.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:24.251+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:24.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:24.373+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:24.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:24.537+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:25.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:25.230+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:25.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:25.248+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:25.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:25.378+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:25.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:25.553+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:26.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:26.196+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:26.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:26.299+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:26.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:26.386+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:26.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:26.523+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:27.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:27.187+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:27.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:27.275+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:27.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:27.363+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:27.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:27.477+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:28.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:28.224+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:28.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:28.227+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:28.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:28.379+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:28.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:28.437+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:28.699 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:41:28.698+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:41:29.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:29.192+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:29.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:29.237+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:29.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:29.341+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:29.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:29.414+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:30.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:30.234+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:30.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:30.259+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:30.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:30.379+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:30.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:30.457+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:31.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:31.214+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:31.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:31.238+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:31.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:31.336+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:31.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:31.481+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:32.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:32.195+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:32.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:32.203+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:32.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:32.317+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:32.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:32.472+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:33.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:33.211+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:33.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:33.226+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:33.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:33.358+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:33.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:33.508+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:34.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:34.240+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:34.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:34.259+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:34.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:34.330+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:34.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:34.479+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:35.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:35.216+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:35.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:35.271+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:35.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:35.363+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:35.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:35.472+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:36.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:36.242+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:36.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:36.254+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:36.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:36.340+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:36.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:36.438+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:37.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:37.224+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:37.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:37.240+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:37.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:37.380+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:37.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:37.417+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:38.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:38.203+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:38.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:38.228+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:38.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:38.334+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:38.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:38.460+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:39.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:39.234+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:39.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:39.236+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:39.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:39.377+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:39.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:39.484+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:40.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:40.185+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:40.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:40.227+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:40.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:40.389+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:40.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:40.503+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:41.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:41.149+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:41.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:41.262+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:41.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:41.353+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:41.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:41.520+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:42.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:42.176+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:42.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:42.222+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:42.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:42.331+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:42.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:42.527+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:43.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:43.182+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:43.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:43.209+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:43.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:43.325+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:43.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:43.490+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:43.715 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:41:43.713+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:41:44.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:44.183+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:44.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:44.222+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:44.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:44.276+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:44.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:44.517+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:45.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:45.136+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:45.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:45.204+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:45.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:45.254+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:45.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:45.526+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:46.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:46.186+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:46.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:46.220+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:46.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:46.243+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:46.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:46.489+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:47.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:47.160+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:47.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:47.217+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:47.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:47.247+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:47.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:47.496+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:48.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:48.195+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:48.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:48.201+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:48.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:48.244+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:48.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:48.492+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:49.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:49.194+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:49.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:49.208+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:49.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:49.226+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:49.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:49.446+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:50.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:50.222+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:50.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:50.228+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:50.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:50.233+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:50.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:41:50.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:41:50.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:50.427+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:51.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:51.204+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:51.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:51.245+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:51.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:51.281+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:51.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:51.442+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:52.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:52.185+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:52.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:52.267+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:52.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:52.290+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:52.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:52.394+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:53.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:53.197+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:53.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:53.290+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:53.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:53.327+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:53.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:53.349+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:54.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:54.242+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:54.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:54.280+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:54.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:54.331+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:54.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:54.354+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:55.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:55.262+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:55.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:55.287+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:55.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:55.294+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:55.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:55.372+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:56.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:56.269+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:56.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:56.310+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:56.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:56.327+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:56.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:56.343+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:57.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:57.270+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:57.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:57.293+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:57.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:57.312+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:57.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:57.386+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:58.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:58.311+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:58.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:58.316+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:58.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:58.337+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:58.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:58.395+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:58.731 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:41:58.729+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:41:59.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:41:59.277+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:59.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:41:59.336+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:59.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:41:59.360+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:41:59.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:41:59.428+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:00.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:00.265+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:00.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:00.291+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:00.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:00.350+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:00.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:00.419+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:01.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:01.263+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:01.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:01.314+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:01.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:01.400+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:01.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:01.409+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:02.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:02.313+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:02.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:02.362+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:02.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:02.393+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:02.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:02.401+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:03.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:03.330+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:03.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:03.347+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:03.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:03.356+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:03.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:03.367+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:04.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:04.328+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:04.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:04.340+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:04.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:04.357+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:04.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:04.371+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:05.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:05.336+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:05.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:05.350+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:05.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:05.378+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:05.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:05.381+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:06.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:06.317+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:06.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:06.385+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:06.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:06.395+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:06.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:06.402+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:07.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:07.353+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:07.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:07.382+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:07.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:07.399+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:07.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:07.421+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:08.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:08.336+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:08.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:08.351+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:08.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:08.386+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:08.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:08.400+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:09.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:09.327+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:09.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:09.333+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:09.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:09.343+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:09.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:09.408+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:10.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:10.344+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:10.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:10.375+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:10.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:10.383+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:10.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:10.455+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:11.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:11.363+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:11.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:11.373+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:11.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:11.406+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:11.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:11.433+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:12.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:12.336+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:12.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:12.341+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:12.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:12.371+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:12.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:12.406+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:13.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:13.359+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:13.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:13.366+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:13.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:13.411+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:13.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:13.443+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:13.734 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:42:13.732+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:42:14.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:14.328+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:14.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:14.368+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:14.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:14.395+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:14.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:14.411+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:15.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:15.345+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:15.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:15.374+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:15.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:15.376+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:15.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:15.418+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:16.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:16.352+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:16.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:16.356+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:16.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:16.409+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:16.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:16.423+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:17.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:17.308+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:17.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:17.326+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:17.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:17.456+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:17.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:17.470+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:18.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:18.337+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:18.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:18.345+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:18.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:18.420+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:18.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:18.467+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:19.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:19.318+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:19.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:19.329+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:19.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:19.457+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:19.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:19.474+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:20.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:20.333+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:20.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:20.334+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:20.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:20.434+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:20.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:20.493+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:20.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:42:20.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:42:21.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:21.318+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:21.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:21.366+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:21.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:21.428+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:21.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:21.494+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:22.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:22.341+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:22.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:22.364+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:22.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:22.429+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:22.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:22.527+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:23.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:23.365+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:23.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:23.408+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:23.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:23.423+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:23.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:23.531+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:24.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:24.366+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:24.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:24.423+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:24.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:24.431+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:24.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:24.520+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:25.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:25.336+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:25.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:25.390+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:25.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:25.465+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:25.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:25.545+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:26.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:26.360+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:26.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:26.381+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:26.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:26.447+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:26.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:26.504+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:27.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:27.398+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:27.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:27.401+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:27.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:27.436+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:27.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:27.488+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:28.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:28.363+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:28.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:28.436+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:28.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:28.454+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:28.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:28.458+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:28.750 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:42:28.747+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:42:29.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:29.337+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:29.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:29.418+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:29.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:29.470+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:29.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:29.489+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:30.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:30.373+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:30.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:30.429+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:30.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:30.474+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:30.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:30.483+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:31.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:31.341+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:31.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:31.382+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:31.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:31.441+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:31.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:31.480+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:32.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:32.373+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:32.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:32.379+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:32.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:32.431+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:32.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:32.529+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:33.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:33.345+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:33.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:33.353+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:33.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:33.393+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:33.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:33.509+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:34.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:34.317+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:34.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:34.361+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:34.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:34.436+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:34.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:34.502+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:35.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:35.274+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:35.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:35.323+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:35.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:35.417+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:35.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:35.541+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:36.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:36.241+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:36.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:36.333+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:36.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:36.446+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:36.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:36.572+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:37.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:37.276+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:37.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:37.341+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:37.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:37.487+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:37.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:37.528+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:38.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:38.241+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:38.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:38.309+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:38.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:38.492+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:38.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:38.552+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:39.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:39.275+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:39.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:39.289+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:39.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:39.529+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:39.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:39.535+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:40.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:40.288+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:40.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:40.294+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:40.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:40.488+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:40.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:40.515+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:41.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:41.259+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:41.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:41.313+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:41.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:41.467+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:41.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:41.485+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:42.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:42.229+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:42.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:42.290+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:42.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:42.462+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:42.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:42.471+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:43.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:43.257+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:43.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:43.282+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:43.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:43.427+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:43.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:43.457+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:43.756 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:42:43.754+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:42:44.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:44.233+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:44.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:44.250+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:44.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:44.436+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:44.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:44.460+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:45.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:45.262+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:45.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:45.276+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:45.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:45.401+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:45.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:45.509+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:46.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:46.216+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:46.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:46.233+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:46.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:46.378+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:46.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:46.475+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:47.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:47.215+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:47.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:47.264+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:47.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:47.425+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:47.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:47.474+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:48.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:48.242+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:48.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:48.303+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:48.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:48.439+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:48.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:48.449+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:49.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:49.257+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:49.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:49.270+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:49.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:49.418+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:49.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:49.460+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:50.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:50.228+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:50.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:50.241+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:50.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:50.408+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:50.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:50.469+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:50.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:42:50.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:42:51.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:51.223+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:51.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:51.224+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:51.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:51.366+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:51.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:51.488+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:52.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:52.215+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:52.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:52.231+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:52.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:52.415+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:52.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:52.441+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:53.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:53.212+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:53.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:53.239+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:53.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:53.407+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:53.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:53.450+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:54.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:54.237+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:54.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:54.257+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:54.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:54.440+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:54.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:54.448+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:55.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:55.226+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:55.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:55.281+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:55.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:55.453+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:55.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:55.469+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:56.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:56.253+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:56.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:56.285+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:56.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:56.498+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:56.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:56.503+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:57.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:57.290+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:57.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:57.295+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:57.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:57.455+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:57.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:57.466+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:58.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:58.293+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:58.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:58.313+0000 7f6e44c9f700 -1 osd.7 111 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:58.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:58.463+0000 7f72c425d700 -1 osd.5 111 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:58.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:58.464+0000 7f389e18e700 -1 osd.4 111 get_health_metrics reporting 61 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:58.771 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:42:58.769+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:42:59.180 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T01:42:59.178+0000 7faabb02c700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:42:59.196 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T01:42:59.178+0000 7faabb02c700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:42:59.196 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T01:42:59.188+0000 7faaba82b700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T01:42:59.217 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T01:42:59.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:42:59.248+0000 7f596d92c700 -1 osd.6 111 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:59.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:42:59.354+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:59.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:42:59.452+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:42:59.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:42:59.515+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:00.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:00.248+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:00.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:00.334+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:00.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:00.467+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:00.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:00.472+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:01.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:01.228+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:01.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:01.342+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:01.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:01.430+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:01.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:01.505+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:02.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:02.260+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:02.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:02.361+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:02.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:02.419+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:02.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:02.471+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:03.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:03.245+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:03.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:03.390+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:03.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:03.411+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:03.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:03.426+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:04.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:04.240+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:04.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:04.417+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:04.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:04.427+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:04.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:04.451+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:05.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:05.230+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:05.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:05.429+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:05.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:05.429+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:05.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:05.429+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:06.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:06.266+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:06.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:06.387+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:06.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:06.427+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:06.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:06.457+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:07.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:07.229+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:07.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:07.378+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:07.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:07.410+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:07.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:07.439+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:08.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:08.252+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:08.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:08.343+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:08.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:08.385+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:08.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:08.398+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:09.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:09.210+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:09.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:09.348+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:09.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:09.348+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:09.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:09.417+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:10.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:10.247+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:10.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:10.343+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:10.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:10.381+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:10.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:10.424+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:11.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:11.259+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:11.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:11.346+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:11.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:11.385+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:11.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:11.415+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:12.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:12.259+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:12.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:12.357+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:12.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:12.388+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:12.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:12.427+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:13.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:13.234+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:13.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:13.353+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:13.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:13.421+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:13.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:13.432+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:13.786 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:43:13.784+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:43:14.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:14.263+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:14.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:14.370+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:14.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:14.397+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:14.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:14.417+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:15.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:15.291+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:15.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:15.405+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:15.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:15.407+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:15.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:15.448+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:16.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:16.251+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:16.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:16.377+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:16.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:16.411+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:16.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:16.413+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:17.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:17.232+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:17.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:17.401+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:17.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:17.423+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:17.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:17.440+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:18.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:18.188+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:18.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:18.353+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:18.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:18.406+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:18.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:18.425+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:19.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:19.157+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:19.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:19.329+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:19.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:19.376+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:19.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:19.447+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:20.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:20.191+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:20.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:20.344+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:20.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:20.353+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:20.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:20.412+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:20.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:43:20.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:43:21.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:21.165+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:21.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:21.302+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:21.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:21.362+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:21.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:21.443+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:22.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:22.191+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:22.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:22.305+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:22.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:22.384+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:22.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:22.435+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:23.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:23.215+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:23.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:23.277+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:23.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:23.420+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:23.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:23.429+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:24.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:24.246+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:24.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:24.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:24.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:24.378+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:24.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:24.471+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:25.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:25.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:25.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:25.270+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:25.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:25.393+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:25.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:25.503+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:26.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:26.244+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:26.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:26.267+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:26.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:26.380+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:26.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:26.522+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:27.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:27.225+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:27.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:27.268+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:27.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:27.416+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:27.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:27.507+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:28.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:28.188+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:28.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:28.307+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:28.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:28.368+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:28.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:28.491+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:28.802 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:43:28.800+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:43:29.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:29.232+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:29.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:29.332+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:29.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:29.335+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:29.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:29.504+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:30.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:30.245+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:30.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:30.303+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:30.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:30.351+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:30.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:30.494+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:31.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:31.291+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:31.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:31.333+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:31.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:31.340+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:31.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:31.504+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:32.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:32.270+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:32.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:32.292+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:32.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:32.344+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:32.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:32.493+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:33.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:33.286+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:33.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:33.296+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:33.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:33.379+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:33.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:33.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:34.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:34.315+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:34.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:34.337+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:34.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:34.419+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:34.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:34.508+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:35.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:35.314+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:35.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:35.331+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:35.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:35.425+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:35.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:35.521+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:36.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:36.276+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:36.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:36.293+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:36.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:36.452+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:36.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:36.497+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:37.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:37.268+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:37.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:37.296+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:37.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:37.405+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:37.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:37.485+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:38.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:38.268+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:38.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:38.340+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:38.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:38.377+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:38.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:38.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:39.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:39.221+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:39.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:39.319+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:39.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:39.399+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:39.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:39.492+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:40.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:40.204+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:40.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:40.292+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:40.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:40.415+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:40.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:40.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:41.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:41.189+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:41.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:41.282+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:41.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:41.461+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:41.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:41.500+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:42.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:42.204+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:42.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:42.298+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:42.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:42.482+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:42.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:42.488+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:43.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:43.219+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:43.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:43.263+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:43.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:43.434+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:43.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:43.510+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:43.818 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:43:43.816+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:43:44.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:44.216+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:44.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:44.270+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:44.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:44.483+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:44.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:44.494+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:45.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:45.202+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:45.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:45.279+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:45.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:45.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:45.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:45.510+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:46.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:46.227+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:46.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:46.317+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:46.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:46.420+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:46.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:46.467+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:47.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:47.187+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:47.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:47.309+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:47.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:47.390+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:47.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:47.433+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:48.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:48.229+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:48.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:48.302+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:48.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:48.354+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:48.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:48.477+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:49.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:49.272+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:49.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:49.319+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:49.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:49.377+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:49.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:49.513+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:50.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:50.248+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:50.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:50.276+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:50.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:50.360+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:50.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:50.477+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:50.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:43:50.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:43:51.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:51.247+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:51.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:51.256+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:51.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:51.321+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:51.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:51.453+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:52.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:52.217+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:52.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:52.222+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:52.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:52.321+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:52.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:52.406+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:53.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:53.199+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:53.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:53.204+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:53.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:53.278+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:53.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:53.394+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:54.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:54.153+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:54.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:54.242+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:54.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:54.261+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:54.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:54.344+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:55.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:55.161+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:55.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:55.216+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:55.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:55.260+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:55.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:55.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:56.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:56.171+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:56.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:56.213+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:56.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:56.308+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:56.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:56.414+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:57.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:57.184+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:57.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:57.236+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:57.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:57.314+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:57.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:57.459+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:58.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:58.206+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:58.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:58.211+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:58.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:58.353+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:58.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:58.424+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:58.834 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:43:58.832+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:43:59.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:43:59.230+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:59.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:43:59.254+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:59.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:43:59.336+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:43:59.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:43:59.431+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:00.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:00.235+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:00.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:00.300+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:00.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:00.304+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:00.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:00.385+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:01.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:01.233+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:01.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:01.325+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:01.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:01.343+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:01.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:01.436+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:02.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:02.192+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:02.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:02.306+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:02.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:02.364+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:02.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:02.420+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:03.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:03.224+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:03.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:03.275+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:03.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:03.331+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:03.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:03.451+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:04.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:04.241+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:04.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:04.264+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:04.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:04.319+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:04.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:04.502+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:05.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:05.255+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:05.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:05.259+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:05.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:05.330+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:05.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:05.512+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:06.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:06.223+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:06.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:06.226+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:06.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:06.334+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:06.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:06.498+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:07.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:07.204+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:07.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:07.255+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:07.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:07.370+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:07.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:07.455+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:08.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:08.227+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:08.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:08.245+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:08.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:08.362+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:08.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:08.424+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:09.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:09.187+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:09.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:09.229+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:09.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:09.412+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:09.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:09.447+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:10.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:10.151+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:10.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:10.207+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:10.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:10.418+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:10.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:10.450+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:11.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:11.185+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:11.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:11.237+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:11.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:11.427+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:11.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:11.436+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:12.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:12.178+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:12.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:12.223+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:12.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:12.386+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:12.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:12.396+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:13.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:13.136+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:13.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:13.175+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:13.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:13.409+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:13.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:13.425+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:13.850 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:44:13.847+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:44:14.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:14.099+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:14.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:14.175+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:14.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:14.382+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:14.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:14.402+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:15.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:15.116+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:15.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:15.197+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:15.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:15.380+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:15.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:15.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:16.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:16.161+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:16.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:16.166+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:16.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:16.356+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:16.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:16.425+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:17.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:17.141+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:17.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:17.158+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:17.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:17.379+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:17.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:17.391+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:18.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:18.124+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:18.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:18.200+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:18.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:18.354+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:18.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:18.397+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:19.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:19.163+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:19.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:19.167+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:19.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:19.323+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:19.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:19.438+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:20.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:20.135+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:20.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:20.156+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:20.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:20.325+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:20.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:20.441+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:21.013 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:44:21.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:44:21.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:21.106+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:21.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:21.132+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:21.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:21.294+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:21.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:21.450+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:22.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:22.103+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:22.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:22.132+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:22.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:22.269+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:22.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:22.450+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:23.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:23.139+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:23.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:23.178+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:23.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:23.230+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:23.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:23.421+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:24.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:24.154+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:24.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:24.160+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:24.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:24.219+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:24.407 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:24.405+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:25.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:25.171+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:25.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:25.188+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:25.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:25.257+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:25.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:25.371+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:26.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:26.171+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:26.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:26.202+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:26.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:26.289+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:26.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:26.374+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:27.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:27.171+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:27.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:27.245+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:27.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:27.332+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:27.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:27.338+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:28.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:28.206+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:28.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:28.291+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:28.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:28.304+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:28.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:28.330+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:28.865 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:44:28.863+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:44:29.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:29.184+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:29.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:29.290+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:29.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:29.330+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:29.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:29.344+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:30.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:30.232+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:30.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:30.263+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:30.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:30.337+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:30.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:30.350+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:31.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:31.212+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:31.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:31.242+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:31.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:31.289+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:31.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:31.342+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:32.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:32.189+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:32.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:32.267+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:32.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:32.318+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:32.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:32.326+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:33.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:33.205+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:33.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:33.299+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:33.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:33.303+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:33.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:33.331+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:34.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:34.219+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:34.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:34.285+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:34.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:34.304+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:34.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:34.351+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:35.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:35.192+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:35.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:35.267+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:35.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:35.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:35.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:35.317+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:36.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:36.165+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:36.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:36.247+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:36.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:36.260+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:36.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:36.271+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:37.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:37.177+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:37.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:37.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:37.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:37.290+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:37.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:37.307+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:38.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:38.180+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:38.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:38.279+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:38.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:38.300+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:38.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:38.339+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:39.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:39.152+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:39.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:39.273+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:39.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:39.337+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:39.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:39.346+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:40.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:40.180+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:40.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:40.257+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:40.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:40.290+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:40.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:40.298+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:41.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:41.132+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:41.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:41.292+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:41.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:41.324+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:41.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:41.328+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:42.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:42.124+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:42.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:42.305+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:42.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:42.353+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:42.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:42.360+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:43.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:43.133+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:43.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:43.355+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:43.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:43.383+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:43.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:43.396+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:43.881 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:44:43.879+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:44:44.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:44.164+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:44.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:44.371+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:44.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:44.400+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:44.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:44.419+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:45.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:45.137+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:45.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:45.391+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:45.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:45.399+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:45.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:45.410+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:46.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:46.133+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:46.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:46.373+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:46.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:46.405+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:46.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:46.460+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:47.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:47.130+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:47.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:47.411+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:47.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:47.443+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:47.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:47.455+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:48.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:48.125+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:48.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:48.408+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:48.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:48.438+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:48.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:48.485+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:49.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:49.120+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:49.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:49.383+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:49.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:49.430+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:49.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:49.479+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:50.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:50.164+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:50.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:50.389+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:50.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:50.453+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:50.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:50.493+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:51.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:44:51.145 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:44:51.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:51.161+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:51.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:51.399+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:51.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:51.426+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:51.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:51.514+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:52.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:52.180+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:52.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:52.416+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:52.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:52.431+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:52.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:52.546+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:53.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:53.152+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:53.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:53.408+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:53.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:53.475+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:53.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:53.527+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:54.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:54.198+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:54.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:54.450+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:54.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:54.450+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:54.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:54.541+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:55.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:55.180+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:55.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:55.414+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:55.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:55.469+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:55.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:55.533+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:56.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:56.218+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:56.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:56.408+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:56.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:56.430+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:56.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:56.531+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:57.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:57.173+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:57.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:57.375+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:57.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:57.384+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:57.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:57.501+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:58.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:58.143+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:58.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:58.361+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:58.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:58.419+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:58.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:58.459+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:58.897 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:44:58.895+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:44:59.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:44:59.131+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:59.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:44:59.397+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:59.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:44:59.426+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:44:59.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:44:59.463+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:00.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:00.178+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:00.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:00.383+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:00.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:00.418+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:00.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:00.511+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:01.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:01.208+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:01.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:01.365+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:01.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:01.391+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:01.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:01.487+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:02.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:02.201+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:02.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:02.353+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:02.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:02.370+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:02.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:02.504+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:03.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:03.251+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:03.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:03.334+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:03.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:03.337+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:03.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:03.512+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:04.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:04.272+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:04.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:04.330+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:04.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:04.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:04.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:04.466+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:05.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:05.279+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:05.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:05.355+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:05.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:05.427+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:05.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:05.463+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:06.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:06.297+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:06.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:06.378+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:06.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:06.425+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:06.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:06.474+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:07.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:07.331+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:07.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:07.405+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:07.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:07.466+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:07.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:07.518+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:08.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:08.380+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:08.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:08.447+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:08.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:08.452+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:08.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:08.524+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:09.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:09.388+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:09.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:09.464+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:09.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:09.475+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:09.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:09.494+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:10.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:10.402+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:10.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:10.463+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:10.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:10.473+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:10.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:10.489+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:11.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:11.429+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:11.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:11.447+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:11.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:11.481+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:11.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:11.529+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:12.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:12.434+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:12.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:12.485+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:12.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:12.496+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:12.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:12.523+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:13.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:13.389+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:13.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:13.461+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:13.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:13.493+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:13.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:13.524+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:13.913 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:45:13.911+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:45:14.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:14.403+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:14.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:14.452+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:14.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:14.475+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:14.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:14.563+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:15.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:15.426+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:15.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:15.448+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:15.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:15.497+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:15.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:15.529+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:16.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:16.451+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:16.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:16.464+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:16.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:16.482+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:16.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:16.516+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:17.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:17.468+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:17.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:17.494+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:17.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:17.497+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:17.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:17.511+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:18.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:18.487+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:18.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:18.504+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:18.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:18.517+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:18.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:18.543+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:19.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:19.479+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:19.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:19.488+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:19.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:19.504+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:19.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:19.533+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:20.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:20.476+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:20.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:20.491+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:20.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:20.494+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:20.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:20.511+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:21.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:45:21.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:45:21.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:21.448+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:21.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:21.474+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:21.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:21.521+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:21.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:21.561+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:22.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:22.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:22.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:22.449+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:22.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:22.544+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:22.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:22.581+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:23.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:23.412+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:23.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:23.473+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:23.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:23.571+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:23.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:23.592+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:24.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:24.421+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:24.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:24.468+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:24.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:24.576+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:24.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:24.611+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:25.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:25.459+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:25.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:25.463+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:25.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:25.611+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:25.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:25.627+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:26.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:26.423+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:26.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:26.498+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:26.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:26.586+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:26.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:26.643+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:27.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:27.384+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:27.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:27.539+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:27.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:27.555+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:27.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:27.611+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:28.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:28.398+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:28.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:28.501+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:28.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:28.518+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:28.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:28.635+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:28.929 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:45:28.926+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:45:29.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:29.427+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:29.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:29.484+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:29.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:29.542+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:29.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:29.635+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:30.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:30.391+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:30.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:30.437+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:30.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:30.502+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:30.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:30.593+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:31.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:31.382+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:31.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:31.419+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:31.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:31.496+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:31.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:31.617+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:32.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:32.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:32.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:32.406+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:32.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:32.514+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:32.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:32.631+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:33.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:33.339+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:33.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:33.384+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:33.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:33.507+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:33.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:33.678+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:34.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:34.345+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:34.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:34.433+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:34.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:34.533+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:34.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:34.705+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:35.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:35.329+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:35.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:35.458+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:35.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:35.507+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:35.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:35.708+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:36.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:36.343+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:36.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:36.467+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:36.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:36.545+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:36.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:36.662+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:37.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:37.373+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:37.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:37.443+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:37.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:37.590+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:37.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:37.692+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:38.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:38.419+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:38.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:38.477+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:38.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:38.616+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:38.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:38.656+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:39.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:39.455+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:39.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:39.475+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:39.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:39.612+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:39.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:39.670+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:40.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:40.458+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:40.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:40.475+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:40.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:40.619+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:40.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:40.621+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:41.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:41.447+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:41.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:41.486+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:41.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:41.606+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:41.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:41.648+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:42.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:42.442+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:42.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:42.463+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:42.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:42.624+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:42.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:42.626+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:43.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:43.466+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:43.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:43.510+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:43.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:43.578+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:43.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:43.618+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:43.945 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:45:43.943+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:45:44.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:44.498+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:44.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:44.515+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:44.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:44.613+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:44.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:44.665+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:45.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:45.470+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:45.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:45.511+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:45.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:45.618+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:45.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:45.657+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:46.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:46.428+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:46.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:46.537+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:46.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:46.612+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:46.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:46.617+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:47.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:47.404+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:47.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:47.560+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:47.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:47.615+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:47.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:47.616+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:48.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:48.386+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:48.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:48.532+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:48.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:48.642+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:48.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:48.653+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:49.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:49.410+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:49.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:49.498+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:49.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:49.593+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:49.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:49.693+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:50.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:50.409+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:50.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:50.533+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:50.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:50.643+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:50.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:50.707+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:51.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:45:51.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:45:51.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:51.380+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:51.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:51.517+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:51.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:51.690+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:51.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:51.692+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:52.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:52.384+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:52.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:52.505+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:52.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:52.691+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:52.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:52.711+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:53.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:53.352+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:53.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:53.486+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:53.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:53.672+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:53.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:53.731+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:54.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:54.359+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:54.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:54.500+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:54.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:54.647+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:54.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:54.731+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:55.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:55.337+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:55.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:55.456+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:55.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:55.681+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:55.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:55.694+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:56.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:56.314+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:56.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:56.425+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:56.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:56.651+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:56.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:56.730+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:57.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:57.329+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:57.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:57.384+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:57.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:57.632+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:57.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:57.754+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:58.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:58.345+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:58.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:58.432+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:58.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:58.656+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:58.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:58.797+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:58.960 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:45:58.958+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:45:59.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:45:59.375+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 35 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:59.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:45:59.481+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:59.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:45:59.681+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:45:59.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:45:59.750+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:00.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:00.404+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:00.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:00.438+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:00.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:00.644+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:00.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:00.764+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:01.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:01.367+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:01.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:01.411+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:01.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:01.686+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:01.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:01.757+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:02.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:02.366+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:02.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:02.374+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:02.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:02.666+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:02.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:02.772+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:03.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:03.332+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:03.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:03.359+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:03.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:03.678+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:03.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:03.773+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:04.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:04.343+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:04.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:04.358+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:04.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:04.649+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:04.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:04.764+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:05.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:05.366+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:05.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:05.380+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:05.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:05.692+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:05.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:05.746+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:06.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:06.373+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:06.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:06.413+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:06.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:06.723+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:06.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:06.725+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:07.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:07.387+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:07.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:07.434+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:07.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:07.718+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:07.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:07.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:08.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:08.429+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:08.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:08.479+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:08.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:08.682+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:08.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:08.688+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:09.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:09.431+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:09.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:09.482+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:09.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:09.677+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:09.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:09.684+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:10.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:10.386+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:10.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:10.529+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:10.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:10.693+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:10.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:10.720+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:11.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:11.379+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:11.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:11.492+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:11.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:11.699+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:11.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:11.709+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:12.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:12.402+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:12.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:12.504+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:12.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:12.682+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:12.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:12.682+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:13.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:13.372+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:13.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:13.491+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:13.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:13.662+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:13.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:13.687+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:13.976 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:46:13.974+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:46:14.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:14.323+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:14.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:14.485+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:14.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:14.677+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:14.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:14.686+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:15.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:15.315+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:15.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:15.482+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:15.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:15.705+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:15.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:15.715+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:16.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:16.278+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:16.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:16.492+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:16.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:16.658+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:16.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:16.732+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:17.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:17.318+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:17.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:17.458+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:17.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:17.690+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:17.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:17.744+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:18.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:18.321+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:18.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:18.466+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:18.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:18.692+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:18.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:18.756+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:19.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:19.328+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:19.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:19.483+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:19.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:19.673+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:19.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:19.755+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:20.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:20.353+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:20.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:20.508+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:20.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:20.704+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:20.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:20.786+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:21.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:21.365+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:21.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:46:21.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:46:21.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:21.527+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:21.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:21.671+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:21.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:21.817+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:22.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:22.347+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:22.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:22.555+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:22.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:22.640+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:22.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:22.786+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:23.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:23.365+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:23.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:23.531+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:23.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:23.649+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:23.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:23.829+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:24.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:24.343+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:24.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:24.520+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:24.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:24.618+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:24.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:24.794+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:25.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:25.341+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:25.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:25.478+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:25.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:25.573+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:25.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:25.764+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:26.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:26.322+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:26.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:26.492+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:26.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:26.572+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:26.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:26.762+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:27.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:27.321+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:27.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:27.525+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:27.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:27.612+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:27.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:27.808+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:28.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:28.313+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:28.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:28.568+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:28.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:28.611+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:28.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:28.772+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:28.992 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:46:28.990+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:46:29.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:29.317+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:29.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:29.609+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:29.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:29.634+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:29.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:29.786+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:30.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:30.317+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:30.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:30.615+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:30.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:30.649+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:30.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:30.817+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:31.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:31.360+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:31.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:31.627+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:31.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:31.660+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:31.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:31.852+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:32.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:32.358+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:32.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:32.579+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:32.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:32.643+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:33.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:32.897+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:33.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:33.329+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:33.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:33.575+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:33.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:33.661+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:33.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:33.896+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:34.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:34.323+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:34.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:34.592+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:34.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:34.667+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:34.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:34.929+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:35.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:35.369+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:35.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:35.606+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:35.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:35.619+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:35.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:35.943+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:36.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:36.398+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:36.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:36.574+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:36.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:36.628+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:36.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:36.947+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:37.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:37.358+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:37.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:37.573+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:37.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:37.610+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:37.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:37.904+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:38.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:38.406+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:38.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:38.550+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:38.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:38.651+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:38.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:38.953+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:39.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:39.416+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:39.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:39.583+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:39.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:39.632+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:39.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:39.938+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:40.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:40.418+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:40.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:40.633+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:40.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:40.640+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:40.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:40.971+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:41.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:41.455+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:41.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:41.594+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:41.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:41.599+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:41.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:41.935+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:42.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:42.482+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:42.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:42.580+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:42.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:42.608+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:42.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:42.929+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:43.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:43.527+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:43.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:43.537+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:43.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:43.572+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:43.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:43.940+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:44.008 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:46:44.006+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:46:44.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:44.554+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:44.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:44.567+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:44.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:44.570+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:44.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:44.943+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:45.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:45.534+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:45.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:45.602+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:45.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:45.618+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:45.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:45.957+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:46.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:46.546+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:46.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:46.560+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:46.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:46.581+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:46.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:46.978+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:47.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:47.587+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:47.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:47.593+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:47.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:47.602+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:48.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:48.026+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:48.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:48.565+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:48.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:48.583+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:48.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:48.607+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:49.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:49.044+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:49.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:49.540+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:49.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:49.594+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:49.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:49.657+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:50.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:50.051+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:50.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:50.572+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:50.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:50.598+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:50.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:50.665+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:51.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:51.063+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:51.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:46:51.584 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:46:51.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:51.600+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:51.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:51.644+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:51.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:51.690+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:52.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:52.093+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:52.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:52.600+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:52.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:52.618+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:52.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:52.701+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:53.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:53.082+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:53.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:53.593+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:53.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:53.596+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:53.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:53.722+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:54.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:54.100+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:54.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:54.621+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:54.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:54.633+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:54.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:54.722+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:55.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:55.093+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:55.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:55.625+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:55.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:55.629+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:55.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:55.719+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:56.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:56.107+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:56.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:56.616+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:56.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:56.627+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:56.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:56.759+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:57.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:57.073+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:57.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:57.610+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:57.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:57.643+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:57.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:57.762+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:58.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:58.068+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:58.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:58.597+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:58.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:58.611+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:58.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:58.744+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:59.024 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:46:59.023+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:46:59.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:46:59.039+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:59.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:46:59.635+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:59.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:46:59.638+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:46:59.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:46:59.772+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:00.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:00.020+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:00.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:00.606+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:00.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:00.666+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:00.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:00.749+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:00.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:00.997+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:01.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:01.560+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:01.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:01.694+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:01.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:01.751+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:01.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:01.990+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:02.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:02.574+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:02.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:02.716+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:02.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:02.743+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:02.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:02.992+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:03.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:03.543+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:03.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:03.763+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:03.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:03.766+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:03.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:03.951+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:04.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:04.566+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:04.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:04.741+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:04.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:04.806+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:04.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:04.995+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:05.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:05.554+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:05.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:05.748+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:05.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:05.836+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:05.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:05.994+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:06.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:06.516+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:06.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:06.784+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:06.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:06.801+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:07.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:07.045+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:07.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:07.549+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:07.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:07.809+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:07.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:07.818+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:08.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:08.081+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:08.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:08.554+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:08.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:08.792+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:08.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:08.837+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:09.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:09.098+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:09.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:09.558+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:09.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:09.813+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:09.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:09.833+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:10.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:10.112+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:10.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:10.600+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:10.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:10.852+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:10.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:10.865+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:11.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:11.153+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:11.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:11.555+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:11.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:11.874+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:11.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:11.878+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:12.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:12.175+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:12.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:12.548+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:12.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:12.847+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:12.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:12.859+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:13.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:13.207+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:13.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:13.590+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:13.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:13.827+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:13.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:13.843+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:14.040 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:47:14.037+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:47:14.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:14.239+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:14.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:14.630+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:14.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:14.779+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:14.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:14.812+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:15.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:15.264+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:15.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:15.666+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:15.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:15.778+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:15.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:15.790+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:16.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:16.242+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:16.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:16.699+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:16.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:16.746+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:16.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:16.839+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:17.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:17.218+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:17.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:17.701+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:17.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:17.725+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:17.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:17.862+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:18.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:18.260+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:18.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:18.732+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:18.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:18.736+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:18.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:18.845+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:19.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:19.263+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:19.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:19.740+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:19.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:19.757+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:19.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:19.836+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:20.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:20.274+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:20.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:20.700+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:20.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:20.740+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:20.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:20.868+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:21.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:21.229+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:21.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:21.675+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:21.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:47:21.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:47:21.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:21.706+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:21.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:21.825+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:22.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:22.263+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:22.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:22.636+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:22.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:22.712+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:22.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:22.808+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:23.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:23.284+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:23.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:23.601+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:23.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:23.703+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:23.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:23.800+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:24.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:24.244+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:24.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:24.554+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:24.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:24.688+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:24.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:24.797+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:25.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:25.206+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:25.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:25.600+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:25.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:25.661+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:25.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:25.776+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:26.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:26.174+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:26.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:26.648+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:26.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:26.649+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:26.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:26.807+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:27.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:27.189+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:27.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:27.665+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:27.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:27.687+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:27.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:27.851+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:28.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:28.158+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:28.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:28.671+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:28.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:28.730+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:28.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:28.867+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:29.056 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:47:29.054+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:47:29.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:29.116+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:29.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:29.676+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:29.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:29.779+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:29.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:29.892+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:30.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:30.091+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:30.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:30.652+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:30.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:30.770+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:30.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:30.846+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:31.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:31.079+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:31.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:31.643+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:31.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:31.734+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:31.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:31.884+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:32.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:32.085+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:32.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:32.693+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:32.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:32.766+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:32.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:32.917+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:33.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:33.103+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:33.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:33.656+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:33.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:33.755+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:33.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:33.915+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:34.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:34.057+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:34.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:34.685+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:34.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:34.792+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:34.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:34.904+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:35.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:35.095+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:35.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:35.690+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:35.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:35.799+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:35.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:35.899+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:36.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:36.086+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:36.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:36.666+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:36.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:36.833+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:36.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:36.921+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:37.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:37.133+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:37.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:37.647+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:37.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:37.820+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:37.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:37.893+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:38.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:38.131+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:38.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:38.671+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:38.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:38.853+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:38.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:38.886+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:39.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:39.104+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:39.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:39.707+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:39.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:39.883+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:39.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:39.900+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:40.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:40.145+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:40.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:40.746+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:40.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:40.870+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:40.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:40.894+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:41.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:41.126+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:41.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:41.709+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:41.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:41.854+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:41.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:41.920+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:42.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:42.154+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:42.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:42.697+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:42.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:42.863+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:42.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:42.883+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:43.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:43.186+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:43.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:43.695+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:43.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:43.872+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:43.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:43.874+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:44.071 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:47:44.069+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:47:44.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:44.225+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:44.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:44.700+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:44.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:44.836+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:44.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:44.858+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:45.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:45.249+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:45.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:45.742+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:45.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:45.856+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:45.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:45.858+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:46.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:46.269+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:46.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:46.742+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:46.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:46.820+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:46.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:46.860+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:47.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:47.305+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:47.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:47.768+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:47.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:47.822+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:47.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:47.875+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:48.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:48.257+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:48.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:48.795+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:48.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:48.834+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:48.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:48.861+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:49.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:49.294+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:49.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:49.802+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:49.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:49.825+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:49.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:49.838+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:50.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:50.320+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:50.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:50.792+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:50.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:50.811+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:50.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:50.821+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:51.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:51.331+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:51.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:51.760+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:51.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:51.779+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:51.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:47:51.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:47:51.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:51.835+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:52.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:52.361+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:52.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:52.726+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:52.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:52.781+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:52.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:52.883+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:53.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:53.399+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:53.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:53.734+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:53.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:53.755+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:53.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:53.881+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:54.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:54.422+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:54.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:54.698+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:54.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:54.787+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:54.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:54.866+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:55.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:55.401+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:55.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:55.720+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:55.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:55.776+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:55.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:55.873+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:56.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:56.422+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:56.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:56.739+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:56.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:56.771+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:56.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:56.899+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:57.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:57.431+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:57.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:57.766+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:57.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:57.773+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:57.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:57.936+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:58.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:58.432+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:58.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:58.732+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:58.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:58.736+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:58.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:58.930+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:59.087 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:47:59.085+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:47:59.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:47:59.422+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:59.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:47:59.750+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:59.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:47:59.781+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:47:59.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:47:59.943+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:00.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:00.394+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:00.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:00.762+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:00.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:00.809+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:00.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:00.924+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:01.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:01.435+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:01.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:01.774+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:01.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:01.834+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:01.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:01.957+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:02.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:02.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:02.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:02.816+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:02.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:02.843+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:02.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:02.921+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:03.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:03.476+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:03.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:03.773+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:03.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:03.801+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:03.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:03.898+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:04.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:04.432+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:04.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:04.733+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:04.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:04.757+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:04.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:04.875+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:05.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:05.458+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:05.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:05.724+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:05.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:05.738+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:05.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:05.850+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:06.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:06.478+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:06.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:06.675+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:06.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:06.703+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:06.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:06.820+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:07.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:07.515+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:07.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:07.672+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:07.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:07.742+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:07.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:07.840+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:08.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:08.544+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:08.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:08.678+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:08.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:08.708+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:08.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:08.845+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:09.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:09.582+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:09.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:09.681+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:09.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:09.731+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:09.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:09.849+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:10.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:10.603+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:10.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:10.655+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:10.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:10.743+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:10.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:10.897+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:11.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:11.598+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:11.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:11.627+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:11.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:11.757+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:11.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:11.893+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:12.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:12.590+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:12.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:12.625+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:12.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:12.755+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:12.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:12.881+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:13.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:13.609+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:13.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:13.637+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:13.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:13.714+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:13.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:13.911+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:14.103 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:48:14.102+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:48:14.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:14.614+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:14.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:14.646+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:14.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:14.751+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:14.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:14.881+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:15.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:15.620+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:15.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:15.639+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:15.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:15.757+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:15.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:15.916+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:16.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:16.592+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:16.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:16.623+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:16.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:16.786+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:16.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:16.881+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:17.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:17.589+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:17.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:17.617+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:17.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:17.801+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:17.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:17.860+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:18.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:18.564+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:18.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:18.583+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:18.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:18.828+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:18.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:18.902+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:19.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:19.553+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:19.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:19.573+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:19.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:19.835+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:19.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:19.911+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:20.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:20.530+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:20.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:20.580+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:20.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:20.879+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:20.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:20.891+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:21.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:21.529+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:21.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:21.561+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:21.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:48:21.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:48:21.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:21.916+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:21.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:21.919+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:22.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:22.492+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:22.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:22.609+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:22.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:22.919+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:22.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:22.943+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:23.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:23.462+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:23.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:23.635+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:23.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:23.906+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:23.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:23.960+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:24.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:24.420+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:24.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:24.610+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:24.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:24.913+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:25.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:25.007+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:25.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:25.388+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:25.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:25.652+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:25.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:25.901+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:25.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:25.998+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:26.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:26.354+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:26.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:26.649+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:26.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:26.908+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:27.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:27.017+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:27.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:27.403+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:27.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:27.631+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:27.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:27.876+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:28.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:28.045+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:28.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:28.362+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:28.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:28.602+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:28.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:28.834+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:29.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:29.023+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:29.104 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:48:29.102+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:48:29.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:29.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:29.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:29.582+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:29.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:29.807+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:29.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:29.985+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:30.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:30.370+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:30.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:30.594+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:30.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:30.793+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:30.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:30.966+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:31.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:31.401+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:31.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:31.567+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:31.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:31.839+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:31.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:31.970+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:32.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:32.355+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:32.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:32.584+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:32.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:32.811+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:32.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:32.959+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:33.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:33.348+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:33.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:33.543+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:33.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:33.773+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:33.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:33.967+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:34.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:34.397+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:34.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:34.533+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:34.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:34.768+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:34.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:34.956+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:35.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:35.384+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:35.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:35.501+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:35.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:35.805+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:35.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:35.947+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:36.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:36.362+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:36.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:36.503+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:36.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:36.814+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:36.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:36.945+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:37.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:37.412+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:37.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:37.551+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:37.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:37.821+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:37.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:37.977+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:38.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:38.428+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:38.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:38.551+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:38.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:38.779+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:38.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:38.990+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:39.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:39.467+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:39.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:39.504+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:39.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:39.794+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:39.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:39.997+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:40.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:40.424+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:40.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:40.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:40.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:40.797+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:40.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:40.991+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:41.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:41.411+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:41.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:41.466+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:41.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:41.750+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:42.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:42.002+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:42.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:42.426+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:42.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:42.432+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:42.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:42.766+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:43.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:43.021+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:43.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:43.399+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:43.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:43.404+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:43.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:43.752+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:44.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:44.052+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:44.120 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:48:44.119+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:48:44.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:44.349+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:44.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:44.361+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:44.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:44.703+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:45.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:45.013+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:45.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:45.374+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:45.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:45.380+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:45.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:45.661+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:46.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:46.017+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:46.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:46.346+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:46.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:46.421+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:46.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:46.710+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:47.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:47.053+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:47.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:47.300+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:47.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:47.391+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:47.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:47.741+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:48.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:48.070+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:48.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:48.266+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:48.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:48.351+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:48.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:48.772+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:49.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:49.106+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:49.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:49.288+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:49.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:49.396+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:49.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:49.774+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:50.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:50.083+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:50.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:50.336+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:50.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:50.444+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:50.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:50.753+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:51.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:51.103+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:51.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:51.289+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:51.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:51.438+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:51.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:51.765+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:52.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:48:52.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:48:52.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:52.128+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:52.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:52.244+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:52.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:52.395+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:52.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:52.800+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:53.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:53.105+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:53.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:53.213+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:53.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:53.409+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:53.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:53.844+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:54.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:54.090+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:54.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:54.192+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:54.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:54.458+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:54.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:54.800+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:55.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:55.120+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:55.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:55.184+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:55.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:55.470+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:55.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:55.753+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:56.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:56.101+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:56.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:56.149+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:56.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:56.485+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:56.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:56.775+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:57.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:57.076+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:57.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:57.183+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:57.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:57.510+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:57.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:57.767+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:58.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:58.092+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:58.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:58.144+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:58.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:58.479+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:58.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:58.747+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:59.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:48:59.092+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:59.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:48:59.101+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:59.136 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:48:59.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:48:59.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:48:59.493+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:48:59.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:48:59.726+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:00.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:00.075+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:00.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:00.097+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:00.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:00.493+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:00.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:00.759+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:01.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:01.087+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:01.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:01.127+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:01.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:01.520+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:01.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:01.778+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:02.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:02.090+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:02.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:02.125+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:02.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:02.564+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:02.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:02.819+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:03.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:03.118+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:03.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:03.151+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:03.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:03.530+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:03.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:03.792+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:04.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:04.138+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:04.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:04.192+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:04.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:04.535+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:04.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:04.778+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:05.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:05.100+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:05.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:05.236+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:05.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:05.546+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:05.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:05.792+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:06.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:06.054+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:06.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:06.271+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:06.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:06.539+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:06.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:06.840+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:07.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:07.065+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:07.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:07.274+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:07.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:07.550+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:07.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:07.803+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:08.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:08.058+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:08.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:08.277+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:08.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:08.515+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:08.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:08.814+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:09.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:09.105+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:09.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:09.235+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:09.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:09.468+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:09.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:09.805+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:10.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:10.124+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:10.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:10.281+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:10.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:10.440+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:10.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:10.849+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:11.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:11.094+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:11.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:11.255+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:11.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:11.489+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:11.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:11.850+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:12.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:12.124+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:12.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:12.299+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:12.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:12.447+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:12.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:12.890+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:13.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:13.090+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:13.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:13.306+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:13.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:13.449+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:13.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:13.850+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:14.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:14.087+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:14.152 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:49:14.150+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:49:14.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:14.337+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:14.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:14.456+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:14.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:14.865+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:15.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:15.075+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:15.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:15.340+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:15.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:15.460+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:15.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:15.870+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:16.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:16.041+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:16.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:16.360+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:16.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:16.464+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:16.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:16.921+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:17.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:17.081+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:17.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:17.333+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:17.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:17.467+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:17.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:17.937+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:18.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:18.073+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:18.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:18.356+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:18.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:18.490+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:18.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:18.933+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:19.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:19.036+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:19.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:19.354+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:19.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:19.520+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:19.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:19.939+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:20.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:20.081+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:20.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:20.321+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:20.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:20.566+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:20.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:20.896+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:21.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:21.111+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:21.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:21.328+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:21.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:21.544+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:21.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:21.914+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:22.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:22.145+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:22.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:49:22.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:49:22.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:22.286+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:22.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:22.558+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:22.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:22.915+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:23.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:23.114+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:23.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:23.271+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:23.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:23.545+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:23.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:23.887+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:24.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:24.150+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:24.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:24.316+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:24.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:24.517+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:24.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:24.873+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:25.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:25.104+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:25.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:25.358+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:25.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:25.499+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:25.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:25.855+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:26.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:26.075+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:26.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:26.337+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:26.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:26.529+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:26.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:26.889+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:27.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:27.087+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:27.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:27.316+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:27.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:27.498+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:27.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:27.934+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:28.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:28.122+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:28.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:28.280+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:28.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:28.547+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:28.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:28.895+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:29.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:29.089+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:29.168 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:49:29.166+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:49:29.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:29.239+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:29.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:29.587+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:29.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:29.849+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:30.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:30.069+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:30.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:30.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:30.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:30.541+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:30.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:30.812+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:31.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:31.105+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:31.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:31.299+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:31.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:31.571+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:31.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:31.779+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:32.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:32.077+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:32.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:32.344+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:32.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:32.581+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:32.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:32.764+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:33.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:33.093+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:33.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:33.339+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:33.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:33.555+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:33.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:33.782+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:34.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:34.074+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:34.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:34.326+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:34.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:34.583+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:34.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:34.828+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:35.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:35.098+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:35.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:35.310+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:35.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:35.580+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:35.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:35.830+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:36.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:36.137+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:36.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:36.320+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:36.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:36.605+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:36.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:36.874+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:37.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:37.104+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:37.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:37.285+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:37.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:37.599+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:37.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:37.868+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:38.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:38.137+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:38.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:38.266+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:38.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:38.585+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:38.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:38.880+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:39.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:39.131+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:39.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:39.238+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:39.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:39.556+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:39.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:39.870+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:40.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:40.094+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:40.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:40.227+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:40.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:40.547+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:40.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:40.852+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:41.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:41.092+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:41.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:41.182+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:41.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:41.543+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:41.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:41.901+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:42.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:42.123+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:42.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:42.156+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:42.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:42.496+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:42.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:42.949+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:43.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:43.095+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:43.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:43.196+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:43.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:43.449+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:43.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:43.990+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:44.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:44.050+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:44.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:44.150+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:44.184 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:49:44.182+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:49:44.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:44.492+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:44.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:44.984+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:45.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:45.044+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:45.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:45.102+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:45.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:45.455+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:46.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:46.009+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:46.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:46.021+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:46.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:46.063+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:46.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:46.489+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:46.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:46.991+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:47.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:47.021+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:47.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:47.101+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:47.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:47.466+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:48.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:48.040+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:48.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:48.042+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:48.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:48.113+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:48.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:48.507+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:49.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:49.009+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:49.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:49.082+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:49.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:49.131+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:49.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:49.531+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:50.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:50.053+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:50.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:50.065+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:50.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:50.106+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:50.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:50.570+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:51.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:51.099+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:51.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:51.103+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:51.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:51.136+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:51.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:51.600+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:52.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:52.064+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:52.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:52.101+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:52.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:52.127+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:52.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:49:52.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:49:52.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:52.619+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:53.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:53.090+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:53.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:53.118+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:53.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:53.162+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:53.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:53.644+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:54.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:54.111+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:54.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:54.117+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:54.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:54.205+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:54.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:54.683+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:55.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:55.071+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:55.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:55.155+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:55.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:55.213+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:55.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:55.695+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:56.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:56.035+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:56.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:56.176+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:56.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:56.252+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:56.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:56.721+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:57.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:57.071+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:57.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:57.128+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:57.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:57.244+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:57.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:57.732+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:58.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:58.103+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:58.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:58.116+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:58.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:58.211+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:58.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:58.735+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:59.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:49:59.077+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:59.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:49:59.137+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:59.187 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:49:59.186+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:49:59.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:49:59.251+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:49:59.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:49:59.716+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:00.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:00.080+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:00.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:00.158+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:00.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:00.280+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:00.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:00.747+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:01.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:01.090+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:01.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:01.206+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:01.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:01.265+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:01.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:01.737+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:02.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:02.100+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:02.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:02.165+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:02.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:02.298+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:02.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:02.755+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:03.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:03.080+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:03.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:03.122+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:03.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:03.274+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:03.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:03.771+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:04.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:04.091+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:04.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:04.122+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:04.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:04.265+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:04.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:04.756+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:05.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:05.060+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:05.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:05.132+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:05.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:05.232+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:05.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:05.782+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:06.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:06.086+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:06.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:06.096+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:06.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:06.267+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:06.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:06.765+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:07.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:07.065+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:07.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:07.120+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:07.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:07.297+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:07.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:07.737+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:08.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:08.102+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:08.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:08.153+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:08.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:08.267+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:08.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:08.758+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:09.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:09.120+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:09.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:09.120+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:09.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:09.314+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:09.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:09.725+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:10.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:10.074+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:10.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:10.158+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:10.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:10.353+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:10.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:10.716+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:11.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:11.073+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:11.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:11.131+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:11.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:11.360+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:11.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:11.734+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:12.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:12.068+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:12.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:12.137+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:12.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:12.337+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:12.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:12.710+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:13.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:13.045+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:13.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:13.107+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:13.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:13.290+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:13.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:13.755+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:14.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:14.011+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:14.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:14.157+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:14.195 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:50:14.193+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:50:14.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:14.291+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:14.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:14.728+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:15.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:15.004+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:15.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:15.197+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:15.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:15.295+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:15.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:15.704+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:16.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:16.012+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:16.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:16.205+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:16.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:16.249+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:16.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:16.700+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:17.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:17.023+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:17.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:17.205+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:17.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:17.236+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:17.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:17.718+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:18.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:18.059+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:18.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:18.238+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:18.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:18.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:18.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:18.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:19.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:19.023+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:19.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:19.256+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:19.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:19.285+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:19.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:19.752+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:20.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:20.051+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:20.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:20.268+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:20.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:20.288+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:20.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:20.741+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:21.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:21.046+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:21.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:21.295+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:21.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:21.301+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:21.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:21.746+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:22.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:22.022+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:22.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:22.281+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:22.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:22.293+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:22.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:50:22.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:50:22.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:22.718+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:23.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:23.061+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:23.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:23.242+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:23.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:23.247+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:23.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:23.734+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:24.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:24.073+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:24.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:24.221+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:24.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:24.283+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:24.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:24.700+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:25.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:25.065+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:25.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:25.184+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:25.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:25.281+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:25.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:25.707+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:26.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:26.098+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:26.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:26.151+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:26.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:26.328+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:26.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:26.716+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:27.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:27.105+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:27.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:27.113+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:27.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:27.288+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:27.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:27.740+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:28.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:28.133+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:28.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:28.136+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:28.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:28.282+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:28.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:28.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:29.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:29.178+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:29.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:29.183+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:29.211 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:50:29.209+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:50:29.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:29.273+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:29.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:29.728+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:30.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:30.187+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:30.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:30.209+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:30.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:30.312+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:30.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:30.774+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:31.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:31.172+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:31.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:31.197+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:31.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:31.297+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:31.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:31.758+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:32.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:32.174+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:32.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:32.234+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:32.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:32.306+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:32.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:32.726+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:33.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:33.201+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:33.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:33.227+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:33.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:33.320+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:33.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:33.752+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:34.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:34.249+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:34.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:34.264+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:34.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:34.353+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:34.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:34.776+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:35.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:35.238+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:35.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:35.245+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:35.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:35.349+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:35.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:35.753+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:36.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:36.209+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:36.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:36.286+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:36.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:36.366+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:36.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:36.722+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:37.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:37.164+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:37.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:37.277+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:37.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:37.348+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:37.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:37.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:38.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:38.168+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:38.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:38.279+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:38.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:38.369+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:38.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:38.725+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:39.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:39.189+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:39.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:39.253+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:39.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:39.336+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:39.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:39.731+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:40.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:40.181+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:40.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:40.232+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:40.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:40.364+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:40.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:40.703+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:41.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:41.199+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:41.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:41.206+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:41.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:41.387+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:41.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:41.655+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:42.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:42.224+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:42.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:42.243+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:42.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:42.406+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:42.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:42.664+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:43.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:43.207+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:43.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:43.265+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:43.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:43.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:43.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:43.657+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:44.227 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:50:44.225+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:50:44.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:44.237+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:44.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:44.250+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:44.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:44.428+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:44.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:44.688+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:45.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:45.190+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:45.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:45.252+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:45.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:45.402+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:45.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:45.680+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:46.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:46.208+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:46.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:46.218+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:46.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:46.373+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:46.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:46.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:47.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:47.221+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:47.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:47.221+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:47.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:47.374+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:47.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:47.729+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:48.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:48.207+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:48.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:48.264+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:48.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:48.397+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:48.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:48.755+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:49.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:49.206+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:49.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:49.311+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:49.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:49.353+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:49.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:49.774+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:50.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:50.244+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:50.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:50.308+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:50.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:50.330+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:50.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:50.794+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:51.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:51.203+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:51.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:51.285+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:51.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:51.338+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:51.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:51.754+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:52.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:52.188+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:52.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:52.288+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:52.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:52.294+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:52.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:50:52.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:50:52.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:52.771+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:53.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:53.170+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:53.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:53.258+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:53.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:53.321+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:53.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:53.819+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:54.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:54.205+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:54.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:54.268+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:54.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:54.361+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:54.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:54.868+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:55.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:55.219+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:55.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:55.245+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:55.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:55.350+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:55.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:55.907+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:56.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:56.184+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:56.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:56.264+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:56.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:56.333+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:56.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:56.864+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:57.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:57.172+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:57.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:57.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:57.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:57.303+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:57.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:57.826+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:58.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:58.194+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:58.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:58.314+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:58.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:58.350+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:58.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:58.806+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:59.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:50:59.194+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:59.243 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:50:59.241+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:50:59.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:50:59.276+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:59.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:50:59.338+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:50:59.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:50:59.776+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:00.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:00.233+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:00.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:00.314+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:00.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:00.370+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:00.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:00.779+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:01.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:01.205+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:01.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:01.271+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:01.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:01.406+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:01.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:01.782+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:02.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:02.237+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:02.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:02.250+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:02.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:02.450+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:02.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:02.792+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:03.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:03.243+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:03.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:03.262+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:03.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:03.489+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:03.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:03.748+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:04.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:04.291+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:04.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:04.298+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:04.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:04.449+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:04.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:04.749+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:05.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:05.263+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:05.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:05.281+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:05.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:05.476+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:05.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:05.731+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:06.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:06.239+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:06.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:06.325+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:06.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:06.470+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:06.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:06.718+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:07.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:07.273+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:07.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:07.280+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:07.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:07.432+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:07.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:07.691+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:08.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:08.234+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:08.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:08.262+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:08.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:08.435+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:08.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:08.720+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:09.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:09.187+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:09.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:09.217+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:09.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:09.459+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:09.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:09.759+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:10.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:10.167+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:10.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:10.209+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:10.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:10.470+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:10.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:10.782+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:11.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:11.168+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:11.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:11.196+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:11.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:11.468+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:11.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:11.744+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:12.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:12.208+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:12.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:12.218+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:12.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:12.518+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:12.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:12.745+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:13.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:13.207+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:13.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:13.257+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:13.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:13.485+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:13.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:13.739+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:14.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:14.192+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:14.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:14.223+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:14.259 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:51:14.258+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:51:14.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:14.490+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:14.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:14.709+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:15.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:15.174+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:15.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:15.214+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:15.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:15.462+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:15.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:15.729+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:16.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:16.172+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:16.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:16.214+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:16.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:16.422+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:16.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:16.765+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:17.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:17.162+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:17.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:17.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:17.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:17.435+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:17.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:17.774+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:18.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:18.164+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:18.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:18.171+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:18.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:18.404+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:18.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:18.806+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:19.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:19.177+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:19.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:19.181+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:19.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:19.410+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:19.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:19.790+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:20.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:20.128+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:20.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:20.158+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:20.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:20.386+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:20.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:20.755+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:21.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:21.134+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:21.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:21.166+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:21.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:21.433+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:21.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:21.778+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:22.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:22.147+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:22.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:22.166+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:22.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:22.442+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:22.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:51:22.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:51:22.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:22.784+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:23.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:23.143+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:23.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:23.183+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:23.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:23.408+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:23.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:23.742+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:24.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:24.141+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:24.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:24.159+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:24.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:24.391+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:24.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:24.755+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:25.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:25.125+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:25.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:25.146+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:25.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:25.417+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:25.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:25.733+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:26.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:26.082+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:26.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:26.166+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:26.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:26.453+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:26.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:26.749+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:27.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:27.033+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:27.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:27.187+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:27.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:27.411+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:27.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:27.777+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:28.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:27.999+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:28.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:28.173+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:28.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:28.414+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:28.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:28.763+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:29.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:29.034+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:29.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:29.146+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:29.275 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:51:29.273+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:51:29.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:29.395+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:29.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:29.737+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:30.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:30.076+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:30.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:30.150+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:30.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:30.392+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:30.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:30.781+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:31.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:31.125+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:31.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:31.196+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:31.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:31.345+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:31.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:31.772+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:32.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:32.108+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:32.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:32.191+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:32.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:32.333+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:32.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:32.743+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:33.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:33.116+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:33.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:33.190+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:33.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:33.351+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:33.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:33.748+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:34.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:34.145+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:34.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:34.212+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:34.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:34.379+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:34.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:34.730+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:35.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:35.127+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:35.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:35.248+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:35.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:35.411+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:35.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:35.699+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:36.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:36.161+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:36.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:36.299+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:36.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:36.432+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:36.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:36.738+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:37.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:37.120+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:37.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:37.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:37.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:37.422+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:37.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:37.703+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:38.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:38.129+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:38.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:38.258+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:38.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:38.389+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:38.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:38.678+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:39.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:39.167+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:39.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:39.265+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:39.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:39.341+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:39.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:39.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:40.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:40.200+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:40.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:40.293+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:40.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:40.297+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:40.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:40.704+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:41.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:41.236+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:41.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:41.288+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:41.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:41.296+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:41.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:41.746+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:42.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:42.209+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:42.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:42.259+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:42.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:42.270+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:42.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:42.757+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:43.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:43.200+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:43.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:43.238+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:43.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:43.289+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:43.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:43.749+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:44.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:44.202+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:44.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:44.247+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:44.291 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:51:44.289+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:51:44.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:44.304+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:44.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:44.766+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:45.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:45.175+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:45.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:45.198+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:45.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:45.279+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:45.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:45.727+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:46.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:46.157+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:46.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:46.196+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:46.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:46.246+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:46.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:46.710+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:47.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:47.134+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:47.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:47.207+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:47.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:47.222+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:47.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:47.724+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:48.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:48.108+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:48.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:48.244+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:48.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:48.269+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:48.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:48.740+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:49.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:49.111+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:49.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:49.294+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:49.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:49.301+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:49.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:49.741+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:50.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:50.093+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:50.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:50.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:50.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:50.302+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:50.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:50.713+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:51.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:51.107+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:51.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:51.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:51.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:51.348+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:51.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:51.698+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:52.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:52.092+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:52.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:52.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:52.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:52.308+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:52.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:52.745+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:52.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:51:52.772 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:51:53.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:53.083+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:53.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:53.269+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:53.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:53.301+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:53.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:53.772+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:54.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:54.097+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:54.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:54.262+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:54.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:54.345+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:54.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:54.757+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:55.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:55.106+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:55.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:55.286+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:55.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:55.392+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:55.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:55.806+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:56.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:56.079+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:56.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:56.268+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:56.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:56.433+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:56.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:56.783+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:57.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:57.090+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:57.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:57.253+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:57.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:57.385+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:57.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:57.781+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:58.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:58.070+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:58.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:58.236+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:58.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:58.392+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:58.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:58.775+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:59.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:51:59.095+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:59.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:51:59.203+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:59.307 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:51:59.304+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:51:59.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:51:59.353+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:51:59.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:51:59.783+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:00.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:00.054+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:00.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:00.178+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:00.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:00.372+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:00.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:00.823+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:01.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:01.104+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:01.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:01.172+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:01.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:01.338+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:01.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:01.775+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:02.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:02.112+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:02.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:02.193+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:02.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:02.289+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:02.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:02.754+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:03.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:03.077+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:03.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:03.156+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:03.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:03.288+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:03.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:03.765+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:04.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:04.103+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:04.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:04.139+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:04.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:04.250+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:04.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:04.762+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:05.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:05.136+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:05.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:05.144+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:05.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:05.212+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:05.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:05.781+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:06.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:06.129+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:06.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:06.172+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:06.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:06.182+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:06.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:06.746+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:07.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:07.116+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:07.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:07.143+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:07.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:07.183+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:07.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:07.763+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:08.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:08.117+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:08.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:08.127+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:08.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:08.150+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:08.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:08.795+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:09.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:09.103+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:09.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:09.153+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:09.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:09.167+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:09.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:09.803+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:10.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:10.059+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:10.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:10.147+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:10.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:10.196+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:10.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:10.839+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:11.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:11.063+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:11.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:11.128+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:11.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:11.150+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:11.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:11.832+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:12.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:12.018+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:12.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:12.114+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:12.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:12.159+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:12.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:12.807+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:13.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:13.000+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:13.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:13.107+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:13.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:13.142+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:13.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:13.817+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:13.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:13.984+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:14.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:14.082+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:14.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:14.107+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:14.323 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:52:14.320+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:52:14.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:14.800+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:15.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:15.019+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:15.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:15.100+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:15.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:15.151+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:15.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:15.812+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:16.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:16.019+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:16.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:16.069+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:16.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:16.170+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:16.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:16.847+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:17.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:17.002+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:17.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:17.058+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:17.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:17.136+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:17.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:17.844+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:18.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:18.014+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:18.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:18.024+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:18.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:18.114+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:18.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:18.804+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:18.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:18.986+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:19.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:19.069+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:19.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:19.155+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:19.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:19.852+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:19.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:19.984+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:20.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:20.111+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:20.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:20.148+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:20.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:20.809+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:20.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:20.943+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:21.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:21.115+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:21.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:21.173+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:21.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:21.830+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:21.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:21.987+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:22.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:22.079+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:22.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:22.204+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:22.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:22.875+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:22.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:52:22.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:52:22.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:22.991+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:23.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:23.097+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:23.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:23.243+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:23.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:23.923+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:23.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:23.944+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:24.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:24.145+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:24.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:24.274+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:24.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:24.911+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:24.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:24.954+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:25.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:25.099+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:25.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:25.299+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:25.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:25.911+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:25.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:25.986+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:26.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:26.124+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:26.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:26.275+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:26.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:26.874+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:26.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:26.940+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:27.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:27.141+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:27.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:27.268+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:27.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:27.883+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:27.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:27.982+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:28.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:28.174+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:28.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:28.231+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:28.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:28.915+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:29.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:29.007+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:29.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:29.144+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:29.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:29.262+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:29.338 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:52:29.337+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:52:29.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:29.901+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:29.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:29.989+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:30.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:30.166+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:30.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:30.250+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:30.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:30.895+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:30.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:30.940+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:31.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:31.210+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:31.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:31.212+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:31.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:31.940+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:31.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:31.951+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:32.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:32.163+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:32.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:32.166+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:32.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:32.931+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:32.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:32.978+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:33.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:33.139+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:33.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:33.153+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:33.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:33.960+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:34.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:34.004+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:34.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:34.123+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:34.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:34.179+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:34.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:34.956+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:34.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:34.976+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:35.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:35.149+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:35.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:35.175+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:35.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:35.953+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:35.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:35.965+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:36.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:36.163+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:36.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:36.174+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:36.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:36.921+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:36.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:36.975+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:37.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:37.155+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:37.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:37.184+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:37.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:37.943+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:37.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:37.949+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:38.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:38.111+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:38.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:38.212+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:38.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:38.921+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:38.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:38.933+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:39.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:39.084+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:39.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:39.200+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:39.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:39.928+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:39.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:39.964+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:40.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:40.091+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:40.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:40.229+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:40.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:40.905+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:41.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:40.999+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:41.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:41.046+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:41.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:41.222+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:41.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:41.869+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:41.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:41.990+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:42.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:42.078+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:42.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:42.208+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:42.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:42.845+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:42.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:42.978+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:43.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:43.115+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:43.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:43.234+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:43.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:43.844+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:44.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:44.018+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:44.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:44.127+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:44.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:44.214+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:44.346 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:52:44.343+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:52:44.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:44.795+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:45.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:45.056+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:45.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:45.168+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:45.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:45.172+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:45.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:45.759+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:46.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:46.085+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:46.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:46.179+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:46.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:46.216+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:46.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:46.739+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:47.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:47.122+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:47.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:47.204+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:47.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:47.227+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:47.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:47.728+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:48.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:48.088+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:48.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:48.177+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:48.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:48.223+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:48.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:48.761+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:49.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:49.127+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:49.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:49.204+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:49.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:49.221+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:49.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:49.806+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:50.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:50.078+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:50.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:50.184+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:50.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:50.188+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:50.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:50.849+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:51.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:51.120+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:51.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:51.160+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:51.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:51.201+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:51.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:51.888+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:52.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:52.088+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:52.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:52.170+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:52.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:52.185+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:52.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:52.890+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:53.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:52:53.047 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:52:53.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:53.046+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:53.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:53.151+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:53.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:53.223+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:53.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:53.887+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:54.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:54.027+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:54.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:54.164+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:54.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:54.237+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:54.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:54.874+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:54.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:54.980+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:55.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:55.207+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:55.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:55.235+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:55.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:55.901+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:55.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:55.980+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:56.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:56.222+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:56.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:56.247+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:56.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:56.902+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:57.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:57.026+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:57.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:57.198+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:57.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:57.213+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:57.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:57.943+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:58.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:58.054+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:58.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:58.168+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:58.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:58.205+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:58.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:58.929+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:59.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:52:59.093+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:59.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:52:59.125+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:59.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:52:59.195+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:52:59.361 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:52:59.360+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:52:59.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:52:59.974+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:00.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:00.055+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:00.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:00.141+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:00.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:00.244+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:00.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:00.952+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:01.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:01.068+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:01.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:01.187+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:01.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:01.284+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:01.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:01.993+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:02.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:02.083+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:02.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:02.158+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:02.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:02.281+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:02.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:02.952+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:03.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:03.133+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:03.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:03.135+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:03.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:03.328+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:03.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:03.992+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:04.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:04.146+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:04.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:04.162+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:04.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:04.322+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:05.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:05.016+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:05.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:05.121+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:05.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:05.159+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:05.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:05.330+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:06.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:06.013+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:06.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:06.163+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:06.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:06.203+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:06.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:06.318+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:07.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:07.048+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:07.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:07.156+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:07.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:07.193+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:07.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:07.344+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:08.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:08.040+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:08.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:08.138+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:08.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:08.208+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:08.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:08.317+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:09.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:09.037+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:09.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:09.164+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:09.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:09.218+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:09.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:09.327+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:10.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:10.068+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:10.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:10.178+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:10.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:10.211+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:10.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:10.334+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:11.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:11.085+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:11.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:11.187+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:11.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:11.224+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:11.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:11.351+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:12.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:12.123+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:12.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:12.222+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:12.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:12.264+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:12.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:12.304+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:13.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:13.136+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:13.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:13.173+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:13.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:13.284+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:13.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:13.324+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:14.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:14.140+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:14.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:14.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:14.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:14.333+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:14.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:14.340+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:14.377 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:53:14.375+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:53:15.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:15.097+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:15.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:15.215+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:15.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:15.299+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:15.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:15.377+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:16.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:16.106+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:16.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:16.232+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:16.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:16.317+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:16.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:16.416+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:17.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:17.118+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:17.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:17.196+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:17.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:17.304+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:17.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:17.462+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:18.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:18.098+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:18.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:18.166+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:18.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:18.330+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:18.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:18.422+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:19.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:19.136+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:19.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:19.204+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:19.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:19.332+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:19.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:19.431+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:20.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:20.165+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:20.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:20.231+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:20.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:20.283+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:20.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:20.461+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:21.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:21.206+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:21.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:21.263+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:21.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:21.277+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:21.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:21.428+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:22.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:22.196+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:22.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:22.255+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:22.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:22.273+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:22.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:22.408+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:23.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:23.212+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:23.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:53:23.235 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:53:23.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:23.282+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:23.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:23.303+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:23.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:23.391+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:24.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:24.173+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:24.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:24.245+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:24.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:24.344+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:24.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:24.397+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:25.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:25.181+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:25.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:25.211+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:25.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:25.369+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:25.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:25.384+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:26.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:26.187+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:26.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:26.243+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:26.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:26.350+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:26.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:26.401+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:27.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:27.204+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:27.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:27.205+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:27.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:27.361+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:27.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:27.383+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:28.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:28.165+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:28.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:28.195+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:28.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:28.343+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:28.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:28.377+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:29.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:29.119+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:29.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:29.226+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:29.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:29.368+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:29.393 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:53:29.391+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:53:29.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:29.422+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:30.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:30.072+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:30.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:30.263+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:30.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:30.374+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:30.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:30.456+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:31.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:31.051+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:31.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:31.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:31.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:31.389+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:31.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:31.439+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:32.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:32.068+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:32.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:32.181+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:32.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:32.413+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:32.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:32.437+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:33.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:33.076+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:33.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:33.168+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:33.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:33.400+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:33.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:33.431+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:34.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:34.032+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:34.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:34.143+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:34.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:34.440+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:34.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:34.460+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:34.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:34.992+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:35.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:35.168+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:35.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:35.463+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:35.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:35.507+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:35.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:35.960+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:36.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:36.169+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:36.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:36.459+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:36.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:36.462+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:36.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:36.922+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:37.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:37.202+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:37.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:37.479+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:37.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:37.497+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:37.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:37.964+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:38.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:38.208+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:38.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:38.485+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:38.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:38.512+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:39.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:38.998+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:39.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:39.238+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:39.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:39.486+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:39.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:39.513+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:39.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:39.965+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:40.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:40.256+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:40.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:40.458+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:40.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:40.512+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:40.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:40.925+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:41.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:41.235+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:41.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:41.479+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:41.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:41.506+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:41.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:41.946+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:42.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:42.284+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:42.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:42.473+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:42.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:42.507+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:42.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:42.952+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:43.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:43.314+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:43.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:43.467+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:43.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:43.551+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:43.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:43.974+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:44.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:44.312+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:44.409 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:53:44.406+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:53:44.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:44.472+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:44.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:44.566+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:45.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:45.014+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:45.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:45.358+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:45.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:45.472+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:45.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:45.521+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:46.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:46.047+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:46.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:46.370+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:46.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:46.472+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:46.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:46.513+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:47.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:47.090+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:47.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:47.364+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:47.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:47.510+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:47.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:47.528+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:48.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:48.132+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:48.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:48.402+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:48.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:48.482+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:48.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:48.536+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:49.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:49.138+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:49.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:49.401+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:49.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:49.495+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:49.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:49.515+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:50.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:50.113+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:50.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:50.374+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:50.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:50.483+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:50.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:50.488+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:51.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:51.101+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:51.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:51.392+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:51.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:51.460+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:51.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:51.535+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:52.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:52.092+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:52.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:52.407+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:52.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:52.487+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:52.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:52.545+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:53.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:53.137+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:53.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:53:53.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:53:53.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:53.380+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:53.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:53.458+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:53.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:53.508+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:54.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:54.141+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:54.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:54.401+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:54.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:54.472+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:54.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:54.482+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:55.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:55.107+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:55.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:55.379+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:55.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:55.449+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:55.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:55.509+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:56.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:56.080+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:56.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:56.347+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:56.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:56.445+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:56.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:56.513+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:57.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:57.076+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:57.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:57.304+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:57.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:57.458+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:57.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:57.472+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:58.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:58.074+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:58.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:58.263+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:58.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:58.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:58.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:58.492+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:59.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:53:59.048+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:59.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:53:59.283+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:59.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:53:59.401+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:53:59.413 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:53:59.411+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:53:59.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:53:59.500+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:00.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:00.005+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:00.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:00.246+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:00.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:00.418+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:00.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:00.460+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:01.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:01.029+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:01.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:01.285+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:01.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:01.411+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:01.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:01.484+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:02.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:02.011+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:02.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:02.237+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:02.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:02.414+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:02.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:02.444+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:02.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:02.981+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:03.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:03.282+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:03.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:03.400+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:03.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:03.417+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:03.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:03.964+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:04.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:04.320+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:04.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:04.389+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:04.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:04.392+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:05.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:05.009+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:05.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:05.304+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:05.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:05.344+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:05.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:05.368+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:06.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:06.031+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:06.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:06.308+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:06.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:06.324+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:06.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:06.370+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:06.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:06.983+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:07.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:07.326+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:07.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:07.345+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:07.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:07.360+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:08.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:08.013+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:08.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:08.303+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:08.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:08.328+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:08.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:08.395+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:09.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:09.041+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:09.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:09.299+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:09.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:09.306+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:09.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:09.369+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:10.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:10.051+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:10.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:10.274+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:10.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:10.307+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:10.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:10.339+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:11.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:11.096+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:11.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:11.276+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:11.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:11.352+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:11.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:11.367+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:12.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:12.062+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:12.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:12.281+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:12.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:12.339+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:12.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:12.342+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:13.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:13.039+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:13.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:13.275+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:13.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:13.362+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:13.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:13.367+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:14.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:14.020+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:14.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:14.226+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:14.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:14.364+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:14.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:14.401+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:14.424 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:54:14.423+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:54:14.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:14.972+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:15.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:15.227+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:15.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:15.351+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:15.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:15.407+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:15.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:15.962+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:16.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:16.201+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:16.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:16.330+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:16.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:16.359+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:16.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:16.946+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:17.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:17.217+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:17.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:17.333+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:17.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:17.341+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:17.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:17.974+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:18.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:18.202+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:18.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:18.330+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:18.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:18.340+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:18.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:18.970+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:19.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:19.202+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:19.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:19.310+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:19.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:19.383+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:19.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:19.980+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:20.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:20.241+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:20.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:20.353+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:20.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:20.407+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:20.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:20.976+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:21.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:21.210+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:21.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:21.304+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:21.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:21.400+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:21.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:21.968+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:22.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:22.224+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:22.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:22.277+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:22.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:22.377+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:23.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:23.004+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:23.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:23.218+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:23.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:23.257+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:23.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:23.415+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:23.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:54:23.462 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:54:23.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:23.995+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:24.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:24.223+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:24.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:24.243+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:24.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:24.403+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:25.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:25.041+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:25.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:25.204+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:25.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:25.286+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:25.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:25.372+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:26.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:26.085+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:26.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:26.198+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:26.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:26.239+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:26.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:26.347+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:27.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:27.059+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:27.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:27.190+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:27.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:27.201+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:27.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:27.355+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:28.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:28.038+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:28.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:28.218+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:28.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:28.242+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:28.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:28.400+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:28.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:28.992+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:29.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:29.197+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:29.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:29.254+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:29.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:29.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:29.440 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:54:29.438+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:54:30.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:30.038+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:30.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:30.197+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:30.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:30.219+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:30.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:30.393+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:31.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:31.029+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:31.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:31.150+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:31.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:31.214+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:31.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:31.423+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:32.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:32.031+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:32.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:32.134+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:32.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:32.239+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:32.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:32.444+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:33.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:33.032+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:33.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:33.162+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:33.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:33.262+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:33.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:33.460+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:34.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:34.050+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:34.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:34.144+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:34.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:34.300+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:34.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:34.439+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:35.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:35.063+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:35.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:35.173+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:35.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:35.275+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:35.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:35.414+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:36.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:36.107+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:36.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:36.129+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:36.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:36.304+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:36.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:36.401+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:37.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:37.104+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:37.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:37.120+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:37.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:37.287+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:37.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:37.423+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:38.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:38.133+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:38.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:38.156+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:38.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:38.257+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:38.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:38.448+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:39.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:39.118+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:39.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:39.131+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:39.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:39.243+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:39.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:39.424+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:40.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:40.132+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:40.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:40.161+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:40.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:40.209+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:40.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:40.424+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:41.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:41.163+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:41.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:41.164+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:41.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:41.256+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:41.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:41.424+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:42.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:42.130+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:42.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:42.161+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:42.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:42.282+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:42.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:42.466+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:43.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:43.153+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:43.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:43.162+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:43.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:43.276+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:43.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:43.476+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:44.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:44.189+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:44.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:44.195+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:44.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:44.297+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:44.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:44.428+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:44.456 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:54:44.454+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:54:45.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:45.146+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:45.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:45.162+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:45.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:45.272+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:45.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:45.438+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:46.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:46.106+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:46.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:46.152+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:46.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:46.295+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:46.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:46.456+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:47.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:47.122+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:47.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:47.126+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:47.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:47.335+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:47.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:47.407+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:48.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:48.133+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:48.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:48.145+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:48.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:48.297+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:48.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:48.429+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:49.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:49.089+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:49.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:49.172+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:49.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:49.265+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:49.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:49.456+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:50.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:50.071+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:50.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:50.212+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:50.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:50.251+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:50.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:50.433+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:51.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:51.121+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:51.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:51.192+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:51.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:51.240+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:51.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:51.469+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:52.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:52.119+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:52.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:52.192+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:52.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:52.215+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:52.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:52.458+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:53.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:53.126+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:53.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:53.227+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:53.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:53.235+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:53.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:53.432+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:53.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:54:53.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:54:54.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:54.119+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:54.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:54.180+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:54.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:54.247+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:54.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:54.466+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:55.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:55.112+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:55.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:55.198+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:55.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:55.205+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:55.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:55.439+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:56.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:56.073+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:56.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:56.188+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:56.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:56.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:56.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:56.411+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:57.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:57.092+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:57.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:57.141+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:57.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:57.223+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:57.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:57.442+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:58.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:58.108+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:58.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:58.149+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:58.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:58.184+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:58.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:58.409+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:59.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:54:59.115+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:59.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:54:59.193+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:59.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:54:59.218+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:59.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:54:59.453+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:54:59.469 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:54:59.467+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:55:00.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:00.111+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:00.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:00.216+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:00.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:00.259+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:00.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:00.413+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:01.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:01.150+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:01.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:01.235+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:01.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:01.237+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:01.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:01.430+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:02.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:02.119+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:02.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:02.235+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:02.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:02.260+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:02.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:02.444+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:03.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:03.134+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:03.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:03.222+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:03.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:03.237+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:03.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:03.412+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:04.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:04.127+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:04.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:04.184+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:04.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:04.240+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:04.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:04.398+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:05.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:05.164+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:05.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:05.203+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:05.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:05.207+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:05.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:05.447+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:06.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:06.159+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:06.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:06.186+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:06.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:06.225+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:06.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:06.459+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:07.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:07.157+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:07.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:07.177+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:07.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:07.211+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:07.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:07.461+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:08.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:08.179+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:08.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:08.186+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:08.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:08.186+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:08.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:08.474+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:09.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:09.130+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:09.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:09.179+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:09.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:09.199+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:09.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:09.427+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:10.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:10.170+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:10.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:10.210+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:10.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:10.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:10.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:10.443+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:11.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:11.131+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:11.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:11.214+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:11.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:11.222+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:11.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:11.439+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:12.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:12.094+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:12.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:12.219+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:12.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:12.231+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:12.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:12.435+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:13.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:13.095+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:13.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:13.217+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:13.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:13.281+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:13.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:13.475+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:14.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:14.120+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:14.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:14.241+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:14.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:14.247+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:14.485 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:55:14.483+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:55:14.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:14.521+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:15.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:15.135+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:15.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:15.213+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:15.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:15.249+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:15.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:15.495+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:16.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:16.157+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:16.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:16.256+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:16.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:16.261+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:16.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:16.521+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:17.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:17.108+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:17.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:17.258+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:17.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:17.280+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:17.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:17.474+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:18.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:18.128+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:18.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:18.268+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:18.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:18.280+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:18.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:18.451+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:19.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:19.176+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:19.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:19.251+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:19.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:19.292+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:19.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:19.488+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:20.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:20.194+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:20.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:20.236+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:20.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:20.338+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:20.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:20.448+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:21.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:21.205+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:21.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:21.223+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:21.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:21.371+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:21.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:21.422+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:22.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:22.210+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:22.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:22.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:22.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:22.410+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:22.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:22.445+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:23.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:23.167+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:23.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:23.182+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:23.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:23.396+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:23.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:23.436+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:23.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:55:23.752 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:55:24.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:24.136+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:24.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:24.163+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:24.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:24.350+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:24.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:24.451+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:25.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:25.130+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:25.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:25.172+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:25.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:25.354+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:25.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:25.502+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:26.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:26.123+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:26.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:26.126+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:26.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:26.353+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:26.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:26.491+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:27.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:27.139+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:27.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:27.146+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:27.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:27.312+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:27.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:27.481+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:28.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:28.116+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:28.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:28.127+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:28.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:28.312+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:28.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:28.522+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:29.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:29.080+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:29.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:29.147+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:29.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:29.289+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:29.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:29.485+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:29.492 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:55:29.488+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:55:30.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:30.036+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:30.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:30.156+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:30.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:30.308+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:30.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:30.485+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:31.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:31.014+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:31.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:31.190+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:31.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:31.267+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:31.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:31.482+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:32.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:32.037+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:32.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:32.188+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:32.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:32.242+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:32.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:32.532+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:33.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:33.047+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:33.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:33.206+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:33.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:33.248+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:33.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:33.522+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:34.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:34.014+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:34.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:34.174+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:34.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:34.200+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:34.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:34.539+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:35.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:35.020+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:35.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:35.187+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:35.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:35.245+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:35.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:35.580+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:36.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:36.035+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:36.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:36.206+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:36.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:36.225+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:36.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:36.549+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:37.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:37.084+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:37.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:37.178+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:37.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:37.217+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:37.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:37.582+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:38.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:38.098+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:38.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:38.190+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:38.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:38.213+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:38.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:38.545+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:39.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:39.072+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:39.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:39.188+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:39.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:39.215+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:39.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:39.524+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:40.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:40.050+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:40.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:40.154+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:40.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:40.241+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:40.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:40.485+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:41.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:41.043+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:41.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:41.193+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:41.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:41.235+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:41.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:41.445+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:42.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:42.092+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:42.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:42.167+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:42.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:42.226+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:42.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:42.404+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:43.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:43.106+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:43.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:43.141+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:43.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:43.185+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:43.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:43.451+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:44.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:44.106+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:44.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:44.123+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:44.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:44.176+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:44.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:44.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:44.506 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:55:44.502+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:55:45.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:45.089+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:45.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:45.170+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:45.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:45.201+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:45.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:45.430+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:46.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:46.073+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:46.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:46.146+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:46.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:46.218+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:46.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:46.414+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:47.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:47.049+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:47.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:47.161+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:47.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:47.261+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:47.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:47.383+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:48.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:48.062+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:48.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:48.132+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:48.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:48.305+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:48.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:48.408+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:49.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:49.059+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:49.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:49.083+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:49.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:49.301+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:49.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:49.412+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:50.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:50.091+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:50.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:50.091+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:50.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:50.301+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:50.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:50.409+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:51.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:51.067+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:51.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:51.097+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:51.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:51.294+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:51.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:51.374+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:52.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:52.023+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:52.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:52.072+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:52.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:52.257+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:52.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:52.379+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:53.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:53.071+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:53.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:53.073+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:53.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:53.266+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:53.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:53.392+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:53.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:55:53.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:55:54.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:54.065+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:54.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:54.083+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:54.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:54.250+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:54.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:54.438+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:55.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:55.036+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:55.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:55.073+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:55.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:55.213+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:55.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:55.450+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:56.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:56.039+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:56.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:56.088+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:56.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:56.253+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:56.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:56.419+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:57.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:57.071+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:57.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:57.121+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:57.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:57.226+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:57.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:57.444+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:58.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:58.079+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:58.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:58.109+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:58.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:58.185+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:58.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:58.400+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:59.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:55:59.083+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:59.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:55:59.136+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:59.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:55:59.147+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:59.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:55:59.362+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:55:59.521 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:55:59.518+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:56:00.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:00.102+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:00.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:00.117+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:00.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:00.131+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:00.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:00.359+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:01.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:01.078+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:01.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:01.133+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:01.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:01.137+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:01.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:01.407+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:02.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:02.052+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:02.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:02.159+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:02.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:02.162+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:02.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:02.423+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:03.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:03.015+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:03.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:03.121+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:03.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:03.190+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:03.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:03.377+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:03.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:03.984+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:04.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:04.144+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:04.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:04.186+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:04.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:04.393+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:04.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:04.969+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:05.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:05.102+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:05.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:05.218+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:05.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:05.406+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:05.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:05.939+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:06.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:06.106+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:06.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:06.243+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:06.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:06.388+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:06.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:06.909+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:07.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:07.111+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:07.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:07.213+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:07.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:07.347+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:07.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:07.890+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:08.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:08.109+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:08.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:08.219+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:08.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:08.360+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:08.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:08.878+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:09.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:09.105+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:09.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:09.189+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:09.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:09.338+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:09.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:09.868+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:10.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:10.085+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:10.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:10.224+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:10.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:10.378+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:10.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:10.904+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:11.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:11.089+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:11.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:11.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:11.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:11.376+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:11.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:11.938+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:12.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:12.105+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:12.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:12.274+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:12.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:12.410+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:12.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:12.901+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:13.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:13.080+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:13.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:13.278+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:13.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:13.438+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:13.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:13.947+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:14.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:14.035+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:14.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:14.322+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:14.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:14.434+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:14.533 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:56:14.530+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:56:14.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:14.939+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:15.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:15.081+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:15.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:15.356+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:15.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:15.433+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:15.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:15.948+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:16.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:16.112+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:16.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:16.362+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:16.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:16.426+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:16.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:16.924+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:17.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:17.073+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:17.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:17.412+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:17.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:17.422+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:17.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:17.887+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:18.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:18.082+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:18.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:18.374+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:18.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:18.377+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:18.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:18.920+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:19.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:19.086+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:19.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:19.359+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:19.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:19.407+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:19.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:19.907+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:20.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:20.058+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:20.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:20.333+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:20.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:20.373+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:20.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:20.939+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:21.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:21.060+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:21.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:21.287+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:21.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:21.412+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:21.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:21.917+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:22.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:22.046+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:22.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:22.289+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:22.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:22.460+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:22.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:22.908+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:23.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:23.081+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:23.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:23.268+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:23.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:23.415+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:23.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:23.933+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:24.012 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:56:24.015 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:56:24.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:24.123+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:24.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:24.266+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:24.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:24.460+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:24.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:24.901+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:25.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:25.151+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:25.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:25.305+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:25.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:25.501+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:25.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:25.901+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:26.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:26.190+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:26.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:26.268+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:26.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:26.543+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:26.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:26.950+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:27.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:27.185+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:27.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:27.275+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:27.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:27.541+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:27.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:27.941+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:28.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:28.202+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:28.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:28.311+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:28.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:28.533+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:28.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:28.901+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:29.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:29.247+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:29.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:29.341+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:29.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:29.543+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:29.548 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:56:29.546+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:56:29.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:29.937+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:30.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:30.251+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:30.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:30.352+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:30.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:30.517+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:30.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:30.964+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:31.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:31.268+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:31.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:31.351+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:31.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:31.511+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:31.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:31.960+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:32.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:32.246+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:32.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:32.350+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:32.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:32.529+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:32.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:32.993+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:33.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:33.267+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:33.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:33.384+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:33.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:33.497+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:33.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:33.958+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:34.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:34.301+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:34.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:34.432+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:34.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:34.523+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:34.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:34.984+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:35.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:35.338+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:35.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:35.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:35.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:35.520+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:35.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:35.944+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:36.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:36.360+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:36.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:36.424+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:36.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:36.479+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:36.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:36.983+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:37.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:37.346+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:37.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:37.441+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:37.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:37.500+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:37.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:37.980+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:38.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:38.369+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:38.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:38.484+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:38.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:38.498+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:39.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:39.017+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:39.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:39.330+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:39.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:39.469+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:39.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:39.480+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:39.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:39.994+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:40.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:40.345+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:40.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:40.478+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:40.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:40.482+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:40.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:40.952+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:41.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:41.382+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:41.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:41.433+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:41.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:41.478+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:41.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:41.964+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:42.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:42.340+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:42.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:42.400+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:42.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:42.517+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:43.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:43.002+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:43.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:43.305+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:43.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:43.363+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:43.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:43.538+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:43.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:43.996+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:44.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:44.322+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:44.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:44.345+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:44.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:44.528+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:44.564 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:56:44.562+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:56:45.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:44.998+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:45.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:45.301+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:45.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:45.391+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:45.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:45.566+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:46.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:46.008+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:46.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:46.278+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:46.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:46.434+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:46.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:46.583+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:47.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:47.041+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:47.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:47.291+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:47.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:47.398+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:47.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:47.570+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:48.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:48.038+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:48.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:48.291+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:48.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:48.374+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:48.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:48.538+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:49.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:49.012+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:49.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:49.284+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:49.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:49.345+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:49.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:49.517+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:50.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:50.045+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:50.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:50.273+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:50.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:50.334+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:50.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:50.497+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:51.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:51.074+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:51.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:51.259+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:51.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:51.379+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:51.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:51.454+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:52.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:52.077+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:52.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:52.250+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:52.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:52.404+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:52.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:52.439+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:53.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:53.069+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:53.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:53.298+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:53.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:53.393+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:53.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:53.447+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:54.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:54.051+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:54.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:56:54.144 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:56:54.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:54.339+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:54.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:54.383+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:54.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:54.482+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:55.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:55.035+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:55.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:55.301+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:55.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:55.402+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:55.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:55.441+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:56.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:56.057+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:56.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:56.345+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:56.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:56.449+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:56.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:56.475+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:57.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:57.075+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:57.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:57.308+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:57.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:57.402+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:57.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:57.516+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:58.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:58.104+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:58.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:58.266+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:58.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:58.408+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:58.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:58.512+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:59.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:56:59.135+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:59.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:56:59.264+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:59.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:56:59.413+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:59.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:56:59.517+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:56:59.580 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:56:59.578+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:57:00.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:00.136+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:00.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:00.225+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:00.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:00.450+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:00.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:00.540+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:01.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:01.166+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:01.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:01.269+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:01.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:01.422+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:01.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:01.526+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:02.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:02.145+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:02.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:02.245+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:02.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:02.382+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:02.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:02.497+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:03.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:03.170+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:03.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:03.224+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:03.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:03.375+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:03.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:03.490+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:04.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:04.189+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:04.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:04.202+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:04.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:04.370+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:04.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:04.529+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:05.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:05.202+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:05.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:05.204+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:05.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:05.365+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:05.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:05.531+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:06.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:06.192+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:06.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:06.195+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:06.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:06.367+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:06.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:06.503+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:07.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:07.153+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:07.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:07.232+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:07.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:07.335+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:07.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:07.510+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:08.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:08.195+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:08.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:08.206+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:08.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:08.299+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:08.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:08.474+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:09.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:09.183+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:09.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:09.227+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:09.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:09.273+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:09.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:09.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:10.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:10.152+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:10.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:10.219+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:10.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:10.228+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:10.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:10.426+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:11.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:11.129+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:11.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:11.197+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:11.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:11.227+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:11.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:11.470+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:12.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:12.137+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:12.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:12.205+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:12.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:12.208+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:12.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:12.514+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:13.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:13.100+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:13.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:13.161+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:13.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:13.252+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:13.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:13.488+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:14.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:14.121+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:14.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:14.179+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:14.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:14.266+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:14.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:14.497+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:14.596 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:57:14.594+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:57:15.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:15.122+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:15.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:15.178+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:15.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:15.247+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:15.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:15.512+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:16.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:16.073+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:16.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:16.204+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:16.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:16.226+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:16.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:16.553+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:17.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:17.089+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:17.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:17.233+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:17.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:17.237+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:17.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:17.572+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:18.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:18.123+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:18.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:18.206+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:18.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:18.250+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:18.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:18.594+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:19.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:19.151+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:19.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:19.214+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:19.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:19.221+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:19.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:19.640+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:20.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:20.164+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:20.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:20.207+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:20.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:20.267+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:20.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:20.622+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:21.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:21.190+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:21.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:21.241+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:21.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:21.290+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:21.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:21.633+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:22.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:22.151+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:22.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:22.252+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:22.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:22.326+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:22.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:22.648+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:23.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:23.135+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:23.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:23.204+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:23.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:23.332+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:23.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:23.615+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:24.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:24.105+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:24.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:24.237+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:24.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:57:24.280 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:57:24.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:24.289+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:24.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:24.631+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:25.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:25.145+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:25.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:25.259+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:25.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:25.284+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:25.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:25.659+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:26.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:26.166+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:26.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:26.241+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:26.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:26.256+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:26.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:26.703+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:27.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:27.209+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:27.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:27.255+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:27.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:27.255+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:27.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:27.658+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:28.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:28.220+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:28.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:28.224+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:28.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:28.275+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:28.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:28.609+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:29.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:29.210+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:29.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:29.228+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:29.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:29.303+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:29.612 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:57:29.609+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:57:29.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:29.634+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:30.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:30.231+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:30.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:30.275+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:30.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:30.329+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:30.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:30.639+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:31.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:31.241+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:31.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:31.264+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:31.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:31.323+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:31.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:31.594+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:32.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:32.219+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:32.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:32.273+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:32.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:32.290+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:32.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:32.589+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:33.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:33.194+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:33.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:33.261+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:33.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:33.340+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:33.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:33.543+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:34.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:34.209+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:34.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:34.279+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:34.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:34.293+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:34.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:34.550+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:35.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:35.171+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:35.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:35.269+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:35.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:35.265+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:35.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:35.578+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:36.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:36.156+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:36.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:36.259+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:36.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:36.279+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:36.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:36.594+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:37.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:37.163+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:37.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:37.222+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:37.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:37.293+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:37.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:37.570+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:38.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:38.174+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:38.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:38.207+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:38.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:38.307+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:38.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:38.582+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:39.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:39.180+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:39.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:39.248+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:39.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:39.292+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:39.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:39.542+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:40.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:40.223+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:40.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:40.224+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:40.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:40.249+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:40.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:40.513+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:41.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:41.236+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:41.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:41.242+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:41.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:41.249+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:41.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:41.472+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:42.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:42.215+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:42.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:42.237+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:42.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:42.246+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:42.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:42.430+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:43.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:43.218+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:43.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:43.270+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:43.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:43.288+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:43.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:43.462+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:44.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:44.181+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:44.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:44.301+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:44.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:44.310+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:44.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:44.466+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:44.618 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:57:44.616+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:57:45.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:45.176+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:45.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:45.285+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:45.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:45.304+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:45.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:45.423+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:46.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:46.131+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:46.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:46.241+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:46.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:46.344+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:46.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:46.429+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:47.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:47.145+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:47.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:47.286+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:47.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:47.376+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:47.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:47.446+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:48.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:48.125+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:48.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:48.330+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:48.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:48.387+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:48.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:48.453+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:49.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:49.084+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:49.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:49.339+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:49.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:49.356+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:49.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:49.441+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:50.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:50.104+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:50.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:50.291+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:50.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:50.343+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:50.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:50.431+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:51.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:51.145+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:51.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:51.289+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:51.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:51.376+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:51.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:51.437+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:52.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:52.101+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:52.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:52.301+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:52.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:52.405+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:52.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:52.478+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:53.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:53.081+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:53.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:53.278+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:53.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:53.394+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:53.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:53.521+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:54.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:54.079+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:54.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:54.249+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:54.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:57:54.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:57:54.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:54.419+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:54.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:54.532+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:55.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:55.067+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:55.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:55.251+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:55.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:55.441+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:55.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:55.564+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:56.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:56.039+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:56.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:56.248+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:56.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:56.488+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:56.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:56.596+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:57.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:57.017+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:57.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:57.285+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:57.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:57.488+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:57.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:57.582+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:58.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:58.059+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:58.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:58.259+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:58.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:58.487+0000 7f72c425d700 -1 osd.5 112 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:58.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:58.563+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:59.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:57:59.070+0000 7f6e44c9f700 -1 osd.7 112 get_health_metrics reporting 49 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:59.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:57:59.284+0000 7f389e18e700 -1 osd.4 112 get_health_metrics reporting 63 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:59.439 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T01:57:59.438+0000 7f50dd5c8700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:57:59.454 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T01:57:59.438+0000 7f50dd5c8700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T01:57:59.476 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T01:57:59.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:57:59.535+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:59.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:57:59.602+0000 7f596d92c700 -1 osd.6 112 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:57:59.618 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:57:59.616+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:58:00.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:00.056+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:00.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:00.266+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:00.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:00.512+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:00.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:00.639+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:01.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:01.051+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:01.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:01.259+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:01.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:01.483+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:01.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:01.617+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:02.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:02.086+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:02.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:02.288+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:02.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:02.461+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:02.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:02.614+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:03.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:03.056+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:03.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:03.320+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:03.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:03.457+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:03.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:03.593+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:04.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:04.015+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:04.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:04.334+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:04.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:04.449+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:04.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:04.641+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:04.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:04.996+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:05.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:05.298+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:05.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:05.461+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:05.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:05.619+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:05.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:05.973+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:06.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:06.342+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:06.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:06.450+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:06.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:06.666+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:07.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:07.011+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:07.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:07.354+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:07.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:07.420+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:07.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:07.709+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:07.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:07.984+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:08.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:08.330+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:08.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:08.406+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:08.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:08.685+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:08.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:08.957+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:09.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:09.295+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:09.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:09.397+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:09.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:09.655+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:09.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:09.959+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:10.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:10.279+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:10.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:10.400+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:10.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:10.701+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:10.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:10.945+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:11.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:11.249+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:11.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:11.391+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:11.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:11.734+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:11.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:11.907+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:12.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:12.239+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:12.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:12.432+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:12.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:12.734+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:12.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:12.937+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:13.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:13.239+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:13.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:13.383+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:13.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:13.728+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:13.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:13.953+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:14.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:14.205+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:14.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:14.407+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:14.625 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:58:14.623+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:58:14.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:14.762+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:14.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:14.914+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:15.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:15.168+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:15.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:15.445+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:15.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:15.772+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:15.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:15.954+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:16.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:16.152+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:16.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:16.467+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:16.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:16.765+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:16.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:16.906+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:17.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:17.162+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:17.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:17.449+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:17.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:17.716+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:17.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:17.928+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:18.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:18.185+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:18.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:18.482+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:18.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:18.667+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:18.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:18.939+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:19.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:19.143+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:19.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:19.477+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:19.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:19.626+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:19.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:19.980+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:20.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:20.119+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:20.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:20.506+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:20.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:20.622+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:21.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:21.023+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:21.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:21.132+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:21.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:21.457+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:21.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:21.639+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:21.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:21.986+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:22.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:22.155+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:22.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:22.462+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:22.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:22.598+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:22.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:22.969+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:23.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:23.105+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:23.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:23.499+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:23.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:23.606+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:23.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:23.971+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:24.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:24.121+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:24.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:58:24.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:58:24.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:24.521+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:24.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:24.593+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:24.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:24.950+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:25.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:25.134+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:25.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:25.518+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:25.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:25.614+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:25.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:25.916+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:26.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:26.158+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:26.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:26.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:26.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:26.585+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:26.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:26.896+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:27.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:27.207+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:27.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:27.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:27.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:27.589+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:27.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:27.888+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:28.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:28.232+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:28.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:28.489+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:28.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:28.564+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:28.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:28.921+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:29.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:29.192+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:29.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:29.503+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:29.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:29.577+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:29.641 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:58:29.640+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:58:29.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:29.882+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:30.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:30.234+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:30.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:30.530+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:30.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:30.534+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:30.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:30.894+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:31.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:31.256+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:31.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:31.525+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:31.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:31.542+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:31.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:31.864+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:32.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:32.226+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:32.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:32.488+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:32.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:32.494+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:32.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:32.874+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:33.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:33.181+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:33.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:33.448+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:33.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:33.531+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:33.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:33.883+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:34.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:34.164+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:34.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:34.462+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:34.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:34.550+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:34.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:34.902+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:35.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:35.193+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:35.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:35.423+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:35.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:35.598+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:35.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:35.908+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:36.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:36.185+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:36.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:36.449+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:36.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:36.560+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:36.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:36.900+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:37.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:37.163+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:37.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:37.479+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:37.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:37.551+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:37.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:37.938+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:38.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:38.183+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:38.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:38.506+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:38.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:38.525+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:38.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:38.896+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:39.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:39.163+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:39.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:39.537+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:39.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:39.555+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:39.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:39.904+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:40.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:40.145+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:40.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:40.497+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:40.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:40.538+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:40.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:40.915+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:41.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:41.146+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:41.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:41.530+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:41.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:41.547+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:41.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:41.902+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:42.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:42.115+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:42.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:42.501+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:42.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:42.549+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:42.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:42.861+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:43.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:43.093+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:43.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:43.479+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:43.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:43.546+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:43.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:43.883+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:44.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:44.126+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:44.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:44.495+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:44.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:44.566+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:44.646 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:58:44.643+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:58:44.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:44.836+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:45.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:45.112+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:45.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:45.451+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:45.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:45.520+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:45.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:45.855+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:46.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:46.080+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:46.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:46.412+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:46.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:46.509+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:46.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:46.821+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:47.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:47.053+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:47.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:47.424+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:47.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:47.495+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:47.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:47.801+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:48.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:48.103+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:48.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:48.399+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:48.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:48.468+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:48.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:48.776+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:49.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:49.098+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:49.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:49.378+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:49.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:49.433+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:49.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:49.781+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:50.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:50.112+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:50.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:50.340+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:50.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:50.393+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:50.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:50.803+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:51.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:51.080+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:51.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:51.384+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:51.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:51.390+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:51.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:51.777+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:52.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:52.072+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:52.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:52.381+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:52.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:52.382+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:52.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:52.792+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:53.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:53.066+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:53.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:53.390+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:53.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:53.393+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:53.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:53.826+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:54.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:54.089+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:54.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:54.387+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:54.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:54.437+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:54.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:58:54.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:58:54.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:54.795+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:55.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:55.058+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:55.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:55.384+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:55.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:55.421+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:55.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:55.766+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:56.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:56.041+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:56.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:56.366+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:56.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:56.396+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:56.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:56.782+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:57.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:57.075+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:57.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:57.381+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:57.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:57.433+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:57.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:57.750+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:58.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:58.100+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:58.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:58.378+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:58.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:58.482+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:58.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:58.714+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:59.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:58:59.065+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:59.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:58:59.379+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:59.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:58:59.498+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:58:59.651 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:58:59.649+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:58:59.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:58:59.751+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:00.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:00.043+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:00.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:00.391+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:00.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:00.547+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:00.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:00.780+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:01.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:01.044+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:01.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:01.362+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:01.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:01.534+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:01.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:01.803+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:02.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:02.016+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:02.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:02.361+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:02.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:02.501+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:02.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:02.793+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:02.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:02.977+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:03.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:03.343+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:03.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:03.501+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:03.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:03.783+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:03.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:03.949+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:04.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:04.337+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:04.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:04.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:04.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:04.763+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:04.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:04.950+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:05.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:05.346+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:05.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:05.466+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:05.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:05.765+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:05.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:05.961+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:06.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:06.323+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:06.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:06.462+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:06.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:06.794+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:06.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:06.923+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:07.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:07.359+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:07.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:07.464+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:07.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:07.774+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:07.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:07.933+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:08.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:08.373+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:08.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:08.467+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:08.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:08.818+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:08.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:08.950+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:09.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:09.353+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:09.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:09.440+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:09.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:09.868+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:09.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:09.921+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:10.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:10.346+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:10.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:10.431+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:10.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:10.851+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:10.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:10.939+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:11.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:11.302+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:11.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:11.462+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:11.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:11.878+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:11.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:11.986+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:12.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:12.323+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:12.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:12.492+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:12.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:12.881+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:12.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:12.986+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:13.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:13.289+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:13.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:13.497+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:13.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:13.897+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:13.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:13.970+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:14.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:14.283+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:14.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:14.511+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:14.668 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:59:14.665+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:59:14.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:14.895+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:14.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:14.992+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:15.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:15.294+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:15.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:15.462+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:15.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:15.851+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:15.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:15.995+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:16.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:16.320+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:16.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:16.487+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:16.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:16.834+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:17.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:17.043+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:17.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:17.341+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:17.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:17.517+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:17.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:17.797+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:18.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:18.094+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:18.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:18.376+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:18.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:18.539+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:18.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:18.818+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:19.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:19.105+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:19.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:19.371+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:19.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:19.514+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:19.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:19.794+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:20.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:20.127+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:20.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:20.400+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:20.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:20.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:20.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:20.816+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:21.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:21.150+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:21.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:21.369+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:21.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:21.444+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:21.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:21.795+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:22.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:22.200+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:22.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:22.406+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:22.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:22.456+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:22.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:22.767+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:23.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:23.199+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:23.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:23.454+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:23.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:23.455+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:23.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:23.720+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:24.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:24.178+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:24.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:24.421+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:24.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:24.471+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:24.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:59:24.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:59:24.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:24.722+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:25.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:25.216+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:25.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:25.406+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:25.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:25.431+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:25.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:25.712+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:26.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:26.208+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:26.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:26.358+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:26.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:26.467+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:26.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:26.699+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:27.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:27.251+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:27.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:27.400+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:27.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:27.434+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:27.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:27.747+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:28.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:28.201+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:28.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:28.358+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:28.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:28.410+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:28.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:28.760+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:29.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:29.239+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:29.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:29.343+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:29.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:29.413+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:29.683 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:59:29.681+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:59:29.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:29.789+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:30.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:30.276+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:30.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:30.372+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:30.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:30.385+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:30.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:30.801+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:31.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:31.284+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:31.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:31.358+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:31.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:31.361+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:31.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:31.812+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:32.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:32.304+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:32.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:32.333+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:32.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:32.346+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:32.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:32.792+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:33.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:33.262+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:33.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:33.287+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:33.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:33.345+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:33.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:33.754+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:34.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:34.257+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:34.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:34.272+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:34.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:34.392+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:34.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:34.785+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:35.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:35.228+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:35.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:35.294+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:35.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:35.416+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:35.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:35.755+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:36.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:36.256+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:36.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:36.279+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:36.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:36.461+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:36.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:36.786+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:37.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:37.239+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:37.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:37.296+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:37.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:37.471+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:37.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:37.815+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:38.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:38.195+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:38.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:38.303+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:38.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:38.459+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:38.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:38.847+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:39.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:39.165+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:39.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:39.347+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:39.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:39.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:39.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:39.867+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:40.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:40.204+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:40.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:40.299+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:40.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:40.446+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:40.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:40.892+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:41.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:41.176+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:41.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:41.257+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:41.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:41.416+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:41.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:41.908+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:42.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:42.164+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:42.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:42.307+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:42.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:42.392+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:42.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:42.914+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:43.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:43.172+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:43.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:43.306+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:43.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:43.396+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:43.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:43.931+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:44.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:44.131+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:44.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:44.320+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:44.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:44.428+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:44.699 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:59:44.698+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:59:44.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:44.969+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:45.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:45.133+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:45.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:45.329+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:45.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:45.424+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:46.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:46.018+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:46.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:46.166+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:46.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:46.346+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:46.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:46.456+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:47.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:47.021+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:47.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:47.179+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:47.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:47.360+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:47.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:47.499+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:48.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:48.063+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:48.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:48.166+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:48.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:48.364+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:48.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:48.528+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:49.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:49.025+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:49.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:49.139+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:49.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:49.376+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:49.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:49.503+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:50.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:50.044+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:50.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:50.149+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:50.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:50.373+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:50.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:50.454+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:51.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:51.081+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:51.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:51.180+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:51.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:51.347+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:51.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:51.442+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:52.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:52.100+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:52.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:52.140+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:52.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:52.300+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:52.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:52.471+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:53.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:53.064+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:53.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:53.145+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:53.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:53.251+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:53.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:53.449+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:54.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:54.083+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:54.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:54.127+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:54.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:54.234+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:54.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:54.459+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:54.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:59:54.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T01:59:55.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:55.043+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:55.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:55.104+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:55.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:55.248+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:55.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:55.458+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:56.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:56.012+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:56.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:56.094+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:56.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:56.298+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:56.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:56.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:56.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:56.992+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:57.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:57.109+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:57.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:57.333+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:57.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:57.449+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:57.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:57.947+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:58.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:58.114+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:58.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:58.323+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:58.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:58.413+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:58.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:58.943+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:59.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T01:59:59.148+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:59.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T01:59:59.303+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:59.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T01:59:59.436+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T01:59:59.706 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T01:59:59.704+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T01:59:59.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T01:59:59.952+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:00.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:00.182+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:00.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:00.324+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:00.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:00.403+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:00.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:00.983+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:01.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:01.202+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:01.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:01.297+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:01.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:01.381+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:01.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:01.972+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:02.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:02.222+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:02.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:02.303+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:02.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:02.332+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:03.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:03.016+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:03.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:03.214+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:03.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:03.259+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:03.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:03.290+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:04.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:04.006+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:04.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:04.229+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:04.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:04.238+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:04.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:04.324+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:05.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:05.028+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:05.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:05.208+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:05.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:05.260+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:05.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:05.335+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:06.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:06.067+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:06.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:06.182+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:06.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:06.301+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:06.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:06.322+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:07.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:07.044+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:07.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:07.158+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:07.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:07.311+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:07.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:07.354+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:08.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:08.007+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:08.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:08.180+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:08.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:08.317+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:08.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:08.350+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:08.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:08.967+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:09.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:09.190+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:09.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:09.306+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:09.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:09.311+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:09.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:09.938+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:10.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:10.152+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:10.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:10.344+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:10.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:10.345+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:10.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:10.898+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:11.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:11.166+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:11.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:11.296+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:11.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:11.325+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:11.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:11.853+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:12.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:12.204+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:12.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:12.285+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:12.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:12.325+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:12.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:12.896+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:13.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:13.217+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:13.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:13.242+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:13.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:13.345+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:13.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:13.929+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:14.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:14.179+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:14.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:14.216+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:14.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:14.302+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:14.712 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:00:14.710+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:00:14.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:14.894+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:15.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:15.170+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:15.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:15.266+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:15.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:15.334+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:15.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:15.935+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:16.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:16.211+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:16.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:16.298+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:16.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:16.358+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:16.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:16.976+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:17.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:17.244+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:17.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:17.328+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:17.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:17.328+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:17.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:17.955+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:18.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:18.197+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:18.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:18.338+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:18.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:18.352+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:18.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:18.973+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:19.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:19.172+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:19.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:19.302+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:19.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:19.348+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:19.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:19.990+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:20.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:20.149+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:20.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:20.281+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:20.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:20.384+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:20.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:20.987+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:21.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:21.144+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:21.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:21.268+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:21.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:21.381+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:21.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:21.993+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:22.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:22.179+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:22.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:22.245+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:22.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:22.351+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:22.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:22.985+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:23.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:23.178+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:23.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:23.219+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:23.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:23.308+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:24.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:24.016+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:24.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:24.214+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:24.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:24.216+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:24.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:24.310+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:24.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:00:24.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:00:24.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:24.978+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:25.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:25.183+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:25.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:25.185+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:25.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:25.323+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:25.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:25.945+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:26.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:26.178+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:26.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:26.215+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:26.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:26.331+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:26.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:26.980+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:27.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:27.146+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:27.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:27.230+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:27.372 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:27.370+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:28.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:28.029+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:28.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:28.106+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:28.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:28.219+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:28.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:28.354+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:29.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:29.061+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:29.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:29.150+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:29.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:29.183+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:29.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:29.351+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:29.723 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:00:29.721+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:00:30.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:30.015+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:30.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:30.126+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:30.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:30.204+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:30.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:30.362+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:30.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:30.982+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:31.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:31.156+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:31.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:31.192+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:31.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:31.345+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:31.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:31.959+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:32.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:32.149+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:32.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:32.216+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:32.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:32.335+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:33.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:33.005+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:33.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:33.145+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:33.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:33.231+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:33.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:33.352+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:34.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:34.047+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:34.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:34.147+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:34.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:34.258+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:34.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:34.307+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:35.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:35.079+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:35.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:35.146+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:35.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:35.244+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:35.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:35.280+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:36.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:36.093+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:36.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:36.158+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:36.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:36.206+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:36.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:36.330+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:37.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:37.092+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:37.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:37.111+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:37.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:37.210+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:37.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:37.358+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:38.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:38.130+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:38.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:38.158+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:38.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:38.173+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:38.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:38.381+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:39.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:39.159+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:39.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:39.163+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:39.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:39.207+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:39.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:39.420+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:40.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:40.118+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:40.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:40.195+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:40.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:40.239+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:40.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:40.375+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:41.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:41.082+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:41.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:41.193+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:41.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:41.268+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:41.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:41.404+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:42.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:42.096+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:42.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:42.168+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:42.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:42.274+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:42.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:42.400+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:43.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:43.061+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:43.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:43.177+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:43.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:43.259+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:43.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:43.439+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:44.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:44.107+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:44.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:44.212+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:44.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:44.263+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:44.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:44.434+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:44.739 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:00:44.737+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:00:45.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:45.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:45.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:45.189+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:45.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:45.254+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:45.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:45.431+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:46.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:46.146+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:46.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:46.146+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:46.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:46.240+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:46.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:46.416+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:47.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:47.097+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:47.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:47.184+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:47.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:47.216+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:47.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:47.417+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:48.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:48.122+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:48.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:48.175+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:48.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:48.216+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:48.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:48.408+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:49.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:49.097+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:49.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:49.200+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:49.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:49.265+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:49.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:49.364+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:50.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:50.142+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:50.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:50.171+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:50.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:50.307+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:50.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:50.400+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:51.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:51.137+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:51.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:51.139+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:51.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:51.283+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:51.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:51.410+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:52.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:52.097+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:52.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:52.167+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:52.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:52.273+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:52.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:52.402+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:53.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:53.067+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:53.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:53.137+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:53.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:53.285+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:53.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:53.373+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:54.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:54.073+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:54.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:54.116+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:54.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:54.280+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:54.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:54.371+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:55.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:00:55.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:00:55.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:55.072+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:55.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:55.089+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:55.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:55.300+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:55.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:55.337+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:56.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:56.033+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:56.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:56.090+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:56.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:56.308+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:56.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:56.336+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:57.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:57.042+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:57.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:57.047+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:57.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:57.305+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:57.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:57.336+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:58.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:58.010+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:58.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:58.012+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:58.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:58.278+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:58.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:58.351+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:58.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:00:58.969+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:59.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:59.012+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:59.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:00:59.262+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 39 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:59.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:00:59.319+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:00:59.755 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:00:59.753+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:00:59.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:00:59.992+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:00.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:00.012+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:00.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:00.287+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:00.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:00.302+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:00.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:00.988+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:01.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:01.036+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:01.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:01.294+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:01.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:01.318+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:01.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:01.968+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:02.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:02.005+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:02.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:02.254+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:02.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:02.292+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:02.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:02.991+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:03.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:03.015+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:03.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:03.244+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:03.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:03.295+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:03.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:03.967+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:04.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:04.019+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:04.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:04.252+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:04.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:04.280+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:04.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:04.924+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:04.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:04.970+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:05.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:05.265+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:05.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:05.288+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:05.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:05.957+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:05.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:05.958+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:06.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:06.251+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:06.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:06.279+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:06.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:06.925+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:06.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:06.926+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:07.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:07.223+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:07.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:07.279+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:07.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:07.933+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:07.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:07.958+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:08.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:08.196+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:08.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:08.271+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:08.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:08.951+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:08.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:08.980+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:09.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:09.229+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:09.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:09.253+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:09.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:09.922+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:09.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:09.961+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:10.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:10.199+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:10.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:10.243+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:10.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:10.948+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:10.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:10.962+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:11.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:11.208+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:11.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:11.243+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:11.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:11.901+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:11.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:11.985+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:12.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:12.221+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:12.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:12.238+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:12.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:12.885+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:12.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:12.981+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:13.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:13.245+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:13.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:13.278+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:13.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:13.917+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:13.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:13.955+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:14.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:14.232+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:14.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:14.236+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:14.761 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:01:14.758+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:01:14.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:14.924+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:14.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:14.964+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:15.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:15.207+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:15.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:15.268+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:15.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:15.888+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:15.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:15.970+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:16.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:16.255+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:16.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:16.271+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:16.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:16.839+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:16.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:16.936+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:17.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:17.259+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:17.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:17.298+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:17.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:17.855+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:17.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:17.900+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:18.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:18.248+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:18.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:18.313+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:18.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:18.884+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:18.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:18.917+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:19.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:19.271+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:19.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:19.337+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:19.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:19.919+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:19.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:19.956+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:20.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:20.257+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:20.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:20.309+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:20.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:20.904+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:20.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:20.934+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:21.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:21.245+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:21.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:21.333+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:21.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:21.864+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:21.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:21.979+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:22.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:22.290+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:22.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:22.360+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:22.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:22.908+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:22.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:22.971+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:23.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:23.258+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:23.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:23.315+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:23.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:23.911+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:23.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:23.929+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:24.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:24.293+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:24.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:24.299+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:24.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:24.910+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:24.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:24.926+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:25.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:01:25.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:01:25.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:25.245+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:25.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:25.348+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:25.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:25.922+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:25.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:25.938+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:26.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:26.198+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:26.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:26.338+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:26.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:26.898+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:26.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:26.975+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:27.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:27.170+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:27.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:27.362+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:27.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:27.850+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:27.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:27.994+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:28.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:28.187+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:28.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:28.402+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:28.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:28.835+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:28.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:28.972+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:29.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:29.154+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:29.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:29.399+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:29.777 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:01:29.775+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:01:29.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:29.786+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:30.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:30.007+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:30.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:30.171+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:30.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:30.378+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:30.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:30.776+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:30.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:30.960+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:31.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:31.171+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:31.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:31.425+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:31.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:31.751+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:31.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:31.946+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:32.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:32.199+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:32.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:32.388+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:32.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:32.774+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:32.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:32.979+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:33.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:33.225+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:33.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:33.392+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:33.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:33.732+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:34.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:34.012+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:34.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:34.185+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:34.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:34.417+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:34.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:34.694+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:35.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:35.015+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:35.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:35.222+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:35.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:35.399+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:35.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:35.678+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:36.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:36.010+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:36.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:36.215+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:36.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:36.408+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:36.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:36.715+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:36.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:36.986+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:37.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:37.194+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:37.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:37.442+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:37.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:37.764+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:38.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:38.014+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:38.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:38.163+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:38.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:38.412+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:38.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:38.736+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:38.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:38.967+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:39.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:39.183+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:39.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:39.372+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:39.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:39.704+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:39.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:39.988+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:40.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:40.153+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:40.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:40.341+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:40.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:40.705+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:40.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:40.948+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:41.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:41.109+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:41.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:41.322+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:41.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:41.659+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:41.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:41.941+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:42.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:42.088+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:42.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:42.354+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:42.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:42.667+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:42.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:42.981+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:43.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:43.110+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:43.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:43.337+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:43.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:43.651+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:43.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:43.936+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:44.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:44.071+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:44.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:44.371+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:44.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:44.683+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:44.780 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:01:44.777+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:01:44.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:44.960+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:45.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:45.083+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:45.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:45.416+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:45.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:45.663+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:45.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:45.982+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:46.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:46.058+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:46.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:46.407+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:46.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:46.693+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:46.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:46.961+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:47.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:47.057+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:47.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:47.399+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:47.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:47.739+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:47.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:47.968+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:48.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:48.031+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:48.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:48.429+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:48.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:48.713+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:48.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:48.922+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:49.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:49.037+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:49.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:49.454+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:49.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:49.692+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:49.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:49.943+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:50.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:50.067+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:50.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:50.481+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:50.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:50.642+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:50.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:50.980+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:51.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:51.102+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:51.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:51.514+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:51.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:51.686+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:52.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:52.028+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:52.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:52.129+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:52.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:52.529+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:52.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:52.644+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:52.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:52.983+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:53.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:53.102+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:53.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:53.532+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:53.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:53.644+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:53.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:53.984+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:54.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:54.116+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:54.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:54.504+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:54.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:54.619+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:55.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:55.023+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:55.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:55.096+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:55.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:01:55.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:01:55.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:55.513+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:55.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:55.571+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:56.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:56.016+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:56.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:56.063+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:56.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:56.543+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:56.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:56.545+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:57.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:57.011+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:57.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:57.111+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:57.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:57.581+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:57.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:57.588+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:57.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:57.972+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:58.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:58.112+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:58.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:58.603+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:58.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:58.622+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:59.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:01:59.016+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:59.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:01:59.157+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:59.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:01:59.640+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:59.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:01:59.666+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:01:59.795 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:01:59.792+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:02:00.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:00.037+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:00.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:00.130+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:00.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:00.656+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:00.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:00.676+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:01.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:01.046+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:01.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:01.102+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:01.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:01.669+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:01.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:01.702+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:02.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:02.064+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:02.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:02.092+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:02.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:02.684+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:02.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:02.747+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:03.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:03.103+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:03.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:03.139+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:03.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:03.733+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:03.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:03.751+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:04.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:04.149+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:04.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:04.151+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:04.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:04.725+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:04.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:04.738+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:05.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:05.184+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:05.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:05.188+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:05.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:05.686+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:05.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:05.695+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:06.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:06.138+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:06.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:06.164+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:06.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:06.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:06.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:06.686+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:07.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:07.097+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:07.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:07.143+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:07.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:07.701+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:07.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:07.704+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:08.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:08.116+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:08.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:08.164+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:08.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:08.687+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:08.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:08.738+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:09.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:09.137+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:09.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:09.201+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:09.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:09.731+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:09.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:09.771+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:10.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:10.093+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:10.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:10.188+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:10.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:10.750+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:10.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:10.763+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:11.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:11.059+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:11.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:11.142+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:11.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:11.754+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:11.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:11.806+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:12.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:12.068+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:12.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:12.181+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:12.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:12.793+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:12.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:12.795+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:13.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:13.020+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:13.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:13.160+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:13.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:13.775+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:13.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:13.784+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:13.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:13.970+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:14.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:14.192+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:14.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:14.776+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:14.810 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:02:14.808+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:02:14.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:14.821+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:14.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:14.980+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:15.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:15.213+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:15.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:15.788+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:15.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:15.841+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:15.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:15.939+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:16.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:16.190+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:16.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:16.798+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:16.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:16.878+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:16.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:16.970+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:17.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:17.180+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:17.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:17.777+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:17.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:17.905+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:18.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:18.002+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:18.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:18.178+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:18.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:18.792+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:18.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:18.904+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:19.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:19.044+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:19.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:19.177+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:19.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:19.773+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:19.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:19.940+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:20.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:20.072+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:20.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:20.225+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:20.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:20.740+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:20.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:20.947+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:21.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:21.083+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:21.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:21.262+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:21.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:21.770+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:21.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:21.907+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:22.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:22.088+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:22.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:22.281+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:22.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:22.812+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:22.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:22.864+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:23.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:23.126+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:23.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:23.282+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:23.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:23.766+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:23.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:23.901+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:24.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:24.119+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:24.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:24.307+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:24.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:24.766+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:24.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:24.942+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:25.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:25.156+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:25.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:25.293+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:25.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:02:25.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:02:25.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:25.745+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:25.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:25.936+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:26.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:26.157+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:26.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:26.256+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:26.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:26.724+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:26.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:26.936+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:27.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:27.108+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:27.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:27.222+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:27.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:27.728+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:27.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:27.904+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:28.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:28.074+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:28.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:28.234+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:28.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:28.720+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:28.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:28.941+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:29.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:29.096+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:29.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:29.265+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:29.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:29.728+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:29.814 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:02:29.811+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:02:29.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:29.912+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:30.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:30.123+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:30.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:30.284+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:30.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:30.687+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:30.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:30.947+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:31.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:31.138+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:31.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:31.329+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:31.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:31.715+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:31.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:31.920+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:32.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:32.090+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:32.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:32.352+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:32.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:32.691+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:32.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:32.904+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:33.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:33.088+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:33.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:33.365+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:33.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:33.688+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:33.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:33.924+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:34.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:34.105+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:34.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:34.363+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:34.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:34.644+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:34.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:34.939+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:35.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:35.090+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:35.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:35.361+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:35.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:35.677+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:35.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:35.976+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:36.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:36.129+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:36.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:36.338+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:36.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:36.655+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:36.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:36.993+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:37.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:37.136+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:37.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:37.330+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:37.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:37.613+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:38.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:38.024+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:38.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:38.101+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:38.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:38.298+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:38.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:38.578+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:39.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:39.018+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:39.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:39.066+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:39.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:39.296+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:39.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:39.614+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:40.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:40.014+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:40.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:40.049+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:40.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:40.277+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:40.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:40.619+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:41.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:41.016+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:41.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:41.060+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:41.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:41.323+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:41.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:41.593+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:42.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:42.036+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:42.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:42.053+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:42.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:42.330+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:42.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:42.588+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:43.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:43.013+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:43.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:43.064+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:43.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:43.309+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:43.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:43.555+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:44.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:44.028+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:44.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:44.075+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:44.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:44.263+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:44.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:44.579+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:44.828 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:02:44.826+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:02:44.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:44.993+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:45.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:45.060+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:45.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:45.311+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:45.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:45.557+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:46.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:46.021+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:46.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:46.088+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:46.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:46.331+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:46.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:46.573+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:46.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:46.981+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:47.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:47.118+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:47.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:47.372+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:47.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:47.608+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:47.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:47.990+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:48.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:48.084+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:48.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:48.387+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:48.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:48.654+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:49.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:49.001+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:49.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:49.078+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:49.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:49.348+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:49.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:49.650+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:50.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:50.021+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:50.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:50.086+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:50.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:50.351+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:50.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:50.603+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:50.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:50.986+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:51.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:51.103+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:51.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:51.341+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:51.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:51.652+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:51.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:51.983+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:52.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:52.090+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:52.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:52.359+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:52.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:52.677+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:52.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:52.978+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:53.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:53.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:53.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:53.352+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:53.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:53.660+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:53.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:53.936+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:54.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:54.105+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:54.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:54.367+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:54.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:54.671+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:54.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:54.898+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:55.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:55.119+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:55.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:55.390+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:55.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:02:55.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:02:55.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:55.633+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:55.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:55.878+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:56.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:56.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:56.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:56.372+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:56.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:56.587+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:56.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:56.840+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:57.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:57.157+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:57.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:57.397+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:57.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:57.611+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:57.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:57.820+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:58.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:58.194+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:58.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:58.356+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:58.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:58.631+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:58.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:58.846+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:59.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:02:59.194+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:59.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:02:59.334+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:59.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:02:59.611+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:02:59.834 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:02:59.832+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:02:59.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:02:59.873+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:00.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:00.166+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:00.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:00.336+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:00.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:00.610+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:00.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:00.861+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:01.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:01.180+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:01.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:01.331+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:01.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:01.638+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:01.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:01.844+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:02.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:02.218+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:02.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:02.325+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:02.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:02.645+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:02.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:02.834+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:03.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:03.183+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:03.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:03.349+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:03.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:03.598+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:03.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:03.862+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:04.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:04.177+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:04.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:04.384+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:04.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:04.596+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:04.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:04.833+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:05.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:05.172+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:05.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:05.340+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:05.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:05.548+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:05.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:05.868+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:06.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:06.145+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:06.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:06.377+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:06.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:06.526+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:06.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:06.823+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:07.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:07.155+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:07.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:07.365+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:07.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:07.522+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:07.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:07.824+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:08.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:08.161+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:08.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:08.349+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:08.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:08.484+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:08.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:08.857+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:09.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:09.190+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:09.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:09.320+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:09.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:09.436+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:09.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:09.897+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:10.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:10.168+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:10.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:10.298+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:10.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:10.430+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:10.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:10.868+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:11.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:11.154+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:11.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:11.249+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:11.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:11.473+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:11.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:11.918+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:12.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:12.110+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:12.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:12.242+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:12.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:12.477+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:12.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:12.878+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:13.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:13.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:13.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:13.270+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:13.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:13.511+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:13.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:13.859+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:14.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:14.089+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:14.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:14.293+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:14.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:14.511+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:14.848 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:03:14.846+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:03:14.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:14.858+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:15.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:15.066+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:15.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:15.289+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:15.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:15.527+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:15.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:15.825+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:16.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:16.062+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:16.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:16.299+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:16.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:16.519+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:16.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:16.783+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:17.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:17.048+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:17.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:17.332+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:17.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:17.568+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:17.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:17.813+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:18.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:18.034+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:18.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:18.357+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:18.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:18.572+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:18.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:18.806+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:19.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:19.045+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:19.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:19.358+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:19.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:19.566+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:19.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:19.816+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:20.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:20.083+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:20.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:20.387+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:20.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:20.575+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:20.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:20.863+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:21.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:21.091+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:21.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:21.416+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:21.542 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:21.539+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:21.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:21.872+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:22.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:22.105+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:22.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:22.416+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:22.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:22.562+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:22.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:22.875+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:23.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:23.068+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:23.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:23.409+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:23.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:23.525+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:23.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:23.924+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:24.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:24.084+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:24.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:24.430+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:24.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:24.503+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:24.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:24.946+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:25.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:25.074+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:25.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:25.427+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:25.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:25.499+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:25.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:03:25.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:03:25.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:25.967+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:26.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:26.116+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:26.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:26.471+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:26.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:26.475+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:26.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:26.921+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:27.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:27.075+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:27.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:27.476+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:27.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:27.502+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:27.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:27.924+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:28.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:28.053+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:28.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:28.468+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:28.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:28.520+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:28.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:28.911+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:29.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:29.101+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:29.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:29.445+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:29.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:29.500+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:29.864 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:03:29.861+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:03:29.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:29.916+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:30.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:30.089+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:30.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:30.401+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:30.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:30.496+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:30.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:30.906+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:31.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:31.121+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:31.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:31.367+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:31.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:31.451+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:31.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:31.888+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:32.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:32.089+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:32.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:32.331+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:32.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:32.435+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:32.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:32.878+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:33.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:33.108+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:33.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:33.353+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:33.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:33.453+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:33.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:33.900+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:34.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:34.145+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:34.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:34.398+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:34.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:34.486+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:34.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:34.941+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:35.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:35.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:35.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:35.408+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:35.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:35.473+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:35.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:35.992+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:36.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:36.141+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:36.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:36.400+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:36.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:36.435+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:37.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:37.009+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:37.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:37.106+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:37.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:37.393+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:37.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:37.432+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:37.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:37.969+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:38.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:38.066+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:38.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:38.404+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:38.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:38.458+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:39.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:39.003+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:39.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:39.088+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:39.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:39.379+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:39.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:39.469+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:40.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:40.014+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:40.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:40.062+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:40.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:40.399+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:40.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:40.434+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:41.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:41.005+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:41.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:41.082+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:41.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:41.425+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:41.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:41.476+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:41.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:41.957+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:42.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:42.122+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:42.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:42.450+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:42.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:42.513+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:42.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:42.924+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:43.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:43.137+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:43.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:43.484+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:43.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:43.495+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:43.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:43.880+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:44.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:44.103+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:44.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:44.484+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:44.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:44.529+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:44.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:44.846+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:44.879 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:03:44.877+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:03:45.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:45.133+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:45.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:45.515+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:45.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:45.523+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:45.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:45.845+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:46.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:46.113+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:46.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:46.523+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:46.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:46.548+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:46.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:46.834+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:47.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:47.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:47.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:47.500+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:47.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:47.565+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:47.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:47.864+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:48.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:48.160+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:48.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:48.500+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:48.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:48.593+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:48.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:48.904+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:49.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:49.174+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:49.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:49.535+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:49.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:49.589+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:49.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:49.944+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:50.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:50.148+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:50.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:50.550+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:50.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:50.558+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:50.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:50.904+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:51.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:51.106+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:51.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:51.541+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:51.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:51.545+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:51.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:51.945+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:52.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:52.116+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:52.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:52.557+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:52.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:52.569+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:52.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:52.967+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:53.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:53.080+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:53.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:53.566+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:53.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:53.577+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:54.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:54.006+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:54.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:54.050+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:54.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:54.558+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:54.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:54.565+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:55.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:55.048+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:55.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:55.061+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:55.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:55.525+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:55.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:55.569+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:55.785 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:03:55.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:03:56.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:56.090+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:56.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:56.104+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:56.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:56.481+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:56.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:56.614+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:57.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:57.072+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:57.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:57.149+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:57.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:57.470+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:57.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:57.615+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:58.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:58.089+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:58.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:58.135+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:58.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:58.421+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:58.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:58.639+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:59.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:03:59.115+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:59.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:03:59.120+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:59.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:03:59.385+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:59.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:03:59.658+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:03:59.880 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:03:59.879+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:04:00.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:00.079+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:00.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:00.127+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:00.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:00.371+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:00.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:00.695+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:01.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:01.097+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:01.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:01.162+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:01.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:01.326+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:01.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:01.683+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:02.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:02.141+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:02.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:02.187+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:02.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:02.312+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:02.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:02.724+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:03.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:03.138+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:03.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:03.150+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:03.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:03.324+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:03.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:03.677+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:04.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:04.124+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:04.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:04.142+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:04.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:04.300+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:04.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:04.649+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:05.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:05.094+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:05.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:05.111+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:05.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:05.255+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:05.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:05.633+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:06.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:06.107+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:06.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:06.150+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:06.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:06.209+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:06.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:06.599+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:07.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:07.074+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:07.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:07.199+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:07.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:07.208+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:07.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:07.633+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:08.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:08.121+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:08.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:08.190+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:08.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:08.243+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:08.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:08.645+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:09.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:09.168+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:09.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:09.234+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:09.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:09.252+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:09.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:09.640+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:10.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:10.188+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:10.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:10.222+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:10.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:10.284+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:10.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:10.684+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:11.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:11.203+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:11.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:11.242+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:11.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:11.249+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:11.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:11.636+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:12.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:12.200+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:12.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:12.201+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:12.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:12.215+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:12.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:12.660+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:13.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:13.212+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:13.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:13.225+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:13.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:13.245+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:13.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:13.640+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:14.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:14.199+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:14.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:14.250+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:14.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:14.259+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:14.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:14.632+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:14.896 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:04:14.894+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:04:15.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:15.226+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:15.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:15.239+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:15.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:15.296+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:15.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:15.596+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:16.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:16.220+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:16.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:16.241+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:16.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:16.342+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:16.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:16.635+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:17.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:17.194+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:17.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:17.255+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:17.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:17.359+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:17.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:17.594+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:18.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:18.166+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:18.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:18.259+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:18.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:18.329+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:18.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:18.633+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:19.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:19.121+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:19.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:19.233+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:19.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:19.308+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:19.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:19.631+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:20.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:20.145+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:20.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:20.207+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:20.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:20.273+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:20.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:20.669+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:21.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:21.128+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:21.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:21.223+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:21.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:21.277+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:21.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:21.669+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:22.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:22.147+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:22.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:22.218+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:22.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:22.250+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:22.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:22.718+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:23.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:23.191+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:23.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:23.198+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:23.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:23.212+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:23.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:23.685+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:24.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:24.213+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:24.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:24.223+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:24.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:24.246+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:24.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:24.641+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:25.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:25.216+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:25.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:25.218+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:25.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:25.245+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:25.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:25.628+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:25.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:04:25.930 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:04:26.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:26.178+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:26.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:26.180+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:26.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:26.198+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:26.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:26.613+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:27.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:27.138+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:27.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:27.193+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:27.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:27.219+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:27.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:27.627+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:28.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:28.146+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:28.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:28.158+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:28.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:28.178+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:28.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:28.647+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:29.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:29.110+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:29.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:29.126+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:29.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:29.135+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:29.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:29.696+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:29.900 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:04:29.898+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:04:30.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:30.087+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:30.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:30.099+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:30.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:30.180+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:30.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:30.741+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:31.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:31.051+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:31.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:31.131+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:31.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:31.147+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:31.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:31.773+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:32.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:32.087+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:32.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:32.147+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:32.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:32.191+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:32.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:32.748+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:33.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:33.067+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:33.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:33.160+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:33.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:33.207+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:33.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:33.779+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:34.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:34.088+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:34.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:34.142+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:34.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:34.243+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:34.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:34.777+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:35.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:35.063+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:35.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:35.096+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:35.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:35.220+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:35.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:35.769+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:36.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:36.045+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:36.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:36.107+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:36.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:36.196+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:36.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:36.721+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:37.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:37.024+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:37.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:37.113+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:37.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:37.162+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:37.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:37.721+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:38.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:38.030+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:38.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:38.077+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:38.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:38.154+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:38.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:38.706+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:39.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:39.060+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:39.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:39.079+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:39.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:39.114+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:39.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:39.670+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:40.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:40.075+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:40.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:40.079+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:40.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:40.090+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:40.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:40.628+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:41.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:41.049+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:41.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:41.086+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:41.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:41.105+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:41.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:41.630+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:42.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:42.043+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:42.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:42.070+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:42.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:42.118+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:42.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:42.604+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:43.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:43.062+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:43.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:43.076+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:43.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:43.122+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:43.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:43.559+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:44.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:44.039+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:44.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:44.087+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:44.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:44.147+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:44.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:44.586+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:44.916 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:04:44.913+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:04:45.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:45.023+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:45.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:45.101+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:45.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:45.137+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:45.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:45.610+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:46.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:46.018+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:46.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:46.081+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:46.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:46.135+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:46.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:46.574+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:47.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:47.064+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:47.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:47.067+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:47.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:47.132+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:47.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:47.566+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:48.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:48.082+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:48.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:48.090+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:48.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:48.129+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:48.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:48.568+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:49.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:49.058+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:49.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:49.076+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:49.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:49.088+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:49.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:49.574+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:50.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:50.011+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:50.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:50.052+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:50.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:50.099+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:50.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:50.528+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:51.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:51.012+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:51.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:51.054+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:51.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:51.077+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:51.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:51.544+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:51.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:51.971+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:52.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:52.055+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:52.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:52.087+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:52.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:52.593+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:52.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:52.974+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:53.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:53.022+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:53.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:53.085+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:53.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:53.591+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:53.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:53.926+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:54.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:54.002+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:54.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:54.129+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:54.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:54.602+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:54.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:54.950+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:55.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:55.031+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:55.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:55.118+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:55.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:55.622+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:55.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:55.981+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:56.021 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:04:56.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:04:56.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:56.064+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:56.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:56.123+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:56.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:56.590+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:56.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:56.959+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:57.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:57.025+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:57.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:57.165+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:57.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:57.567+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:57.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:57.973+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:58.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:58.052+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:58.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:58.215+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:58.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:58.533+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:58.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:58.928+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:59.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:04:59.051+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:59.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:04:59.251+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:59.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:04:59.489+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:59.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:04:59.898+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:04:59.929 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:04:59.926+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:05:00.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:00.100+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:00.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:00.202+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:00.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:00.466+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:00.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:00.867+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:01.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:01.143+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:01.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:01.198+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:01.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:01.460+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:01.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:01.874+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:02.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:02.118+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:02.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:02.177+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:02.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:02.414+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:02.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:02.883+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:03.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:03.145+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:03.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:03.149+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:03.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:03.388+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:03.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:03.850+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:04.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:04.136+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:04.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:04.182+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:04.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:04.428+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:04.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:04.867+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:05.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:05.167+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:05.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:05.218+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:05.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:05.465+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:05.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:05.825+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:06.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:06.133+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:06.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:06.207+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:06.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:06.457+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:06.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:06.782+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:07.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:07.113+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:07.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:07.161+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:07.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:07.423+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:07.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:07.745+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:08.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:08.105+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:08.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:08.152+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:08.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:08.417+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:08.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:08.754+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:09.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:09.074+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:09.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:09.171+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:09.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:09.451+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:09.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:09.779+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:10.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:10.040+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:10.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:10.149+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:10.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:10.457+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:10.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:10.730+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:11.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:11.063+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:11.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:11.195+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:11.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:11.452+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:11.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:11.708+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:12.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:12.087+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:12.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:12.163+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:12.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:12.409+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:12.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:12.737+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:13.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:13.125+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:13.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:13.166+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:13.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:13.395+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:13.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:13.703+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:14.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:14.082+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:14.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:14.208+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:14.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:14.424+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:14.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:14.718+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:14.945 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:05:14.942+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:05:15.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:15.113+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:15.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:15.229+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:15.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:15.428+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:15.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:15.697+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:16.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:16.162+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:16.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:16.237+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:16.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:16.388+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:16.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:16.724+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:17.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:17.132+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:17.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:17.282+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:17.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:17.343+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:17.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:17.706+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:18.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:18.102+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:18.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:18.274+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:18.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:18.353+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:18.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:18.700+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:19.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:19.119+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:19.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:19.274+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:19.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:19.402+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:19.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:19.653+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:20.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:20.100+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:20.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:20.309+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:20.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:20.371+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:20.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:20.672+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:21.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:21.064+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:21.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:21.285+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:21.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:21.324+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:21.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:21.696+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:22.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:22.058+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:22.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:22.238+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:22.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:22.359+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:22.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:22.660+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:23.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:23.059+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:23.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:23.274+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:23.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:23.389+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:23.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:23.612+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:24.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:24.058+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:24.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:24.315+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:24.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:24.350+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:24.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:24.635+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:25.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:25.051+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:25.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:25.273+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:25.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:25.309+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:25.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:25.676+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:26.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:26.013+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:26.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:05:26.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:05:26.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:26.316+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:26.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:26.357+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:26.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:26.651+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:27.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:27.007+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:27.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:27.276+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:27.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:27.376+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:27.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:27.606+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:27.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:27.961+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:28.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:28.230+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:28.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:28.330+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:28.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:28.629+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:28.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:28.965+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:29.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:29.260+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:29.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:29.338+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:29.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:29.627+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:29.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:29.922+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:29.961 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:05:29.958+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:05:30.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:30.278+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:30.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:30.376+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:30.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:30.600+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:30.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:30.940+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:31.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:31.310+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:31.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:31.332+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:31.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:31.590+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:31.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:31.983+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:32.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:32.289+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:32.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:32.335+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:32.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:32.589+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:32.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:32.944+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:33.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:33.301+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:33.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:33.321+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:33.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:33.622+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:33.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:33.930+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:34.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:34.343+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:34.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:34.354+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:34.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:34.623+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:34.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:34.911+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:35.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:35.341+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:35.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:35.351+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:35.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:35.602+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:35.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:35.921+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:36.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:36.329+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:36.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:36.384+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:36.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:36.589+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:36.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:36.944+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:37.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:37.318+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:37.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:37.338+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:37.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:37.603+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:37.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:37.895+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:38.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:38.297+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:38.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:38.365+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:38.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:38.606+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:38.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:38.877+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:39.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:39.293+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:39.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:39.382+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:39.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:39.590+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:39.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:39.852+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:40.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:40.338+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:40.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:40.338+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:40.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:40.609+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:40.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:40.840+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:41.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:41.304+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:41.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:41.361+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:41.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:41.638+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:41.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:41.877+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:42.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:42.274+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:42.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:42.324+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:42.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:42.627+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:42.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:42.903+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:43.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:43.293+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:43.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:43.323+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:43.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:43.595+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:43.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:43.945+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:44.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:44.320+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:44.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:44.343+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:44.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:44.602+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:44.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:44.953+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:44.961 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:05:44.960+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:05:45.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:45.276+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:45.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:45.363+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:45.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:45.607+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:45.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:45.929+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:46.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:46.293+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:46.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:46.391+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:46.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:46.626+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:46.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:46.931+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:47.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:47.254+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:47.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:47.347+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:47.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:47.581+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:47.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:47.912+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:48.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:48.296+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:48.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:48.345+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:48.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:48.620+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:48.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:48.877+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:49.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:49.260+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:49.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:49.379+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:49.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:49.646+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:49.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:49.900+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:50.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:50.310+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:50.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:50.334+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:50.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:50.661+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:50.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:50.934+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:51.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:51.288+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:51.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:51.288+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:51.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:51.710+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:51.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:51.907+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:52.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:52.295+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:52.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:52.314+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:52.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:52.720+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:52.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:52.907+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:53.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:53.306+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:53.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:53.344+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:53.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:53.751+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:53.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:53.908+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:54.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:54.355+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:54.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:54.373+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:54.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:54.795+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:54.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:54.873+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:55.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:55.371+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:55.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:55.417+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:55.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:55.793+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:55.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:55.891+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:56.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:05:56.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:05:56.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:56.330+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:56.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:56.420+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:56.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:56.808+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:56.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:56.923+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:57.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:57.314+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:57.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:57.404+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:57.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:57.813+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:57.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:57.883+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:58.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:58.358+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:58.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:58.401+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:58.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:58.794+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:58.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:58.852+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:59.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:05:59.314+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:59.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:05:59.380+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:59.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:05:59.746+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:59.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:05:59.843+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:05:59.977 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:05:59.975+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:06:00.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:00.328+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:00.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:00.397+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:00.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:00.786+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:00.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:00.847+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:01.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:01.338+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:01.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:01.379+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:01.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:01.742+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:01.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:01.839+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:02.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:02.340+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:02.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:02.395+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:02.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:02.779+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:02.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:02.816+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:03.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:03.349+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:03.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:03.393+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:03.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:03.782+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:03.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:03.834+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:04.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:04.361+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:04.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:04.396+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:04.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:04.765+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:04.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:04.813+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:05.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:05.407+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:05.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:05.408+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:05.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:05.730+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:05.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:05.774+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:06.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:06.421+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:06.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:06.450+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:06.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:06.751+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:06.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:06.768+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:07.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:07.416+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:07.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:07.437+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:07.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:07.719+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:07.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:07.747+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:08.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:08.404+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:08.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:08.455+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:08.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:08.713+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:08.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:08.768+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:09.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:09.368+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:09.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:09.412+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:09.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:09.756+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:09.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:09.810+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:10.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:10.378+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:10.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:10.409+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:10.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:10.762+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:10.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:10.807+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:11.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:11.420+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:11.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:11.448+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:11.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:11.733+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:11.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:11.857+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:12.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:12.424+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:12.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:12.491+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:12.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:12.754+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:12.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:12.893+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:13.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:13.464+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:13.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:13.509+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:13.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:13.784+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:13.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:13.846+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:14.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:14.473+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:14.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:14.484+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:14.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:14.738+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:14.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:14.835+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:14.993 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:06:14.991+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:06:15.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:15.446+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:15.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:15.517+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:15.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:15.710+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:15.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:15.800+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:16.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:16.459+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:16.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:16.470+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:16.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:16.737+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:16.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:16.786+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:17.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:17.460+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:17.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:17.479+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:17.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:17.736+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:17.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:17.783+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:18.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:18.441+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:18.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:18.472+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:18.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:18.756+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:18.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:18.758+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:19.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:19.437+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:19.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:19.450+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:19.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:19.717+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:19.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:19.732+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:20.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:20.419+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:20.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:20.463+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:20.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:20.697+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:20.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:20.716+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:21.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:21.439+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:21.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:21.449+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:21.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:21.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:21.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:21.718+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:22.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:22.462+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:22.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:22.474+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:22.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:22.631+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:22.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:22.762+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:23.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:23.436+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:23.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:23.507+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:23.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:23.662+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:23.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:23.741+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:24.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:24.415+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:24.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:24.493+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:24.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:24.679+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:24.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:24.713+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:25.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:25.394+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:25.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:25.517+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:25.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:25.685+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:25.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:25.708+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:26.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:06:26.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:26.398+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:26.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:06:26.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:26.554+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:26.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:26.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:26.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:26.675+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:27.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:27.433+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:27.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:27.580+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:27.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:27.629+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:27.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:27.653+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:28.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:28.390+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:28.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:28.579+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:28.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:28.659+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:28.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:28.681+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:29.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:29.428+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:29.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:29.580+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:29.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:29.636+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:29.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:29.656+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:29.995 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:06:29.992+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:06:30.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:30.399+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:30.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:30.602+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:30.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:30.625+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:30.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:30.673+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:31.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:31.413+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:31.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:31.582+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:31.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:31.638+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:31.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:31.675+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:32.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:32.406+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:32.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:32.608+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:32.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:32.620+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:32.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:32.693+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:33.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:33.440+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:33.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:33.589+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:33.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:33.627+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:33.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:33.662+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:34.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:34.478+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:34.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:34.575+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:34.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:34.614+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:34.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:34.649+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:35.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:35.503+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:35.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:35.568+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:35.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:35.633+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:35.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:35.657+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:36.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:36.532+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:36.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:36.597+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:36.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:36.637+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:36.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:36.641+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:37.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:37.551+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:37.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:37.612+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:37.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:37.624+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:37.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:37.644+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:38.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:38.543+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:38.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:38.620+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:38.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:38.630+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:38.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:38.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:39.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:39.535+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:39.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:39.579+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:39.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:39.590+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:39.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:39.681+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:40.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:40.549+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:40.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:40.576+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:40.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:40.581+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:40.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:40.695+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:41.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:41.542+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:41.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:41.544+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:41.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:41.567+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:41.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:41.698+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:42.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:42.520+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:42.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:42.540+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:42.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:42.555+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:42.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:42.721+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:43.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:43.481+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:43.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:43.521+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:43.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:43.574+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:43.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:43.757+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:44.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:44.479+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:44.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:44.528+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:44.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:44.582+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:44.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:44.709+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:45.011 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:06:45.008+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:06:45.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:45.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:45.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:45.494+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:45.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:45.573+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:45.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:45.701+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:46.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:46.427+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:46.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:46.503+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:46.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:46.534+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:46.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:46.715+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:47.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:47.425+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:47.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:47.502+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:47.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:47.533+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:47.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:47.696+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:48.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:48.450+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:48.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:48.491+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:48.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:48.546+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:48.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:48.692+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:49.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:49.463+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:49.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:49.533+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:49.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:49.547+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:49.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:49.676+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:50.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:50.488+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:50.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:50.568+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:50.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:50.598+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:50.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:50.712+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:51.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:51.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:51.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:51.587+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:51.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:51.587+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:51.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:51.720+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:52.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:52.495+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:52.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:52.543+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:52.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:52.586+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:52.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:52.708+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:53.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:53.506+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:53.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:53.535+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:53.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:53.621+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:53.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:53.669+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:54.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:54.506+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:54.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:54.559+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:54.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:54.624+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:54.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:54.662+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:55.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:55.514+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:55.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:55.577+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:55.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:55.632+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:55.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:55.647+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:56.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:56.527+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:56.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:06:56.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:06:56.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:56.555+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:56.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:56.677+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:56.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:56.681+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:57.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:57.494+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:57.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:57.550+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:57.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:57.645+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:57.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:57.679+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:58.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:58.504+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:58.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:58.547+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:58.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:58.640+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:58.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:58.644+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:59.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:06:59.527+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:59.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:06:59.549+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:59.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:06:59.599+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:06:59.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:06:59.602+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:00.026 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:07:00.025+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:07:00.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:00.535+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:00.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:00.548+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:00.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:00.571+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:00.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:00.617+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:01.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:01.505+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:01.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:01.532+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:01.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:01.576+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:01.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:01.591+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:02.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:02.500+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:02.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:02.516+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:02.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:02.530+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:02.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:02.593+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:03.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:03.485+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:03.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:03.503+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:03.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:03.508+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:03.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:03.633+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:04.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:04.481+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:04.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:04.486+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:04.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:04.556+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:04.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:04.618+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:05.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:05.492+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:05.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:05.533+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:05.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:05.578+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:05.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:05.584+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:06.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:06.497+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:06.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:06.574+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:06.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:06.582+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:06.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:06.623+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:07.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:07.458+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:07.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:07.584+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:07.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:07.587+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:07.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:07.629+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:08.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:08.503+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:08.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:08.588+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:08.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:08.633+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:08.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:08.659+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:09.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:09.543+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:09.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:09.562+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:09.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:09.636+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:09.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:09.699+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:10.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:10.589+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:10.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:10.591+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:10.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:10.632+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:10.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:10.733+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:11.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:11.576+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:11.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:11.596+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:11.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:11.679+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:11.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:11.705+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:12.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:12.528+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:12.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:12.611+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:12.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:12.658+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:12.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:12.744+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:13.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:13.498+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:13.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:13.566+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:13.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:13.619+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:13.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:13.704+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:14.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:14.543+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:14.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:14.610+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:14.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:14.622+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:14.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:14.754+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:15.042 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:07:15.040+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:07:15.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:15.532+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:15.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:15.590+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:15.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:15.614+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:15.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:15.779+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:16.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:16.564+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:16.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:16.565+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:16.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:16.632+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:16.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:16.819+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:17.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:17.554+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:17.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:17.600+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:17.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:17.664+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:17.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:17.774+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:18.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:18.545+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:18.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:18.563+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:18.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:18.624+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:18.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:18.733+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:19.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:19.566+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:19.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:19.570+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:19.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:19.620+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:19.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:19.747+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:20.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:20.529+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:20.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:20.533+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:20.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:20.590+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:20.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:20.746+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:21.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:21.531+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:21.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:21.542+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:21.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:21.544+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:21.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:21.789+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:22.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:22.538+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:22.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:22.562+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:22.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:22.576+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:22.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:22.780+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:23.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:23.534+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:23.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:23.545+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:23.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:23.551+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:23.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:23.756+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:24.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:24.519+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:24.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:24.561+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:24.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:24.564+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:24.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:24.804+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:25.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:25.494+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:25.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:25.545+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:25.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:25.578+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:25.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:25.780+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:26.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:26.505+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:26.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:26.507+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:26.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:26.544+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:26.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:07:26.689 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:07:26.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:26.775+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:27.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:27.489+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:27.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:27.492+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:27.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:27.509+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:27.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:27.759+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:28.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:28.460+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:28.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:28.463+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:28.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:28.482+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:28.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:28.786+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:29.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:29.419+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:29.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:29.462+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:29.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:29.524+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:29.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:29.829+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:30.058 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:07:30.056+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:07:30.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:30.413+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:30.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:30.416+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:30.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:30.543+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:30.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:30.839+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:31.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:31.422+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:31.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:31.455+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:31.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:31.495+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:31.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:31.846+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:32.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:32.393+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:32.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:32.420+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:32.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:32.532+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:32.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:32.828+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:33.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:33.384+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:33.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:33.395+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:33.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:33.519+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:33.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:33.839+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:34.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:34.376+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:34.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:34.443+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:34.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:34.548+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:34.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:34.889+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:35.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:35.393+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:35.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:35.431+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:35.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:35.511+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:35.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:35.911+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:36.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:36.351+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:36.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:36.447+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:36.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:36.471+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:36.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:36.952+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:37.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:37.381+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:37.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:37.404+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:37.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:37.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:37.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:37.986+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:38.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:38.357+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:38.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:38.368+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:38.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:38.532+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:38.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:38.950+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:39.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:39.334+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:39.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:39.368+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:39.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:39.525+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:39.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:39.905+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:40.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:40.367+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:40.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:40.389+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:40.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:40.488+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:40.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:40.939+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:41.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:41.379+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:41.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:41.390+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:41.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:41.526+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:41.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:41.969+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:42.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:42.396+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:42.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:42.415+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:42.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:42.535+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:42.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:42.968+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:43.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:43.368+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:43.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:43.464+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:43.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:43.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:44.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:44.014+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:44.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:44.326+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:44.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:44.501+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:44.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:44.530+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:45.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:45.050+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:45.073 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:07:45.071+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:07:45.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:45.336+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:45.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:45.484+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:45.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:45.495+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:46.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:46.043+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:46.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:46.354+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:46.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:46.480+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:46.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:46.481+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:47.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:47.043+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:47.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:47.395+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:47.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:47.435+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:47.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:47.518+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:48.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:48.058+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:48.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:48.403+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:48.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:48.411+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:48.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:48.550+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:49.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:49.108+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:49.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:49.378+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:49.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:49.451+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:49.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:49.576+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:50.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:50.120+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:50.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:50.366+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:50.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:50.478+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:50.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:50.539+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:51.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:51.083+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:51.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:51.395+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:51.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:51.437+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:51.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:51.495+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:52.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:52.098+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:52.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:52.419+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:52.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:52.472+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:52.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:52.476+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:53.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:53.079+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:53.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:53.434+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:53.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:53.441+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:53.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:53.499+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:54.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:54.098+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:54.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:54.433+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:54.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:54.447+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:54.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:54.538+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:55.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:55.144+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:55.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:55.426+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:55.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:55.442+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:55.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:55.565+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:56.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:56.151+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:56.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:56.409+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:56.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:56.451+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:56.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:56.578+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:56.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:07:56.774 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:07:57.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:57.107+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:57.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:57.360+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:57.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:57.467+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:57.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:57.614+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:58.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:58.079+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:58.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:58.352+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:58.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:58.497+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:58.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:58.571+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:59.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:07:59.076+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:59.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:07:59.383+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:59.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:07:59.536+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:07:59.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:07:59.559+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:00.089 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:08:00.087+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:08:00.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:00.115+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:00.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:00.421+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:00.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:00.511+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:00.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:00.590+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:01.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:01.110+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:01.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:01.380+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:01.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:01.538+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:01.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:01.629+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:02.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:02.117+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:02.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:02.422+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:02.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:02.513+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:02.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:02.643+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:03.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:03.106+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:03.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:03.433+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:03.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:03.488+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:03.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:03.632+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:04.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:04.131+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:04.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:04.400+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:04.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:04.538+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:04.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:04.643+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:05.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:05.090+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:05.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:05.433+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:05.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:05.528+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:05.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:05.599+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:06.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:06.070+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:06.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:06.437+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:06.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:06.560+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:06.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:06.611+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:07.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:07.057+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:07.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:07.434+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:07.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:07.568+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:07.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:07.612+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:08.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:08.066+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:08.402 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:08.401+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:08.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:08.559+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:08.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:08.588+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:09.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:09.053+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:09.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:09.397+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:09.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:09.591+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:09.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:09.622+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:10.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:10.004+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:10.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:10.376+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:10.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:10.579+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:10.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:10.619+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:10.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:10.982+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:11.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:11.341+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:11.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:11.531+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:11.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:11.635+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:11.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:11.980+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:12.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:12.327+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:12.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:12.536+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:12.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:12.641+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:12.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:12.950+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:13.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:13.286+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:13.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:13.581+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:13.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:13.616+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:13.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:13.908+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:14.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:14.280+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:14.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:14.560+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:14.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:14.577+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:14.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:14.948+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:15.105 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:08:15.104+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:08:15.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:15.301+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:15.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:15.513+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:15.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:15.559+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:15.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:15.907+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:16.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:16.318+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:16.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:16.529+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:16.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:16.606+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:16.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:16.875+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:17.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:17.353+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:17.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:17.542+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:17.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:17.583+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:17.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:17.835+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:18.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:18.332+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:18.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:18.519+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:18.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:18.566+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:18.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:18.882+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:19.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:19.371+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:19.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:19.472+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:19.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:19.616+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:19.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:19.890+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:20.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:20.395+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:20.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:20.508+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:20.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:20.658+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:20.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:20.846+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:21.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:21.373+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:21.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:21.485+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:21.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:21.621+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:21.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:21.863+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:22.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:22.409+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:22.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:22.479+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:22.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:22.628+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:22.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:22.870+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:23.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:23.408+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:23.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:23.512+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:23.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:23.629+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:23.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:23.881+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:24.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:24.441+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:24.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:24.498+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:24.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:24.586+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:24.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:24.834+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:25.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:25.469+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:25.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:25.506+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:25.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:25.591+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:25.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:25.880+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:26.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:26.432+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:26.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:26.546+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:26.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:26.582+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:26.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:08:26.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:08:26.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:26.875+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:27.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:27.433+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:27.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:27.507+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:27.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:27.625+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:27.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:27.853+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:28.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:28.431+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:28.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:28.483+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:28.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:28.663+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:28.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:28.824+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:29.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:29.452+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:29.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:29.478+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:29.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:29.644+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:29.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:29.798+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:30.121 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:08:30.119+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:08:30.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:30.423+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:30.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:30.443+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:30.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:30.595+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:30.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:30.776+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:31.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:31.410+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:31.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:31.458+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:31.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:31.554+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:31.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:31.795+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:32.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:32.435+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:32.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:32.497+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:32.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:32.552+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:32.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:32.772+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:33.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:33.406+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:33.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:33.517+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:33.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:33.601+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:33.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:33.734+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:34.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:34.438+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:34.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:34.519+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:34.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:34.559+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:34.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:34.750+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:35.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:35.445+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:35.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:35.474+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:35.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:35.531+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:35.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:35.705+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:36.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:36.455+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:36.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:36.507+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:36.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:36.576+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:36.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:36.736+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:37.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:37.472+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:37.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:37.527+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:37.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:37.553+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:37.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:37.724+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:38.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:38.458+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:38.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:38.489+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:38.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:38.597+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:38.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:38.705+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:39.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:39.421+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:39.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:39.523+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:39.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:39.618+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:39.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:39.726+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:40.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:40.470+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:40.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:40.485+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:40.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:40.621+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:40.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:40.702+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:41.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:41.436+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:41.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:41.442+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:41.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:41.591+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:41.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:41.700+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:42.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:42.415+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:42.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:42.460+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:42.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:42.612+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:42.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:42.703+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:43.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:43.415+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:43.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:43.493+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:43.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:43.572+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:43.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:43.739+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:44.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:44.429+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:44.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:44.479+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:44.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:44.586+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:44.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:44.785+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:45.137 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:08:45.135+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:08:45.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:45.429+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:45.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:45.504+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:45.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:45.537+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:45.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:45.791+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:46.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:46.457+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:46.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:46.503+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:46.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:46.568+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:46.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:46.791+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:47.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:47.415+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:47.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:47.476+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:47.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:47.566+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:47.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:47.835+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:48.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:48.453+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:48.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:48.506+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:48.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:48.526+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:48.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:48.879+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:49.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:49.456+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:49.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:49.479+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:49.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:49.506+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:49.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:49.841+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:50.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:50.461+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:50.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:50.503+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:50.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:50.515+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:50.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:50.890+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:51.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:51.501+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:51.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:51.515+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:51.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:51.546+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:51.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:51.922+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:52.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:52.515+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:52.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:52.565+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:52.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:52.593+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:52.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:52.922+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:53.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:53.472+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:53.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:53.615+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:53.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:53.621+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:53.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:53.930+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:54.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:54.456+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:54.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:54.612+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:54.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:54.661+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:54.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:54.954+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:55.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:55.424+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:55.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:55.574+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:55.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:55.642+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:55.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:55.904+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:56.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:56.413+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:56.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:56.530+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:56.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:56.629+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:56.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:56.883+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:56.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:08:56.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:08:57.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:57.396+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:57.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:57.507+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:57.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:57.639+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:57.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:57.838+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:58.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:58.429+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:58.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:58.468+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:58.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:58.601+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:58.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:58.795+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:59.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:08:59.436+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:59.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:08:59.440+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:59.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:08:59.577+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:08:59.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:08:59.835+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:00.153 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:09:00.151+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:09:00.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:00.453+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:00.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:00.478+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:00.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:00.623+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:00.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:00.844+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:01.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:01.438+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:01.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:01.450+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:01.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:01.612+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:01.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:01.879+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:02.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:02.391+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:02.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:02.454+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:02.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:02.607+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:02.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:02.883+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:03.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:03.371+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:03.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:03.444+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:03.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:03.600+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:03.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:03.896+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:04.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:04.385+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:04.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:04.481+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:04.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:04.647+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:04.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:04.856+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:05.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:05.391+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:05.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:05.446+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:05.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:05.672+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:05.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:05.843+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:06.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:06.416+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:06.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:06.424+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:06.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:06.703+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:06.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:06.836+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:07.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:07.416+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:07.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:07.463+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:07.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:07.735+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:07.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:07.816+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:08.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:08.426+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:08.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:08.454+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:08.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:08.699+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:08.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:08.851+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:09.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:09.420+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:09.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:09.503+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:09.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:09.672+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:09.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:09.814+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:10.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:10.439+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:10.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:10.511+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:10.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:10.683+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:10.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:10.803+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:11.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:11.416+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:11.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:11.466+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:11.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:11.704+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:11.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:11.802+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:12.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:12.430+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:12.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:12.469+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:12.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:12.712+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:12.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:12.768+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:13.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:13.420+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:13.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:13.425+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:13.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:13.727+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:13.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:13.800+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:14.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:14.444+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:14.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:14.464+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:14.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:14.741+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:14.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:14.799+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:15.169 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:09:15.166+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:09:15.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:15.448+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:15.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:15.464+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:15.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:15.789+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:15.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:15.830+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:16.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:16.452+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:16.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:16.465+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:16.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:16.773+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:16.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:16.820+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:17.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:17.476+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:17.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:17.489+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:17.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:17.744+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:17.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:17.820+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:18.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:18.511+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:18.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:18.515+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:18.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:18.771+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:18.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:18.866+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:19.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:19.535+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:19.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:19.548+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:19.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:19.755+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:19.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:19.912+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:20.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:20.506+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:20.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:20.532+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:20.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:20.782+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:20.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:20.941+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:21.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:21.497+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:21.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:21.563+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:21.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:21.744+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:21.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:21.923+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:22.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:22.538+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:22.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:22.542+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:22.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:22.713+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:22.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:22.911+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:23.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:23.512+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:23.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:23.582+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:23.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:23.749+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:23.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:23.923+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:24.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:24.533+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:24.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:24.572+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:24.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:24.744+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:24.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:24.928+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:25.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:25.577+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:25.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:25.593+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:25.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:25.704+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:25.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:25.920+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:26.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:26.569+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:26.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:26.571+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:26.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:26.702+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:26.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:26.891+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:27.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:09:27.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:09:27.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:27.594+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:27.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:27.611+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:27.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:27.704+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:27.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:27.926+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:28.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:28.552+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:28.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:28.565+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:28.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:28.752+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:28.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:28.933+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:29.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:29.582+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:29.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:29.582+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:29.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:29.704+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:29.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:29.898+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:30.180 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:09:30.177+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:09:30.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:30.580+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:30.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:30.616+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:30.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:30.680+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:30.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:30.878+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:31.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:31.594+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:31.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:31.663+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:31.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:31.702+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:31.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:31.860+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:32.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:32.567+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:32.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:32.664+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:32.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:32.718+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:32.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:32.899+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:33.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:33.602+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:33.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:33.648+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:33.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:33.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:33.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:33.917+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:34.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:34.575+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:34.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:34.645+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:34.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:34.692+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:34.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:34.944+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:35.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:35.618+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:35.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:35.646+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:35.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:35.646+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:35.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:35.905+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:36.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:36.603+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:36.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:36.610+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:36.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:36.641+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:36.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:36.901+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:37.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:37.574+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:37.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:37.603+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:37.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:37.666+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:37.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:37.946+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:38.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:38.531+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:38.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:38.645+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:38.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:38.691+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:38.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:38.940+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:39.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:39.551+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:39.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:39.673+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:39.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:39.681+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:39.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:39.935+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:40.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:40.512+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:40.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:40.669+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:40.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:40.683+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:40.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:40.974+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:41.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:41.474+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:41.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:41.689+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:41.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:41.696+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:42.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:41.999+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:42.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:42.454+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:42.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:42.662+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:42.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:42.697+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:43.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:43.048+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:43.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:43.474+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:43.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:43.626+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:43.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:43.710+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:44.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:44.042+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:44.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:44.475+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:44.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:44.607+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:44.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:44.750+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:45.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:45.060+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:45.186 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:09:45.184+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:09:45.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:45.524+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:45.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:45.647+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:45.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:45.721+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:46.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:46.094+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:46.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:46.534+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:46.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:46.617+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:46.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:46.709+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:47.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:47.101+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:47.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:47.485+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:47.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:47.641+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:47.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:47.739+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:48.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:48.105+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:48.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:48.456+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:48.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:48.597+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:48.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:48.736+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:49.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:49.081+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:49.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:49.471+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:49.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:49.589+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:49.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:49.721+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:50.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:50.044+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:50.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:50.491+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:50.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:50.630+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:50.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:50.717+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:51.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:51.050+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:51.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:51.498+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:51.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:51.603+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:51.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:51.709+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:52.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:52.033+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:52.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:52.477+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:52.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:52.562+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:52.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:52.724+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:53.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:53.060+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:53.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:53.450+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:53.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:53.517+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:53.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:53.698+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:54.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:54.017+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:54.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:54.487+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:54.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:54.528+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:54.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:54.724+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:55.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:55.059+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:55.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:55.482+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:55.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:55.516+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:55.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:55.739+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:56.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:56.015+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:56.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:56.486+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:56.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:56.525+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:56.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:56.707+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:57.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:57.018+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:57.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:09:57.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:09:57.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:57.475+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:57.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:57.490+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:57.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:57.739+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:57.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:57.974+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:58.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:58.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:58.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:58.518+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:58.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:58.764+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:58.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:58.982+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:59.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:09:59.489+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:59.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:09:59.550+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:59.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:09:59.806+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:09:59.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:09:59.994+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:00.202 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:10:00.201+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:10:00.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:00.535+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:00.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:00.591+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:00.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:00.765+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:01.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:01.029+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:01.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:01.532+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:01.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:01.596+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:01.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:01.748+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:02.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:02.062+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:02.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:02.492+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:02.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:02.626+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:02.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:02.796+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:03.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:03.051+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:03.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:03.465+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:03.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:03.640+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:03.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:03.835+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:04.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:04.086+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:04.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:04.421+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:04.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:04.610+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:04.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:04.795+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:05.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:05.060+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:05.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:05.463+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:05.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:05.656+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:05.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:05.778+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:06.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:06.106+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:06.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:06.501+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:06.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:06.688+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:06.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:06.820+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:07.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:07.075+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:07.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:07.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:07.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:07.708+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:07.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:07.801+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:08.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:08.116+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:08.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:08.506+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:08.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:08.665+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:08.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:08.851+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:09.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:09.133+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:09.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:09.470+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:09.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:09.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:09.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:09.900+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:10.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:10.116+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:10.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:10.487+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:10.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:10.637+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:10.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:10.913+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:11.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:11.140+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:11.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:11.474+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:11.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:11.634+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:11.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:11.897+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:12.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:12.102+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:12.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:12.444+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:12.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:12.631+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:12.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:12.906+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:13.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:13.133+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:13.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:13.471+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:13.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:13.655+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:13.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:13.894+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:14.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:14.116+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:14.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:14.434+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:14.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:14.684+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:14.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:14.894+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:15.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:15.073+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:15.213 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:10:15.210+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:10:15.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:15.444+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:15.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:15.696+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:15.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:15.851+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:16.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:16.051+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:16.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:16.459+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:16.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:16.690+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:16.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:16.857+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:17.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:17.092+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:17.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:17.415+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:17.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:17.665+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:17.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:17.814+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:18.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:18.137+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:18.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:18.365+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:18.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:18.662+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:18.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:18.777+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:19.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:19.171+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:19.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:19.324+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:19.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:19.690+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:19.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:19.798+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:20.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:20.125+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:20.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:20.307+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:20.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:20.675+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:20.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:20.816+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:21.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:21.121+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:21.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:21.298+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:21.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:21.630+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:21.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:21.831+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:22.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:22.149+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:22.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:22.308+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:22.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:22.598+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:22.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:22.810+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:23.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:23.107+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:23.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:23.279+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:23.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:23.626+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:23.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:23.828+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:24.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:24.074+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:24.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:24.321+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:24.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:24.629+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:24.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:24.841+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:25.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:25.055+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:25.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:25.361+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:25.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:25.635+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:25.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:25.837+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:26.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:26.018+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:26.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:26.366+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:26.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:26.680+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:26.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:26.803+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:27.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:27.003+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:27.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:10:27.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:10:27.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:27.396+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:27.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:27.671+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:27.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:27.828+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:28.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:28.034+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:28.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:28.365+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:28.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:28.626+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:28.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:28.786+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:29.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:29.056+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:29.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:29.324+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:29.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:29.654+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:29.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:29.836+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:30.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:30.028+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:30.229 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:10:30.226+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:10:30.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:30.347+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:30.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:30.662+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:30.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:30.864+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:31.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:31.070+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:31.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:31.330+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:31.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:31.707+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:31.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:31.815+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:32.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:32.027+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:32.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:32.361+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:32.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:32.753+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:32.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:32.822+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:33.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:33.023+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:33.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:33.377+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:33.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:33.735+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:33.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:33.842+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:34.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:34.010+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:34.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:34.332+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:34.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:34.749+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:34.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:34.838+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:34.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:34.965+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:35.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:35.344+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:35.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:35.717+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:35.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:35.884+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:35.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:35.984+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:36.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:36.353+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:36.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:36.756+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:36.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:36.843+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:36.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:36.949+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:37.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:37.331+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:37.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:37.800+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:37.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:37.878+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:37.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:37.925+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:38.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:38.349+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:38.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:38.770+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:38.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:38.854+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:38.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:38.896+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:39.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:39.384+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:39.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:39.806+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:39.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:39.821+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:39.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:39.902+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:40.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:40.347+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:40.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:40.788+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:40.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:40.838+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:40.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:40.895+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:41.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:41.303+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:41.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:41.795+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:41.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:41.884+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:41.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:41.892+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:42.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:42.338+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:42.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:42.804+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:42.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:42.847+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:42.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:42.854+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:43.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:43.353+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:43.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:43.761+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:43.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:43.827+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:43.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:43.849+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:44.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:44.370+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:44.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:44.796+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:44.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:44.848+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:44.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:44.862+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:45.244 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:10:45.242+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:10:45.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:45.366+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:45.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:45.837+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:45.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:45.845+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:45.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:45.876+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:46.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:46.371+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:46.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:46.809+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:46.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:46.883+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:46.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:46.924+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:47.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:47.357+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:47.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:47.793+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:47.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:47.888+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:47.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:47.938+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:48.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:48.378+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:48.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:48.826+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:48.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:48.870+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:48.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:48.986+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:49.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:49.383+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:49.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:49.823+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:49.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:49.859+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:50.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:50.023+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:50.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:50.341+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:50.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:50.850+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:50.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:50.856+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:51.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:51.058+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:51.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:51.352+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:51.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:51.852+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:51.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:51.860+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:52.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:52.048+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:52.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:52.305+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:52.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:52.850+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:52.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:52.880+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:53.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:53.067+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:53.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:53.345+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:53.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:53.848+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:53.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:53.886+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:54.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:54.018+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:54.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:54.320+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:54.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:54.801+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:54.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:54.844+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:54.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:54.992+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:55.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:55.342+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:55.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:55.769+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:55.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:55.864+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:56.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:56.007+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:56.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:56.317+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:56.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:56.767+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:56.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:56.881+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:57.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:57.038+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:57.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:57.277+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:57.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:10:57.462 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:10:57.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:57.757+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:57.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:57.881+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:58.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:58.054+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:58.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:58.319+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:58.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:58.737+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:58.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:58.895+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:59.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:10:59.067+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:59.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:10:59.345+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:59.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:10:59.755+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:10:59.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:10:59.846+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:00.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:00.057+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:00.247 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:11:00.244+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:11:00.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:00.326+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:00.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:00.758+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:00.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:00.880+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:01.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:01.076+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:01.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:01.338+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:01.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:01.799+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:01.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:01.901+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:02.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:02.067+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:02.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:02.382+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:02.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:02.780+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:02.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:02.949+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:03.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:03.056+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:03.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:03.426+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:03.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:03.775+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:03.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:03.918+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:04.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:04.053+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:04.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:04.463+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:04.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:04.742+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:04.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:04.882+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:05.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:05.097+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:05.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:05.468+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:05.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:05.772+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:05.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:05.915+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:06.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:06.052+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:06.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:06.462+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:06.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:06.815+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:06.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:06.883+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:07.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:07.040+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:07.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:07.430+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:07.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:07.811+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:07.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:07.883+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:08.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:08.034+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:08.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:08.407+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:08.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:08.828+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:08.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:08.902+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:09.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:09.044+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:09.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:09.420+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:09.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:09.856+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:09.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:09.869+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:10.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:10.047+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:10.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:10.385+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:10.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:10.836+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:10.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:10.893+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:11.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:11.001+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:11.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:11.372+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:11.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:11.853+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:11.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:11.865+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:11.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:11.953+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:12.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:12.379+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:12.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:12.835+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:12.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:12.854+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:12.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:12.948+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:13.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:13.351+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:13.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:13.862+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:13.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:13.886+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:13.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:13.997+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:14.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:14.396+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:14.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:14.886+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:14.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:14.919+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:14.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:14.973+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:15.263 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:11:15.261+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:11:15.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:15.373+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:15.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:15.847+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:15.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:15.940+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:15.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:15.941+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:16.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:16.327+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:16.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:16.823+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:16.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:16.957+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:16.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:16.962+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:17.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:17.328+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:17.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:17.795+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:17.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:17.946+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:17.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:17.983+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:18.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:18.351+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:18.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:18.845+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:18.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:18.979+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:18.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:18.989+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:19.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:19.389+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:19.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:19.798+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:19.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:19.952+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:20.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:20.032+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:20.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:20.418+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:20.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:20.758+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:20.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:20.970+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:21.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:21.026+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:21.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:21.374+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:21.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:21.778+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:21.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:21.965+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:22.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:22.011+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:22.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:22.358+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:22.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:22.733+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:22.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:22.971+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:22.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:22.971+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:23.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:23.322+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:23.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:23.727+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:23.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:23.946+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:23.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:23.996+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:24.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:24.281+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:24.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:24.767+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:24.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:24.991+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:24.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:24.991+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:25.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:25.316+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:25.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:25.804+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:25.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:25.984+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:26.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:26.011+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:26.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:26.354+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:26.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:26.783+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:26.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:26.979+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:26.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:26.993+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:27.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:27.313+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:27.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:11:27.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:11:27.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:27.772+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:27.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:27.993+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:28.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:28.007+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:28.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:28.281+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:28.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:28.750+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:28.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:28.980+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:29.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:29.019+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:29.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:29.323+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:29.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:29.725+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:30.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:30.022+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:30.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:30.054+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:30.278 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:11:30.276+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:11:30.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:30.356+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:30.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:30.697+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:31.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:31.003+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:31.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:31.083+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:31.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:31.358+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:31.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:31.691+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:32.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:32.029+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:32.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:32.114+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:32.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:32.363+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:32.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:32.655+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:33.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:33.043+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:33.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:33.076+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:33.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:33.384+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:33.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:33.679+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:34.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:34.019+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:34.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:34.102+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:34.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:34.354+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:34.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:34.644+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:35.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:35.064+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:35.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:35.080+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:35.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:35.358+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:35.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:35.652+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:36.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:36.031+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:36.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:36.067+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:36.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:36.355+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:36.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:36.618+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:37.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:37.060+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:37.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:37.086+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:37.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:37.364+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:37.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:37.592+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:38.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:38.072+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:38.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:38.133+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:38.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:38.384+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:38.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:38.605+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:39.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:39.035+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:39.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:39.111+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:39.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:39.397+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:39.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:39.563+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:40.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:40.074+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:40.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:40.156+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:40.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:40.415+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:40.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:40.545+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:41.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:41.111+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:41.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:41.130+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:41.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:41.386+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:41.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:41.504+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:42.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:42.078+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:42.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:42.082+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:42.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:42.415+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:42.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:42.494+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:43.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:43.120+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:43.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:43.122+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:43.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:43.372+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:43.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:43.493+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:44.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:44.091+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:44.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:44.136+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:44.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:44.352+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:44.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:44.522+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:45.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:45.123+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:45.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:45.147+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:45.294 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:11:45.292+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:11:45.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:45.330+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:45.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:45.550+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:46.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:46.082+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:46.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:46.141+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:46.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:46.347+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:46.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:46.543+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:47.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:47.039+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:47.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:47.095+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:47.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:47.327+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:47.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:47.513+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:48.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:48.036+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:48.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:48.098+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:48.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:48.351+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:48.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:48.475+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:49.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:49.066+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:49.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:49.120+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:49.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:49.325+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:49.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:49.497+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:50.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:50.061+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:50.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:50.085+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:50.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:50.334+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:50.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:50.450+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:51.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:51.061+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:51.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:51.083+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:51.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:51.286+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:51.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:51.421+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:52.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:52.022+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:52.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:52.038+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:52.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:52.262+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:52.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:52.434+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:52.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:52.992+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:53.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:53.014+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:53.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:53.263+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:53.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:53.437+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:53.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:53.969+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:54.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:54.054+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:54.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:54.248+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:54.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:54.477+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:54.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:54.926+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:55.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:55.068+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:55.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:55.284+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:55.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:55.457+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:55.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:55.955+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:56.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:56.054+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:56.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:56.294+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:56.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:56.489+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:56.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:56.960+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:57.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:57.038+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:57.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:57.320+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:57.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:57.470+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:57.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:11:57.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:11:57.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:57.950+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:58.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:58.088+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:58.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:58.276+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:58.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:58.445+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:58.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:58.910+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:59.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:11:59.057+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:59.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:11:59.230+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:59.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:11:59.401+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:11:59.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:11:59.902+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:00.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:00.074+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:00.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:00.208+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:00.310 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:12:00.308+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:12:00.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:00.421+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:00.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:00.895+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:01.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:01.097+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:01.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:01.235+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:01.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:01.441+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:01.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:01.885+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:02.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:02.080+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:02.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:02.250+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:02.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:02.471+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:02.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:02.906+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:03.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:03.126+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:03.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:03.223+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:03.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:03.481+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:03.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:03.943+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:04.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:04.163+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:04.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:04.250+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:04.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:04.509+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:04.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:04.983+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:05.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:05.138+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:05.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:05.213+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:05.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:05.535+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:05.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:05.951+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:06.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:06.107+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:06.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:06.164+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:06.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:06.552+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:06.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:06.942+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:07.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:07.099+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:07.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:07.134+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:07.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:07.554+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:07.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:07.971+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:08.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:08.093+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:08.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:08.120+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:08.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:08.601+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:08.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:08.924+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:09.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:09.122+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:09.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:09.165+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:09.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:09.631+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:09.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:09.968+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:10.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:10.151+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:10.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:10.193+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:10.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:10.641+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:10.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:10.946+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:11.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:11.194+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:11.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:11.205+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:11.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:11.592+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:11.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:11.944+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:12.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:12.158+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:12.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:12.185+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:12.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:12.562+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:12.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:12.983+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:13.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:13.119+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:13.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:13.210+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:13.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:13.586+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:14.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:14.025+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:14.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:14.156+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:14.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:14.215+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:14.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:14.561+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:15.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:15.068+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:15.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:15.207+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:15.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:15.227+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:15.319 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:12:15.316+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:12:15.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:15.600+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:16.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:16.091+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:16.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:16.205+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:16.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:16.253+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:16.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:16.602+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:17.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:17.141+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:17.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:17.213+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:17.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:17.228+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:17.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:17.630+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:18.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:18.111+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:18.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:18.193+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:18.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:18.220+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:18.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:18.654+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:19.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:19.067+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:19.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:19.182+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:19.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:19.233+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:19.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:19.608+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:20.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:20.023+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:20.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:20.187+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:20.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:20.231+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:20.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:20.579+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:21.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:21.017+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:21.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:21.170+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:21.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:21.210+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:21.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:21.628+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:22.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:22.052+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:22.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:22.180+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:22.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:22.183+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:22.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:22.645+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:23.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:23.022+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:23.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:23.169+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:23.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:23.219+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:23.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:23.613+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:24.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:24.024+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:24.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:24.143+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:24.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:24.265+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:24.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:24.636+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:25.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:25.061+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:25.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:25.145+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:25.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:25.248+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:25.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:25.605+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:26.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:26.078+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:26.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:26.121+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:26.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:26.216+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:26.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:26.591+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:27.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:27.044+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:27.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:27.095+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:27.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:27.236+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:27.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:27.591+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:27.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:12:27.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:12:28.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:28.051+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:28.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:28.067+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:28.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:28.282+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:28.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:28.629+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:29.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:29.005+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:29.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:29.114+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:29.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:29.284+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:29.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:29.671+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:29.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:29.962+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:30.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:30.150+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:30.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:30.284+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:30.335 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:12:30.333+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:12:30.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:30.676+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:30.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:30.936+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:31.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:31.127+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:31.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:31.265+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:31.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:31.645+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:31.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:31.930+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:32.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:32.092+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:32.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:32.230+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:32.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:32.638+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:32.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:32.901+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:33.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:33.087+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:33.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:33.236+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:33.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:33.655+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:33.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:33.928+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:34.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:34.081+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:34.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:34.228+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:34.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:34.637+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:34.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:34.889+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:35.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:35.113+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:35.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:35.211+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:35.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:35.627+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:35.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:35.899+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:36.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:36.153+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:36.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:36.239+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:36.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:36.618+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:36.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:36.911+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:37.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:37.160+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:37.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:37.266+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:37.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:37.626+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:37.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:37.878+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:38.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:38.181+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:38.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:38.285+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:38.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:38.676+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:38.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:38.900+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:39.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:39.190+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:39.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:39.273+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:39.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:39.647+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:39.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:39.943+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:40.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:40.175+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:40.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:40.269+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:40.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:40.637+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:40.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:40.948+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:41.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:41.134+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:41.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:41.266+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:41.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:41.618+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:41.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:41.965+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:42.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:42.117+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:42.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:42.236+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:42.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:42.591+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:42.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:42.988+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:43.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:43.086+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:43.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:43.217+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:43.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:43.630+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:44.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:44.008+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:44.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:44.115+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:44.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:44.205+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:44.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:44.603+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:44.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:44.993+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:45.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:45.149+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:45.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:45.234+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:45.350 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:12:45.348+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:12:45.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:45.603+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:45.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:45.950+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:46.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:46.121+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:46.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:46.259+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:46.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:46.571+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:46.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:46.954+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:47.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:47.105+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:47.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:47.232+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:47.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:47.523+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:47.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:47.941+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:48.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:48.147+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:48.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:48.214+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:48.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:48.502+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:48.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:48.897+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:49.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:49.165+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:49.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:49.218+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:49.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:49.550+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:49.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:49.890+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:50.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:50.157+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:50.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:50.185+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:50.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:50.533+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:50.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:50.885+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:51.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:51.167+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:51.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:51.185+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:51.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:51.553+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:51.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:51.878+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:52.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:52.164+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:52.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:52.216+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:52.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:52.579+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:52.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:52.916+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:53.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:53.192+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:53.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:53.242+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:53.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:53.614+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:53.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:53.940+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:54.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:54.148+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:54.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:54.208+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:54.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:54.572+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:54.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:54.986+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:55.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:55.120+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:55.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:55.206+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:55.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:55.548+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:55.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:55.988+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:56.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:56.162+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:56.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:56.232+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:56.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:56.597+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:57.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:57.035+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:57.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:57.192+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:57.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:57.230+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:57.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:57.636+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:57.895 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:12:57.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:12:58.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:58.021+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:58.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:58.228+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:58.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:58.239+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:58.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:58.613+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:59.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:12:59.063+0000 7f72c425d700 -1 osd.5 113 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:59.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:12:59.259+0000 7f389e18e700 -1 osd.4 113 get_health_metrics reporting 65 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:59.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:12:59.270+0000 7f6e44c9f700 -1 osd.7 113 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:59.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:12:59.572+0000 7f596d92c700 -1 osd.6 113 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:12:59.621 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T02:12:59.619+0000 7ff4c54a3700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:12:59.636 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T02:12:59.619+0000 7ff4c54a3700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:12:59.637 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T02:12:59.631+0000 7ff4c4ca2700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T02:12:59.657 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T02:13:00.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:00.016+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:00.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:00.227+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:00.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:00.232+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:00.352 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:13:00.350+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:13:00.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:00.613+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:01.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:01.024+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:01.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:01.195+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:01.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:01.232+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:01.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:01.656+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:01.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:01.989+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:02.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:02.176+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:02.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:02.245+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:02.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:02.608+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:03.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:03.032+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:03.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:03.195+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:03.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:03.212+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:03.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:03.566+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:03.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:03.984+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:04.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:04.164+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:04.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:04.173+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:04.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:04.602+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:04.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:04.948+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:05.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:05.147+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:05.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:05.196+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:05.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:05.648+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:05.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:05.910+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:06.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:06.105+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:06.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:06.214+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:06.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:06.690+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:06.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:06.945+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:07.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:07.058+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:07.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:07.243+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:07.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:07.721+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:07.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:07.978+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:08.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:08.088+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:08.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:08.203+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:08.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:08.694+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:09.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:09.022+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:09.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:09.118+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:09.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:09.223+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:09.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:09.680+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:09.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:09.981+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:10.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:10.095+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:10.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:10.259+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:10.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:10.637+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:10.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:10.936+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:11.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:11.062+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:11.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:11.290+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:11.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:11.595+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:11.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:11.983+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:12.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:12.108+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:12.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:12.288+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:12.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:12.629+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:12.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:12.957+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:13.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:13.112+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:13.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:13.293+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:13.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:13.666+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:13.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:13.948+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:14.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:14.092+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:14.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:14.245+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:14.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:14.628+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:14.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:14.933+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:15.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:15.080+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:15.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:15.240+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:15.361 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:13:15.358+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:13:15.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:15.641+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:15.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:15.938+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:16.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:16.119+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:16.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:16.191+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:16.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:16.648+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:16.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:16.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:17.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:17.110+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:17.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:17.179+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:17.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:17.634+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:17.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:17.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:18.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:18.157+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:18.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:18.198+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:18.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:18.596+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:18.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:18.853+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:19.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:19.109+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:19.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:19.228+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:19.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:19.560+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:19.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:19.841+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:20.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:20.157+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:20.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:20.201+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:20.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:20.540+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:20.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:20.794+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:21.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:21.138+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:21.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:21.177+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:21.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:21.587+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:21.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:21.778+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:22.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:22.089+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:22.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:22.218+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:22.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:22.599+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:22.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:22.770+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:23.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:23.109+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:23.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:23.235+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:23.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:23.616+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:23.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:23.725+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:24.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:24.100+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:24.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:24.198+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:24.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:24.627+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:24.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:24.760+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:25.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:25.140+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:25.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:25.153+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:25.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:25.660+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:25.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:25.714+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:26.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:26.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:26.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:26.177+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:26.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:26.664+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:26.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:26.756+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:27.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:27.162+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:27.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:27.178+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:27.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:27.628+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:27.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:27.732+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:28.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:13:28.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:13:28.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:28.127+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:28.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:28.207+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:28.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:28.669+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:28.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:28.711+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:29.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:29.163+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:29.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:29.173+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:29.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:29.688+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:29.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:29.724+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:30.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:30.176+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:30.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:30.185+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:30.377 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:13:30.374+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:13:30.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:30.647+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:30.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:30.747+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:31.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:31.162+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:31.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:31.212+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:31.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:31.616+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:31.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:31.767+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:32.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:32.132+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:32.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:32.232+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:32.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:32.665+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:32.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:32.808+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:33.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:33.134+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:33.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:33.213+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:33.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:33.658+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:33.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:33.849+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:34.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:34.087+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:34.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:34.219+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:34.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:34.651+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:34.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:34.820+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:35.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:35.099+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:35.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:35.184+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:35.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:35.662+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:35.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:35.843+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:36.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:36.079+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:36.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:36.215+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:36.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:36.636+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:36.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:36.813+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:37.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:37.088+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:37.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:37.240+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:37.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:37.683+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:37.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:37.771+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:38.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:38.125+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:38.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:38.230+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:38.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:38.675+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:38.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:38.727+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:39.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:39.117+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:39.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:39.256+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:39.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:39.656+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:39.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:39.706+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:40.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:40.112+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:40.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:40.221+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:40.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:40.653+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:40.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:40.691+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:41.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:41.120+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:41.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:41.233+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:41.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:41.640+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:41.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:41.722+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:42.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:42.151+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:42.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:42.207+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:42.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:42.654+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:42.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:42.697+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:43.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:43.112+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:43.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:43.194+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:43.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:43.622+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:43.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:43.713+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:44.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:44.101+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:44.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:44.146+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:44.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:44.663+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:44.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:44.739+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:45.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:45.056+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:45.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:45.135+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:45.393 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:13:45.390+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:13:45.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:45.647+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:45.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:45.720+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:46.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:46.088+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:46.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:46.139+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:46.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:46.641+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:46.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:46.731+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:47.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:47.124+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:47.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:47.189+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:47.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:47.617+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:47.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:47.720+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:48.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:48.087+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:48.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:48.225+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:48.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:48.630+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:48.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:48.677+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:49.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:49.102+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:49.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:49.274+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:49.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:49.623+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:49.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:49.633+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:50.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:50.054+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:50.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:50.299+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:50.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:50.588+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:50.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:50.661+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:51.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:51.082+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:51.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:51.258+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:51.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:51.587+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:51.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:51.669+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:52.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:52.133+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:52.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:52.287+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:52.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:52.613+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:52.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:52.678+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:53.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:53.183+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:53.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:53.303+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:53.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:53.602+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:53.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:53.717+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:54.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:54.192+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:54.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:54.306+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:54.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:54.652+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:54.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:54.719+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:55.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:55.143+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:55.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:55.269+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:55.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:55.701+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:55.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:55.730+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:56.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:56.123+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:56.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:56.241+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:56.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:56.745+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:56.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:56.746+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:57.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:57.075+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:57.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:57.224+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:57.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:57.772+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:57.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:57.782+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:58.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:58.072+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:58.115 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:13:58.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:13:58.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:58.196+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:58.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:58.760+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:58.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:58.800+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:59.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:13:59.030+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:59.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:13:59.152+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:59.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:13:59.756+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:13:59.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:13:59.789+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:00.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:00.072+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:00.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:00.117+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:00.408 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:14:00.406+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:14:00.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:00.768+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:00.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:00.821+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:01.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:01.067+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:01.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:01.164+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:01.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:01.789+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:01.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:01.844+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:02.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:02.090+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:02.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:02.157+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:02.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:02.802+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:02.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:02.823+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:03.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:03.058+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:03.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:03.135+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:03.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:03.849+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:03.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:03.850+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:04.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:04.017+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:04.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:04.096+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:04.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:04.809+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:04.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:04.814+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:05.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:05.032+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:05.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:05.111+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:05.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:05.815+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:05.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:05.831+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:06.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:06.055+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:06.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:06.067+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:06.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:06.770+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:06.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:06.814+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:07.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:07.023+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:07.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:07.055+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:07.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:07.789+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:07.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:07.823+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:07.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:07.991+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:08.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:08.091+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:08.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:08.777+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:08.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:08.838+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:08.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:08.972+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:09.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:09.136+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:09.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:09.796+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:09.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:09.861+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:09.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:09.981+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:10.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:10.174+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:10.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:10.773+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:10.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:10.875+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:10.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:10.962+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:11.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:11.130+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:11.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:11.766+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:11.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:11.885+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:11.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:11.931+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:12.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:12.114+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:12.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:12.722+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:12.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:12.922+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:12.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:12.931+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:13.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:13.144+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:13.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:13.742+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:13.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:13.941+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:13.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:13.948+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:14.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:14.147+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:14.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:14.705+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:14.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:14.947+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:14.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:14.965+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:15.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:15.188+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:15.424 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:14:15.423+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:14:15.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:15.733+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:15.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:15.962+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:15.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:15.977+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:16.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:16.228+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:16.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:16.744+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:16.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:16.968+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:16.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:16.970+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:17.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:17.199+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:17.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:17.783+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:17.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:17.947+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:17.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:17.995+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:18.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:18.169+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:18.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:18.816+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:18.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:18.907+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:18.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:18.982+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:19.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:19.217+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:19.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:19.865+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:19.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:19.942+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:20.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:20.023+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:20.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:20.231+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:20.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:20.909+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:20.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:20.972+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:21.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:21.002+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:21.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:21.267+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:21.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:21.928+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:21.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:21.930+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:22.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:22.033+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:22.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:22.248+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:22.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:22.935+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:22.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:22.946+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:22.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:22.995+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:23.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:23.270+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:23.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:23.945+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:23.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:23.966+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:24.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:24.013+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:24.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:24.269+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:24.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:24.904+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:24.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:24.944+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:24.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:24.996+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:25.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:25.244+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:25.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:25.886+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:25.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:25.934+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:25.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:25.981+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:26.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:26.222+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:26.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:26.924+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:26.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:26.948+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:27.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:27.006+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:27.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:27.231+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:27.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:27.952+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:27.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:27.997+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:28.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:28.057+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:28.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:14:28.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:28.272+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:28.276 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:14:28.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:28.985+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:29.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:29.003+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:29.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:29.091+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:29.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:29.300+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:30.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:30.017+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:30.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:30.043+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:30.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:30.044+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:30.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:30.262+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:30.440 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:14:30.438+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:14:31.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:31.047+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:31.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:31.055+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:31.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:31.066+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:31.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:31.249+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:32.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:32.037+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:32.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:32.045+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:32.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:32.111+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:32.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:32.244+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:33.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:33.001+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:33.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:33.014+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:33.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:33.152+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:33.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:33.264+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:34.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:34.000+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:34.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:34.046+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:34.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:34.192+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:34.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:34.216+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:35.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:34.998+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:35.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:35.095+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:35.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:35.202+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:35.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:35.208+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:35.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:35.994+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:36.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:36.098+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:36.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:36.197+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:36.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:36.244+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:37.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:37.040+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:37.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:37.133+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:37.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:37.184+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:37.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:37.222+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:38.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:38.084+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:38.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:38.151+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:38.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:38.208+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:38.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:38.250+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:39.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:39.039+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:39.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:39.144+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:39.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:39.192+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:39.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:39.224+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:40.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:40.006+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:40.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:40.143+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:40.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:40.182+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:40.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:40.196+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:41.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:41.003+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:41.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:41.146+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:41.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:41.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:41.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:41.187+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:41.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:41.990+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:42.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:42.096+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:42.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:42.147+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:42.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:42.199+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:42.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:42.992+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:43.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:43.099+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:43.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:43.119+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:43.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:43.205+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:43.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:43.987+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:44.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:44.059+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:44.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:44.084+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:44.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:44.203+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:44.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:44.980+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:45.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:45.033+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:45.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:45.084+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:45.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:45.182+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:45.456 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:14:45.454+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:14:46.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:46.013+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:46.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:46.022+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:46.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:46.100+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:46.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:46.208+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:46.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:46.988+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:47.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:47.054+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:47.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:47.127+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:47.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:47.248+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:48.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:47.998+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:48.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:48.054+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:48.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:48.112+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:48.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:48.297+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:49.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:49.000+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:49.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:49.071+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:49.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:49.074+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:49.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:49.310+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:49.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:49.965+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:50.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:50.033+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:50.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:50.057+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:50.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:50.319+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:50.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:50.941+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:51.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:51.013+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:51.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:51.081+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:51.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:51.316+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:51.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:51.940+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:51.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:51.986+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:52.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:52.078+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:52.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:52.294+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:52.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:52.928+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:52.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:52.975+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:53.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:53.126+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:53.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:53.300+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:53.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:53.931+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:53.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:53.937+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:54.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:54.077+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:54.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:54.296+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:54.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:54.939+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:54.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:54.956+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:55.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:55.070+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:55.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:55.311+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:55.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:55.897+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:55.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:55.946+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:56.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:56.116+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:56.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:56.265+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:56.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:56.941+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:56.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:56.968+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:57.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:57.156+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:57.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:57.235+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:57.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:57.899+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:58.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:58.003+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:58.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:58.160+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:58.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:58.188+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:58.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:14:58.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:14:58.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:58.855+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:59.026 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:14:59.025+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:59.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:14:59.177+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:59.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:14:59.179+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:14:59.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:14:59.813+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:00.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:00.045+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:00.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:00.131+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:00.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:00.216+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:00.472 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:15:00.470+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:15:00.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:00.809+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:01.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:01.003+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:01.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:01.168+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:01.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:01.239+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:01.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:01.829+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:01.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:01.957+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:02.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:02.189+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:02.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:02.289+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:02.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:02.832+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:02.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:02.934+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:03.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:03.205+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:03.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:03.290+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:03.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:03.845+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:03.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:03.934+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:04.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:04.238+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:04.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:04.323+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:04.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:04.847+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:04.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:04.963+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:05.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:05.275+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:05.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:05.371+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:05.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:05.837+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:05.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:05.984+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:06.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:06.274+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:06.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:06.398+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:06.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:06.865+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:06.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:06.974+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:07.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:07.287+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:07.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:07.386+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:07.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:07.909+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:08.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:08.014+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:08.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:08.291+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:08.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:08.353+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:08.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:08.882+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:09.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:09.002+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:09.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:09.303+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:09.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:09.322+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:09.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:09.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:09.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:09.958+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:10.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:10.340+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:10.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:10.352+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:10.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:10.896+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:10.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:10.927+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:11.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:11.308+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:11.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:11.333+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:11.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:11.901+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:11.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:11.961+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:12.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:12.298+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:12.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:12.380+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:12.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:12.925+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:12.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:12.938+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:13.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:13.287+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:13.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:13.352+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:13.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:13.880+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:13.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:13.891+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:14.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:14.334+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:14.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:14.401+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:14.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:14.900+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:14.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:14.928+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:15.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:15.371+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:15.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:15.449+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:15.488 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:15:15.486+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:15:15.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:15.892+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:15.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:15.955+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:16.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:16.403+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:16.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:16.444+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:16.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:16.890+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:16.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:16.960+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:17.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:17.448+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:17.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:17.452+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:17.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:17.911+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:17.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:17.981+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:18.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:18.431+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:18.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:18.467+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:18.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:18.884+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:18.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:18.939+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:19.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:19.429+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:19.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:19.458+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:19.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:19.838+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:19.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:19.989+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:20.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:20.424+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:20.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:20.476+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:20.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:20.828+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:20.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:20.970+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:21.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:21.394+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:21.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:21.510+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:21.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:21.782+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:21.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:21.965+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:22.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:22.434+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:22.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:22.482+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:22.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:22.807+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:22.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:22.925+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:23.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:23.407+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:23.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:23.466+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:23.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:23.835+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:23.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:23.942+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:24.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:24.448+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:24.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:24.449+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:24.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:24.795+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:24.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:24.917+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:25.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:25.492+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:25.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:25.495+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:25.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:25.794+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:25.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:25.951+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:26.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:26.518+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:26.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:26.528+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:26.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:26.826+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:26.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:26.929+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:27.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:27.483+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:27.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:27.499+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:27.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:27.798+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:27.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:27.889+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:28.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:15:28.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:15:28.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:28.511+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:28.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:28.512+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:28.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:28.804+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:28.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:28.926+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:29.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:29.498+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:29.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:29.554+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:29.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:29.854+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:29.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:29.885+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:30.504 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:15:30.502+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:15:30.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:30.509+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:30.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:30.530+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:30.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:30.850+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:30.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:30.904+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:31.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:31.469+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:31.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:31.508+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:31.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:31.857+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:31.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:31.939+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:32.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:32.420+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:32.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:32.537+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:32.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:32.825+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:32.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:32.934+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:33.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:33.381+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:33.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:33.545+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:33.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:33.823+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:33.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:33.926+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:34.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:34.419+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:34.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:34.518+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:34.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:34.797+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:34.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:34.912+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:35.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:35.382+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:35.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:35.566+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:35.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:35.822+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:35.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:35.910+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:36.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:36.425+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:36.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:36.564+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:36.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:36.821+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:36.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:36.867+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:37.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:37.377+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:37.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:37.576+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:37.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:37.792+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:37.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:37.872+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:38.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:38.423+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:38.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:38.608+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:38.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:38.832+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:38.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:38.870+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:39.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:39.435+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:39.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:39.633+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:39.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:39.814+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:39.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:39.871+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:40.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:40.395+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:40.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:40.653+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:40.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:40.828+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:40.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:40.836+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:41.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:41.392+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:41.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:41.617+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:41.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:41.795+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:41.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:41.804+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:42.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:42.416+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:42.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:42.617+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:42.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:42.751+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:42.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:42.832+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:43.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:43.409+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:43.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:43.582+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:43.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:43.717+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:43.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:43.871+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:44.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:44.455+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:44.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:44.591+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:44.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:44.735+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:44.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:44.914+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:45.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:45.505+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:45.519 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:15:45.517+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:15:45.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:45.565+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:45.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:45.753+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:45.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:45.905+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:46.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:46.489+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:46.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:46.599+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:46.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:46.713+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:46.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:46.907+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:47.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:47.504+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:47.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:47.590+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:47.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:47.706+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:47.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:47.947+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:48.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:48.549+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:48.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:48.560+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:48.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:48.711+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:48.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:48.987+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:49.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:49.548+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:49.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:49.598+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:49.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:49.728+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:49.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:49.990+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:50.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:50.516+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:50.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:50.604+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:50.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:50.712+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:50.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:50.968+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:51.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:51.556+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:51.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:51.613+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:51.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:51.696+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:51.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:51.951+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:52.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:52.572+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:52.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:52.604+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:52.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:52.649+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:52.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:52.991+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:53.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:53.599+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:53.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:53.638+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:53.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:53.641+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:53.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:53.967+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:54.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:54.623+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:54.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:54.638+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:54.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:54.657+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:54.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:54.947+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:55.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:55.575+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:55.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:55.619+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:55.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:55.642+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:55.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:55.937+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:56.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:56.622+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:56.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:56.650+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:56.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:56.669+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:56.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:56.889+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:57.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:57.614+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:57.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:57.630+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:57.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:57.631+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:57.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:57.874+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:58.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:58.576+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:58.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:15:58.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:15:58.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:58.663+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:58.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:58.668+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:58.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:58.830+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:59.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:15:59.572+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:59.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:15:59.652+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:59.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:15:59.690+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:15:59.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:15:59.785+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 12 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:00.535 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:16:00.533+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:16:00.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:00.550+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:00.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:00.653+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:00.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:00.683+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:00.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:00.805+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:01.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:01.553+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:01.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:01.647+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:01.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:01.661+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:01.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:01.765+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:02.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:02.570+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:02.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:02.610+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:02.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:02.707+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:02.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:02.726+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:03.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:03.613+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:03.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:03.644+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:03.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:03.684+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:03.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:03.732+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:04.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:04.599+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:04.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:04.649+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:04.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:04.716+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:04.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:04.718+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:05.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:05.636+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:05.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:05.664+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:05.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:05.729+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:05.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:05.749+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:06.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:06.613+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:06.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:06.632+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:06.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:06.696+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:06.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:06.795+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:07.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:07.612+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:07.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:07.622+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:07.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:07.720+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:07.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:07.761+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:08.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:08.606+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:08.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:08.630+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:08.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:08.706+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:08.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:08.797+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:09.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:09.589+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:09.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:09.648+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:09.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:09.690+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:09.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:09.786+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:10.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:10.568+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:10.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:10.656+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:10.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:10.677+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:10.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:10.796+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:11.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:11.566+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:11.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:11.671+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:11.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:11.680+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:11.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:11.798+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:12.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:12.533+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:12.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:12.638+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:12.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:12.666+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:12.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:12.821+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:13.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:13.526+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:13.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:13.650+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:13.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:13.660+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:13.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:13.775+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:14.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:14.521+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:14.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:14.616+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:14.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:14.691+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:14.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:14.728+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:15.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:15.515+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:15.551 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:16:15.549+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:16:15.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:15.590+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:15.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:15.656+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:15.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:15.687+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:16.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:16.526+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:16.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:16.633+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:16.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:16.670+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:16.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:16.698+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:17.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:17.530+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:17.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:17.647+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:17.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:17.683+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:17.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:17.704+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:18.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:18.563+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:18.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:18.611+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:18.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:18.655+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:18.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:18.710+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:19.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:19.554+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:19.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:19.568+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:19.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:19.689+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:19.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:19.738+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:20.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:20.546+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:20.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:20.576+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:20.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:20.711+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:20.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:20.712+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:21.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:21.564+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:21.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:21.612+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:21.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:21.700+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:21.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:21.723+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:22.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:22.559+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:22.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:22.649+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:22.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:22.677+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:22.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:22.680+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:23.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:23.527+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:23.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:23.678+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:23.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:23.716+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:23.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:23.720+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:24.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:24.491+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:24.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:24.648+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:24.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:24.692+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:24.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:24.731+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:25.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:25.450+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:25.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:25.671+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:25.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:25.695+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:25.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:25.715+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:26.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:26.448+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:26.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:26.692+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:26.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:26.714+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:26.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:26.732+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:27.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:27.411+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:27.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:27.687+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:27.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:27.732+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:27.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:27.755+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:28.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:28.430+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:28.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:28.660+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:28.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:16:28.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:16:28.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:28.706+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:28.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:28.751+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:29.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:29.460+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:29.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:29.632+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:29.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:29.704+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:29.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:29.717+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:30.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:30.485+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:30.567 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:16:30.565+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:16:30.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:30.673+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:30.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:30.738+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:30.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:30.743+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:31.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:31.447+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:31.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:31.643+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:31.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:31.725+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:31.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:31.793+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:32.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:32.413+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:32.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:32.621+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:32.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:32.679+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:32.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:32.775+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:33.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:33.421+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:33.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:33.662+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:33.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:33.686+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:33.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:33.760+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:34.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:34.412+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:34.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:34.667+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:34.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:34.733+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:34.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:34.799+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:35.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:35.447+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:35.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:35.650+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:35.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:35.737+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:35.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:35.846+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:36.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:36.476+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:36.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:36.601+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:36.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:36.773+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:36.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:36.806+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:37.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:37.490+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:37.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:37.633+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:37.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:37.757+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:37.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:37.809+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:38.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:38.466+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:38.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:38.680+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:38.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:38.779+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:38.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:38.816+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:39.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:39.445+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:39.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:39.637+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:39.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:39.750+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:39.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:39.775+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:40.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:40.433+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:40.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:40.591+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:40.746 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:40.744+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:40.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:40.814+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:41.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:41.451+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:41.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:41.563+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:41.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:41.766+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:41.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:41.793+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:42.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:42.427+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:42.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:42.563+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:42.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:42.769+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:42.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:42.795+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:43.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:43.447+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:43.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:43.533+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:43.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:43.797+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:43.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:43.829+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:44.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:44.493+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:44.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:44.534+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:44.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:44.754+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:44.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:44.877+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:45.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:45.494+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:45.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:45.500+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:45.583 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:16:45.582+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:16:45.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:45.744+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:45.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:45.887+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:46.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:46.453+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:46.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:46.487+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:46.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:46.789+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:46.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:46.882+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:47.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:47.434+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:47.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:47.452+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:47.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:47.790+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:47.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:47.858+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:48.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:48.433+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:48.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:48.462+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:48.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:48.819+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:48.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:48.886+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:49.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:49.400+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:49.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:49.456+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:49.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:49.854+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:49.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:49.925+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:50.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:50.353+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:50.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:50.494+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:50.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:50.836+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:50.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:50.901+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:51.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:51.333+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:51.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:51.481+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:51.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:51.817+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:51.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:51.898+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:52.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:52.369+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:52.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:52.489+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:52.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:52.787+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:52.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:52.854+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:53.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:53.345+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:53.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:53.525+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:53.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:53.830+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:53.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:53.845+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:54.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:54.362+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:54.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:54.559+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:54.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:54.855+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:54.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:54.884+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:55.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:55.383+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:55.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:55.533+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:55.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:55.854+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:55.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:55.861+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:56.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:56.369+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:56.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:56.578+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:56.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:56.817+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:56.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:56.865+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:57.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:57.354+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:57.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:57.585+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:57.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:57.789+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:57.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:57.821+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:58.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:58.308+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:58.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:58.619+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:58.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:58.753+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:58.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:16:58.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:16:58.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:58.860+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:59.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:16:59.284+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:59.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:16:59.660+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:59.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:16:59.794+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:16:59.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:16:59.903+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:00.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:00.321+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:00.599 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:17:00.596+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:17:00.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:00.688+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:00.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:00.800+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:00.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:00.855+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:01.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:01.304+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:01.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:01.732+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:01.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:01.820+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:01.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:01.888+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:02.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:02.293+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:02.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:02.727+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:02.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:02.815+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:02.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:02.907+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:03.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:03.297+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:03.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:03.690+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:03.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:03.775+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:03.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:03.918+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:04.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:04.316+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:04.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:04.709+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:04.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:04.753+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:04.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:04.923+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:05.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:05.291+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:05.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:05.704+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:05.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:05.709+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:05.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:05.884+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:06.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:06.292+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:06.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:06.660+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:06.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:06.746+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:06.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:06.861+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:07.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:07.341+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:07.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:07.706+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:07.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:07.724+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:07.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:07.822+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:08.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:08.375+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:08.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:08.681+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:08.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:08.727+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:08.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:08.827+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:09.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:09.340+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:09.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:09.669+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:09.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:09.715+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:09.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:09.865+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:10.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:10.340+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:10.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:10.701+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:10.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:10.737+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:10.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:10.888+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:11.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:11.376+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:11.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:11.707+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:11.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:11.747+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:11.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:11.862+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:12.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:12.358+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:12.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:12.704+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:12.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:12.748+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:12.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:12.834+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:13.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:13.374+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:13.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:13.687+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:13.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:13.785+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:13.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:13.791+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:14.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:14.346+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:14.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:14.652+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:14.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:14.749+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:14.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:14.810+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:15.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:15.396+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:15.609 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:17:15.607+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:17:15.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:15.685+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:15.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:15.710+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:15.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:15.853+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:16.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:16.350+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:16.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:16.721+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:16.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:16.742+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:16.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:16.851+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:17.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:17.390+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:17.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:17.765+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:17.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:17.768+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:17.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:17.848+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:18.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:18.420+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:18.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:18.721+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:18.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:18.790+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:18.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:18.886+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:19.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:19.437+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:19.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:19.674+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:19.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:19.770+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:19.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:19.867+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:20.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:20.399+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:20.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:20.683+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:20.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:20.800+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:20.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:20.887+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:21.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:21.359+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:21.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:21.696+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:21.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:21.818+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:21.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:21.859+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:22.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:22.397+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:22.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:22.685+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:22.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:22.828+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:22.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:22.882+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:23.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:23.427+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:23.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:23.694+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:23.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:23.807+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:23.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:23.905+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:24.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:24.458+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:24.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:24.657+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:24.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:24.773+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:24.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:24.908+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:25.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:25.419+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:25.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:25.626+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:25.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:25.757+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:25.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:25.875+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:26.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:26.371+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:26.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:26.593+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:26.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:26.786+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:26.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:26.886+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:27.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:27.342+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:27.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:27.587+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:27.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:27.824+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:27.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:27.898+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:28.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:28.299+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:28.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:28.600+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:28.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:28.857+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:28.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:28.869+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:28.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:17:28.993 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:17:29.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:29.331+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:29.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:29.607+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:29.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:29.874+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:29.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:29.888+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:30.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:30.319+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:30.624 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:17:30.622+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:17:30.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:30.638+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:30.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:30.863+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:30.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:30.893+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:31.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:31.289+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:31.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:31.626+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:31.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:31.905+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:31.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:31.938+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:32.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:32.292+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:32.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:32.648+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:32.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:32.863+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:32.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:32.888+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:33.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:33.268+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:33.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:33.684+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:33.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:33.889+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:33.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:33.904+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:34.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:34.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:34.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:34.732+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:34.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:34.918+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:34.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:34.924+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:35.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:35.292+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:35.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:35.684+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:35.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:35.887+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:35.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:35.960+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:36.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:36.292+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:36.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:36.727+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:36.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:36.877+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:36.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:36.991+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:37.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:37.290+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:37.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:37.720+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:37.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:37.833+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:38.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:38.042+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:38.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:38.264+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:38.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:38.703+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:38.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:38.844+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:39.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:39.058+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:39.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:39.258+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:39.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:39.705+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:39.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:39.822+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:40.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:40.043+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:40.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:40.222+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:40.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:40.675+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:40.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:40.784+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:41.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:41.079+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:41.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:41.216+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:41.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:41.701+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:41.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:41.778+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:42.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:42.109+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:42.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:42.176+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:42.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:42.683+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:42.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:42.822+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:43.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:43.134+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:43.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:43.196+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:43.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:43.698+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:43.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:43.814+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:44.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:44.157+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:44.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:44.169+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:44.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:44.664+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:44.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:44.766+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:45.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:45.135+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:45.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:45.165+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:45.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:45.624+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:45.640 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:17:45.637+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:17:45.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:45.766+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:46.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:46.157+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:46.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:46.188+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:46.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:46.604+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:46.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:46.770+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:47.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:47.156+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:47.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:47.227+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:47.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:47.595+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:47.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:47.799+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:48.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:48.127+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:48.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:48.264+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:48.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:48.638+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:48.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:48.775+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:49.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:49.082+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:49.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:49.252+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:49.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:49.630+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:49.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:49.779+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:50.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:50.073+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:50.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:50.222+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:50.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:50.675+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:50.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:50.817+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:51.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:51.101+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:51.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:51.213+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:51.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:51.715+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:51.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:51.789+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:52.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:52.085+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:52.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:52.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:52.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:52.718+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:52.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:52.816+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:53.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:53.074+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:53.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:53.195+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:53.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:53.688+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:53.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:53.853+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:54.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:54.097+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:54.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:54.239+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:54.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:54.665+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:54.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:54.855+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:55.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:55.059+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:55.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:55.242+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:55.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:55.669+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:55.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:55.833+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:56.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:56.043+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:56.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:56.260+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:56.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:56.625+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:56.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:56.826+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:57.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:57.011+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:57.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:57.290+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:57.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:57.667+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:57.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:57.833+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:58.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:58.025+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:58.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:58.296+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:58.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:58.701+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:58.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:58.871+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:59.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:17:59.024+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:59.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:17:59.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:17:59.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:17:59.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:59.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:17:59.656+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:17:59.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:17:59.920+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:00.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:00.074+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:00.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:00.312+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:00.656 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:18:00.653+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:18:00.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:00.684+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:00.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:00.889+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:01.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:01.075+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:01.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:01.286+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:01.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:01.706+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:01.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:01.896+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:02.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:02.101+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:02.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:02.271+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:02.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:02.710+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:02.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:02.867+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:03.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:03.087+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:03.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:03.267+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:03.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:03.696+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:03.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:03.877+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:04.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:04.042+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:04.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:04.233+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:04.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:04.722+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:04.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:04.857+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:05.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:05.050+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:05.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:05.204+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:05.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:05.752+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:05.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:05.878+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:06.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:06.016+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:06.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:06.250+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:06.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:06.798+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:06.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:06.890+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:07.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:07.058+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:07.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:07.297+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:07.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:07.795+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:07.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:07.843+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:08.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:08.048+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:08.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:08.291+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:08.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:08.824+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:08.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:08.879+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:09.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:09.097+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:09.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:09.332+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:09.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:09.800+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:09.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:09.850+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:10.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:10.096+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:10.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:10.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:10.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:10.786+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:10.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:10.818+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:11.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:11.092+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:11.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:11.319+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:11.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:11.748+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:11.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:11.769+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:12.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:12.133+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:12.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:12.353+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:12.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:12.699+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:12.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:12.755+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:13.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:13.128+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:13.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:13.354+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:13.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:13.726+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:13.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:13.735+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:14.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:14.110+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:14.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:14.342+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:14.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:14.749+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:14.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:14.776+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:15.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:15.144+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:15.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:15.368+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:15.664 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:18:15.661+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:18:15.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:15.747+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:15.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:15.788+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:16.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:16.194+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:16.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:16.406+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:16.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:16.710+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:16.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:16.779+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:17.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:17.237+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:17.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:17.358+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:17.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:17.725+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:17.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:17.764+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:18.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:18.209+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:18.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:18.333+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:18.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:18.696+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:18.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:18.746+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:19.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:19.245+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:19.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:19.292+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:19.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:19.656+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:19.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:19.779+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:20.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:20.252+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:20.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:20.255+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:20.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:20.698+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:20.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:20.807+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:21.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:21.266+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:21.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:21.272+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:21.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:21.695+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:21.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:21.835+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:22.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:22.228+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:22.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:22.321+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:22.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:22.668+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:22.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:22.821+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:23.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:23.275+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:23.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:23.358+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:23.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:23.641+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:23.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:23.854+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:24.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:24.295+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:24.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:24.359+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:24.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:24.627+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:24.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:24.881+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:25.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:25.275+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:25.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:25.407+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:25.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:25.636+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:25.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:25.890+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:26.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:26.248+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:26.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:26.375+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:26.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:26.616+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:26.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:26.921+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:27.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:27.247+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:27.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:27.326+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:27.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:27.574+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:27.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:27.920+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:28.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:28.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:28.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:28.343+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:28.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:28.617+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:28.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:28.913+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:29.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:18:29.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:18:29.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:29.296+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:29.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:29.328+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:29.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:29.637+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:29.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:29.911+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:30.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:30.286+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:30.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:30.344+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:30.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:30.635+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:30.680 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:18:30.678+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:18:30.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:30.947+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:31.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:31.283+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:31.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:31.318+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:31.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:31.651+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:31.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:31.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:32.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:32.256+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:32.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:32.317+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:32.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:32.700+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:32.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:32.901+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:33.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:33.218+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:33.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:33.320+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:33.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:33.700+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:33.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:33.925+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:34.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:34.192+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:34.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:34.349+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:34.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:34.733+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:34.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:34.939+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:35.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:35.188+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:35.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:35.309+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:35.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:35.714+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:35.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:35.916+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:36.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:36.195+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:36.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:36.323+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:36.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:36.685+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:36.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:36.890+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:37.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:37.240+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:37.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:37.369+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:37.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:37.651+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:37.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:37.883+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:38.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:38.255+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:38.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:38.358+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:38.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:38.697+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:38.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:38.840+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:39.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:39.272+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:39.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:39.394+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:39.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:39.726+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:39.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:39.842+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:40.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:40.257+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:40.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:40.441+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:40.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:40.700+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:40.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:40.876+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:41.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:41.232+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:41.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:41.406+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:41.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:41.749+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:41.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:41.915+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:42.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:42.273+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:42.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:42.380+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:42.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:42.736+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:42.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:42.886+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:43.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:43.285+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:43.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:43.422+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:43.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:43.712+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:43.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:43.875+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:44.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:44.282+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:44.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:44.373+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:44.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:44.755+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:44.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:44.885+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:45.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:45.233+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:45.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:45.362+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:45.695 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:18:45.693+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:18:45.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:45.788+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:45.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:45.853+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:46.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:46.190+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:46.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:46.378+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:46.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:46.744+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:46.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:46.886+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:47.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:47.236+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:47.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:47.400+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:47.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:47.776+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:47.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:47.926+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:48.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:48.266+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:48.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:48.368+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:48.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:48.741+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:48.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:48.888+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:49.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:49.229+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:49.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:49.352+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:49.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:49.706+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:49.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:49.855+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:50.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:50.228+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:50.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:50.343+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:50.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:50.752+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:50.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:50.808+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:51.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:51.248+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:51.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:51.296+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:51.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:51.789+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:51.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:51.842+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:52.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:52.222+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:52.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:52.250+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:52.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:52.805+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:52.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:52.805+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:53.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:53.190+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:53.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:53.216+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:53.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:53.820+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:53.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:53.841+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:54.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:54.215+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:54.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:54.220+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:54.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:54.808+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:54.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:54.850+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:55.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:55.226+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:55.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:55.236+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:55.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:55.761+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:55.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:55.829+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:56.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:56.227+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:56.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:56.247+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:56.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:56.797+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:56.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:56.844+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:57.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:57.249+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:57.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:57.277+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:57.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:57.762+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:57.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:57.804+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:58.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:58.266+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:58.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:58.305+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:58.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:58.757+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:58.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:58.841+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:59.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:18:59.267+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:59.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:18:59.350+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:59.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:18:59.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:18:59.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:18:59.781+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:18:59.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:18:59.820+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:00.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:00.276+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:00.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:00.355+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:00.711 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:19:00.709+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:19:00.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:00.750+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:00.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:00.806+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:01.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:01.255+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:01.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:01.379+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:01.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:01.700+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:01.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:01.794+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:02.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:02.305+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:02.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:02.371+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:02.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:02.673+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:02.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:02.754+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:03.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:03.339+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:03.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:03.384+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:03.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:03.721+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:03.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:03.752+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:04.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:04.338+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:04.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:04.424+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:04.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:04.717+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:04.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:04.753+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:05.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:05.300+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:05.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:05.389+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:05.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:05.747+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:05.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:05.772+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:06.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:06.322+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:06.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:06.421+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:06.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:06.719+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:06.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:06.745+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:07.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:07.361+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:07.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:07.410+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:07.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:07.758+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:07.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:07.770+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:08.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:08.320+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:08.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:08.404+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:08.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:08.726+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:08.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:08.785+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:09.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:09.367+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:09.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:09.441+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:09.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:09.677+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:09.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:09.787+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:10.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:10.333+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:10.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:10.453+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:10.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:10.628+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:10.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:10.828+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:11.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:11.382+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:11.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:11.450+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:11.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:11.632+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:11.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:11.806+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:12.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:12.424+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:12.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:12.480+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:12.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:12.620+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:12.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:12.824+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:13.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:13.388+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:13.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:13.465+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:13.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:13.640+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:13.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:13.786+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:14.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:14.365+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:14.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:14.432+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:14.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:14.658+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:14.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:14.748+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:15.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:15.352+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:15.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:15.397+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:15.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:15.623+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:15.714 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:19:15.712+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:19:15.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:15.777+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:16.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:16.326+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:16.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:16.350+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:16.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:16.616+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:16.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:16.800+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:17.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:17.329+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:17.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:17.340+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:17.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:17.606+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:17.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:17.850+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:18.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:18.321+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:18.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:18.323+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:18.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:18.593+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:18.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:18.884+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:19.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:19.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:19.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:19.354+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:19.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:19.600+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:19.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:19.862+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:20.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:20.292+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:20.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:20.336+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:20.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:20.565+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:20.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:20.892+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:21.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:21.317+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:21.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:21.356+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:21.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:21.538+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:21.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:21.923+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:22.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:22.291+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:22.394 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:22.392+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:22.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:22.565+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:22.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:22.877+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:23.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:23.278+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:23.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:23.366+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:23.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:23.579+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:23.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:23.918+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:24.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:24.249+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:24.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:24.372+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:24.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:24.556+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:24.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:24.942+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:25.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:25.293+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:25.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:25.346+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:25.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:25.534+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:25.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:25.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:26.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:26.305+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:26.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:26.307+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:26.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:26.491+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:26.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:26.913+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:27.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:27.319+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:27.354 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:27.352+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:27.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:27.512+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:27.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:27.913+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:28.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:28.353+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:28.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:28.372+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:28.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:28.541+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:28.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:28.934+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:29.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:29.345+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:29.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:29.381+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:29.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:29.498+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:29.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:19:29.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:19:29.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:29.934+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:30.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:30.316+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:30.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:30.413+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:30.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:30.487+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:30.729 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:19:30.727+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:19:30.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:30.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:31.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:31.347+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:31.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:31.429+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:31.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:31.526+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:31.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:31.875+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:32.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:32.363+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:32.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:32.421+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:32.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:32.503+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:32.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:32.859+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:33.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:33.332+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:33.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:33.398+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:33.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:33.513+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:33.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:33.830+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:34.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:34.356+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:34.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:34.402+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:34.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:34.484+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:34.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:34.812+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:35.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:35.338+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:35.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:35.380+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:35.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:35.474+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:35.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:35.816+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:36.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:36.336+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:36.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:36.401+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:36.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:36.469+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:36.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:36.812+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:37.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:37.322+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:37.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:37.362+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:37.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:37.484+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:37.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:37.828+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:38.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:38.355+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:38.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:38.411+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:38.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:38.533+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:38.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:38.831+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:39.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:39.373+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:39.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:39.394+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:39.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:39.571+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:39.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:39.872+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:40.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:40.337+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:40.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:40.354+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:40.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:40.595+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:40.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:40.861+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:41.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:41.336+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:41.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:41.342+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:41.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:41.637+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:41.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:41.869+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:42.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:42.303+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:42.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:42.335+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:42.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:42.588+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:42.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:42.841+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:43.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:43.318+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:43.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:43.346+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:43.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:43.565+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:43.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:43.834+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:44.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:44.290+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:44.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:44.366+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:44.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:44.530+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:44.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:44.861+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:45.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:45.261+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:45.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:45.340+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:45.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:45.555+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:45.745 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:19:45.743+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:19:45.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:45.899+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:46.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:46.254+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:46.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:46.370+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:46.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:46.513+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:46.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:46.899+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:47.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:47.239+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:47.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:47.343+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:47.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:47.521+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:47.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:47.895+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:48.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:48.237+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:48.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:48.321+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:48.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:48.495+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:48.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:48.917+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:49.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:49.269+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:49.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:49.341+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:49.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:49.459+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:49.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:49.940+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:50.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:50.280+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:50.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:50.358+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:50.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:50.443+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:50.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:50.970+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:51.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:51.249+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:51.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:51.379+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:51.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:51.418+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:51.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:51.933+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:52.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:52.249+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:52.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:52.335+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:52.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:52.383+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:52.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:52.888+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:53.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:53.261+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:53.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:53.326+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:53.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:53.386+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:53.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:53.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:54.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:54.292+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:54.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:54.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:54.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:54.403+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:54.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:54.949+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:55.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:55.276+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:55.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:55.360+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:55.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:55.392+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:55.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:55.944+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:56.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:56.242+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:56.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:56.388+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:56.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:56.406+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:56.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:56.924+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:57.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:57.197+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:57.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:57.403+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:57.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:57.407+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:57.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:57.954+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:58.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:58.159+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:58.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:58.370+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:58.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:58.392+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:58.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:58.923+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:59.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:19:59.141+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:59.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:19:59.339+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:59.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:19:59.413+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:19:59.588 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:19:59.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:19:59.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:19:59.926+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:00.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:00.144+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:00.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:00.383+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:00.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:00.410+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:00.761 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:20:00.758+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:20:00.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:00.970+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:01.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:01.122+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:01.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:01.344+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:01.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:01.400+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:01.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:01.968+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:02.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:02.123+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:02.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:02.378+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:02.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:02.427+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:02.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:02.991+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:03.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:03.128+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:03.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:03.357+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:03.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:03.448+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:04.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:04.020+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:04.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:04.151+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:04.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:04.352+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:04.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:04.453+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:04.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:04.980+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:05.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:05.199+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:05.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:05.334+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:05.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:05.425+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:05.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:05.936+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:06.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:06.191+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:06.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:06.384+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:06.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:06.452+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:06.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:06.898+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:07.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:07.147+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:07.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:07.344+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:07.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:07.469+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:07.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:07.932+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:08.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:08.125+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:08.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:08.388+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:08.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:08.449+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:08.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:08.904+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:09.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:09.148+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:09.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:09.419+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:09.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:09.497+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:09.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:09.901+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:10.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:10.108+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:10.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:10.382+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:10.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:10.507+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:10.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:10.895+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:11.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:11.149+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:11.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:11.363+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:11.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:11.464+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:11.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:11.884+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:12.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:12.181+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:12.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:12.369+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:12.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:12.496+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:12.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:12.897+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:13.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:13.139+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:13.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:13.414+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:13.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:13.480+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:13.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:13.893+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:14.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:14.129+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:14.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:14.426+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:14.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:14.461+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:14.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:14.853+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:15.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:15.155+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:15.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:15.397+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:15.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:15.447+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:15.777 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:20:15.774+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:20:15.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:15.837+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:16.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:16.204+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:16.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:16.383+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:16.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:16.463+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:16.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:16.788+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:17.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:17.202+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:17.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:17.413+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:17.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:17.476+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:17.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:17.836+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:18.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:18.153+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:18.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:18.456+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:18.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:18.463+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:18.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:18.834+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:19.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:19.175+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:19.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:19.409+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:19.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:19.469+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:19.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:19.877+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:20.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:20.209+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:20.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:20.377+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:20.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:20.489+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:20.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:20.906+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:21.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:21.243+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:21.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:21.353+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:21.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:21.529+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:21.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:21.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:22.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:22.231+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:22.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:22.350+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:22.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:22.572+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:22.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:22.923+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:23.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:23.256+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:23.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:23.342+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:23.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:23.589+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:23.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:23.953+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:24.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:24.221+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:24.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:24.368+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:24.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:24.618+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:24.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:24.926+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:25.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:25.250+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:25.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:25.358+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:25.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:25.627+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:25.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:25.927+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:26.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:26.217+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:26.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:26.317+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:26.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:26.629+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:26.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:26.893+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:27.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:27.195+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:27.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:27.365+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:27.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:27.590+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:27.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:27.911+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:28.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:28.149+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:28.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:28.334+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:28.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:28.601+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:28.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:28.933+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:29.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:29.131+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:29.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:29.363+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:29.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:29.600+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:29.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:20:29.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:20:29.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:29.917+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:30.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:30.088+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:30.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:30.321+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:30.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:30.619+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:30.788 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:20:30.785+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:20:30.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:30.868+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:31.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:31.097+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:31.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:31.325+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:31.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:31.651+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:31.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:31.892+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:32.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:32.072+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:32.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:32.279+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:32.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:32.667+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:32.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:32.934+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:33.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:33.049+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:33.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:33.283+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:33.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:33.717+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:33.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:33.928+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:34.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:34.046+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:34.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:34.326+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:34.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:34.687+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:34.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:34.902+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:35.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:35.028+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:35.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:35.315+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:35.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:35.656+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:35.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:35.923+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:35.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:35.991+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:36.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:36.282+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:36.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:36.616+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:36.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:36.940+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:36.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:36.955+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:37.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:37.306+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:37.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:37.601+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:37.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:37.918+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:37.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:37.935+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:38.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:38.308+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:38.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:38.605+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:38.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:38.897+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:38.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:38.940+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:39.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:39.279+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:39.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:39.591+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:39.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:39.897+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:39.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:39.946+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:40.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:40.291+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:40.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:40.619+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:40.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:40.879+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:40.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:40.924+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:41.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:41.274+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:41.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:41.661+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:41.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:41.887+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:41.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:41.905+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:42.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:42.294+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:42.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:42.677+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:42.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:42.871+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:42.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:42.922+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:43.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:43.270+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:43.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:43.678+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:43.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:43.882+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:43.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:43.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:44.305 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:44.303+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:44.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:44.713+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:44.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:44.833+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:44.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:44.906+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:45.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:45.307+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:45.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:45.727+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:45.804 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:20:45.801+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:20:45.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:45.826+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:45.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:45.864+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:46.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:46.280+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:46.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:46.727+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:46.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:46.786+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:46.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:46.846+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:47.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:47.297+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:47.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:47.758+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:47.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:47.827+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:47.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:47.883+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:48.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:48.279+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:48.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:48.747+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:48.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:48.838+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:48.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:48.838+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:49.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:49.294+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:49.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:49.766+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:49.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:49.807+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:49.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:49.868+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:50.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:50.246+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:50.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:50.732+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:50.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:50.830+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:50.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:50.833+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:51.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:51.199+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:51.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:51.747+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:51.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:51.840+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:51.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:51.874+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:52.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:52.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:52.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:52.765+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:52.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:52.861+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:52.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:52.900+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:53.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:53.172+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:53.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:53.729+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:53.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:53.878+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:53.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:53.891+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:54.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:54.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:54.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:54.747+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:54.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:54.897+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:54.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:54.911+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:55.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:55.141+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:55.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:55.699+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:55.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:55.852+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:55.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:55.885+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:56.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:56.187+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:56.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:56.736+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:56.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:56.853+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:56.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:56.923+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:57.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:57.139+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:57.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:57.752+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:57.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:57.835+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:57.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:57.965+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:58.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:58.137+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:58.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:58.800+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:58.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:58.807+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:58.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:58.958+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:59.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:20:59.169+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:59.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:20:59.804+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:59.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:20:59.839+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:59.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:20:59.937+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:20:59.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:20:59.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:21:00.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:00.173+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:00.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:00.767+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:00.806 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:21:00.805+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:21:00.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:00.864+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:00.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:00.963+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:01.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:01.197+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:01.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:01.724+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:01.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:01.891+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:01.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:01.992+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:02.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:02.177+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:02.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:02.697+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:02.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:02.878+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:02.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:02.986+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:03.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:03.180+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:03.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:03.665+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:03.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:03.875+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:03.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:03.967+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:04.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:04.227+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:04.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:04.615+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:04.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:04.859+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:04.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:04.936+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:05.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:05.197+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:05.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:05.610+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:05.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:05.810+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:05.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:05.905+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:06.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:06.202+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:06.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:06.595+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:06.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:06.832+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:06.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:06.904+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:07.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:07.240+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:07.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:07.615+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:07.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:07.808+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:07.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:07.913+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:08.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:08.234+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:08.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:08.568+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:08.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:08.815+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:08.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:08.932+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:09.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:09.251+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:09.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:09.549+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:09.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:09.787+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:09.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:09.907+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:10.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:10.296+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:10.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:10.525+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:10.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:10.775+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:10.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:10.937+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:11.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:11.259+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:11.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:11.506+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:11.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:11.740+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:11.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:11.896+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:12.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:12.284+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:12.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:12.548+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:12.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:12.713+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:12.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:12.909+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:13.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:13.251+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:13.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:13.567+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:13.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:13.671+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:13.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:13.930+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:14.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:14.201+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:14.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:14.537+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:14.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:14.686+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:14.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:14.927+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:15.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:15.165+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:15.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:15.530+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:15.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:15.735+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:15.822 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:21:15.820+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:21:15.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:15.918+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:16.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:16.128+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:16.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:16.517+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:16.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:16.759+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:16.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:16.928+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:17.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:17.144+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:17.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:17.552+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:17.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:17.745+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:17.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:17.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:18.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:18.173+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:18.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:18.564+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:18.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:18.737+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:18.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:18.874+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:19.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:19.213+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:19.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:19.558+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:19.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:19.702+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:19.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:19.871+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:20.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:20.190+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:20.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:20.509+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:20.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:20.665+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:20.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:20.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:21.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:21.208+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:21.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:21.510+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:21.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:21.708+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:21.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:21.913+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:22.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:22.231+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:22.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:22.466+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:22.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:22.728+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:22.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:22.877+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:23.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:23.204+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:23.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:23.442+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:23.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:23.688+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:23.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:23.920+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:24.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:24.173+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:24.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:24.439+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:24.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:24.706+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:24.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:24.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:25.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:25.208+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:25.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:25.479+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:25.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:25.729+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:25.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:25.910+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:26.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:26.224+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:26.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:26.519+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:26.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:26.687+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:26.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:26.954+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:27.231 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:27.229+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:27.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:27.501+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:27.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:27.675+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:27.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:27.926+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:28.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:28.179+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:28.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:28.545+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:28.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:28.712+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:28.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:28.932+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:29.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:29.195+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:29.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:29.578+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:29.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:29.733+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:29.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:29.888+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:30.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:21:30.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:21:30.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:30.195+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:30.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:30.561+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:30.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:30.727+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:30.826 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:21:30.824+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:21:30.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:30.870+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:31.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:31.151+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:31.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:31.599+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:31.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:31.743+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:31.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:31.891+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:32.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:32.136+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:32.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:32.555+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:32.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:32.719+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:32.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:32.868+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:33.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:33.114+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:33.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:33.537+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:33.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:33.748+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:33.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:33.853+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:34.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:34.146+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:34.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:34.579+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:34.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:34.779+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:34.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:34.874+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:35.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:35.118+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:35.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:35.589+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:35.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:35.826+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:35.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:35.909+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:36.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:36.156+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:36.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:36.573+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:36.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:36.842+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:36.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:36.930+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:37.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:37.159+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:37.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:37.598+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:37.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:37.860+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:37.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:37.913+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:38.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:38.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:38.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:38.564+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:38.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:38.824+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:38.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:38.918+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:39.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:39.175+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:39.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:39.567+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:39.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:39.871+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:39.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:39.931+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:40.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:40.216+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:40.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:40.526+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:40.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:40.902+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:40.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:40.963+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:41.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:41.251+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:41.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:41.523+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:41.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:41.868+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:41.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:41.916+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:42.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:42.210+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:42.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:42.503+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:42.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:42.884+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:42.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:42.940+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:43.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:43.204+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:43.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:43.489+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:43.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:43.857+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:43.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:43.894+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:44.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:44.191+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:44.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:44.481+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:44.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:44.883+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:44.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:44.895+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:45.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:45.232+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:45.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:45.489+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:45.843 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:21:45.840+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:21:45.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:45.869+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:45.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:45.890+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:46.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:46.204+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:46.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:46.465+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:46.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:46.852+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:46.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:46.917+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:47.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:47.218+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:47.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:47.417+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:47.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:47.804+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:47.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:47.914+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:48.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:48.214+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:48.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:48.405+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:48.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:48.763+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:48.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:48.937+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:49.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:49.213+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:49.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:49.431+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:49.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:49.811+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:49.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:49.987+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:50.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:50.234+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:50.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:50.417+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:50.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:50.840+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:50.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:50.970+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:51.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:51.262+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:51.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:51.410+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:51.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:51.815+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:51.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:51.974+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:52.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:52.303+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:52.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:52.361+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:52.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:52.814+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:53.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:53.005+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:53.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:53.264+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:53.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:53.331+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:53.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:53.769+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:53.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:53.996+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:54.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:54.302+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:54.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:54.313+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:54.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:54.786+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:54.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:54.955+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:55.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:55.276+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:55.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:55.357+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:55.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:55.763+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:55.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:55.948+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:56.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:56.231+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:56.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:56.398+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:56.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:56.789+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:56.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:56.976+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:57.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:57.278+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:57.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:57.376+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:57.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:57.812+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:57.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:57.973+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:58.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:58.259+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:58.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:58.406+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:58.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:58.780+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:58.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:58.993+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:59.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:21:59.301+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:59.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:21:59.432+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:59.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:21:59.734+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:21:59.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:21:59.951+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:00.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:22:00.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:22:00.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:00.334+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:00.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:00.449+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:00.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:00.718+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:00.854 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:22:00.852+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:22:00.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:00.944+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:01.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:01.348+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:01.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:01.458+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:01.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:01.681+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:01.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:01.963+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:02.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:02.347+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:02.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:02.420+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:02.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:02.634+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:02.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:02.928+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:03.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:03.338+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:03.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:03.416+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:03.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:03.619+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:03.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:03.938+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:04.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:04.327+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:04.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:04.455+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:04.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:04.591+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:04.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:04.965+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:05.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:05.289+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:05.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:05.449+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:05.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:05.553+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:06.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:06.015+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:06.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:06.332+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:06.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:06.477+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:06.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:06.589+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:07.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:07.052+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:07.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:07.294+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:07.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:07.467+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:07.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:07.571+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:08.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:08.074+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:08.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:08.255+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:08.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:08.490+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:08.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:08.599+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:09.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:09.039+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:09.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:09.245+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:09.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:09.485+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:09.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:09.612+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:10.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:10.067+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:10.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:10.237+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:10.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:10.466+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:10.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:10.597+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:11.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:11.030+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:11.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:11.236+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:11.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:11.495+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:11.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:11.616+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:12.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:12.065+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:12.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:12.214+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:12.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:12.506+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:12.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:12.628+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:13.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:13.025+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:13.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:13.197+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:13.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:13.531+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:13.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:13.657+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:14.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:14.018+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:14.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:14.227+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:14.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:14.569+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:14.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:14.640+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:15.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:15.018+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:15.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:15.223+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:15.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:15.570+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:15.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:15.678+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:15.870 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:22:15.867+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:22:16.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:16.052+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:16.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:16.212+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:16.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:16.548+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:16.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:16.684+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:17.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:17.096+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:17.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:17.164+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:17.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:17.552+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:17.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:17.650+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:18.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:18.130+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:18.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:18.134+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:18.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:18.577+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:18.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:18.613+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:19.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:19.128+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:19.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:19.135+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:19.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:19.529+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:19.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:19.590+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:20.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:20.084+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:20.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:20.115+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:20.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:20.525+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:20.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:20.612+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:21.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:21.057+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:21.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:21.110+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:21.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:21.490+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:21.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:21.614+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:22.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:22.075+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:22.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:22.106+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:22.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:22.477+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:22.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:22.592+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:23.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:23.065+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:23.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:23.083+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:23.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:23.515+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:23.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:23.608+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:24.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:24.050+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:24.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:24.065+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:24.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:24.500+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:24.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:24.587+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:25.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:25.025+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:25.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:25.096+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:25.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:25.500+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:25.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:25.551+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:26.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:26.022+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:26.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:26.055+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:26.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:26.478+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:26.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:26.545+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:27.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:27.026+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:27.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:27.056+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:27.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:27.429+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:27.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:27.574+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:28.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:28.041+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:28.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:28.086+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:28.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:28.450+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:28.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:28.573+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:29.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:29.001+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:29.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:29.083+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:29.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:29.445+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:29.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:29.623+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:30.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:30.007+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:30.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:30.104+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:30.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:22:30.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:22:30.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:30.471+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:30.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:30.611+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:30.886 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:22:30.883+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:22:30.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:30.961+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:31.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:31.132+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:31.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:31.426+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:31.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:31.648+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:31.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:31.925+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:32.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:32.156+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:32.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:32.409+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:32.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:32.641+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:32.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:32.974+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:33.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:33.165+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:33.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:33.446+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:33.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:33.612+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:34.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:34.021+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:34.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:34.190+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:34.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:34.469+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:34.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:34.642+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:35.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:35.024+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:35.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:35.160+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:35.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:35.443+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:35.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:35.637+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:36.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:36.027+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:36.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:36.207+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:36.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:36.443+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:36.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:36.626+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:37.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:37.077+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:37.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:37.200+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:37.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:37.402+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:37.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:37.628+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:38.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:38.120+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:38.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:38.202+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:38.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:38.382+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:38.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:38.632+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:39.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:39.097+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:39.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:39.180+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:39.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:39.421+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:39.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:39.594+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:40.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:40.134+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:40.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:40.145+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:40.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:40.419+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:40.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:40.551+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:41.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:41.109+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:41.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:41.159+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:41.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:41.424+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:41.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:41.526+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:42.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:42.132+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:42.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:42.165+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:42.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:42.429+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:42.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:42.515+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:43.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:43.140+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:43.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:43.178+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:43.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:43.397+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:43.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:43.499+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:44.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:44.118+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:44.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:44.142+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:44.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:44.389+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:44.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:44.484+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:45.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:45.117+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:45.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:45.172+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:45.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:45.413+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:45.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:45.437+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:45.888 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:22:45.886+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:22:46.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:46.147+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:46.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:46.154+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:46.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:46.368+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:46.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:46.435+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:47.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:47.109+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:47.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:47.184+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:47.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:47.357+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:47.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:47.462+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:48.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:48.077+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:48.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:48.142+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:48.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:48.331+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:48.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:48.414+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:49.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:49.074+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:49.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:49.121+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:49.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:49.337+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:49.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:49.414+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:50.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:50.046+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:50.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:50.124+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:50.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:50.303+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:50.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:50.451+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:51.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:51.017+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:51.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:51.148+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:51.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:51.271+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:51.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:51.486+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:51.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:51.981+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:52.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:52.154+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:52.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:52.271+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:52.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:52.531+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:53.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:52.997+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:53.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:53.111+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:53.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:53.299+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:53.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:53.516+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:54.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:54.034+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:54.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:54.069+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:54.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:54.299+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:54.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:54.534+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:55.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:55.009+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:55.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:55.087+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:55.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:55.321+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:55.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:55.492+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:56.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:56.034+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:56.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:56.059+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:56.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:56.316+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:56.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:56.457+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:57.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:57.069+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:57.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:57.095+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:57.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:57.300+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:57.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:57.412+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:58.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:58.100+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:58.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:58.120+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:58.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:58.296+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:58.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:58.432+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:59.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:22:59.091+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:59.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:22:59.163+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:59.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:22:59.308+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:22:59.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:22:59.448+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:00.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:00.092+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:00.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:00.201+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:00.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:00.327+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:00.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:23:00.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:23:00.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:00.415+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:00.904 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:23:00.901+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:23:01.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:01.047+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:01.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:01.178+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:01.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:01.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:01.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:01.367+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:02.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:02.082+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:02.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:02.224+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:02.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:02.296+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:02.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:02.391+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:03.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:03.068+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:03.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:03.191+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:03.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:03.276+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:03.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:03.382+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:04.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:04.038+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:04.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:04.237+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:04.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:04.295+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:04.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:04.387+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:05.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:05.020+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:05.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:05.246+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:05.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:05.279+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:05.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:05.338+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:05.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:05.977+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:06.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:06.270+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:06.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:06.292+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:06.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:06.382+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:07.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:07.003+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:07.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:07.262+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:07.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:07.334+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:07.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:07.424+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:08.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:08.027+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:08.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:08.226+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:08.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:08.324+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:08.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:08.390+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:09.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:09.032+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:09.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:09.235+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:09.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:09.326+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:09.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:09.349+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:10.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:10.070+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:10.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:10.231+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:10.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:10.310+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:10.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:10.355+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:11.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:11.113+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:11.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:11.181+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:11.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:11.321+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:11.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:11.325+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:12.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:12.133+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:12.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:12.136+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:12.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:12.306+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:12.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:12.359+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:13.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:13.113+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:13.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:13.176+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:13.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:13.271+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:13.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:13.398+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:14.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:14.140+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:14.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:14.223+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:14.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:14.225+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:14.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:14.373+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:15.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:15.179+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:15.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:15.189+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:15.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:15.271+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:15.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:15.333+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:15.917 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:23:15.914+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:23:16.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:16.192+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:16.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:16.211+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:16.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:16.254+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:16.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:16.304+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:17.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:17.165+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:17.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:17.179+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:17.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:17.207+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:17.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:17.306+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:18.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:18.188+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:18.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:18.216+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:18.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:18.224+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:18.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:18.356+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:19.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:19.164+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:19.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:19.177+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:19.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:19.210+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:19.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:19.336+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:20.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:20.139+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:20.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:20.192+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:20.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:20.242+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:20.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:20.305+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:21.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:21.184+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:21.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:21.234+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:21.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:21.242+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:21.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:21.345+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:22.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:22.157+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:22.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:22.215+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:22.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:22.260+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:22.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:22.342+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:23.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:23.167+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:23.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:23.178+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:23.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:23.271+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:23.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:23.381+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:24.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:24.171+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:24.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:24.207+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:24.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:24.246+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:24.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:24.364+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:25.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:25.176+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:25.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:25.217+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:25.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:25.247+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:25.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:25.330+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:26.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:26.208+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:26.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:26.212+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:26.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:26.236+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:26.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:26.316+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:27.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:27.168+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:27.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:27.221+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:27.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:27.240+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:27.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:27.306+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:28.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:28.186+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:28.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:28.208+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:28.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:28.246+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:28.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:28.274+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:29.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:29.178+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:29.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:29.229+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:29.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:29.231+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:29.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:29.240+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:30.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:30.143+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:30.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:30.222+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:30.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:30.229+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:30.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:30.254+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:30.492 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:23:30.495 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:23:30.932 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:23:30.930+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:23:31.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:31.181+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:31.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:31.249+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:31.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:31.254+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:31.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:31.275+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:32.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:32.221+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:32.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:32.235+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:32.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:32.262+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:32.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:32.288+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:33.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:33.215+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:33.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:33.221+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:33.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:33.268+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:33.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:33.319+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:34.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:34.199+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:34.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:34.210+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:34.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:34.268+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:34.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:34.337+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:35.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:35.196+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:35.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:35.229+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:35.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:35.246+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:35.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:35.359+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:36.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:36.209+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:36.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:36.254+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:36.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:36.262+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:36.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:36.332+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:37.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:37.182+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:37.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:37.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:37.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:37.300+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:37.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:37.301+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:38.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:38.137+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:38.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:38.283+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:38.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:38.299+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:38.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:38.335+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:39.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:39.106+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:39.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:39.261+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:39.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:39.281+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:39.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:39.382+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:40.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:40.139+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:40.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:40.241+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:40.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:40.299+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:40.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:40.413+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:41.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:41.092+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:41.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:41.212+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:41.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:41.257+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:41.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:41.439+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:42.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:42.080+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:42.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:42.221+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:42.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:42.297+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:42.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:42.458+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:43.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:43.038+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:43.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:43.205+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:43.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:43.258+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:43.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:43.501+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:44.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:44.082+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:44.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:44.223+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:44.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:44.256+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:44.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:44.490+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:45.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:45.066+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:45.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:45.248+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:45.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:45.290+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:45.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:45.498+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:45.948 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:23:45.946+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:23:46.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:46.107+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:46.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:46.294+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:46.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:46.295+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:46.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:46.468+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:47.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:47.124+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:47.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:47.247+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:47.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:47.337+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:47.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:47.419+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:48.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:48.079+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:48.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:48.233+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:48.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:48.319+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:48.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:48.420+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:49.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:49.054+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:49.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:49.185+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:49.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:49.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:49.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:49.436+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:50.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:50.078+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:50.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:50.142+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:50.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:50.332+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:50.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:50.473+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:51.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:51.085+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:51.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:51.126+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:51.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:51.340+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:51.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:51.448+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:52.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:52.097+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:52.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:52.099+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:52.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:52.308+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:52.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:52.482+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:53.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:53.056+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:53.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:53.061+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:53.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:53.287+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:53.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:53.446+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:54.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:54.015+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:54.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:54.080+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:54.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:54.284+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:54.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:54.415+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:54.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:54.969+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:55.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:55.039+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:55.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:55.284+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:55.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:55.368+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:55.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:55.987+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:56.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:56.027+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:56.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:56.325+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:56.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:56.334+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:57.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:57.003+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:57.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:57.004+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:57.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:57.300+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:57.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:57.346+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:57.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:57.956+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:57.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:57.977+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:58.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:58.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:58.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:58.378+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:58.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:58.913+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:58.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:58.951+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:59.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:23:59.339+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:59.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:23:59.401+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:59.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:23:59.963+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:23:59.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:23:59.965+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:00.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:00.308+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:00.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:00.400+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:00.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:24:00.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:24:00.964 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:24:00.963+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:24:00.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:00.974+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:00.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:00.980+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:01.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:01.290+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:01.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:01.425+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:02.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:01.998+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:02.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:02.023+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:02.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:02.317+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:02.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:02.457+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:03.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:03.004+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:03.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:03.030+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:03.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:03.273+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:03.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:03.436+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:04.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:04.016+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:04.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:04.028+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:04.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:04.300+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:04.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:04.453+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:04.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:04.992+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:05.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:05.070+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:05.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:05.328+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:05.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:05.498+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:06.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:05.999+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:06.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:06.118+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:06.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:06.328+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:06.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:06.516+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:07.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:07.040+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:07.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:07.144+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:07.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:07.365+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:07.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:07.541+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:08.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:08.080+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:08.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:08.114+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:08.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:08.371+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:08.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:08.563+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:09.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:09.055+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:09.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:09.131+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:09.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:09.380+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:09.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:09.519+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:10.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:10.089+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:10.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:10.116+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:10.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:10.424+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:10.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:10.498+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:11.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:11.121+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:11.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:11.163+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:11.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:11.418+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:11.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:11.482+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:12.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:12.142+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:12.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:12.167+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:12.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:12.377+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:12.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:12.506+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:13.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:13.183+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:13.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:13.189+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:13.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:13.344+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:13.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:13.536+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:14.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:14.143+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:14.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:14.212+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:14.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:14.357+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:14.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:14.553+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:15.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:15.142+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:15.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:15.179+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:15.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:15.359+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:15.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:15.516+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:15.974 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:24:15.971+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:24:16.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:16.158+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:16.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:16.196+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:16.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:16.355+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:16.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:16.536+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:17.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:17.180+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:17.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:17.208+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:17.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:17.404+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:17.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:17.513+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:18.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:18.192+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:18.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:18.229+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:18.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:18.373+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:18.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:18.522+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:19.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:19.219+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:19.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:19.220+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:19.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:19.395+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:19.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:19.515+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:20.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:20.191+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:20.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:20.213+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:20.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:20.378+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:20.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:20.532+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:21.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:21.168+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:21.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:21.249+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:21.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:21.348+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:21.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:21.542+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:22.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:22.150+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:22.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:22.254+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:22.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:22.350+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:22.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:22.527+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:23.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:23.110+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:23.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:23.256+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:23.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:23.345+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:23.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:23.553+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:24.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:24.102+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:24.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:24.279+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:24.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:24.372+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:24.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:24.593+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:25.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:25.102+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:25.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:25.253+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:25.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:25.337+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:25.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:25.575+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:26.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:26.111+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:26.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:26.216+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:26.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:26.302+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:26.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:26.603+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:27.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:27.141+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:27.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:27.232+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:27.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:27.272+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:27.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:27.613+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:28.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:28.186+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:28.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:28.195+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:28.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:28.253+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:28.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:28.598+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:29.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:29.177+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:29.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:29.182+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:29.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:29.248+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:29.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:29.621+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:30.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:30.138+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:30.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:30.171+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:30.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:30.277+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:30.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:30.628+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:30.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:24:30.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:24:30.980 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:24:30.978+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:24:31.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:31.128+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:31.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:31.182+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:31.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:31.284+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:31.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:31.643+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:32.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:32.092+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:32.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:32.222+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:32.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:32.244+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:32.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:32.660+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:33.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:33.095+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:33.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:33.248+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:33.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:33.272+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:33.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:33.688+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:34.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:34.072+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:34.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:34.226+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:34.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:34.262+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:34.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:34.641+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:35.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:35.071+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:35.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:35.267+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:35.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:35.310+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:35.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:35.601+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:36.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:36.082+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:36.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:36.301+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:36.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:36.315+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:36.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:36.648+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:37.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:37.060+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:37.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:37.271+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:37.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:37.277+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:37.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:37.655+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:38.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:38.027+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:38.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:38.264+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:38.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:38.314+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:38.668 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:38.666+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:39.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:39.053+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:39.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:39.231+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:39.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:39.288+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:39.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:39.694+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:40.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:40.037+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:40.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:40.269+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:40.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:40.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:40.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:40.679+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:41.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:41.034+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:41.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:41.300+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:41.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:41.343+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:41.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:41.704+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:41.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:41.986+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:42.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:42.300+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:42.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:42.338+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:42.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:42.709+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:42.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:42.965+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:43.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:43.295+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:43.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:43.318+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:43.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:43.693+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:44.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:43.994+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:44.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:44.272+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:44.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:44.344+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:44.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:44.717+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:45.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:45.005+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:45.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:45.272+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:45.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:45.319+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:45.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:45.720+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:45.993 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:24:45.990+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:24:46.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:45.999+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:46.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:46.240+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:46.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:46.270+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:46.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:46.726+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:47.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:47.013+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:47.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:47.244+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:47.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:47.270+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:47.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:47.752+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:47.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:47.991+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:48.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:48.205+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:48.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:48.302+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:48.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:48.710+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:49.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:49.011+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:49.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:49.193+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:49.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:49.314+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:49.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:49.671+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:50.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:50.035+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:50.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:50.242+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:50.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:50.275+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:50.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:50.674+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:50.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:50.990+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:51.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:51.261+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:51.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:51.264+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:51.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:51.705+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:51.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:51.950+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:52.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:52.273+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:52.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:52.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:52.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:52.704+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:52.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:52.912+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:53.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:53.269+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:53.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:53.342+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:53.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:53.710+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:53.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:53.939+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:54.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:54.308+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:54.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:54.380+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:54.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:54.742+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:54.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:54.893+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:55.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:55.272+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:55.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:55.363+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:55.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:55.775+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:55.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:55.906+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:56.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:56.247+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:56.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:56.394+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:56.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:56.732+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:56.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:56.887+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:57.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:57.234+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:57.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:57.408+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:57.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:57.700+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:57.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:57.894+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:58.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:58.187+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:58.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:58.380+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:58.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:58.740+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:58.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:58.880+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:59.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:24:59.193+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:59.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:24:59.334+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:59.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:24:59.695+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:24:59.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:24:59.912+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:00.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:00.186+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:00.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:00.319+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:00.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:00.740+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:00.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:25:00.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:25:00.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:00.879+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:01.008 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:25:01.006+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:25:01.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:01.194+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:01.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:01.304+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:01.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:01.737+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:01.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:01.906+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:02.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:02.226+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:02.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:02.270+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:02.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:02.692+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:02.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:02.876+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:03.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:03.259+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:03.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:03.298+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:03.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:03.697+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:03.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:03.853+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:04.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:04.252+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:04.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:04.273+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:04.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:04.666+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:04.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:04.869+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:05.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:05.224+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:05.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:05.280+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:05.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:05.657+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:05.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:05.874+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:06.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:06.236+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:06.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:06.255+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:06.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:06.673+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:06.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:06.900+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:07.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:07.227+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:07.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:07.230+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:07.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:07.639+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:07.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:07.899+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:08.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:08.228+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:08.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:08.233+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:08.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:08.598+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:08.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:08.859+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:09.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:09.195+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:09.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:09.244+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:09.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:09.581+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:09.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:09.859+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:10.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:10.204+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:10.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:10.228+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:10.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:10.594+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:10.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:10.897+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:11.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:11.171+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:11.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:11.270+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:11.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:11.567+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:11.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:11.894+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:12.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:12.164+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:12.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:12.258+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:12.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:12.589+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:12.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:12.908+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:13.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:13.199+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:13.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:13.255+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:13.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:13.639+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:13.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:13.924+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:14.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:14.243+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:14.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:14.286+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:14.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:14.622+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:14.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:14.919+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:15.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:15.275+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:15.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:15.284+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:15.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:15.669+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:15.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:15.930+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:16.024 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:25:16.022+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:25:16.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:16.296+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:16.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:16.322+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:16.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:16.674+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:16.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:16.888+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:17.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:17.272+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:17.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:17.333+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:17.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:17.663+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:17.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:17.906+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:18.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:18.236+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:18.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:18.289+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:18.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:18.697+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:18.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:18.919+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:19.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:19.234+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:19.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:19.295+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:19.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:19.743+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:19.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:19.890+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:20.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:20.208+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:20.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:20.277+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:20.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:20.751+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:20.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:20.919+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:21.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:21.185+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:21.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:21.296+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:21.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:21.772+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:21.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:21.931+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:22.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:22.182+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:22.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:22.260+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:22.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:22.743+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:22.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:22.927+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:23.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:23.143+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:23.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:23.305+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:23.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:23.725+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:23.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:23.976+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:24.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:24.123+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:24.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:24.334+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:24.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:24.728+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:24.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:24.935+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:25.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:25.150+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:25.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:25.336+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:25.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:25.710+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:25.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:25.907+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:26.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:26.116+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:26.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:26.312+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:26.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:26.670+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:26.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:26.886+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:27.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:27.148+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:27.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:27.329+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:27.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:27.715+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:27.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:27.867+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:28.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:28.184+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:28.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:28.328+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:28.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:28.715+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:28.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:28.868+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:29.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:29.226+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:29.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:29.329+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:29.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:29.709+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:29.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:29.914+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:30.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:30.181+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:30.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:30.300+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:30.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:30.671+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:30.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:25:30.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:25:30.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:30.956+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:31.038 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:25:31.036+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:25:31.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:31.166+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:31.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:31.329+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:31.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:31.632+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:31.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:31.982+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:32.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:32.159+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:32.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:32.356+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:32.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:32.667+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:32.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:32.945+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:33.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:33.136+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:33.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:33.358+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:33.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:33.691+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:33.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:33.924+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:34.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:34.100+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:34.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:34.311+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:34.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:34.693+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:34.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:34.878+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:35.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:35.145+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:35.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:35.296+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:35.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:35.689+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:35.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:35.873+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:36.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:36.107+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:36.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:36.301+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:36.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:36.683+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:36.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:36.892+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:37.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:37.087+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:37.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:37.315+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:37.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:37.661+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:37.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:37.900+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:38.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:38.076+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:38.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:38.319+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:38.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:38.621+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:38.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:38.876+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:39.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:39.051+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:39.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:39.363+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:39.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:39.638+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:39.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:39.909+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:40.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:40.099+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:40.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:40.363+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:40.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:40.589+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:40.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:40.910+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:41.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:41.056+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:41.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:41.344+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:41.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:41.574+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:41.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:41.892+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:42.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:42.083+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:42.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:42.359+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:42.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:42.527+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:42.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:42.850+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:43.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:43.090+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:43.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:43.393+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:43.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:43.536+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:43.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:43.832+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:44.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:44.139+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:44.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:44.397+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:44.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:44.488+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:44.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:44.874+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:45.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:45.145+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:45.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:45.436+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:45.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:45.494+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:45.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:45.922+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:46.054 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:25:46.052+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:25:46.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:46.162+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:46.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:46.433+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:46.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:46.470+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:46.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:46.915+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:47.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:47.150+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:47.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:47.435+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:47.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:47.456+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:47.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:47.914+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:48.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:48.170+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:48.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:48.425+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:48.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:48.443+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:48.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:48.913+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:49.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:49.219+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:49.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:49.417+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:49.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:49.466+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:49.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:49.942+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:50.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:50.221+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:50.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:50.412+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:50.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:50.458+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:50.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:50.990+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:51.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:51.191+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:51.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:51.422+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:51.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:51.448+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:52.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:52.004+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:52.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:52.215+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:52.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:52.445+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:52.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:52.472+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:53.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:53.004+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:53.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:53.221+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:53.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:53.396+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:53.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:53.512+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:53.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:53.996+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:54.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:54.202+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:54.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:54.355+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:54.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:54.499+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:54.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:54.971+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:55.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:55.224+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:55.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:55.344+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:55.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:55.526+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:55.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:55.928+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:56.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:56.209+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:56.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:56.334+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:56.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:56.558+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:56.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:56.908+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:57.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:57.166+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:57.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:57.361+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:57.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:57.596+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:57.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:57.879+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:58.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:58.190+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:58.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:58.353+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:58.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:58.631+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:58.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:58.853+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:59.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:25:59.153+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:59.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:25:59.357+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:59.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:25:59.670+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:25:59.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:25:59.880+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:00.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:00.131+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:00.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:00.307+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:00.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:00.639+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:00.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:00.903+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:01.057 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:26:01.054+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:26:01.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:26:01.110 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:26:01.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:01.180+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:01.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:01.302+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:01.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:01.609+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:01.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:01.875+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:02.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:02.198+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:02.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:02.308+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:02.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:02.604+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:02.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:02.830+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:03.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:03.181+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:03.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:03.298+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:03.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:03.592+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:03.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:03.849+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:04.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:04.196+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:04.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:04.324+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:04.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:04.633+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:04.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:04.868+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:05.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:05.175+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:05.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:05.325+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:05.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:05.638+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:05.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:05.888+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:06.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:06.145+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:06.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:06.367+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:06.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:06.627+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:06.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:06.936+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:07.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:07.186+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:07.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:07.370+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:07.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:07.633+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:07.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:07.951+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:08.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:08.217+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:08.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:08.378+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:08.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:08.587+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:08.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:08.981+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:09.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:09.175+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:09.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:09.422+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:09.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:09.547+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:09.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:09.946+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:10.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:10.203+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:10.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:10.454+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:10.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:10.554+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:10.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:10.914+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:11.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:11.178+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:11.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:11.467+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:11.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:11.511+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:11.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:11.893+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:12.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:12.162+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:12.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:12.478+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:12.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:12.553+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:12.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:12.904+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:13.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:13.189+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:13.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:13.436+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:13.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:13.515+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:13.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:13.908+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:14.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:14.175+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:14.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:14.438+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:14.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:14.553+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:14.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:14.922+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:15.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:15.220+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:15.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:15.416+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:15.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:15.579+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:15.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:15.932+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:16.073 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:26:16.070+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:26:16.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:16.262+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:16.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:16.420+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:16.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:16.537+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:16.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:16.970+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:17.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:17.218+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:17.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:17.381+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:17.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:17.510+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:17.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:17.959+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:18.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:18.259+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:18.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:18.407+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:18.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:18.540+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:18.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:18.980+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:19.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:19.221+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:19.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:19.411+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:19.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:19.523+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:19.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:19.956+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:20.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:20.206+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:20.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:20.423+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:20.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:20.486+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:20.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:20.974+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:21.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:21.210+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:21.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:21.463+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:21.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:21.488+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:21.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:21.967+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:22.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:22.168+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:22.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:22.459+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:22.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:22.501+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:22.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:22.979+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:23.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:23.127+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:23.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:23.454+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:23.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:23.510+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:24.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:24.019+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:24.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:24.086+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:24.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:24.497+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:24.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:24.546+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:25.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:25.063+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:25.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:25.090+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:25.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:25.519+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:25.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:25.556+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:26.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:26.062+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:26.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:26.074+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:26.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:26.488+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:26.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:26.581+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:27.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:27.036+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:27.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:27.085+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:27.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:27.461+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:27.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:27.564+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:28.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:28.051+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:28.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:28.086+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:28.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:28.413+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:28.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:28.569+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:29.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:29.048+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:29.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:29.126+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:29.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:29.395+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:29.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:29.585+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:30.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:30.053+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:30.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:30.156+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:30.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:30.397+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:30.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:30.598+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:31.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:31.003+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:31.088 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:26:31.087+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:26:31.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:31.144+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:31.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:26:31.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:26:31.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:31.384+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:31.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:31.622+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:32.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:32.042+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:32.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:32.178+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:32.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:32.346+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:32.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:32.608+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:33.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:33.038+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:33.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:33.157+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:33.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:33.358+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:33.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:33.566+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:34.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:34.088+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:34.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:34.126+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:34.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:34.384+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:34.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:34.579+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:35.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:35.058+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:35.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:35.116+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:35.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:35.402+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:35.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:35.585+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:36.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:36.027+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:36.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:36.164+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:36.360 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:36.357+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:36.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:36.588+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:36.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:36.991+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:37.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:37.175+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:37.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:37.353+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:37.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:37.632+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:38.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:38.038+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:38.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:38.171+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:38.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:38.391+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:38.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:38.669+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:39.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:39.012+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:39.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:39.209+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:39.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:39.434+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:39.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:39.714+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:40.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:40.059+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:40.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:40.238+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:40.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:40.470+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:40.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:40.672+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:41.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:41.027+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:41.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:41.265+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:41.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:41.445+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:41.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:41.716+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:42.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:42.017+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:42.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:42.311+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:42.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:42.448+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:42.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:42.669+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:43.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:43.012+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:43.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:43.353+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:43.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:43.487+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:43.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:43.678+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:44.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:44.041+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:44.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:44.310+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:44.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:44.487+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:44.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:44.678+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:45.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:45.064+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:45.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:45.309+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:45.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:45.487+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:45.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:45.694+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:46.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:46.030+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:46.104 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:26:46.102+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:26:46.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:46.279+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:46.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:46.443+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:46.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:46.741+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:47.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:47.014+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:47.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:47.301+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:47.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:47.456+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:47.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:47.769+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:48.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:48.007+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:48.272 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:48.271+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:48.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:48.462+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:48.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:48.760+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:48.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:48.994+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:49.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:49.232+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:49.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:49.429+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:49.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:49.806+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:49.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:49.961+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:50.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:50.184+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:50.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:50.431+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:50.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:50.758+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:50.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:50.965+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:51.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:51.179+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:51.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:51.474+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:51.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:51.742+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:51.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:51.954+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:52.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:52.188+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:52.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:52.500+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:52.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:52.755+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:52.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:52.943+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:53.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:53.161+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:53.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:53.545+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:53.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:53.776+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:53.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:53.917+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:54.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:54.209+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:54.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:54.531+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:54.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:54.737+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:54.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:54.885+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:55.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:55.162+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:55.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:55.484+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:55.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:55.747+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:55.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:55.921+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:56.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:56.163+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:56.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:56.522+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:56.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:56.755+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:56.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:56.952+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:57.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:57.145+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:57.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:57.500+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:57.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:57.711+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:57.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:57.996+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:58.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:58.158+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:58.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:58.482+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:58.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:58.682+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:59.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:59.011+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:59.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:26:59.113+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:59.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:26:59.507+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:59.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:26:59.656+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:26:59.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:26:59.980+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:00.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:00.110+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:00.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:00.504+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:00.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:00.692+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:00.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:00.943+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:01.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:01.103+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:01.120 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:27:01.118+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:27:01.345 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:27:01.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:27:01.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:01.513+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:01.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:01.659+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:01.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:01.927+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:02.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:02.088+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:02.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:02.529+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:02.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:02.659+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:02.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:02.969+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:03.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:03.080+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:03.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:03.497+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:03.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:03.694+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:04.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:04.008+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:04.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:04.114+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:04.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:04.450+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:04.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:04.662+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:05.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:05.000+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:05.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:05.087+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:05.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:05.464+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:05.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:05.646+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:06.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:06.016+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:06.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:06.089+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:06.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:06.423+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:06.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:06.640+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:06.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:06.988+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:07.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:07.121+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:07.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:07.446+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:07.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:07.592+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:07.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:07.973+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:08.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:08.093+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:08.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:08.408+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:08.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:08.628+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:09.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:09.017+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:09.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:09.068+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:09.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:09.449+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:09.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:09.670+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:10.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:10.062+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:10.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:10.071+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:10.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:10.484+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:10.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:10.662+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:11.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:11.033+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:11.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:11.045+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:11.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:11.504+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:11.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:11.682+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:12.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:12.054+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:12.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:12.077+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:12.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:12.469+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:12.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:12.724+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:13.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:13.059+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:13.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:13.076+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:13.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:13.458+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:13.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:13.681+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:14.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:14.048+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:14.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:14.053+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:14.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:14.471+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:14.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:14.726+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:15.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:15.024+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:15.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:15.027+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:15.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:15.499+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:15.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:15.683+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:15.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:15.979+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:16.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:16.035+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:16.136 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:27:16.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:27:16.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:16.480+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:16.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:16.686+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:16.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:16.987+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:17.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:17.048+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:17.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:17.525+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:17.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:17.676+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:17.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:17.973+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:18.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:18.008+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:18.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:18.481+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:18.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:18.640+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:18.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:18.943+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:18.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:18.974+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:19.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:19.431+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:19.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:19.681+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:19.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:19.941+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:20.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:20.021+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:20.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:20.381+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:20.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:20.691+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:20.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:20.947+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:21.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:21.014+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:21.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:21.415+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:21.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:21.704+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:21.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:21.935+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:22.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:22.029+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:22.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:22.446+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:22.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:22.741+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:22.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:22.983+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:23.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:23.026+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:23.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:23.446+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:23.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:23.783+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:24.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:24.026+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:24.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:24.040+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:24.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:24.490+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:24.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:24.776+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:24.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:24.991+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:25.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:25.021+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:25.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:25.506+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:25.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:25.806+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:25.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:25.969+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:26.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:26.039+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:26.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:26.547+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:26.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:26.787+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:27.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:27.013+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:27.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:27.055+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:27.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:27.551+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:27.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:27.746+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:27.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:27.989+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:28.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:28.091+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:28.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:28.587+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:28.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:28.722+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:28.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:28.983+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:29.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:29.106+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:29.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:29.562+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:29.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:29.730+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:30.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:30.009+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:30.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:30.068+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:30.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:30.576+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:30.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:30.693+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:31.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:31.029+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:31.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:31.060+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:31.151 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:27:31.150+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:27:31.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:27:31.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:27:31.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:31.594+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:31.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:31.644+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:32.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:32.007+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:32.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:32.027+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:32.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:32.614+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:32.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:32.628+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:33.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:33.016+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:33.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:33.074+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:33.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:33.643+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:33.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:33.662+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:33.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:33.996+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:34.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:34.064+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:34.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:34.595+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:34.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:34.672+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:34.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:34.984+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:35.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:35.092+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:35.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:35.601+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:35.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:35.711+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:35.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:35.943+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:36.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:36.104+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:36.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:36.558+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:36.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:36.734+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:36.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:36.907+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:37.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:37.106+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:37.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:37.534+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:37.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:37.780+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:37.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:37.882+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:38.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:38.120+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:38.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:38.532+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:38.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:38.765+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:38.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:38.876+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:39.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:39.078+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:39.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:39.557+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:39.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:39.759+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:39.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:39.846+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:40.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:40.052+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:40.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:40.561+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:40.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:40.801+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:40.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:40.830+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:41.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:41.097+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:41.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:41.567+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:41.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:41.797+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:41.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:41.824+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:42.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:42.067+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:42.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:42.563+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:42.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:42.775+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:42.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:42.846+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:43.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:43.098+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:43.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:43.580+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:43.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:43.801+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:43.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:43.889+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:44.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:44.113+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:44.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:44.615+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:44.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:44.846+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:44.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:44.900+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:45.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:45.092+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:45.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:45.657+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:45.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:45.874+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:45.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:45.903+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:46.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:46.066+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:46.167 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:27:46.165+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:27:46.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:46.637+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:46.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:46.867+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:46.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:46.935+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:47.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:47.106+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:47.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:47.604+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:47.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:47.855+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:47.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:47.975+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:48.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:48.106+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:48.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:48.555+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:48.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:48.905+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:48.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:48.942+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:49.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:49.086+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:49.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:49.512+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:49.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:49.868+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:49.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:49.962+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:50.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:50.049+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:50.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:50.559+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:50.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:50.887+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:50.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:50.970+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:51.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:51.052+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:51.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:51.573+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:51.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:51.866+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:51.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:51.940+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:52.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:52.094+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:52.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:52.582+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:52.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:52.890+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:52.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:52.925+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:53.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:53.123+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:53.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:53.631+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:53.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:53.893+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:53.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:53.940+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:54.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:54.116+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:54.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:54.650+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:54.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:54.900+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:54.918 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:54.916+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:55.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:55.097+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:55.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:55.643+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:55.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:55.883+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:55.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:55.958+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:56.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:56.144+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:56.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:56.660+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:56.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:56.927+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:56.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:56.954+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:57.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:57.142+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:57.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:57.628+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:57.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:57.880+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:57.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:57.957+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:58.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:58.154+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:58.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:58.592+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:58.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:58.855+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:58.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:58.986+0000 7f72c425d700 -1 osd.5 114 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:59.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:27:59.147+0000 7f389e18e700 -1 osd.4 114 get_health_metrics reporting 67 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:59.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:27:59.589+0000 7f596d92c700 -1 osd.6 114 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:59.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:27:59.824+0000 7f6e44c9f700 -1 osd.7 114 get_health_metrics reporting 51 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:27:59.885 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T02:27:59.883+0000 7faec1d84700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:27:59.900 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T02:27:59.883+0000 7faec1d84700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:27:59.922 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T02:27:59.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:27:59.951+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:00.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:00.196+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:00.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:00.568+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:00.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:00.828+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:00.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:00.926+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:01.170 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:28:01.167+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:28:01.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:01.242+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:01.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:28:01.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:28:01.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:01.571+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:01.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:01.838+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:01.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:01.923+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:02.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:02.266+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:02.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:02.601+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:02.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:02.821+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:02.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:02.892+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:03.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:03.274+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:03.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:03.592+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:03.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:03.787+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:03.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:03.858+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:04.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:04.312+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:04.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:04.566+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:04.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:04.819+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:04.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:04.874+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:05.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:05.329+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:05.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:05.539+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:05.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:05.828+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:05.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:05.882+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:06.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:06.289+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:06.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:06.515+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:06.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:06.839+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:06.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:06.839+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:07.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:07.333+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:07.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:07.471+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:07.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:07.800+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:07.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:07.839+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:08.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:08.319+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:08.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:08.513+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:08.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:08.807+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:08.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:08.844+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:09.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:09.310+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:09.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:09.550+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:09.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:09.798+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:09.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:09.801+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:10.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:10.335+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:10.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:10.516+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:10.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:10.817+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:10.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:10.834+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:11.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:11.295+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:11.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:11.473+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:11.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:11.827+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:11.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:11.838+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:12.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:12.246+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:12.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:12.464+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:12.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:12.821+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:12.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:12.858+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:13.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:13.248+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:13.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:13.494+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:13.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:13.862+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:13.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:13.896+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:14.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:14.241+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:14.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:14.510+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:14.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:14.869+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:14.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:14.895+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:15.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:15.252+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:15.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:15.558+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:15.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:15.899+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:15.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:15.901+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:16.186 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:28:16.184+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:28:16.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:16.268+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:16.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:16.551+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:16.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:16.912+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:16.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:16.923+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:17.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:17.307+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:17.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:17.591+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:17.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:17.953+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:17.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:17.960+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:18.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:18.324+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:18.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:18.605+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:18.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:18.933+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:18.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:18.974+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:19.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:19.307+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:19.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:19.639+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:19.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:19.950+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:20.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:20.021+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:20.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:20.294+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:20.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:20.593+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:20.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:20.974+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:20.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:20.996+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:21.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:21.265+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:21.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:21.560+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:21.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:21.932+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:21.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:21.952+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:22.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:22.250+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:22.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:22.530+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:22.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:22.934+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:22.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:22.966+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:23.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:23.244+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:23.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:23.529+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:23.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:23.922+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:23.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:23.951+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:24.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:24.207+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:24.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:24.578+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:24.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:24.913+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:24.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:24.934+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:25.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:25.213+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:25.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:25.548+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:25.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:25.876+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:25.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:25.968+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:26.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:26.175+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:26.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:26.527+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:26.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:26.883+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:27.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:27.009+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:27.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:27.154+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:27.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:27.573+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:27.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:27.858+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:28.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:28.022+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:28.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:28.171+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:28.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:28.581+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:28.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:28.901+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:29.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:29.064+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:29.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:29.209+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:29.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:29.542+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:29.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:29.933+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:30.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:30.077+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:30.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:30.220+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:30.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:30.495+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:30.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:30.967+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:31.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:31.112+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:31.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:31.190+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:31.195 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:28:31.193+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:28:31.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:31.509+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:31.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:28:31.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:28:31.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:31.981+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:32.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:32.144+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:32.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:32.221+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:32.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:32.479+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:32.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:32.964+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:33.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:33.145+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:33.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:33.247+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:33.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:33.508+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:33.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:33.950+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:34.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:34.132+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:34.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:34.230+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:34.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:34.522+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:34.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:34.987+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:35.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:35.176+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:35.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:35.227+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:35.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:35.558+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:36.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:36.025+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:36.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:36.159+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:36.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:36.180+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:36.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:36.521+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:37.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:37.074+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:37.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:37.139+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:37.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:37.208+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:37.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:37.518+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:38.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:38.028+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:38.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:38.171+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:38.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:38.250+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:38.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:38.526+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:39.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:38.999+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:39.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:39.215+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:39.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:39.257+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:39.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:39.482+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:40.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:40.034+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:40.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:40.255+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:40.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:40.303+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:40.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:40.504+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:41.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:41.084+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:41.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:41.299+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:41.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:41.304+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:41.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:41.467+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:42.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:42.042+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:42.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:42.330+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:42.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:42.335+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:42.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:42.496+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:43.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:43.025+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:43.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:43.329+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:43.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:43.350+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:43.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:43.538+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:44.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:44.000+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:44.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:44.298+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:44.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:44.313+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:44.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:44.506+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:44.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:44.983+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:45.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:45.306+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:45.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:45.338+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:45.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:45.493+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:45.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:45.944+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:46.199 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:28:46.196+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:28:46.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:46.262+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:46.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:46.321+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:46.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:46.518+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:46.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:46.980+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:47.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:47.242+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:47.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:47.321+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:47.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:47.554+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:48.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:48.029+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:48.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:48.273+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:48.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:48.367+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:48.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:48.555+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:49.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:48.997+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:49.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:49.233+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:49.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:49.349+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:49.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:49.538+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:49.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:49.969+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:50.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:50.239+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:50.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:50.312+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:50.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:50.587+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:50.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:50.940+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:51.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:51.271+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:51.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:51.315+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:51.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:51.563+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:51.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:51.933+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:52.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:52.296+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:52.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:52.339+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:52.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:52.527+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:52.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:52.979+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:53.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:53.320+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:53.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:53.339+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:53.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:53.520+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:54.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:54.023+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:54.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:54.335+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:54.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:54.342+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:54.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:54.526+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:55.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:55.053+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:55.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:55.345+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:55.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:55.361+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:55.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:55.483+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:56.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:56.064+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:56.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:56.305+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:56.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:56.368+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:56.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:56.494+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:57.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:57.035+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:57.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:57.337+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:57.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:57.394+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:57.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:57.500+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:58.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:58.025+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:58.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:58.380+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:58.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:58.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:58.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:58.474+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:58.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:58.984+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:59.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:28:59.392+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:59.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:28:59.420+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:59.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:28:59.433+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:28:59.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:28:59.963+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:00.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:00.410+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:00.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:00.424+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:00.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:00.477+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:00.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:00.914+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:01.212 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:29:01.209+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:29:01.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:01.441+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:01.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:01.441+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:01.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:01.508+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:01.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:29:01.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:29:01.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:01.869+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:02.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:02.430+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:02.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:02.483+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:02.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:02.485+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:02.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:02.826+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:03.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:03.431+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:03.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:03.438+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:03.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:03.532+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:03.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:03.823+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:04.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:04.398+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:04.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:04.442+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:04.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:04.508+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:04.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:04.852+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:05.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:05.374+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:05.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:05.459+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:05.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:05.476+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:05.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:05.891+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:06.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:06.358+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:06.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:06.485+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:06.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:06.502+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:06.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:06.847+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:07.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:07.333+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:07.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:07.453+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:07.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:07.485+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:07.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:07.800+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:08.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:08.302+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:08.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:08.443+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:08.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:08.535+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:08.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:08.794+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:09.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:09.353+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:09.405 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:09.403+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:09.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:09.538+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:09.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:09.841+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:10.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:10.359+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:10.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:10.419+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:10.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:10.551+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:10.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:10.890+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:11.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:11.408+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:11.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:11.434+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:11.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:11.559+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:11.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:11.850+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:12.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:12.381+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:12.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:12.463+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:12.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:12.518+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:12.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:12.826+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:13.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:13.388+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:13.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:13.471+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:13.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:13.486+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:13.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:13.866+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:14.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:14.392+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:14.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:14.455+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:14.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:14.475+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:14.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:14.894+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:15.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:15.425+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:15.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:15.436+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:15.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:15.440+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:15.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:15.848+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:16.227 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:29:16.225+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:29:16.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:16.402+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:16.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:16.442+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:16.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:16.449+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:16.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:16.803+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:17.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:17.392+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:17.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:17.418+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:17.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:17.493+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:17.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:17.837+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:18.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:18.410+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:18.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:18.411+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:18.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:18.506+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:18.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:18.854+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:19.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:19.375+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:19.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:19.436+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:19.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:19.514+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:19.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:19.827+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:20.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:20.339+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:20.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:20.415+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:20.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:20.465+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:20.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:20.782+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:21.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:21.290+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:21.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:21.379+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:21.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:21.490+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:21.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:21.783+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:22.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:22.333+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:22.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:22.396+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:22.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:22.524+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:22.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:22.792+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:23.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:23.323+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:23.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:23.444+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:23.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:23.533+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:23.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:23.813+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:24.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:24.367+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:24.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:24.433+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:24.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:24.514+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:24.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:24.843+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:25.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:25.417+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:25.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:25.433+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:25.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:25.530+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:25.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:25.826+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:26.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:26.423+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:26.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:26.437+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:26.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:26.514+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:26.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:26.816+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:27.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:27.391+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:27.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:27.447+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:27.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:27.538+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:27.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:27.854+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:28.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:28.388+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:28.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:28.494+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:28.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:28.549+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:28.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:28.825+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:29.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:29.418+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:29.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:29.519+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:29.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:29.530+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:29.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:29.819+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:30.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:30.423+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:30.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:30.494+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:30.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:30.576+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:30.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:30.772+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:31.231 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:29:31.230+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:29:31.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:31.429+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:31.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:31.525+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:31.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:31.552+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:31.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:31.748+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:31.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:29:31.888 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:29:32.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:32.397+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:32.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:32.477+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:32.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:32.541+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:32.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:32.705+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:33.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:33.351+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:33.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:33.455+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:33.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:33.589+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:33.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:33.683+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:34.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:34.319+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:34.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:34.498+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:34.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:34.541+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:34.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:34.689+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:35.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:35.294+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:35.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:35.468+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:35.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:35.545+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:35.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:35.690+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:36.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:36.254+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:36.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:36.471+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:36.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:36.529+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:36.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:36.683+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:37.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:37.205+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:37.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:37.424+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:37.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:37.532+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:37.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:37.691+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:38.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:38.255+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:38.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:38.410+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:38.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:38.545+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:38.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:38.731+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:39.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:39.306+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:39.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:39.459+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:39.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:39.594+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:39.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:39.730+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:40.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:40.263+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:40.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:40.467+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:40.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:40.556+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:40.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:40.699+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:41.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:41.231+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:41.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:41.460+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:41.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:41.580+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:41.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:41.713+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:42.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:42.236+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:42.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:42.485+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:42.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:42.536+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:42.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:42.717+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:43.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:43.240+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:43.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:43.480+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:43.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:43.512+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:43.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:43.672+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:44.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:44.246+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:44.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:44.472+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:44.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:44.489+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:44.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:44.720+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:45.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:45.209+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:45.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:45.442+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:45.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:45.484+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:45.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:45.673+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:46.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:46.219+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:46.235 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:29:46.233+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:29:46.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:46.394+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:46.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:46.474+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:46.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:46.634+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:47.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:47.256+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:47.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:47.401+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:47.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:47.472+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:47.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:47.637+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:48.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:48.216+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:48.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:48.362+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:48.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:48.464+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:48.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:48.629+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:49.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:49.171+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:49.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:49.336+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:49.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:49.438+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:49.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:49.663+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:50.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:50.138+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:50.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:50.298+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:50.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:50.394+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:50.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:50.633+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:51.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:51.097+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:51.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:51.272+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:51.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:51.424+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:51.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:51.620+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:52.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:52.117+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:52.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:52.254+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:52.445 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:52.443+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:52.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:52.638+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:53.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:53.078+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:53.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:53.212+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:53.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:53.485+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:53.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:53.683+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:54.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:54.121+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:54.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:54.231+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:54.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:54.505+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:54.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:54.701+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:55.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:55.125+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:55.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:55.235+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:55.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:55.503+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:55.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:55.680+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:56.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:56.136+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:56.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:56.208+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:56.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:56.545+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:56.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:56.642+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:57.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:57.160+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:57.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:57.164+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:57.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:57.565+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:57.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:57.645+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:58.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:58.157+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:58.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:58.179+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:58.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:58.519+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:58.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:58.686+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:59.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:29:59.159+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:59.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:29:59.220+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:59.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:29:59.482+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:29:59.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:29:59.685+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:00.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:00.116+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:00.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:00.262+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:00.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:00.516+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:00.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:00.700+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:01.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:01.127+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:01.251 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:30:01.249+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:30:01.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:01.277+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:01.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:01.556+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:01.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:01.672+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:02.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:30:02.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:30:02.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:02.143+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:02.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:02.302+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:02.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:02.593+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:02.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:02.656+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:03.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:03.180+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:03.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:03.341+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:03.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:03.553+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:03.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:03.629+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:04.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:04.204+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:04.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:04.332+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:04.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:04.592+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:04.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:04.639+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:05.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:05.194+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:05.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:05.335+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:05.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:05.574+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:05.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:05.666+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:06.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:06.180+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:06.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:06.296+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:06.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:06.590+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:06.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:06.670+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:07.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:07.158+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:07.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:07.251+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:07.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:07.603+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:07.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:07.622+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:08.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:08.126+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:08.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:08.242+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:08.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:08.635+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:08.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:08.650+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:09.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:09.140+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:09.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:09.224+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:09.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:09.634+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:09.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:09.636+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:10.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:10.165+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:10.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:10.233+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:10.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:10.623+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:10.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:10.646+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:11.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:11.193+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:11.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:11.194+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:11.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:11.617+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:11.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:11.643+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:12.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:12.170+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:12.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:12.189+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:12.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:12.652+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:12.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:12.652+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:13.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:13.155+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:13.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:13.187+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:13.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:13.606+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:13.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:13.702+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:14.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:14.142+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:14.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:14.225+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:14.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:14.633+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:14.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:14.718+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:15.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:15.175+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:15.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:15.192+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:15.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:15.679+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:15.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:15.700+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:16.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:16.143+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:16.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:16.190+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:16.266 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:30:16.264+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:30:16.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:16.705+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:16.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:16.708+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:17.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:17.145+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:17.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:17.169+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:17.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:17.657+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:17.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:17.745+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:18.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:18.183+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:18.185 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:18.184+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:18.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:18.638+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:18.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:18.742+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:19.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:19.135+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:19.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:19.205+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:19.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:19.655+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:19.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:19.718+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:20.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:20.122+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:20.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:20.206+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:20.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:20.695+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:20.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:20.755+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:21.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:21.126+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:21.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:21.165+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:21.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:21.713+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:21.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:21.715+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:22.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:22.123+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:22.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:22.180+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:22.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:22.666+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:22.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:22.666+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:23.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:23.096+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:23.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:23.220+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:23.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:23.644+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:23.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:23.654+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:24.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:24.062+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:24.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:24.265+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:24.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:24.600+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:24.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:24.670+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:25.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:25.060+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:25.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:25.307+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:25.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:25.645+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:25.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:25.672+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:26.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:26.087+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:26.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:26.324+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:26.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:26.634+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:26.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:26.699+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:27.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:27.063+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:27.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:27.324+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:27.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:27.616+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:27.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:27.706+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:28.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:28.102+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:28.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:28.348+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:28.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:28.608+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:28.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:28.717+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:29.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:29.136+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:29.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:29.372+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:29.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:29.579+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:29.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:29.671+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:30.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:30.174+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:30.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:30.379+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:30.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:30.622+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:30.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:30.623+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:31.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:31.125+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:31.275 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:30:31.272+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:30:31.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:31.365+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:31.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:31.578+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:31.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:31.665+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:32.149 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:30:32.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:30:32.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:32.171+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:32.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:32.360+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:32.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:32.585+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:32.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:32.642+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:33.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:33.214+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:33.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:33.381+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:33.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:33.548+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:33.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:33.609+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:34.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:34.167+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:34.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:34.365+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:34.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:34.525+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:34.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:34.569+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:35.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:35.189+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:35.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:35.403+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:35.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:35.528+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:35.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:35.551+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:36.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:36.211+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:36.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:36.354+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:36.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:36.496+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:36.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:36.572+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:37.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:37.177+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:37.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:37.388+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:37.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:37.463+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:37.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:37.550+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:38.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:38.185+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:38.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:38.363+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:38.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:38.504+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:38.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:38.505+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:39.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:39.201+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:39.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:39.390+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:39.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:39.534+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:39.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:39.549+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:40.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:40.213+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:40.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:40.360+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:40.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:40.533+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:40.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:40.581+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:41.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:41.176+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:41.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:41.373+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:41.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:41.548+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:41.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:41.577+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:42.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:42.168+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:42.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:42.405+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:42.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:42.532+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:42.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:42.603+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:43.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:43.206+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:43.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:43.386+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:43.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:43.493+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:43.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:43.630+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:44.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:44.163+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:44.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:44.380+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:44.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:44.449+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:44.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:44.680+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:45.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:45.168+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:45.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:45.409+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:45.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:45.489+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:45.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:45.631+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:46.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:46.146+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:46.291 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:30:46.286+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:30:46.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:46.371+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:46.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:46.466+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:46.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:46.641+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:47.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:47.154+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:47.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:47.392+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:47.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:47.430+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:47.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:47.620+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:48.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:48.129+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:48.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:48.400+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:48.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:48.437+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:48.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:48.622+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:49.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:49.137+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:49.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:49.433+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:49.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:49.440+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:49.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:49.579+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:50.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:50.102+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:50.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:50.470+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:50.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:50.470+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:50.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:50.542+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:51.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:51.121+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:51.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:51.464+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:51.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:51.512+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:51.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:51.546+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:52.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:52.157+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:52.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:52.476+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:52.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:52.525+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:52.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:52.534+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:53.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:53.149+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:53.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:53.445+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:53.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:53.519+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:53.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:53.539+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:54.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:54.132+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:54.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:54.471+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:54.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:54.501+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:54.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:54.529+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:55.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:55.180+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:55.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:55.431+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:55.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:55.504+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:55.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:55.509+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:56.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:56.219+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:56.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:56.460+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:56.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:56.518+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:56.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:56.524+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:57.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:57.263+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:57.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:57.410+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:57.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:57.545+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:57.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:57.547+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:58.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:58.254+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:58.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:58.402+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:58.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:58.498+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:58.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:58.544+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:59.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:30:59.265+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 62 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:59.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:30:59.419+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:59.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:30:59.494+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:30:59.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:30:59.540+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:00.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:00.294+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:00.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:00.453+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:00.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:00.492+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:00.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:00.510+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:01.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:01.264+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:01.303 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:31:01.301+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:31:01.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:01.431+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:01.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:01.477+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:01.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:01.540+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:02.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:02.225+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:02.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:31:02.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:31:02.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:02.381+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:02.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:02.437+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:02.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:02.520+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:03.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:03.208+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:03.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:03.415+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:03.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:03.454+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:03.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:03.553+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:04.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:04.248+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:04.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:04.377+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:04.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:04.476+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:04.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:04.531+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:05.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:05.293+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:05.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:05.427+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:05.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:05.434+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:05.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:05.549+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:06.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:06.248+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:06.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:06.433+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:06.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:06.472+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:06.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:06.535+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:07.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:07.203+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:07.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:07.424+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:07.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:07.472+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:07.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:07.493+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:08.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:08.210+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:08.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:08.432+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:08.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:08.454+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:08.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:08.453+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:09.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:09.162+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:09.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:09.431+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:09.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:09.437+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:09.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:09.454+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:10.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:10.130+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:10.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:10.425+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:10.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:10.458+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:10.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:10.479+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:11.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:11.148+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:11.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:11.429+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:11.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:11.486+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:11.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:11.529+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:12.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:12.147+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:12.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:12.420+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:12.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:12.479+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:12.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:12.500+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:13.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:13.128+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:13.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:13.377+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:13.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:13.458+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:13.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:13.525+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:14.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:14.106+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:14.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:14.401+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:14.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:14.480+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:14.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:14.504+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:15.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:15.099+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:15.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:15.357+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:15.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:15.488+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:15.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:15.529+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:16.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:16.069+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:16.319 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:31:16.318+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:31:16.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:16.380+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:16.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:16.513+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:16.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:16.525+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:17.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:17.096+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:17.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:17.349+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:17.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:17.483+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:17.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:17.539+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:18.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:18.122+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:18.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:18.390+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:18.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:18.511+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:18.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:18.564+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:19.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:19.091+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:19.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:19.352+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:19.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:19.482+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:19.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:19.572+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:20.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:20.062+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:20.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:20.321+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:20.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:20.489+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:20.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:20.547+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:21.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:21.016+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:21.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:21.370+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:21.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:21.503+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:21.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:21.509+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:22.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:22.061+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:22.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:22.392+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:22.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:22.470+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:22.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:22.486+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:23.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:23.027+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:23.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:23.347+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:23.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:23.444+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:23.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:23.529+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:24.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:24.061+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:24.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:24.390+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:24.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:24.442+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:24.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:24.563+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:25.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:25.045+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:25.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:25.351+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:25.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:25.462+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:25.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:25.516+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:26.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:26.017+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:26.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:26.339+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:26.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:26.438+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:26.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:26.560+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:26.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:26.983+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:27.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:27.336+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:27.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:27.421+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:27.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:27.589+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:28.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:28.031+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:28.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:28.352+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:28.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:28.379+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:28.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:28.597+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:29.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:29.009+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:29.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:29.338+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:29.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:29.382+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:29.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:29.560+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:29.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:29.971+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:30.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:30.335+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:30.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:30.406+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:30.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:30.522+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:30.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:30.942+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:31.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:31.304+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:31.335 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:31:31.333+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:31:31.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:31.377+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:31.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:31.552+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:31.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:31.946+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:32.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:32.317+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:32.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:31:32.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:31:32.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:32.412+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:32.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:32.517+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:32.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:32.972+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:33.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:33.315+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:33.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:33.373+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:33.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:33.487+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:34.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:34.016+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:34.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:34.307+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:34.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:34.402+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:34.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:34.471+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:34.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:34.991+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:35.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:35.345+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:35.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:35.378+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:35.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:35.503+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:36.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:35.999+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:36.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:36.374+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:36.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:36.422+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:36.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:36.481+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:36.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:36.982+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:37.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:37.411+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:37.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:37.420+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:37.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:37.512+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:37.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:37.945+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:38.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:38.415+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:38.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:38.442+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:38.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:38.554+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:38.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:38.992+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:39.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:39.385+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:39.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:39.408+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:39.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:39.509+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:40.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:40.026+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:40.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:40.357+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:40.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:40.458+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:40.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:40.524+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:41.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:41.019+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:41.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:41.355+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:41.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:41.475+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:41.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:41.498+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:41.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:41.995+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:42.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:42.359+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:42.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:42.459+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:42.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:42.538+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:42.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:42.993+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:43.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:43.328+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:43.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:43.452+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:43.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:43.529+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:44.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:44.020+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:44.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:44.378+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:44.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:44.453+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:44.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:44.562+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:45.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:45.011+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:45.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:45.341+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:45.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:45.475+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:45.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:45.583+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:46.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:46.029+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:46.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:46.325+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:46.351 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:31:46.349+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:31:46.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:46.455+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:46.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:46.566+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:47.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:47.009+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:47.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:47.363+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:47.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:47.475+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:47.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:47.615+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:48.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:48.022+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:48.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:48.397+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:48.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:48.487+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:48.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:48.660+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:49.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:49.002+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:49.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:49.354+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:49.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:49.476+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:49.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:49.700+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:49.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:49.953+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:50.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:50.397+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:50.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:50.436+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:50.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:50.743+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:50.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:50.949+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:51.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:51.445+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:51.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:51.455+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:51.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:51.725+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:51.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:51.939+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:52.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:52.428+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:52.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:52.452+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:52.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:52.689+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:52.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:52.979+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:53.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:53.444+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:53.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:53.463+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:53.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:53.716+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:54.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:54.016+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:54.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:54.448+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:54.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:54.454+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:54.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:54.713+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:54.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:54.975+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:55.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:55.431+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:55.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:55.485+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:55.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:55.706+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:55.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:55.974+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:56.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:56.396+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:56.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:56.452+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:56.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:56.676+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:57.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:57.004+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:57.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:57.388+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:57.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:57.482+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:57.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:57.700+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:57.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:57.990+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:58.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:58.354+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:58.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:58.453+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:58.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:58.682+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:58.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:58.945+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:59.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:31:59.336+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:59.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:31:59.468+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:59.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:31:59.673+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:31:59.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:31:59.931+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:00.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:00.338+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:00.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:00.483+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:00.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:00.640+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:00.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:00.919+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:01.367 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:32:01.365+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:32:01.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:01.383+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:01.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:01.523+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:01.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:01.660+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:01.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:01.870+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:02.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:02.416+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:02.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:32:02.528 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:32:02.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:02.560+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:02.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:02.628+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:02.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:02.854+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:03.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:03.390+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:03.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:03.599+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:03.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:03.606+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:03.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:03.889+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:04.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:04.400+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:04.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:04.646+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:04.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:04.646+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:04.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:04.871+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:05.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:05.365+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:05.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:05.634+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:05.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:05.667+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:05.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:05.825+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:06.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:06.360+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:06.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:06.587+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:06.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:06.701+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:06.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:06.828+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:07.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:07.361+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:07.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:07.592+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:07.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:07.717+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:07.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:07.852+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:08.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:08.333+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:08.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:08.571+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:08.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:08.681+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:08.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:08.873+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:09.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:09.359+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:09.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:09.564+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:09.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:09.636+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:09.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:09.829+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:10.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:10.342+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:10.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:10.544+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:10.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:10.639+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:10.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:10.850+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:11.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:11.365+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:11.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:11.557+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:11.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:11.642+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:11.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:11.827+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:12.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:12.316+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:12.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:12.550+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:12.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:12.684+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:12.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:12.793+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:13.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:13.270+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:13.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:13.556+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:13.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:13.682+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:13.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:13.753+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:14.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:14.271+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:14.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:14.603+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:14.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:14.723+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:14.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:14.804+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:15.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:15.281+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:15.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:15.560+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:15.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:15.736+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:15.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:15.782+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:16.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:16.292+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:16.382 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:32:16.380+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:32:16.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:16.560+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:16.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:16.722+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:16.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:16.790+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:17.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:17.309+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:17.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:17.593+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:17.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:17.685+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:17.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:17.831+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:18.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:18.325+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:18.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:18.579+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:18.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:18.718+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:18.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:18.815+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:19.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:19.332+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:19.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:19.572+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:19.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:19.744+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:19.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:19.819+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:20.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:20.351+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:20.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:20.596+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:20.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:20.770+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:20.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:20.780+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:21.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:21.349+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:21.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:21.554+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:21.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:21.746+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:21.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:21.757+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:22.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:22.398+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:22.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:22.545+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:22.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:22.738+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:22.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:22.782+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:23.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:23.412+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:23.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:23.579+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:23.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:23.698+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:23.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:23.746+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:24.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:24.401+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:24.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:24.544+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:24.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:24.658+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:24.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:24.775+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:25.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:25.370+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:25.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:25.561+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:25.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:25.691+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:25.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:25.731+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:26.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:26.366+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:26.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:26.594+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:26.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:26.711+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:26.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:26.735+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:27.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:27.399+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:27.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:27.578+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:27.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:27.700+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:27.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:27.731+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:28.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:28.353+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:28.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:28.601+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:28.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:28.667+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:28.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:28.780+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:29.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:29.316+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:29.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:29.563+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:29.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:29.646+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:29.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:29.809+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:30.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:30.279+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:30.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:30.587+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:30.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:30.678+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:30.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:30.845+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:31.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:31.312+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:31.398 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:32:31.397+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:32:31.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:31.600+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:31.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:31.634+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:31.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:31.827+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:32.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:32.316+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:32.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:32.613+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:32.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:32:32.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:32:32.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:32.672+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:32.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:32.782+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:33.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:33.311+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:33.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:33.606+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:33.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:33.691+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:33.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:33.824+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:34.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:34.300+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:34.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:34.571+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:34.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:34.663+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:34.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:34.867+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:35.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:35.304+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:35.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:35.571+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:35.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:35.651+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:35.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:35.886+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:36.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:36.277+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:36.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:36.583+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:36.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:36.647+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:36.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:36.886+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:37.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:37.274+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:37.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:37.595+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:37.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:37.697+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:37.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:37.845+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:38.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:38.269+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:38.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:38.582+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:38.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:38.654+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:38.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:38.877+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:39.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:39.250+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:39.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:39.536+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:39.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:39.623+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:39.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:39.864+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:40.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:40.210+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:40.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:40.510+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:40.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:40.626+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:40.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:40.829+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:41.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:41.183+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:41.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:41.485+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:41.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:41.584+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:41.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:41.875+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:42.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:42.191+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:42.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:42.454+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:42.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:42.627+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:42.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:42.892+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:43.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:43.208+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:43.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:43.447+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:43.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:43.662+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:43.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:43.904+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:44.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:44.165+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:44.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:44.495+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:44.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:44.613+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:44.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:44.930+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:45.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:45.195+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:45.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:45.496+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:45.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:45.605+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:45.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:45.930+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:46.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:46.195+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:46.414 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:32:46.412+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:32:46.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:46.497+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:46.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:46.596+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:46.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:46.893+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:47.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:47.211+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:47.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:47.487+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:47.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:47.600+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:47.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:47.867+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:48.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:48.195+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:48.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:48.461+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:48.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:48.649+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:48.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:48.903+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:49.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:49.202+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:49.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:49.484+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:49.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:49.605+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:49.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:49.932+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:50.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:50.173+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:50.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:50.515+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:50.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:50.618+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:50.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:50.902+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:51.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:51.202+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:51.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:51.469+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:51.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:51.618+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:51.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:51.881+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:52.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:52.166+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:52.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:52.486+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:52.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:52.605+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:52.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:52.916+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:53.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:53.206+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:53.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:53.502+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:53.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:53.623+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:53.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:53.886+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:54.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:54.235+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:54.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:54.539+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:54.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:54.584+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:54.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:54.869+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:55.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:55.224+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:55.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:55.527+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:55.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:55.597+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:55.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:55.829+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:56.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:56.178+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:56.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:56.493+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:56.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:56.584+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:56.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:56.855+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:57.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:57.171+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:57.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:57.517+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:57.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:57.546+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:57.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:57.867+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:58.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:58.140+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:58.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:58.493+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:58.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:58.595+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:58.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:58.911+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:59.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:32:59.125+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:59.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:32:59.500+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:59.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:32:59.570+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:32:59.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:32:59.882+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:00.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:00.120+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:00.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:00.533+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:00.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:00.619+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:00.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:00.894+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:01.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:01.098+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:01.430 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:33:01.428+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:33:01.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:01.554+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:01.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:01.666+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:01.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:01.934+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:02.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:02.081+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:02.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:02.558+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:02.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:02.629+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:02.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:33:02.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:33:02.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:02.944+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:03.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:03.091+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:03.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:03.587+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:03.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:03.603+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:03.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:03.935+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:04.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:04.051+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:04.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:04.551+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:04.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:04.553+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:04.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:04.978+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:05.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:05.043+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:05.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:05.520+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:05.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:05.524+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:05.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:05.929+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:06.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:06.021+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:06.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:06.509+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:06.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:06.518+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:06.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:06.888+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:07.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:07.066+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:07.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:07.530+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:07.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:07.537+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:07.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:07.909+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:08.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:08.072+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:08.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:08.517+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:08.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:08.518+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:08.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:08.895+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:09.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:09.104+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:09.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:09.494+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:09.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:09.497+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:09.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:09.925+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:10.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:10.111+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:10.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:10.461+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:10.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:10.471+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:10.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:10.943+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:11.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:11.153+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:11.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:11.440+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:11.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:11.501+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:11.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:11.950+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:12.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:12.120+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:12.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:12.440+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:12.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:12.469+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:12.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:12.909+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:13.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:13.100+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:13.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:13.437+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:13.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:13.440+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:13.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:13.959+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:14.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:14.103+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:14.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:14.429+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:14.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:14.462+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:14.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:14.915+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:15.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:15.102+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:15.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:15.458+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:15.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:15.476+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:15.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:15.936+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:16.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:16.101+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:16.446 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:33:16.444+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:33:16.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:16.491+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:16.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:16.524+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:16.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:16.938+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:17.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:17.093+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:17.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:17.528+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:17.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:17.574+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:17.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:17.966+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:18.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:18.123+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:18.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:18.544+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:18.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:18.560+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:19.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:19.011+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:19.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:19.160+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:19.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:19.553+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:19.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:19.592+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:20.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:20.051+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:20.125 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:20.123+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:20.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:20.577+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:20.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:20.615+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:21.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:21.004+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:21.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:21.134+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:21.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:21.589+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:21.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:21.615+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:22.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:22.044+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:22.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:22.182+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:22.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:22.581+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:22.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:22.623+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:23.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:23.030+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:23.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:23.156+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:23.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:23.556+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:23.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:23.596+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:24.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:24.007+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:24.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:24.160+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:24.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:24.569+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:24.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:24.585+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:24.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:24.983+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:25.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:25.124+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:25.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:25.592+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:25.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:25.599+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:25.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:25.993+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:26.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:26.113+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:26.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:26.603+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:26.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:26.640+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:26.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:26.973+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:27.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:27.148+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:27.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:27.598+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:27.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:27.675+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:27.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:27.961+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:28.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:28.117+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:28.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:28.552+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:28.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:28.725+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:28.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:28.935+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:29.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:29.145+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:29.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:29.559+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:29.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:29.714+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:29.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:29.912+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:30.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:30.194+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:30.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:30.566+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:30.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:30.688+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:30.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:30.902+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:31.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:31.157+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:31.462 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:33:31.459+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:33:31.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:31.531+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:31.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:31.691+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:31.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:31.893+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:32.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:32.138+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:32.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:32.534+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:32.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:32.722+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:32.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:32.935+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:32.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:33:32.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:33:33.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:33.125+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:33.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:33.507+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:33.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:33.732+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:33.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:33.961+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:34.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:34.100+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:34.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:34.548+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:34.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:34.694+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:34.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:34.996+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:35.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:35.091+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:35.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:35.572+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:35.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:35.690+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:35.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:35.954+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:36.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:36.133+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:36.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:36.585+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:36.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:36.727+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:36.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:36.939+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:37.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:37.106+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:37.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:37.613+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:37.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:37.718+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:37.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:37.899+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:38.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:38.069+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:38.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:38.585+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:38.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:38.766+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:38.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:38.932+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:39.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:39.030+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:39.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:39.591+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:39.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:39.785+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:39.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:39.942+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:40.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:40.050+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:40.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:40.555+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:40.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:40.821+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:40.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:40.936+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:41.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:41.027+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:41.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:41.590+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:41.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:41.845+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:41.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:41.889+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:41.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:41.985+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:42.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:42.558+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:42.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:42.804+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:42.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:42.845+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:42.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:42.936+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:43.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:43.601+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:43.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:43.799+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:43.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:43.846+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:43.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:43.908+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:44.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:44.577+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:44.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:44.786+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:44.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:44.814+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:44.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:44.910+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:45.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:45.556+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:45.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:45.815+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:45.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:45.845+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:45.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:45.955+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:46.478 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:33:46.476+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:33:46.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:46.518+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:46.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:46.771+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:46.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:46.864+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:46.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:46.906+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:47.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:47.473+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:47.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:47.771+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:47.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:47.852+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:47.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:47.882+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:48.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:48.435+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:48.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:48.766+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:48.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:48.808+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:48.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:48.890+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:49.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:49.396+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:49.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:49.779+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:49.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:49.844+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:49.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:49.938+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:50.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:50.357+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:50.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:50.820+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:50.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:50.882+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:50.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:50.967+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:51.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:51.379+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:51.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:51.830+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:51.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:51.914+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:51.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:51.982+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:52.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:52.392+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:52.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:52.784+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:52.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:52.918+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:53.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:53.000+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:53.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:53.438+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:53.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:53.757+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:53.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:53.959+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:54.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:54.023+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:54.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:54.487+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:54.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:54.748+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:54.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:54.991+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:55.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:55.006+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:55.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:55.492+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:55.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:55.755+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:55.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:55.989+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:56.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:56.026+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:56.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:56.504+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:56.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:56.796+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:56.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:56.977+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:56.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:56.995+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:57.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:57.488+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:57.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:57.818+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:57.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:57.956+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:58.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:58.015+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:58.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:58.481+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:58.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:58.842+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:58.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:58.920+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:58.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:58.978+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:59.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:33:59.465+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:59.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:33:59.804+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:59.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:33:59.958+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:33:59.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:33:59.992+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:00.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:00.505+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:00.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:00.829+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:00.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:00.968+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:00.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:00.992+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:01.481 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:34:01.478+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:34:01.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:01.495+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:01.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:01.856+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:01.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:01.940+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:01.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:01.985+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:02.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:02.453+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:02.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:02.886+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:02.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:02.952+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:02.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:02.973+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:03.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:34:03.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:34:03.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:03.471+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:03.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:03.888+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:03.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:03.936+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:04.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:04.003+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:04.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:04.458+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:04.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:04.913+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:04.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:04.938+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:05.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:05.039+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:05.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:05.506+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:05.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:05.946+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:05.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:05.950+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:05.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:05.997+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:06.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:06.473+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:06.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:06.914+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:06.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:06.932+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:06.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:06.995+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:07.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:07.455+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:07.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:07.933+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:07.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:07.950+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:07.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:07.980+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:08.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:08.458+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:08.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:08.979+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:08.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:08.995+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:09.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:09.000+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:09.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:09.420+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:09.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:09.931+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:10.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:10.013+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:10.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:10.021+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:10.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:10.443+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:10.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:10.891+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:10.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:10.982+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:11.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:11.068+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:11.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:11.444+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:11.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:11.843+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:12.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:12.001+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:12.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:12.070+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:12.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:12.462+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:12.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:12.893+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:12.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:12.953+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:13.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:13.072+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:13.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:13.446+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:13.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:13.907+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:13.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:13.929+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:14.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:14.116+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:14.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:14.431+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:14.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:14.932+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:14.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:14.976+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:15.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:15.115+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:15.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:15.464+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:15.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:15.905+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:15.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:15.966+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:16.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:16.082+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:16.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:16.432+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:16.496 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:34:16.494+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:34:16.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:16.875+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:16.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:16.921+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:17.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:17.048+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:17.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:17.411+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:17.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:17.861+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:17.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:17.910+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:18.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:18.088+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:18.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:18.436+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:18.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:18.872+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:18.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:18.957+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:19.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:19.094+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:19.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:19.415+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:19.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:19.921+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:19.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:19.953+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:20.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:20.112+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:20.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:20.390+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:20.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:20.929+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:20.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:20.931+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:21.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:21.078+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:21.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:21.432+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:21.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:21.929+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:21.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:21.981+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:22.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:22.052+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:22.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:22.388+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:22.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:22.898+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:22.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:22.965+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:23.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:23.009+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:23.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:23.435+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:23.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:23.931+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:23.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:23.938+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:24.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:24.013+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:24.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:24.461+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:24.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:24.886+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:24.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:24.967+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:24.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:24.990+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:25.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:25.438+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:25.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:25.880+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:25.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:25.948+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:25.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:25.978+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:26.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:26.414+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:26.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:26.856+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:26.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:26.931+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:27.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:27.000+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:27.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:27.406+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:27.830 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:27.828+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:27.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:27.936+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:28.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:28.039+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:28.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:28.417+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:28.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:28.830+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:28.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:28.921+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:29.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:29.051+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:29.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:29.467+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:29.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:29.848+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:29.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:29.954+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:30.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:30.013+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:30.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:30.479+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:30.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:30.813+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:30.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:30.918+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:31.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:31.054+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:31.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:31.442+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:31.512 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:34:31.510+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:34:31.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:31.850+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:31.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:31.895+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:32.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:32.019+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:32.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:32.437+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:32.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:32.854+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:32.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:32.921+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:33.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:33.034+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:33.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:34:33.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:34:33.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:33.456+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:33.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:33.828+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:33.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:33.884+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:34.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:34.023+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:34.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:34.458+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:34.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:34.878+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:34.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:34.933+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:35.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:35.007+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:35.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:35.414+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:35.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:35.844+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:35.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:35.958+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:36.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:36.057+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:36.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:36.415+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:36.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:36.829+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:36.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:36.985+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:37.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:37.086+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:37.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:37.442+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:37.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:37.860+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:37.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:37.982+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:38.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:38.112+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:38.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:38.401+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:38.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:38.860+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:38.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:38.938+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:39.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:39.146+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:39.402 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:39.400+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:39.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:39.851+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:39.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:39.975+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:40.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:40.140+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:40.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:40.408+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:40.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:40.822+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:40.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:40.941+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:41.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:41.114+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:41.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:41.429+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:41.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:41.868+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:41.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:41.931+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:42.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:42.094+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:42.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:42.409+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:42.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:42.890+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:42.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:42.912+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:43.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:43.109+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:43.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:43.421+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:43.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:43.886+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:43.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:43.899+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:44.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:44.096+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:44.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:44.373+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:44.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:44.868+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:44.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:44.928+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:45.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:45.134+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:45.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:45.390+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:45.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:45.862+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:45.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:45.903+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:46.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:46.103+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:46.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:46.434+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:46.513 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:34:46.511+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:34:46.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:46.862+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:46.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:46.947+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:47.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:47.078+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:47.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:47.471+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:47.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:47.878+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:47.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:47.982+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:48.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:48.090+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:48.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:48.442+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:48.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:48.832+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:48.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:48.955+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:49.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:49.140+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:49.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:49.435+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:49.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:49.784+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:49.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:49.988+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:50.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:50.173+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:50.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:50.388+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:50.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:50.826+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:50.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:50.939+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:51.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:51.177+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:51.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:51.419+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:51.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:51.836+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:51.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:51.985+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:52.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:52.137+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:52.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:52.421+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:52.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:52.827+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:52.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:52.947+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:53.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:53.126+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:53.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:53.428+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:53.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:53.811+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:53.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:53.962+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:54.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:54.125+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:54.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:54.477+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:54.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:54.834+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:54.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:54.947+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:55.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:55.127+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:55.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:55.481+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:55.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:55.867+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:55.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:55.965+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:56.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:56.092+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:56.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:56.511+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:56.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:56.883+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:57.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:57.000+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:57.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:57.089+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:57.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:57.544+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:57.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:57.910+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:58.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:58.044+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:58.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:58.116+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:58.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:58.521+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:58.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:58.864+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:59.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:59.005+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:59.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:34:59.086+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:59.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:34:59.542+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:59.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:34:59.832+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:34:59.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:34:59.972+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:00.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:00.118+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:00.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:00.578+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:00.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:00.796+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:00.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:00.986+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:01.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:01.106+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:01.529 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:35:01.528+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:35:01.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:01.606+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:01.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:01.782+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:02.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:02.007+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:02.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:02.091+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:02.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:02.624+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:02.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:02.739+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:02.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:02.978+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:03.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:03.069+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:03.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:35:03.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:35:03.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:03.595+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:03.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:03.752+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:03.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:03.940+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:04.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:04.066+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:04.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:04.612+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:04.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:04.717+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:04.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:04.907+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:05.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:05.073+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:05.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:05.651+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:05.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:05.677+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:05.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:05.951+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:06.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:06.083+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:06.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:06.687+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:06.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:06.713+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:06.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:06.977+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:07.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:07.095+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:07.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:07.714+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:07.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:07.742+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:08.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:08.017+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:08.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:08.132+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:08.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:08.703+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:08.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:08.747+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:09.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:08.999+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:09.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:09.176+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:09.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:09.739+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:09.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:09.796+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:09.964 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:09.963+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:10.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:10.220+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:10.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:10.733+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:10.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:10.775+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:11.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:11.004+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:11.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:11.263+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:11.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:11.722+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:11.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:11.776+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:11.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:11.978+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:12.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:12.226+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:12.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:12.681+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:12.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:12.820+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:12.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:12.939+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:13.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:13.205+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:13.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:13.653+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:13.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:13.823+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:13.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:13.928+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:14.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:14.173+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:14.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:14.699+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:14.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:14.850+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:14.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:14.927+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:15.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:15.138+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:15.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:15.744+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:15.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:15.847+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:15.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:15.879+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:16.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:16.132+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:16.545 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:35:16.543+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:35:16.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:16.787+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:16.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:16.823+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:16.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:16.870+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:17.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:17.111+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:17.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:17.797+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:17.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:17.823+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:17.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:17.917+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:18.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:18.078+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:18.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:18.777+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:18.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:18.835+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:18.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:18.967+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:19.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:19.089+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:19.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:19.764+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:19.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:19.878+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:19.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:19.960+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:20.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:20.090+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:20.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:20.778+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:20.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:20.916+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:20.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:20.988+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:21.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:21.102+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:21.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:21.826+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:21.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:21.954+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:22.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:22.037+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:22.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:22.067+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:22.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:22.780+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:22.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:22.920+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:23.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:23.005+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:23.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:23.110+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:23.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:23.830+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:23.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:23.958+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:24.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:24.045+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:24.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:24.087+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:24.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:24.833+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:24.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:24.978+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:25.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:25.077+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:25.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:25.106+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:25.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:25.830+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:26.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:26.024+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:26.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:26.063+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:26.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:26.116+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:26.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:26.878+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:27.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:27.021+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:27.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:27.068+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:27.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:27.095+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:27.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:27.886+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:27.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:27.984+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:28.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:28.118+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:28.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:28.130+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:28.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:28.912+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:28.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:28.971+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:29.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:29.078+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:29.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:29.177+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:29.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:29.869+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:29.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:29.966+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:30.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:30.086+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:30.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:30.208+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:30.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:30.850+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:30.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:30.990+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:31.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:31.126+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:31.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:31.215+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:31.547 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:35:31.545+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:35:31.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:31.802+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:31.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:31.985+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:32.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:32.155+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:32.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:32.255+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:32.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:32.837+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:32.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:32.995+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:33.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:33.147+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:33.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:33.264+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:33.545 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:35:33.549 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:35:33.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:33.861+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:34.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:34.038+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:34.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:34.119+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:34.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:34.242+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:34.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:34.874+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:35.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:35.007+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:35.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:35.139+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:35.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:35.276+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:35.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:35.914+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:36.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:36.034+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:36.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:36.097+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:36.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:36.309+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:36.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:36.876+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:37.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:37.055+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:37.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:37.087+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:37.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:37.326+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:37.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:37.843+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:38.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:38.067+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:38.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:38.090+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:38.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:38.339+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:38.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:38.856+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:39.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:39.050+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:39.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:39.107+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:39.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:39.296+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:39.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:39.898+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:40.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:40.049+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:40.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:40.073+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:40.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:40.278+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:40.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:40.927+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:41.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:41.034+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:41.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:41.096+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:41.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:41.306+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:41.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:41.907+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:42.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:42.014+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:42.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:42.106+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:42.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:42.332+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:42.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:42.942+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:42.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:42.974+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:43.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:43.125+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:43.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:43.375+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:43.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:43.916+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:43.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:43.957+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:44.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:44.145+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:44.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:44.338+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:44.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:44.922+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:44.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:44.928+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:45.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:45.171+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:45.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:45.312+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:45.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:45.921+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:45.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:45.957+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:46.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:46.189+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:46.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:46.346+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:46.562 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:35:46.560+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:35:46.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:46.891+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:46.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:46.963+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:47.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:47.176+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:47.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:47.305+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:47.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:47.907+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:47.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:47.929+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:48.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:48.173+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:48.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:48.284+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:48.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:48.952+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:48.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:48.958+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:49.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:49.167+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:49.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:49.297+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:49.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:49.932+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:49.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:49.990+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:50.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:50.195+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:50.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:50.295+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:50.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:50.942+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:50.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:50.946+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:51.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:51.244+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:51.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:51.314+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:51.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:51.897+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:51.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:51.931+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:52.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:52.210+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:52.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:52.320+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:52.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:52.873+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:52.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:52.896+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:53.221 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:53.219+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:53.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:53.336+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:53.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:53.881+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:53.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:53.884+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:54.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:54.223+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:54.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:54.367+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:54.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:54.869+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:54.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:54.916+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:55.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:55.182+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:55.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:55.333+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:55.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:55.839+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:55.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:55.921+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:56.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:56.185+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:56.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:56.372+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:56.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:56.860+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:56.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:56.925+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:57.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:57.212+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:57.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:57.408+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:57.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:57.853+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:57.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:57.967+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:58.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:58.189+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:58.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:58.448+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:58.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:58.874+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:58.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:58.932+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:59.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:35:59.228+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:59.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:35:59.450+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:59.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:35:59.843+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:35:59.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:35:59.955+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:00.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:00.218+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:00.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:00.424+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:00.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:00.893+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:00.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:00.942+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:01.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:01.244+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:01.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:01.397+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:01.579 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:36:01.577+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:36:01.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:01.892+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:01.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:01.940+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:02.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:02.283+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:02.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:02.388+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:02.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:02.881+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:02.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:02.978+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:03.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:03.332+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:03.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:03.430+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:03.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:36:03.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:36:03.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:03.904+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:03.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:03.981+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:04.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:04.373+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:04.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:04.468+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:04.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:04.894+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:04.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:04.982+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:05.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:05.396+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:05.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:05.486+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:05.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:05.892+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:05.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:05.966+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:06.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:06.423+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:06.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:06.514+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:06.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:06.870+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:06.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:06.963+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:07.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:07.459+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:07.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:07.556+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:07.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:07.902+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:07.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:07.990+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:08.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:08.465+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:08.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:08.547+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:08.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:08.927+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:09.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:09.001+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:09.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:09.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:09.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:09.510+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:09.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:09.970+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:09.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:09.975+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:10.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:10.386+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:10.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:10.499+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:10.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:10.959+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:11.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:11.001+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:11.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:11.395+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:11.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:11.520+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:11.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:11.933+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:12.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:12.021+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:12.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:12.429+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:12.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:12.511+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:12.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:12.923+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:12.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:12.977+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:13.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:13.384+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:13.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:13.522+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:13.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:13.946+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:13.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:13.996+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:14.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:14.428+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:14.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:14.553+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:14.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:14.939+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:14.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:14.951+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:15.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:15.396+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:15.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:15.544+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:15.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:15.891+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:15.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:15.924+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:16.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:16.398+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:16.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:16.559+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:16.594 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:36:16.592+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:36:16.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:16.867+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:16.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:16.901+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:17.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:17.365+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:17.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:17.599+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:17.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:17.860+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:17.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:17.913+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:18.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:18.386+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:18.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:18.584+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:18.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:18.845+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:18.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:18.896+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:19.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:19.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:19.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:19.611+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:19.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:19.882+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:19.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:19.925+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:20.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:20.450+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:20.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:20.578+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:20.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:20.854+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:20.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:20.934+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:21.447 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:21.446+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:21.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:21.613+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:21.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:21.808+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:21.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:21.888+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:22.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:22.400+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:22.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:22.652+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:22.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:22.769+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:22.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:22.843+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:23.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:23.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:23.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:23.647+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:23.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:23.762+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:23.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:23.842+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:24.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:24.421+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:24.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:24.661+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:24.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:24.801+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:24.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:24.840+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:25.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:25.457+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:25.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:25.669+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:25.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:25.852+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:25.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:25.889+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:26.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:26.482+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:26.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:26.631+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:26.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:26.885+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:26.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:26.913+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:27.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:27.452+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:27.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:27.604+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:27.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:27.836+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:27.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:27.916+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:28.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:28.459+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:28.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:28.616+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:28.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:28.810+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:28.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:28.955+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:29.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:29.426+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:29.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:29.584+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:29.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:29.762+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:30.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:30.005+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:30.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:30.467+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:30.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:30.552+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:30.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:30.714+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:30.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:30.971+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:31.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:31.429+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:31.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:31.527+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:31.610 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:36:31.608+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:36:31.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:31.737+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:31.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:31.984+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:32.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:32.407+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:32.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:32.566+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:32.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:32.777+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:33.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:33.015+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:33.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:33.422+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:33.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:33.586+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:33.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:33.804+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:33.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:36:33.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:36:34.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:34.034+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:34.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:34.394+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:34.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:34.614+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:34.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:34.777+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:35.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:35.011+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:35.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:35.396+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:35.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:35.611+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:35.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:35.801+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:35.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:35.971+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:36.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:36.355+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:36.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:36.632+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:36.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:36.774+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:37.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:37.019+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:37.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:37.362+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:37.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:37.638+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:37.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:37.733+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:37.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:37.993+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:38.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:38.320+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:38.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:38.687+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:38.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:38.741+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:38.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:38.967+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:39.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:39.307+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:39.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:39.676+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:39.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:39.780+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:39.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:39.983+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:40.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:40.284+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:40.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:40.707+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:40.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:40.773+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:41.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:41.010+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:41.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:41.288+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:41.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:41.715+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:41.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:41.784+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:41.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:41.980+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:42.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:42.293+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:42.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:42.707+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:42.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:42.830+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:42.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:42.996+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:43.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:43.340+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:43.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:43.752+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:43.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:43.824+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:43.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:43.969+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:44.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:44.387+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:44.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:44.735+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:44.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:44.845+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:44.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:44.955+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:45.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:45.341+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:45.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:45.702+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:45.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:45.883+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:45.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:45.972+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:46.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:46.312+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:46.619 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:36:46.618+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:36:46.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:46.654+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:46.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:46.917+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:46.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:46.960+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:47.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:47.267+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:47.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:47.686+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:47.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:47.914+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:47.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:47.916+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:48.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:48.284+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:48.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:48.679+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:48.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:48.883+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:48.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:48.902+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:49.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:49.293+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:49.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:49.696+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:49.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:49.850+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:49.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:49.886+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:50.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:50.276+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:50.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:50.662+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:50.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:50.842+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:50.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:50.935+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:51.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:51.268+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:51.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:51.702+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:51.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:51.800+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:51.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:51.980+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:52.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:52.269+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:52.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:52.720+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:52.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:52.847+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:52.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:52.988+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:53.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:53.236+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:53.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:53.703+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:53.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:53.886+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:53.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:53.951+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:54.214 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:54.211+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:54.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:54.730+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:54.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:54.836+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:54.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:54.975+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:55.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:55.258+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:55.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:55.696+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:55.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:55.823+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:55.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:55.958+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:56.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:56.308+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:56.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:56.672+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:56.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:56.785+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:56.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:56.988+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:57.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:57.293+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:57.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:57.684+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:57.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:57.826+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:57.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:57.998+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:58.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:58.316+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:58.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:58.702+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:58.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:58.864+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:58.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:58.958+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:59.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:36:59.294+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:59.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:36:59.740+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:59.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:36:59.825+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:36:59.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:36:59.945+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:00.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:00.290+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:00.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:00.738+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:00.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:00.828+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:00.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:00.930+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:01.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:01.329+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:01.635 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:37:01.633+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:37:01.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:01.781+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:01.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:01.793+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:01.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:01.976+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:02.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:02.294+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:02.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:02.775+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:02.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:02.816+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:02.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:02.988+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:03.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:03.314+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:03.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:03.809+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:03.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:03.818+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:03.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:03.976+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:03.996 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:37:04.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:37:04.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:04.303+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:04.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:04.807+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:04.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:04.812+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:05.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:05.017+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:05.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:05.282+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:05.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:05.789+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:05.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:05.845+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:06.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:06.053+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:06.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:06.267+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:06.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:06.746+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:06.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:06.809+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:07.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:07.062+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:07.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:07.239+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:07.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:07.734+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:07.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:07.762+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:08.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:08.085+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:08.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:08.271+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:08.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:08.774+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:08.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:08.790+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:09.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:09.107+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:09.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:09.301+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:09.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:09.816+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:09.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:09.819+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:10.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:10.115+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:10.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:10.314+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:10.811 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:10.810+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:10.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:10.845+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:11.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:11.118+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:11.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:11.308+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:11.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:11.809+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:11.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:11.812+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:12.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:12.109+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:12.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:12.341+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:12.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:12.816+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:12.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:12.847+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:13.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:13.148+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:13.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:13.305+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:13.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:13.775+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:13.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:13.879+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:14.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:14.108+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:14.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:14.329+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:14.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:14.793+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:14.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:14.860+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:15.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:15.139+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:15.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:15.374+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:15.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:15.820+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:15.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:15.893+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:16.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:16.132+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:16.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:16.399+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:16.651 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:37:16.649+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:37:16.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:16.792+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:16.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:16.914+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:17.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:17.089+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:17.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:17.370+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:17.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:17.827+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:17.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:17.930+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:18.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:18.045+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:18.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:18.388+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:18.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:18.782+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:18.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:18.928+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:19.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:19.090+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:19.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:19.430+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:19.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:19.832+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:19.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:19.895+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:20.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:20.119+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:20.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:20.436+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:20.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:20.850+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:20.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:20.897+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:21.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:21.093+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:21.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:21.464+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:21.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:21.873+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:21.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:21.932+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:22.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:22.098+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:22.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:22.460+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:22.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:22.864+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:22.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:22.923+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:23.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:23.129+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:23.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:23.430+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:23.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:23.901+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:23.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:23.969+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:24.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:24.157+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:24.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:24.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:24.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:24.864+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:24.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:24.961+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:25.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:25.173+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:25.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:25.396+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:25.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:25.907+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:25.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:25.942+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:26.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:26.147+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:26.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:26.398+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:26.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:26.954+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:26.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:26.983+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:27.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:27.132+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:27.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:27.444+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:27.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:27.916+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:27.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:27.988+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:28.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:28.154+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:28.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:28.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:28.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:28.904+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:28.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:28.976+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:29.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:29.152+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:29.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:29.417+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:29.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:29.934+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:29.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:29.954+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:30.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:30.118+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:30.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:30.375+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:30.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:30.962+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:30.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:30.982+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:31.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:31.124+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:31.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:31.359+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:31.653 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:37:31.651+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:37:31.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:31.973+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:31.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:31.982+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:32.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:32.123+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:32.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:32.373+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:32.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:32.935+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:33.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:33.008+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:33.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:33.167+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:33.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:33.338+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:33.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:33.977+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:34.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:34.021+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:34.149 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:37:34.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:37:34.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:34.155+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:34.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:34.328+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:34.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:34.965+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:34.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:34.991+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:35.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:35.131+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:35.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:35.344+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:35.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:35.958+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:36.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:36.007+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:36.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:36.131+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:36.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:36.348+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:36.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:36.929+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:37.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:37.045+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:37.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:37.121+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:37.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:37.345+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:37.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:37.962+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:38.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:37.999+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:38.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:38.095+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:38.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:38.388+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:38.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:38.987+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:39.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:39.008+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:39.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:39.071+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:39.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:39.371+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:40.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:40.005+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:40.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:40.019+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:40.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:40.050+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:40.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:40.401+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:40.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:40.965+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:41.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:41.064+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:41.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:41.069+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:41.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:41.409+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:41.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:41.975+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:42.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:42.044+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:42.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:42.096+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:42.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:42.458+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:42.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:42.970+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:43.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:43.009+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:43.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:43.089+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:43.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:43.478+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:43.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:43.942+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:44.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:44.005+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:44.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:44.107+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:44.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:44.528+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:44.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:44.973+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:44.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:44.975+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:45.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:45.103+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:45.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:45.517+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:45.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:45.946+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:46.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:46.021+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:46.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:46.153+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:46.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:46.516+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:46.669 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:37:46.667+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:37:46.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:46.956+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:47.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:47.053+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:47.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:47.105+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:47.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:47.551+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:47.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:47.963+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:48.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:48.041+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:48.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:48.063+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:48.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:48.530+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:48.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:48.953+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:49.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:49.021+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:49.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:49.079+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:49.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:49.500+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:49.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:49.973+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:50.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:50.036+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:50.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:50.117+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:50.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:50.486+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:51.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:51.008+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:51.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:51.062+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:51.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:51.148+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:51.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:51.498+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:52.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:52.045+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:52.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:52.046+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:52.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:52.158+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:52.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:52.455+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:53.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:53.028+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:53.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:53.031+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:53.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:53.190+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:53.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:53.420+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:54.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:54.002+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:54.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:54.046+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:54.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:54.151+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:54.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:54.384+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:54.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:54.960+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:55.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:55.069+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:55.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:55.177+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:55.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:55.350+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:55.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:55.991+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:56.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:56.073+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:56.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:56.166+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:56.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:56.395+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:56.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:56.982+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:57.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:57.103+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:57.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:57.163+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:57.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:57.398+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:57.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:57.976+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:58.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:58.116+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:58.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:58.161+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:58.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:58.352+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:58.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:58.987+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:59.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:37:59.165+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:59.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:37:59.200+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:59.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:37:59.303+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:37:59.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:37:59.940+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:00.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:00.134+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:00.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:00.200+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:00.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:00.339+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:00.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:00.922+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:01.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:01.135+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:01.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:01.240+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:01.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:01.323+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:01.685 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:38:01.684+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:38:01.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:01.905+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:02.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:02.138+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:02.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:02.288+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:02.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:02.333+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:02.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:02.932+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:03.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:03.170+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:03.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:03.326+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:03.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:03.374+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:03.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:03.913+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:04.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:04.214+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:04.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:38:04.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:38:04.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:04.308+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:04.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:04.388+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:04.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:04.955+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:05.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:05.214+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:05.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:05.333+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:05.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:05.394+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:05.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:05.964+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:06.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:06.230+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:06.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:06.331+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:06.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:06.440+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:06.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:06.915+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:07.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:07.251+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:07.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:07.355+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:07.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:07.423+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:07.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:07.964+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:08.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:08.278+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:08.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:08.392+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:08.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:08.420+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:08.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:08.997+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:09.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:09.283+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:09.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:09.405+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:09.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:09.433+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:09.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:09.980+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:10.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:10.269+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:10.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:10.430+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:10.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:10.454+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:10.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:10.974+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:11.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:11.259+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:11.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:11.389+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:11.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:11.487+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:11.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:11.963+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:12.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:12.242+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:12.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:12.389+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:12.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:12.491+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:12.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:12.922+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:13.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:13.221+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:13.412 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:13.410+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:13.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:13.502+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:13.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:13.960+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:14.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:14.247+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:14.451 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:14.448+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:14.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:14.530+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:14.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:14.988+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:15.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:15.221+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:15.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:15.498+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:15.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:15.577+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:15.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:15.976+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:16.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:16.265+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:16.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:16.529+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:16.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:16.598+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:16.698 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:38:16.695+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:38:17.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:17.000+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:17.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:17.255+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:17.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:17.508+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:17.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:17.566+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:18.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:18.038+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:18.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:18.220+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:18.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:18.525+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:18.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:18.549+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:19.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:19.057+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:19.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:19.232+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:19.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:19.486+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:19.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:19.510+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:20.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:20.033+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:20.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:20.270+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:20.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:20.487+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:20.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:20.561+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:21.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:21.047+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:21.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:21.289+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:21.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:21.518+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:21.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:21.562+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:22.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:22.029+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:22.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:22.313+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:22.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:22.525+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:22.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:22.554+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:23.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:23.074+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:23.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:23.353+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:23.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:23.522+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:23.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:23.581+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:24.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:24.055+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:24.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:24.326+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:24.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:24.502+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:24.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:24.596+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:25.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:25.073+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:25.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:25.351+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:25.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:25.530+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:25.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:25.573+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:26.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:26.031+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:26.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:26.398+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:26.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:26.493+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:26.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:26.582+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:27.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:27.049+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:27.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:27.396+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:27.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:27.448+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:27.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:27.630+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:28.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:28.064+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:28.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:28.437+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:28.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:28.460+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:28.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:28.641+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:29.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:29.077+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:29.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:29.400+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:29.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:29.436+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:29.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:29.648+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:30.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:30.113+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:30.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:30.431+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:30.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:30.484+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:30.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:30.602+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:31.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:31.091+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:31.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:31.414+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:31.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:31.442+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:31.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:31.578+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:31.714 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:38:31.711+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:38:32.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:32.131+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:32.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:32.438+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:32.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:32.488+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:32.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:32.622+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:33.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:33.171+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:33.490 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:33.488+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:33.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:33.516+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:33.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:33.626+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:34.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:34.210+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:34.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:38:34.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:38:34.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:34.466+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:34.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:34.471+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:34.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:34.599+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:35.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:35.240+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:35.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:35.457+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:35.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:35.463+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:35.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:35.573+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:36.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:36.284+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:36.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:36.434+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:36.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:36.487+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:36.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:36.572+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:37.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:37.295+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:37.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:37.454+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:37.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:37.491+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:37.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:37.585+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:38.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:38.334+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:38.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:38.455+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:38.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:38.467+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:38.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:38.608+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:39.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:39.376+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:39.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:39.501+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:39.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:39.504+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:39.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:39.655+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:40.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:40.352+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:40.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:40.462+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:40.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:40.540+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:40.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:40.658+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:41.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:41.354+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:41.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:41.413+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:41.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:41.556+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:41.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:41.611+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:42.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:42.381+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:42.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:42.417+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:42.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:42.562+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:42.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:42.624+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:43.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:43.391+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:43.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:43.411+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:43.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:43.560+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:43.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:43.576+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:44.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:44.381+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:44.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:44.426+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:44.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:44.540+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:44.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:44.621+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:45.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:45.374+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:45.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:45.434+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:45.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:45.512+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:45.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:45.608+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:46.358 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:46.357+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:46.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:46.387+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:46.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:46.511+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:46.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:46.598+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:46.723 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:38:46.721+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:38:47.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:47.328+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:47.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:47.436+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:47.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:47.503+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:47.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:47.588+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:48.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:48.326+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:48.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:48.414+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:48.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:48.459+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:48.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:48.611+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:49.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:49.324+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:49.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:49.399+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:49.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:49.464+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:49.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:49.570+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:50.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:50.313+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:50.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:50.367+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:50.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:50.461+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:50.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:50.615+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:51.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:51.296+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:51.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:51.357+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:51.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:51.468+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:51.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:51.567+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:52.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:52.253+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:52.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:52.333+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:52.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:52.512+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:52.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:52.530+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:53.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:53.236+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:53.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:53.314+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:53.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:53.475+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:53.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:53.563+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:54.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:54.210+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:54.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:54.298+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:54.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:54.509+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:54.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:54.586+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:55.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:55.243+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:55.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:55.292+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:55.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:55.553+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:55.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:55.615+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:56.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:56.215+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:56.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:56.270+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:56.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:56.552+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:56.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:56.609+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:57.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:57.184+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:57.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:57.244+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:57.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:57.541+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:57.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:57.605+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:58.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:58.231+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:58.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:58.252+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:58.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:58.558+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:58.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:58.614+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:59.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:38:59.251+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:59.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:38:59.262+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:59.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:38:59.535+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:38:59.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:38:59.578+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:00.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:00.224+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:00.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:00.287+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:00.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:00.550+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:00.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:00.554+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:01.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:01.252+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:01.318 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:01.316+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:01.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:01.532+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:01.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:01.565+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:01.731 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:39:01.728+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:39:02.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:02.299+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:02.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:02.352+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:02.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:02.570+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:02.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:02.575+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:03.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:03.338+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:03.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:03.338+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:03.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:03.545+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:03.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:03.592+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:04.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:04.300+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:04.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:04.342+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:04.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:39:04.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:39:04.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:04.543+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:04.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:04.571+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:05.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:05.276+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:05.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:05.388+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:05.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:05.504+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:05.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:05.583+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:06.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:06.248+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:06.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:06.344+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:06.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:06.508+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:06.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:06.539+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:07.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:07.247+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:07.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:07.364+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:07.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:07.520+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:07.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:07.570+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:08.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:08.214+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:08.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:08.405+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:08.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:08.555+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:08.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:08.576+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:09.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:09.192+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:09.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:09.377+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:09.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:09.544+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:09.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:09.595+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:10.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:10.216+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:10.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:10.410+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:10.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:10.536+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:10.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:10.582+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:11.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:11.185+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:11.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:11.420+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:11.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:11.544+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:11.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:11.593+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:12.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:12.209+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:12.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:12.425+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:12.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:12.538+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:12.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:12.552+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:13.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:13.241+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:13.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:13.457+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:13.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:13.528+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:13.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:13.551+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:14.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:14.223+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:14.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:14.411+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:14.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:14.525+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:14.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:14.551+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:15.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:15.226+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:15.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:15.452+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:15.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:15.502+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:15.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:15.548+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:16.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:16.181+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:16.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:16.496+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:16.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:16.516+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:16.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:16.556+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:16.733 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:39:16.732+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:39:17.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:17.202+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:17.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:17.470+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:17.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:17.489+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:17.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:17.526+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:18.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:18.228+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:18.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:18.513+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:18.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:18.517+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:18.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:18.519+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:19.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:19.272+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:19.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:19.521+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:19.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:19.528+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:19.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:19.533+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:20.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:20.315+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:20.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:20.496+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:20.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:20.518+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:20.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:20.527+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:21.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:21.359+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:21.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:21.535+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:21.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:21.536+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:21.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:21.569+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:22.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:22.314+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:22.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:22.539+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:22.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:22.548+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:22.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:22.576+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:23.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:23.301+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:23.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:23.556+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:23.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:23.556+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:23.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:23.618+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:24.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:24.307+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:24.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:24.520+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:24.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:24.526+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:24.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:24.583+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:25.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:25.317+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:25.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:25.538+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:25.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:25.544+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:25.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:25.574+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:26.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:26.284+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:26.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:26.528+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:26.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:26.546+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:26.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:26.554+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:27.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:27.244+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:27.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:27.535+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:27.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:27.544+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:27.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:27.566+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:28.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:28.283+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:28.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:28.519+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:28.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:28.569+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:28.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:28.574+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:29.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:29.300+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:29.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:29.515+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:29.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:29.612+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:29.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:29.618+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:30.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:30.311+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:30.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:30.476+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:30.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:30.581+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:30.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:30.649+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:31.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:31.269+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:31.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:31.509+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:31.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:31.609+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:31.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:31.625+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:31.746 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:39:31.744+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:39:32.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:32.291+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:32.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:32.516+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:32.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:32.627+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:32.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:32.650+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:33.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:33.289+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:33.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:33.550+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:33.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:33.607+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:33.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:33.633+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:34.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:34.246+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:34.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:34.522+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:34.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:39:34.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:39:34.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:34.630+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:34.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:34.661+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:35.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:35.232+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:35.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:35.514+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:35.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:35.657+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:35.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:35.665+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:36.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:36.224+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:36.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:36.544+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:36.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:36.611+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:36.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:36.618+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:37.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:37.226+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:37.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:37.543+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:37.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:37.596+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:37.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:37.639+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:38.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:38.251+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:38.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:38.544+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:38.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:38.606+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:38.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:38.632+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:39.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:39.233+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:39.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:39.500+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:39.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:39.642+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:39.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:39.659+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:40.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:40.199+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:40.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:40.532+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:40.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:40.660+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:40.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:40.705+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:41.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:41.171+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:41.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:41.539+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:41.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:41.646+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:41.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:41.674+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:42.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:42.172+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:42.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:42.580+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:42.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:42.645+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:42.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:42.672+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:43.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:43.205+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:43.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:43.546+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:43.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:43.609+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:43.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:43.650+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:44.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:44.244+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:44.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:44.516+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:44.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:44.646+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:44.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:44.667+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:45.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:45.211+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:45.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:45.478+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:45.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:45.648+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:45.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:45.705+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:46.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:46.248+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:46.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:46.509+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:46.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:46.678+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:46.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:46.699+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:46.762 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:39:46.760+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:39:47.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:47.266+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:47.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:47.486+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:47.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:47.629+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:47.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:47.682+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:48.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:48.236+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:48.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:48.467+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:48.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:48.606+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:48.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:48.721+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:49.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:49.252+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:49.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:49.511+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:49.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:49.651+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:49.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:49.677+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:50.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:50.281+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:50.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:50.511+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:50.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:50.687+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:50.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:50.728+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:51.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:51.294+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:51.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:51.533+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:51.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:51.650+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:51.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:51.723+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:52.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:52.295+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:52.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:52.490+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:52.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:52.625+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:52.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:52.726+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:53.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:53.257+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:53.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:53.450+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:53.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:53.624+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:53.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:53.695+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:54.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:54.250+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:54.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:54.464+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:54.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:54.597+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:54.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:54.682+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:55.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:55.282+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:55.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:55.457+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:55.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:55.616+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:55.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:55.685+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:56.281 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:56.278+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:56.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:56.506+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:56.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:56.585+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:56.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:56.639+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:57.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:57.276+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:57.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:57.501+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:57.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:57.577+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:57.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:57.678+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:58.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:58.289+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:58.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:58.465+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:58.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:58.555+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:58.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:58.667+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:59.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:39:59.288+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:59.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:39:59.471+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:59.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:39:59.553+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:39:59.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:39:59.642+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:00.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:00.267+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:00.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:00.490+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:00.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:00.559+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:00.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:00.602+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:01.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:01.294+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:01.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:01.525+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:01.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:01.537+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:01.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:01.634+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:01.778 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:40:01.776+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:40:02.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:02.264+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:02.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:02.551+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:02.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:02.575+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:02.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:02.587+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:03.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:03.236+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:03.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:03.517+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:03.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:03.544+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:03.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:03.596+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:04.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:04.242+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:04.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:04.487+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:04.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:04.557+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:04.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:04.594+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:04.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:40:04.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:40:05.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:05.246+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:05.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:05.528+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:05.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:05.596+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:05.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:05.597+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:06.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:06.238+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:06.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:06.481+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:06.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:06.558+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:06.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:06.627+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:07.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:07.258+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:07.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:07.513+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:07.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:07.576+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:07.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:07.624+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:08.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:08.225+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:08.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:08.468+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:08.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:08.543+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:08.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:08.653+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:09.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:09.269+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:09.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:09.462+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:09.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:09.494+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:09.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:09.703+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:10.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:10.255+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:10.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:10.504+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:10.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:10.524+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:10.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:10.706+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:11.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:11.233+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:11.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:11.501+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:11.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:11.508+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:11.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:11.707+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:12.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:12.191+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:12.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:12.484+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:12.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:12.491+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:12.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:12.732+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:13.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:13.172+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:13.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:13.482+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:13.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:13.501+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:13.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:13.717+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:14.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:14.146+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:14.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:14.462+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:14.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:14.491+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:14.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:14.689+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:15.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:15.192+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:15.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:15.500+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:15.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:15.502+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:15.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:15.659+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:16.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:16.172+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:16.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:16.503+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:16.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:16.506+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:16.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:16.611+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:16.793 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:40:16.791+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:40:17.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:17.209+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:17.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:17.494+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:17.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:17.507+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:17.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:17.649+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:18.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:18.189+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:18.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:18.503+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:18.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:18.529+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:18.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:18.606+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:19.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:19.159+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:19.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:19.465+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:19.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:19.555+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:19.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:19.619+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:20.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:20.157+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:20.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:20.437+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:20.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:20.526+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:20.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:20.579+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:21.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:21.155+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:21.476 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:21.474+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:21.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:21.509+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:21.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:21.550+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:22.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:22.164+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:22.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:22.435+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:22.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:22.556+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:22.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:22.594+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:23.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:23.186+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:23.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:23.416+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:23.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:23.583+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:23.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:23.611+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:24.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:24.205+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:24.374 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:24.373+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:24.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:24.590+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:24.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:24.630+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:25.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:25.181+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:25.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:25.391+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:25.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:25.582+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:25.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:25.674+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:26.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:26.156+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:26.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:26.425+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:26.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:26.629+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:26.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:26.645+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:27.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:27.162+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:27.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:27.442+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:27.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:27.595+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:27.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:27.616+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:28.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:28.199+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:28.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:28.481+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:28.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:28.551+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:28.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:28.619+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:29.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:29.225+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:29.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:29.500+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:29.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:29.588+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:29.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:29.592+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:30.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:30.190+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:30.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:30.489+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:30.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:30.571+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:30.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:30.581+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:31.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:31.151+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:31.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:31.507+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:31.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:31.591+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:31.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:31.621+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:31.806 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:40:31.803+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:40:32.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:32.168+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:32.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:32.510+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:32.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:32.575+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:32.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:32.585+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:33.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:33.187+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:33.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:33.515+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:33.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:33.573+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:33.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:33.597+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:34.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:34.179+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:34.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:34.562+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:34.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:34.581+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:34.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:34.612+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:34.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:40:34.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:40:35.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:35.202+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:35.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:35.532+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:35.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:35.567+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:35.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:35.604+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:36.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:36.186+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:36.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:36.539+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:36.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:36.615+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:36.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:36.652+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:37.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:37.177+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:37.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:37.546+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:37.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:37.634+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:37.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:37.681+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:38.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:38.134+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:38.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:38.566+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:38.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:38.614+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:38.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:38.652+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:39.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:39.126+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:39.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:39.604+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:39.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:39.635+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:39.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:39.699+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:40.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:40.151+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:40.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:40.645+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:40.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:40.648+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:40.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:40.748+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:41.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:41.120+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:41.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:41.623+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:41.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:41.648+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:41.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:41.780+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:42.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:42.107+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:42.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:42.645+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:42.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:42.694+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:42.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:42.756+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:43.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:43.106+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:43.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:43.641+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:43.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:43.662+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:43.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:43.712+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:44.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:44.074+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:44.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:44.641+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:44.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:44.667+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:44.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:44.705+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:45.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:45.050+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:45.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:45.657+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:45.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:45.666+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:45.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:45.731+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:46.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:46.015+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:46.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:46.652+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:46.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:46.670+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:46.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:46.722+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:46.822 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:40:46.819+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:40:47.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:47.009+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:47.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:47.634+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:47.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:47.675+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:47.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:47.765+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:48.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:48.016+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:48.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:48.675+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:48.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:48.714+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:48.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:48.730+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:48.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:48.974+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:49.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:49.699+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:49.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:49.702+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:49.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:49.738+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:49.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:49.927+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:50.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:50.658+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:50.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:50.707+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:50.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:50.743+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:50.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:50.958+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:51.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:51.684+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:51.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:51.757+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:51.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:51.763+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:51.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:51.969+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:52.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:52.664+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:52.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:52.740+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:52.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:52.805+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:52.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:52.925+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:53.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:53.679+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:53.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:53.759+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:53.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:53.807+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:53.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:53.940+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:54.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:54.637+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:54.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:54.753+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:54.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:54.849+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:54.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:54.939+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:55.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:55.660+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:55.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:55.704+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:55.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:55.825+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:55.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:55.911+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:56.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:56.654+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:56.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:56.675+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:56.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:56.803+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:56.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:56.919+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:57.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:57.668+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:57.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:57.704+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:57.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:57.844+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:57.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:57.964+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:58.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:58.679+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:58.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:58.723+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:58.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:58.797+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:59.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:40:59.006+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:59.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:40:59.676+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:59.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:40:59.679+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:40:59.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:40:59.783+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:00.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:00.018+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:00.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:00.667+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:00.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:00.709+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:00.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:00.807+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:00.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:00.973+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:01.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:01.637+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:01.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:01.667+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:01.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:01.827+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:01.837 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:41:01.835+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:41:01.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:01.925+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:02.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:02.597+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:02.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:02.649+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:02.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:02.876+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:02.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:02.972+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:03.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:03.557+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:03.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:03.670+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:03.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:03.882+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:03.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:03.965+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:04.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:04.539+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:04.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:04.663+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:04.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:04.871+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:04.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:41:04.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:41:04.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:04.970+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:05.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:05.549+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:05.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:05.693+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:05.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:05.875+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:05.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:05.993+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:06.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:06.549+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:06.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:06.671+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:06.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:06.827+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:06.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:06.962+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:07.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:07.571+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:07.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:07.634+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:07.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:07.854+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:07.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:07.952+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:08.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:08.529+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:08.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:08.588+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:08.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:08.901+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:08.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:08.941+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:09.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:09.493+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:09.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:09.605+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:09.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:09.877+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:09.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:09.985+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:10.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:10.542+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:10.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:10.643+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:10.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:10.919+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:10.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:10.966+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:11.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:11.578+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:11.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:11.650+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:11.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:11.887+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:11.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:11.942+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:12.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:12.573+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:12.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:12.607+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:12.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:12.850+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:12.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:12.949+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:13.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:13.569+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:13.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:13.598+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:13.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:13.818+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:13.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:13.941+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:14.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:14.548+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:14.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:14.602+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:14.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:14.849+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:14.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:14.907+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:15.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:15.541+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:15.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:15.568+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:15.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:15.838+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:15.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:15.867+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:16.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:16.550+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:16.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:16.561+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:16.842 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:41:16.839+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:41:16.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:16.886+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:16.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:16.901+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:17.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:17.561+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:17.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:17.588+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:17.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:17.901+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:17.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:17.921+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:18.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:18.553+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:18.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:18.604+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:18.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:18.866+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:18.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:18.938+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:19.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:19.573+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:19.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:19.593+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:19.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:19.900+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:19.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:19.933+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:20.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:20.614+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:20.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:20.615+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:20.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:20.895+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:20.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:20.952+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:21.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:21.613+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:21.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:21.659+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:21.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:21.848+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:21.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:21.933+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:22.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:22.634+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:22.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:22.650+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:22.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:22.882+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:22.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:22.931+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:23.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:23.621+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:23.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:23.623+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:23.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:23.903+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:23.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:23.910+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:24.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:24.578+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:24.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:24.651+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:24.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:24.862+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:24.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:24.941+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:25.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:25.598+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:25.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:25.607+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:25.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:25.868+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:25.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:25.895+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:26.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:26.609+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:26.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:26.625+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:26.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:26.831+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:26.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:26.849+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:27.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:27.591+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:27.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:27.639+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:27.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:27.825+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:27.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:27.880+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:28.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:28.609+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:28.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:28.653+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:28.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:28.864+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:28.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:28.914+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:29.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:29.601+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:29.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:29.627+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:29.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:29.822+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:29.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:29.879+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:30.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:30.578+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:30.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:30.673+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:30.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:30.792+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:30.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:30.830+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:31.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:31.602+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:31.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:31.710+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:31.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:31.763+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:31.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:31.843+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:31.849 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:41:31.847+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:41:32.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:32.565+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:32.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:32.758+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:32.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:32.804+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:32.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:32.811+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:33.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:33.567+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:33.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:33.740+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:33.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:33.813+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:33.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:33.829+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:34.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:34.585+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:34.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:34.724+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:34.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:34.797+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:34.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:34.825+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:35.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:41:35.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:41:35.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:35.578+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:35.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:35.767+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:35.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:35.780+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:35.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:35.792+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:36.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:36.622+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:36.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:36.720+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:36.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:36.790+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:36.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:36.809+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:37.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:37.638+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:37.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:37.709+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:37.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:37.766+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:37.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:37.800+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:38.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:38.591+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:38.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:38.720+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:38.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:38.738+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:38.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:38.849+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:39.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:39.585+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:39.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:39.675+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:39.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:39.693+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:39.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:39.880+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:40.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:40.554+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:40.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:40.645+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:40.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:40.670+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:40.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:40.875+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:41.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:41.576+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:41.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:41.611+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:41.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:41.720+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:41.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:41.856+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:42.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:42.574+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:42.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:42.634+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:42.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:42.685+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:42.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:42.866+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:43.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:43.562+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:43.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:43.615+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:43.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:43.647+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:43.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:43.880+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:44.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:44.529+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:44.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:44.660+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:44.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:44.670+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:44.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:44.923+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:45.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:45.556+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:45.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:45.657+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:45.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:45.682+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:45.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:45.876+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:46.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:46.550+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:46.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:46.664+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:46.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:46.697+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:46.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:46.855+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:46.865 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:41:46.863+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:41:47.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:47.515+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:47.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:47.628+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:47.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:47.692+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:47.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:47.864+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:48.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:48.518+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:48.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:48.669+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:48.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:48.713+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:48.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:48.879+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:49.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:49.521+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:49.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:49.660+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:49.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:49.672+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:49.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:49.886+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:50.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:50.544+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:50.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:50.623+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:50.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:50.629+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:50.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:50.885+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:51.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:51.539+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:51.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:51.625+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:51.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:51.646+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:51.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:51.893+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:52.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:52.501+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:52.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:52.604+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:52.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:52.670+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:52.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:52.892+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:53.460 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:53.458+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:53.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:53.594+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:53.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:53.713+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:53.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:53.875+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:54.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:54.422+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:54.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:54.630+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:54.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:54.723+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:54.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:54.851+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:55.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:55.400+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:55.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:55.667+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:55.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:55.748+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:55.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:55.851+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:56.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:56.366+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:56.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:56.698+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:56.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:56.699+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:56.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:56.872+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:57.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:57.361+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:57.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:57.674+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:57.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:57.716+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:57.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:57.850+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:58.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:58.374+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:58.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:58.687+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:58.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:58.687+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:58.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:58.818+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:59.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:41:59.358+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:59.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:41:59.662+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:59.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:41:59.728+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:41:59.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:41:59.854+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:00.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:00.338+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:00.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:00.690+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:00.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:00.737+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:00.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:00.866+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:01.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:01.331+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:01.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:01.729+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:01.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:01.737+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:01.866 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:42:01.864+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:42:01.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:01.894+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:02.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:02.346+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:02.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:02.682+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:02.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:02.719+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:02.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:02.935+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:03.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:03.385+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:03.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:03.658+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:03.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:03.688+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:03.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:03.950+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:04.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:04.433+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:04.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:04.639+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:04.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:04.700+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:04.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:04.927+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:05.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:42:05.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:42:05.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:05.403+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:05.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:05.668+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:05.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:05.705+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:05.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:05.898+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:06.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:06.358+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:06.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:06.624+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:06.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:06.698+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:06.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:06.928+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:07.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:07.322+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:07.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:07.642+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:07.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:07.682+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:07.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:07.906+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:08.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:08.340+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:08.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:08.652+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:08.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:08.660+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:08.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:08.908+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:09.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:09.306+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:09.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:09.608+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:09.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:09.675+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:09.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:09.916+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:10.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:10.350+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:10.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:10.607+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:10.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:10.685+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:10.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:10.887+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:11.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:11.320+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:11.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:11.582+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:11.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:11.724+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:11.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:11.927+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:12.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:12.306+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:12.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:12.561+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:12.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:12.732+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:12.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:12.971+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:13.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:13.263+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:13.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:13.598+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:13.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:13.773+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:13.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:13.967+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:14.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:14.290+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:14.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:14.617+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:14.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:14.774+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:14.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:14.943+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:15.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:15.285+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:15.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:15.569+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:15.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:15.814+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:15.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:15.904+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:16.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:16.247+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:16.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:16.563+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:16.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:16.852+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:16.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:16.880+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:16.882 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:42:16.881+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:42:17.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:17.250+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:17.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:17.611+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:17.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:17.853+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:17.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:17.870+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:18.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:18.213+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:18.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:18.627+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:18.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:18.897+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:18.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:18.920+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:19.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:19.209+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:19.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:19.590+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:19.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:19.921+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:19.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:19.957+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:20.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:20.247+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:20.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:20.638+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:20.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:20.879+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:20.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:20.971+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:21.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:21.231+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:21.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:21.654+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:21.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:21.856+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:21.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:21.933+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:22.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:22.271+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:22.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:22.690+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:22.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:22.810+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:22.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:22.929+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:23.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:23.263+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:23.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:23.691+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:23.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:23.806+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:23.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:23.931+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:24.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:24.229+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:24.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:24.724+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:24.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:24.843+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:24.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:24.971+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:25.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:25.193+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:25.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:25.726+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:25.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:25.885+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:26.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:26.013+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:26.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:26.206+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:26.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:26.747+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:26.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:26.888+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:27.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:27.027+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:27.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:27.184+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:27.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:27.748+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:27.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:27.867+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:28.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:28.037+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:28.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:28.223+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:28.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:28.759+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:28.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:28.834+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:29.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:29.005+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:29.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:29.206+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:29.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:29.729+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:29.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:29.822+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:30.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:30.000+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:30.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:30.203+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:30.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:30.687+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:30.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:30.855+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:31.043 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:31.041+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:31.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:31.227+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:31.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:31.641+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:31.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:31.806+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:31.898 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:42:31.896+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:42:32.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:32.089+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:32.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:32.199+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:32.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:32.679+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:32.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:32.851+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:33.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:33.136+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:33.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:33.184+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:33.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:33.635+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:33.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:33.850+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:34.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:34.140+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:34.171 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:34.169+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:34.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:34.681+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:34.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:34.860+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:35.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:35.176+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:35.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:35.179+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:35.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:42:35.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:42:35.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:35.706+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:35.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:35.878+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:36.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:36.148+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:36.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:36.209+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:36.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:36.689+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:36.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:36.872+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:37.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:37.131+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:37.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:37.189+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:37.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:37.700+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:37.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:37.825+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:38.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:38.174+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:38.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:38.187+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:38.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:38.695+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:38.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:38.835+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:39.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:39.149+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:39.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:39.216+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:39.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:39.668+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:39.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:39.846+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:40.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:40.175+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:40.266 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:40.264+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:40.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:40.680+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:40.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:40.896+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:41.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:41.141+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:41.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:41.234+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:41.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:41.653+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:41.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:41.916+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:42.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:42.110+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:42.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:42.275+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:42.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:42.667+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:42.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:42.908+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:43.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:43.125+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:43.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:43.237+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:43.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:43.709+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:43.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:43.894+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:44.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:44.164+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:44.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:44.284+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:44.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:44.699+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:44.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:44.938+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:45.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:45.203+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:45.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:45.323+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:45.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:45.707+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:45.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:45.894+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:46.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:46.214+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:46.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:46.289+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:46.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:46.719+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:46.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:46.851+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:46.914 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:42:46.912+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:42:47.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:47.173+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:47.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:47.313+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:47.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:47.750+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:47.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:47.847+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:48.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:48.176+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:48.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:48.320+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:48.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:48.800+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:48.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:48.827+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:49.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:49.154+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:49.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:49.371+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:49.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:49.778+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:49.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:49.822+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:50.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:50.168+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:50.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:50.333+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:50.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:50.793+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:50.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:50.829+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:51.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:51.160+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:51.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:51.342+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:51.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:51.815+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:51.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:51.842+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:52.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:52.168+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:52.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:52.376+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:52.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:52.802+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:52.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:52.857+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:53.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:53.120+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:53.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:53.410+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:53.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:53.805+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:53.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:53.894+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:54.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:54.096+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:54.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:54.383+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:54.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:54.834+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:54.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:54.889+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:55.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:55.128+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:55.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:55.434+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:55.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:55.798+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:55.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:55.845+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:56.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:56.120+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:56.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:56.426+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:56.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:56.792+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:56.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:56.893+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:57.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:57.114+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:57.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:57.397+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:57.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:57.838+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:57.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:57.923+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:58.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:58.090+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:58.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:58.423+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:58.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:58.815+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:58.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:58.875+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:59.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:42:59.129+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:59.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:42:59.471+0000 7f6e44c9f700 -1 osd.7 115 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:59.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:42:59.816+0000 7f389e18e700 -1 osd.4 115 get_health_metrics reporting 69 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:42:59.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:42:59.841+0000 7f596d92c700 -1 osd.6 115 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:00.089 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T02:43:00.087+0000 7f655589f700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:43:00.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:00.099+0000 7f72c425d700 -1 osd.5 115 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:00.103 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T02:43:00.087+0000 7f655589f700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:43:00.125 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T02:43:00.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:00.465+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:00.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:00.802+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:00.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:00.858+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:01.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:01.086+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:01.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:01.457+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:01.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:01.804+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:01.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:01.873+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:01.916 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:43:01.914+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:43:02.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:02.099+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:02.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:02.457+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:02.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:02.762+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:02.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:02.863+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:03.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:03.118+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:03.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:03.470+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:03.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:03.789+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:03.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:03.831+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:04.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:04.131+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:04.476 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:04.475+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:04.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:04.761+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:04.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:04.865+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:05.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:05.132+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:05.391 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:43:05.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:43:05.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:05.524+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:05.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:05.794+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:05.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:05.822+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:06.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:06.161+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:06.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:06.549+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:06.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:06.826+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:06.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:06.868+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:07.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:07.183+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:07.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:07.558+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:07.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:07.779+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:07.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:07.875+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:08.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:08.137+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:08.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:08.582+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:08.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:08.784+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:08.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:08.919+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:09.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:09.179+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:09.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:09.586+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:09.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:09.765+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:09.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:09.887+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:10.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:10.193+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:10.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:10.563+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:10.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:10.813+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:10.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:10.895+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:11.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:11.215+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:11.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:11.554+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:11.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:11.825+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:11.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:11.943+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:12.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:12.240+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:12.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:12.602+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:12.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:12.857+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:12.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:12.940+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:13.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:13.274+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:13.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:13.584+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:13.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:13.864+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:13.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:13.934+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:14.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:14.278+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:14.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:14.618+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:14.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:14.816+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:14.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:14.974+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:15.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:15.309+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:15.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:15.663+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:15.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:15.837+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:15.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:15.944+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:16.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:16.357+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:16.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:16.707+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:16.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:16.806+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:16.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:16.911+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:16.931 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:43:16.929+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:43:17.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:17.383+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:17.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:17.713+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:17.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:17.837+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:17.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:17.870+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:18.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:18.380+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:18.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:18.699+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:18.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:18.850+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:18.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:18.878+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:19.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:19.407+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:19.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:19.657+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:19.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:19.892+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:19.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:19.923+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:20.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:20.416+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:20.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:20.648+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:20.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:20.920+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:20.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:20.967+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:21.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:21.396+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:21.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:21.676+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:21.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:21.875+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:22.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:22.003+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:22.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:22.370+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:22.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:22.664+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:22.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:22.915+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:22.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:22.984+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:23.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:23.360+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:23.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:23.634+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:23.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:23.908+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:24.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:24.001+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:24.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:24.312+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:24.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:24.634+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:24.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:24.946+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:24.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:24.986+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:25.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:25.312+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:25.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:25.684+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:25.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:25.948+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:25.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:25.988+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:26.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:26.351+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:26.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:26.697+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:26.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:26.949+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:26.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:26.956+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:27.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:27.367+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:27.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:27.685+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:27.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:27.907+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:27.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:27.968+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:28.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:28.333+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:28.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:28.660+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:28.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:28.894+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:28.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:28.934+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:29.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:29.306+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:29.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:29.702+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:29.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:29.907+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:29.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:29.968+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:30.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:30.355+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:30.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:30.663+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:30.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:30.897+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:30.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:30.932+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:31.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:31.392+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:31.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:31.626+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:31.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:31.861+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:31.947 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:43:31.946+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:43:31.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:31.971+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:32.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:32.373+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:32.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:32.623+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:32.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:32.836+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:32.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:32.979+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:33.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:33.392+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:33.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:33.636+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:33.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:33.796+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:33.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:33.946+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:34.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:34.376+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:34.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:34.662+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:34.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:34.808+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:34.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:34.963+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:35.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:35.337+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:35.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:43:35.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:43:35.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:35.708+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:35.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:35.842+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:35.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:35.977+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:36.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:36.318+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:36.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:36.686+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:36.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:36.813+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:36.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:36.983+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:37.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:37.272+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:37.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:37.648+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:37.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:37.778+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:37.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:37.953+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:38.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:38.263+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:38.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:38.669+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:38.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:38.762+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:38.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:38.922+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:39.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:39.267+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:39.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:39.660+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:39.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:39.753+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:39.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:39.962+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:40.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:40.275+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:40.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:40.670+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:40.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:40.795+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:41.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:41.007+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:41.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:41.306+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:41.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:41.708+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:41.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:41.746+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:42.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:42.053+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:42.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:42.343+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:42.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:42.706+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:42.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:42.722+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:43.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:43.061+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:43.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:43.374+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:43.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:43.681+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:43.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:43.696+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:44.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:44.040+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:44.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:44.415+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:44.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:44.654+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:44.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:44.736+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:45.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:45.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:45.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:45.453+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:45.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:45.686+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:45.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:45.712+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:46.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:46.007+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:46.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:46.499+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:46.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:46.685+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:46.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:46.715+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:46.954 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:43:46.951+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:43:46.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:46.959+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:47.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:47.505+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:47.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:47.642+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:47.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:47.677+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:47.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:47.967+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:48.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:48.552+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:48.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:48.652+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:48.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:48.715+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:48.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:48.955+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:49.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:49.602+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:49.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:49.615+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:49.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:49.701+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:49.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:49.985+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:50.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:50.591+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:50.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:50.613+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:50.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:50.688+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:50.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:50.977+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:51.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:51.622+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:51.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:51.625+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:51.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:51.649+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:52.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:52.006+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:52.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:52.602+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:52.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:52.636+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:52.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:52.645+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:52.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:52.985+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:53.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:53.572+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:53.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:53.599+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:53.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:53.614+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:53.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:53.995+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:54.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:54.536+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:54.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:54.564+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:54.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:54.643+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:54.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:54.983+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:55.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:55.538+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:55.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:55.562+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:55.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:55.685+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:55.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:55.954+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:56.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:56.517+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:56.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:56.518+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:56.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:56.670+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:56.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:56.944+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:57.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:57.479+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:57.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:57.543+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:57.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:57.718+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:57.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:57.921+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:58.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:58.462+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:58.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:58.592+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:58.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:58.687+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:58.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:43:58.959+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:59.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:43:59.414+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:59.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:43:59.602+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:43:59.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:43:59.725+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:00.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:00.007+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:00.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:00.385+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:00.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:00.559+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:00.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:00.758+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:00.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:00.994+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:01.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:01.397+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:01.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:01.530+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:01.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:01.783+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:01.969 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:44:01.967+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:44:01.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:01.996+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:02.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:02.421+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:02.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:02.555+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:02.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:02.808+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:03.030 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:03.028+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:03.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:03.378+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:03.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:03.544+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:03.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:03.845+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:04.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:04.039+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:04.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:04.332+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:04.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:04.524+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:04.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:04.821+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:05.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:05.014+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:05.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:05.305+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:05.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:05.492+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:05.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:44:05.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:44:05.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:05.810+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:06.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:06.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:06.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:06.295+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:06.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:06.487+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:06.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:06.761+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:06.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:06.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:07.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:07.312+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:07.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:07.470+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:07.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:07.759+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:07.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:07.974+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:08.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:08.337+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:08.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:08.499+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:08.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:08.782+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:08.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:08.971+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:09.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:09.340+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:09.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:09.536+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:09.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:09.805+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:09.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:09.954+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:10.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:10.294+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:10.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:10.500+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:10.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:10.783+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:10.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:10.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:11.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:11.300+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:11.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:11.492+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:11.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:11.773+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:11.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:11.942+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:12.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:12.250+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:12.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:12.443+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:12.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:12.779+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:12.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:12.930+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:13.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:13.283+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:13.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:13.471+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:13.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:13.752+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:13.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:13.971+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:14.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:14.239+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:14.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:14.454+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:14.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:14.732+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:14.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:14.945+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:15.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:15.195+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:15.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:15.491+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:15.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:15.748+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:15.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:15.983+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:16.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:16.159+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:16.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:16.518+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:16.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:16.776+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:16.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:16.947+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:16.970 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:44:16.968+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:44:17.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:17.131+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:17.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:17.520+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:17.744 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:17.742+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:17.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:17.899+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:18.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:18.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:18.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:18.525+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:18.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:18.716+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:18.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:18.912+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:19.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:19.104+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:19.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:19.569+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:19.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:19.670+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:19.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:19.932+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:20.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:20.098+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:20.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:20.606+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:20.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:20.665+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:20.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:20.940+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:21.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:21.083+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:21.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:21.638+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:21.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:21.682+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:21.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:21.896+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:22.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:22.059+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:22.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:22.634+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:22.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:22.656+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:22.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:22.916+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:23.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:23.022+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:23.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:23.662+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:23.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:23.663+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:23.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:23.878+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:24.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:24.059+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:24.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:24.622+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:24.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:24.672+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:24.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:24.895+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:25.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:25.053+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:25.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:25.649+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:25.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:25.675+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:25.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:25.881+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:26.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:26.021+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:26.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:26.690+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:26.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:26.713+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:26.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:26.861+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:27.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:27.012+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:27.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:27.656+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:27.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:27.731+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:27.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:27.812+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:27.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:27.977+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:28.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:28.650+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:28.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:28.746+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:28.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:28.819+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:28.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:28.944+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:29.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:29.607+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:29.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:29.712+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:29.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:29.800+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:29.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:29.952+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:30.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:30.582+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:30.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:30.740+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:30.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:30.845+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:30.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:30.945+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:31.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:31.581+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:31.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:31.746+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:31.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:31.844+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:31.986 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:44:31.984+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:44:31.986 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:31.984+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:32.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:32.567+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:32.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:32.749+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:32.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:32.863+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:32.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:32.939+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:33.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:33.565+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:33.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:33.711+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:33.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:33.817+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:33.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:33.983+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:34.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:34.605+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:34.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:34.704+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:34.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:34.848+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:34.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:34.992+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:35.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:35.608+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:35.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:35.674+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:35.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:44:35.811 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:44:35.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:35.820+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:35.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:35.951+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:36.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:36.613+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:36.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:36.710+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:36.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:36.849+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:36.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:36.920+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:37.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:37.655+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:37.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:37.728+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:37.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:37.869+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:37.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:37.932+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:38.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:38.630+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:38.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:38.719+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:38.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:38.851+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:38.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:38.972+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:39.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:39.595+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:39.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:39.743+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:39.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:39.853+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:40.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:40.012+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:40.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:40.547+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:40.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:40.772+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:40.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:40.889+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:41.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:41.016+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:41.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:41.501+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:41.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:41.754+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:41.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:41.842+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:42.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:42.000+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:42.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:42.487+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:42.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:42.754+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:42.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:42.817+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:43.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:43.032+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:43.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:43.517+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:43.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:43.769+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:43.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:43.798+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:44.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:44.052+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:44.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:44.543+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:44.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:44.793+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:44.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:44.834+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:45.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:45.057+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:45.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:45.582+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:45.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:45.753+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:45.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:45.850+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:46.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:46.097+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:46.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:46.623+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:46.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:46.727+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:46.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:46.871+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:46.992 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:44:46.990+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:44:47.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:47.142+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:47.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:47.580+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:47.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:47.703+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:47.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:47.894+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:48.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:48.187+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:48.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:48.579+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:48.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:48.743+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:48.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:48.924+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:49.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:49.179+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:49.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:49.628+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:49.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:49.706+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:49.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:49.885+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:50.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:50.138+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:50.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:50.595+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:50.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:50.672+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:50.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:50.843+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:51.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:51.116+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:51.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:51.631+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:51.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:51.720+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:51.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:51.807+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:52.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:52.082+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:52.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:52.617+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:52.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:52.687+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:52.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:52.795+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:53.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:53.127+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:53.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:53.613+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:53.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:53.720+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:53.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:53.814+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:54.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:54.092+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:54.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:54.646+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:54.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:54.722+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:54.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:54.810+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:55.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:55.124+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:55.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:55.663+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:55.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:55.688+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:55.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:55.810+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:56.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:56.081+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:56.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:56.619+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:56.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:56.679+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:56.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:56.787+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:57.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:57.088+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:57.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:57.569+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:57.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:57.699+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:57.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:57.831+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:58.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:58.129+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:58.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:58.538+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:58.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:58.715+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:58.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:58.789+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:59.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:44:59.167+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:59.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:44:59.582+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:59.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:44:59.680+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:44:59.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:44:59.791+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:00.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:00.139+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:00.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:00.615+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:00.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:00.649+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:00.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:00.787+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:01.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:01.144+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:01.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:01.606+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:01.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:01.646+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:01.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:01.745+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:02.007 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:45:02.005+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:45:02.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:02.135+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:02.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:02.641+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:02.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:02.678+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:02.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:02.723+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:03.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:03.155+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:03.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:03.595+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:03.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:03.717+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:03.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:03.755+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:04.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:04.136+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:04.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:04.587+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:04.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:04.691+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:04.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:04.760+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:05.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:05.108+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:05.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:05.552+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:05.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:05.723+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:05.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:05.731+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:05.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:45:05.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:45:06.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:06.135+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:06.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:06.520+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:06.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:06.697+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:06.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:06.728+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:07.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:07.102+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:07.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:07.555+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:07.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:07.719+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:07.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:07.746+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:08.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:08.116+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:08.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:08.566+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:08.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:08.760+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:08.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:08.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:09.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:09.107+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:09.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:09.551+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:09.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:09.793+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:09.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:09.801+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:10.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:10.076+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:10.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:10.505+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:10.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:10.755+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:10.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:10.793+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:11.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:11.118+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:11.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:11.470+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:11.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:11.763+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:11.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:11.804+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:12.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:12.075+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:12.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:12.446+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:12.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:12.754+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:12.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:12.823+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:13.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:13.111+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:13.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:13.469+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:13.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:13.711+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:13.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:13.789+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:14.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:14.111+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:14.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:14.474+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:14.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:14.664+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:14.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:14.799+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:15.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:15.119+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:15.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:15.435+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:15.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:15.658+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:15.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:15.764+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:16.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:16.169+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:16.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:16.436+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:16.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:16.645+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:16.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:16.802+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:17.023 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:45:17.022+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:45:17.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:17.148+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:17.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:17.469+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:17.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:17.651+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:17.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:17.802+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:18.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:18.098+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:18.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:18.478+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:18.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:18.678+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:18.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:18.774+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:19.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:19.097+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:19.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:19.502+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:19.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:19.642+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:19.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:19.735+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:20.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:20.083+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:20.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:20.530+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:20.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:20.642+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:20.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:20.728+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:21.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:21.095+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:21.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:21.504+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:21.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:21.607+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:21.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:21.747+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:22.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:22.087+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:22.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:22.545+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:22.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:22.590+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:22.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:22.732+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:23.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:23.075+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:23.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:23.498+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:23.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:23.549+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:23.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:23.735+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:24.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:24.026+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:24.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:24.480+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:24.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:24.529+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:24.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:24.753+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:24.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:24.977+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:25.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:25.438+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:25.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:25.524+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:25.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:25.712+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:25.988 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:25.986+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:26.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:26.444+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:26.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:26.571+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:26.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:26.752+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:26.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:26.962+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:27.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:27.488+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:27.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:27.621+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:27.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:27.753+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:28.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:28.000+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:28.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:28.509+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:28.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:28.574+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:28.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:28.734+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:29.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:29.030+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:29.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:29.467+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:29.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:29.590+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:29.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:29.711+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:30.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:30.068+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:30.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:30.461+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:30.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:30.624+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:30.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:30.735+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:31.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:31.082+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:31.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:31.453+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:31.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:31.637+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:31.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:31.762+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:32.026 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:45:32.023+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:45:32.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:32.108+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:32.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:32.452+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:32.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:32.651+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:32.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:32.794+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:33.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:33.124+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:33.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:33.407+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:33.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:33.657+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:33.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:33.781+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:34.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:34.124+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:34.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:34.427+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:34.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:34.629+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:34.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:34.794+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:35.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:35.078+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:35.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:35.399+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:35.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:35.659+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:35.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:35.830+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:36.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:45:36.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:45:36.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:36.044+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:36.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:36.415+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:36.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:36.701+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:36.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:36.797+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:37.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:37.009+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:37.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:37.385+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:37.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:37.730+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:37.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:37.809+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:38.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:38.027+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:38.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:38.409+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:38.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:38.754+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:38.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:38.801+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:38.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:38.996+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:39.457 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:39.455+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:39.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:39.773+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:39.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:39.815+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:39.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:39.960+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:40.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:40.502+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:40.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:40.816+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:40.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:40.847+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:40.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:40.916+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:41.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:41.533+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:41.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:41.778+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:41.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:41.872+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:41.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:41.942+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:42.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:42.554+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:42.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:42.802+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:42.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:42.861+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:42.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:42.983+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:43.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:43.581+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:43.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:43.850+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:43.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:43.896+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:43.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:43.996+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:44.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:44.602+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:44.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:44.801+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:44.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:44.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:44.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:44.963+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:45.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:45.638+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:45.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:45.806+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:45.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:45.889+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:45.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:45.996+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:46.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:46.671+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:46.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:46.840+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:46.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:46.849+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:47.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:47.029+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:47.040 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:45:47.038+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:45:47.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:47.685+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:47.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:47.826+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:47.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:47.842+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:48.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:48.011+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:48.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:48.638+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:48.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:48.801+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:48.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:48.821+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:48.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:48.975+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:49.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:49.591+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:49.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:49.829+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:49.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:49.856+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:50.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:50.022+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:50.640 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:50.638+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:50.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:50.835+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:50.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:50.848+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:51.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:51.059+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:51.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:51.609+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:51.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:51.824+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:51.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:51.828+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:52.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:52.094+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:52.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:52.625+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:52.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:52.780+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:52.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:52.827+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:53.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:53.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:53.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:53.600+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:53.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:53.783+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:53.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:53.789+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:54.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:54.124+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:54.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:54.553+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:54.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:54.745+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:54.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:54.755+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:55.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:55.122+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:55.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:55.526+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:55.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:55.729+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:55.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:55.749+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:56.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:56.131+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:56.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:56.492+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:56.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:56.752+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:56.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:56.797+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:57.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:57.113+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:57.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:57.470+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:57.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:57.745+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:57.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:57.789+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:58.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:58.130+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:58.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:58.451+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:58.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:58.755+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:58.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:58.766+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:59.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:45:59.099+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:59.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:45:59.457+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:59.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:45:59.750+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:45:59.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:45:59.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 17 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:00.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:00.063+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 6 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:00.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:00.474+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:00.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:00.757+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:00.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:00.784+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:01.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:01.064+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:01.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:01.487+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:01.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:01.716+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:01.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:01.829+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:02.056 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:46:02.054+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:46:02.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:02.060+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:02.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:02.480+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:02.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:02.763+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:02.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:02.827+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:03.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:03.014+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:03.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:03.496+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:03.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:03.790+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:03.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:03.838+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:04.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:04.062+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:04.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:04.537+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:04.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:04.827+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:04.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:04.886+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:05.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:05.034+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:05.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:05.576+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:05.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:05.835+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:05.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:05.844+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:06.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:06.045+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:06.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:46:06.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:46:06.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:06.615+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:06.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:06.807+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:06.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:06.893+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:07.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:07.028+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:07.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:07.565+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:07.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:07.782+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:07.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:07.876+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:07.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:07.988+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:08.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:08.552+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:08.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:08.813+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:08.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:08.917+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:09.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:09.024+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:09.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:09.594+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:09.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:09.770+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:09.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:09.912+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:09.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:09.998+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:10.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:10.586+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:10.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:10.780+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:10.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:10.944+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:10.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:10.982+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:11.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:11.577+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:11.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:11.766+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:11.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:11.924+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:12.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:12.001+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:12.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:12.550+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:12.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:12.782+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:12.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:12.914+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:13.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:13.014+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:13.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:13.531+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:13.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:13.782+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:13.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:13.925+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:14.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:14.031+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:14.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:14.504+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:14.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:14.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:14.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:14.970+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:15.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:15.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:15.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:15.554+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:15.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:15.784+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:15.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:15.923+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:16.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:16.037+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:16.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:16.504+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:16.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:16.798+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:16.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:16.935+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:17.058 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:46:17.056+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:46:17.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:17.073+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:17.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:17.515+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:17.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:17.827+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:17.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:17.918+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:18.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:18.046+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:18.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:18.489+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:18.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:18.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:18.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:18.920+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:19.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:19.055+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:19.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:19.449+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:19.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:19.820+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:19.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:19.968+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:20.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:20.011+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:20.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:20.418+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:20.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:20.846+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:20.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:20.919+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:21.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:21.032+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:21.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:21.429+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:21.888 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:21.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:21.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:21.953+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:22.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:22.024+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:22.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:22.424+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:22.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:22.866+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:22.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:22.982+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:23.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:23.019+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:23.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:23.398+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:23.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:23.866+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:24.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:23.999+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:24.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:24.034+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:24.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:24.419+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:24.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:24.876+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:24.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:24.989+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:25.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:25.082+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:25.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:25.379+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:25.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:25.876+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:26.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:26.015+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:26.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:26.070+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:26.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:26.367+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:26.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:26.893+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:26.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:26.976+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:27.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:27.073+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:27.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:27.402+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:27.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:27.857+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:28.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:28.014+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:28.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:28.046+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:28.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:28.397+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:28.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:28.821+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:29.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:29.015+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:29.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:29.090+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:29.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:29.445+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:29.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:29.824+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:29.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:29.972+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:30.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:30.042+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:30.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:30.404+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:30.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:30.785+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:30.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:30.981+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:31.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:31.081+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:31.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:31.439+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:31.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:31.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:31.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:31.997+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:32.061 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:46:32.060+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:46:32.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:32.117+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:32.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:32.479+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:32.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:32.771+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:32.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:32.988+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:33.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:33.114+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:33.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:33.470+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:33.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:33.772+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:33.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:33.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:34.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:34.117+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:34.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:34.495+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:34.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:34.743+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:34.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:34.996+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:35.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:35.151+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:35.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:35.489+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:35.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:35.723+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:35.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:35.998+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:36.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:36.164+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:36.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:46:36.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:46:36.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:36.469+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:36.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:36.763+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:36.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:36.961+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:37.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:37.145+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:37.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:37.494+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:37.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:37.801+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:37.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:37.915+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:38.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:38.184+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:38.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:38.534+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:38.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:38.765+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:38.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:38.887+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:39.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:39.178+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:39.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:39.503+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:39.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:39.742+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:39.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:39.864+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:40.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:40.201+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:40.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:40.515+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:40.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:40.736+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:40.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:40.825+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:41.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:41.235+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:41.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:41.477+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:41.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:41.728+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:41.875 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:41.873+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:42.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:42.238+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:42.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:42.491+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:42.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:42.762+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:42.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:42.902+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:43.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:43.199+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:43.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:43.484+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:43.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:43.773+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:43.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:43.946+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:44.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:44.172+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:44.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:44.462+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:44.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:44.757+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:44.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:44.991+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:45.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:45.211+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:45.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:45.419+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:45.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:45.715+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:46.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:46.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:46.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:46.242+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:46.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:46.395+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:46.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:46.665+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:47.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:47.014+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:47.063 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:46:47.061+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:46:47.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:47.201+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:47.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:47.355+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:47.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:47.645+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:48.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:48.058+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:48.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:48.208+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:48.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:48.329+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:48.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:48.627+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:49.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:49.015+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:49.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:49.193+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:49.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:49.373+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:49.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:49.626+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:50.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:50.019+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:50.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:50.158+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:50.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:50.422+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:50.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:50.637+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:51.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:51.040+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:51.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:51.192+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:51.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:51.438+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:51.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:51.641+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:52.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:52.020+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:52.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:52.163+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:52.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:52.418+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:52.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:52.620+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:53.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:53.021+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:53.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:53.123+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:53.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:53.414+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:53.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:53.622+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:54.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:54.004+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:54.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:54.105+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:54.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:54.452+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:54.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:54.671+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:54.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:54.979+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:55.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:55.125+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:55.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:55.488+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:55.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:55.700+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:56.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:56.005+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:56.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:56.094+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:56.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:56.478+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:56.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:56.732+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:57.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:57.007+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:57.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:57.064+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:57.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:57.459+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:57.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:57.739+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:57.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:57.989+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:58.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:58.048+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:58.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:58.475+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:58.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:58.710+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:58.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:58.963+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:59.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:46:59.055+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:59.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:46:59.503+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:59.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:46:59.726+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:46:59.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:46:59.995+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:00.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:00.089+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:00.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:00.502+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:00.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:00.693+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:00.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:00.974+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:01.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:01.043+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:01.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:01.479+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:01.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:01.718+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:01.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:01.959+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:02.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:02.023+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:02.066 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:47:02.064+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:47:02.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:02.453+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:02.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:02.677+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:02.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:02.925+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:03.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:03.026+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:03.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:03.475+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:03.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:03.721+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:03.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:03.928+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:04.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:04.071+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:04.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:04.520+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:04.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:04.734+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:04.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:04.884+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:05.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:05.117+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:05.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:05.550+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:05.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:05.749+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:05.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:05.924+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:06.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:06.117+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:06.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:47:06.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:47:06.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:06.568+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:06.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:06.796+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:06.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:06.877+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:07.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:07.132+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:07.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:07.599+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:07.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:07.759+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:07.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:07.868+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:08.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:08.089+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:08.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:08.591+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:08.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:08.748+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:08.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:08.906+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:09.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:09.127+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:09.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:09.601+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:09.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:09.741+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:09.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:09.902+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:10.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:10.141+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:10.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:10.560+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:10.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:10.789+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:10.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:10.881+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:11.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:11.177+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:11.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:11.572+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:11.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:11.832+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:11.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:11.833+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:12.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:12.153+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:12.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:12.562+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:12.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:12.826+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:12.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:12.867+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:13.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:13.139+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:13.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:13.518+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:13.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:13.823+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:13.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:13.848+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:14.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:14.186+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:14.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:14.476+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:14.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:14.826+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:14.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:14.893+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:15.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:15.163+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:15.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:15.526+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:15.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:15.852+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:15.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:15.879+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:16.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:16.163+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:16.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:16.545+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:16.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:16.819+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:16.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:16.862+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:17.082 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:47:17.080+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:47:17.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:17.133+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:17.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:17.542+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:17.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:17.847+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:17.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:17.861+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:18.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:18.154+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:18.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:18.585+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:18.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:18.881+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:18.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:18.911+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:19.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:19.163+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:19.576 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:19.575+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:19.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:19.842+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:19.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:19.878+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:20.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:20.150+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:20.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:20.583+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:20.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:20.825+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:20.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:20.863+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:21.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:21.149+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:21.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:21.539+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:21.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:21.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:21.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:21.850+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:22.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:22.116+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:22.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:22.553+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:22.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:22.817+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:22.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:22.850+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:23.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:23.096+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:23.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:23.535+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:23.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:23.811+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:23.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:23.852+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:24.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:24.095+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:24.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:24.521+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:24.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:24.820+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:24.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:24.850+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:25.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:25.118+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:25.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:25.484+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:25.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:25.814+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:25.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:25.819+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:26.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:26.149+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:26.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:26.524+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:26.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:26.785+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:26.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:26.819+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:27.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:27.195+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:27.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:27.522+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:27.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:27.816+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:27.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:27.849+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:28.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:28.154+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:28.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:28.552+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:28.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:28.801+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:28.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:28.852+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:29.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:29.205+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:29.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:29.538+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:29.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:29.831+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:29.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:29.843+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:30.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:30.197+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:30.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:30.499+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:30.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:30.815+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:30.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:30.867+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:31.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:31.203+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:31.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:31.488+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:31.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:31.814+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:31.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:31.866+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:32.093 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:47:32.091+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:47:32.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:32.231+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:32.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:32.470+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:32.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:32.828+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:32.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:32.882+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:33.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:33.202+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:33.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:33.519+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:33.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:33.876+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:33.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:33.931+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:34.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:34.171+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:34.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:34.540+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:34.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:34.875+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:34.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:34.944+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:35.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:35.175+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:35.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:35.494+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:35.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:35.848+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:35.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:35.948+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:36.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:36.180+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:36.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:47:36.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:47:36.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:36.524+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:36.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:36.836+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:36.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:36.936+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:37.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:37.137+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:37.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:37.503+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:37.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:37.877+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:37.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:37.910+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:38.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:38.164+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:38.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:38.554+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:38.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:38.890+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:38.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:38.900+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:39.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:39.142+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:39.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:39.596+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:39.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:39.876+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:39.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:39.890+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:40.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:40.125+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:40.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:40.592+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:40.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:40.862+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:40.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:40.899+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:41.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:41.107+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:41.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:41.597+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:41.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:41.883+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:41.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:41.893+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:42.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:42.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:42.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:42.570+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:42.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:42.888+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:42.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:42.904+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:43.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:43.155+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:43.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:43.596+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:43.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:43.906+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:43.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:43.945+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:44.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:44.192+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:44.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:44.646+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:44.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:44.866+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:44.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:44.963+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:45.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:45.187+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:45.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:45.659+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:45.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:45.894+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:45.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:45.979+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:46.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:46.206+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:46.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:46.675+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:46.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:46.883+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:46.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:46.962+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:47.109 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:47:47.108+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:47:47.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:47.171+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:47.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:47.628+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:47.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:47.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:47.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:47.994+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:48.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:48.214+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:48.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:48.589+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:48.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:48.856+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:48.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:48.946+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:49.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:49.205+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:49.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:49.634+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:49.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:49.814+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:49.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:49.967+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:50.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:50.190+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:50.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:50.630+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:50.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:50.797+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:51.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:51.016+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:51.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:51.227+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:51.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:51.588+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:51.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:51.796+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:52.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:52.018+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:52.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:52.264+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:52.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:52.612+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:52.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:52.801+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:52.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:52.979+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:53.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:53.275+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:53.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:53.635+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:53.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:53.834+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:54.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:54.006+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:54.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:54.235+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:54.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:54.653+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:54.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:54.869+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:55.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:55.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:55.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:55.195+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:55.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:55.656+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:55.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:55.889+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:55.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:55.995+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:56.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:56.151+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:56.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:56.656+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:56.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:56.865+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:57.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:57.001+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:57.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:57.145+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:57.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:57.625+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:57.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:57.821+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:58.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:58.003+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:58.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:58.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:58.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:58.655+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:58.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:58.816+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:58.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:58.993+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:59.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:47:59.134+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:59.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:47:59.702+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:59.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:47:59.781+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:47:59.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:47:59.977+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:00.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:00.107+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:00.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:00.655+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:00.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:00.781+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:00.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:00.955+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:01.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:01.126+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:01.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:01.639+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:01.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:01.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:01.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:01.997+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:02.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:02.085+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:02.120 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:48:02.118+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:48:02.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:02.676+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:02.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:02.734+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:02.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:02.949+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:03.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:03.101+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:03.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:03.655+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:03.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:03.757+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:03.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:03.992+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:04.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:04.066+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:04.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:04.679+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:04.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:04.789+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:05.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:05.031+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:05.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:05.097+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:05.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:05.680+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:05.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:05.767+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:06.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:06.018+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:06.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:06.126+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:06.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:48:06.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:48:06.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:06.707+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:06.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:06.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:06.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:06.989+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:07.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:07.091+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:07.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:07.738+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:07.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:07.824+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:07.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:07.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:08.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:08.115+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:08.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:08.725+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:08.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:08.846+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:08.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:08.940+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:09.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:09.085+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:09.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:09.749+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:09.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:09.835+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:09.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:09.970+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:10.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:10.087+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:10.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:10.765+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:10.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:10.811+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:11.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:11.001+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:11.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:11.125+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:11.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:11.766+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:11.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:11.853+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:12.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:12.034+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:12.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:12.139+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:12.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:12.787+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:12.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:12.854+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:13.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:13.082+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:13.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:13.145+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:13.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:13.764+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:13.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:13.806+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:14.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:14.059+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:14.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:14.154+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:14.750 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:14.749+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:14.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:14.818+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:15.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:15.042+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:15.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:15.197+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:15.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:15.747+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:15.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:15.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:16.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:16.014+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:16.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:16.156+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:16.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:16.746+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:16.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:16.784+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:16.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:16.978+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:17.129 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:48:17.127+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:48:17.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:17.177+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:17.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:17.738+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:17.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:17.792+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:17.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:17.966+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:18.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:18.222+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:18.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:18.702+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:18.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:18.772+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:18.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:18.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:19.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:19.175+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:19.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:19.723+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:19.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:19.752+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:20.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:20.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:20.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:20.161+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:20.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:20.773+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:20.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:20.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:21.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:21.043+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:21.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:21.122+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:21.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:21.782+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:21.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:21.796+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:22.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:22.004+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:22.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:22.136+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:22.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:22.737+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:22.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:22.834+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:22.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:22.995+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:23.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:23.181+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:23.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:23.734+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:23.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:23.830+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:24.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:24.036+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:24.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:24.182+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:24.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:24.744+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:24.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:24.810+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:25.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:25.018+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:25.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:25.202+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:25.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:25.767+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:25.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:25.777+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:25.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:25.985+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:26.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:26.158+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:26.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:26.730+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:26.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:26.753+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:26.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:26.957+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:27.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:27.119+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:27.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:27.737+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:27.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:27.757+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:27.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:27.967+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:28.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:28.151+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:28.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:28.743+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:28.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:28.805+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:29.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:29.001+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:29.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:29.185+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:29.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:29.765+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:29.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:29.807+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:30.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:30.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:30.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:30.156+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:30.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:30.786+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:30.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:30.791+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:30.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:30.967+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:31.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:31.169+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:31.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:31.811+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:31.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:31.828+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:31.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:31.992+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:32.145 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:48:32.143+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:48:32.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:32.147+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:32.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:32.793+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:32.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:32.860+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:33.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:33.014+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:33.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:33.177+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:33.759 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:33.757+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:33.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:33.859+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:34.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:34.007+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:34.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:34.199+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:34.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:34.790+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:34.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:34.870+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:34.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:34.974+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:35.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:35.159+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:35.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:35.803+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:35.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:35.903+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:35.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:35.932+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:36.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:36.178+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:36.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:48:36.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:48:36.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:36.832+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:36.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:36.869+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:36.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:36.941+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:37.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:37.206+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:37.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:37.850+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:37.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:37.876+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:37.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:37.933+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:38.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:38.240+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:38.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:38.820+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:38.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:38.882+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:38.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:38.898+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:39.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:39.202+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:39.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:39.790+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:39.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:39.893+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:39.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:39.907+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:40.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:40.171+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:40.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:40.762+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:40.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:40.892+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:40.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:40.944+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:41.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:41.151+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:41.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:41.793+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:41.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:41.859+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:41.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:41.940+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:42.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:42.179+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:42.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:42.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:42.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:42.897+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:42.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:42.951+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:43.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:43.220+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:43.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:43.769+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:43.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:43.870+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:43.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:43.976+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:44.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:44.233+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:44.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:44.725+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:44.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:44.844+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:45.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:45.007+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:45.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:45.237+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:45.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:45.765+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:45.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:45.876+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:46.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:46.011+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:46.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:46.217+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:46.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:46.738+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:46.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:46.833+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:47.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:47.051+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:47.154 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:48:47.152+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:48:47.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:47.171+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:47.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:47.778+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:47.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:47.790+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:48.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:48.030+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:48.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:48.123+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:48.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:48.757+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:48.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:48.766+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:49.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:49.021+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:49.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:49.099+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:49.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:49.766+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:49.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:49.784+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:49.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:49.984+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:50.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:50.058+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:50.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:50.748+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:50.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:50.790+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:51.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:50.991+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:51.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:51.108+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:51.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:51.733+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:51.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:51.821+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:52.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:51.999+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:52.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:52.063+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:52.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:52.699+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:52.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:52.811+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:52.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:52.983+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:53.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:53.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:53.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:53.709+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:53.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:53.860+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:53.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:53.971+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:54.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:54.112+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:54.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:54.759+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:54.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:54.820+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:54.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:54.997+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:55.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:55.127+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:55.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:55.739+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:55.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:55.773+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:56.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:56.039+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:56.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:56.123+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:56.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:56.725+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:56.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:56.763+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:57.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:57.080+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:57.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:57.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:57.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:57.730+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:57.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:57.731+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:58.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:58.047+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:58.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:58.070+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:58.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:58.759+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:58.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:58.766+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:59.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:48:59.044+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:59.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:48:59.082+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:59.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:48:59.721+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:48:59.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:48:59.726+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:00.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:00.044+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:00.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:00.085+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:00.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:00.722+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:00.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:00.756+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:01.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:01.043+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:01.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:01.101+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:01.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:01.747+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:01.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:01.799+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:02.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:02.016+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:02.100 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:02.099+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:02.158 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:49:02.156+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:49:02.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:02.763+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:02.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:02.781+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:03.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:03.007+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:03.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:03.069+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:03.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:03.763+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:03.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:03.780+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:04.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:04.020+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:04.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:04.062+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:04.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:04.746+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:04.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:04.784+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:05.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:05.006+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:05.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:05.069+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:05.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:05.765+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:05.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:05.768+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:05.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:05.972+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:06.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:06.094+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:06.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:06.753+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:06.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:06.788+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:06.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:49:06.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:49:06.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:06.958+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:07.132 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:07.131+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:07.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:07.769+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:07.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:07.792+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:07.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:07.952+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:08.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:08.135+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:08.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:08.752+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:08.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:08.802+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:08.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:08.997+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:09.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:09.142+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:09.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:09.770+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:09.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:09.798+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:09.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:09.960+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:10.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:10.121+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:10.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:10.765+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:10.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:10.809+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:10.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:10.987+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:11.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:11.169+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:11.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:11.810+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:11.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:11.856+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:12.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:12.015+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:12.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:12.163+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:12.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:12.837+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:12.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:12.845+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:13.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:12.998+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:13.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:13.136+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:13.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:13.795+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:13.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:13.867+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:14.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:14.005+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:14.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:14.183+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:14.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:14.806+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:14.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:14.877+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:15.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:15.047+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:15.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:15.146+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:15.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:15.837+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:15.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:15.852+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:16.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:16.023+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:16.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:16.137+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:16.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:16.831+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:16.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:16.888+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:17.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:17.022+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:17.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:17.170+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:17.174 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:49:17.171+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:49:17.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:17.879+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:17.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:17.904+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:18.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:18.048+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:18.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:18.193+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:18.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:18.869+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:18.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:18.947+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:19.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:19.098+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:19.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:19.186+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:19.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:19.893+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:19.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:19.945+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:20.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:20.085+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:20.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:20.208+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:20.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:20.917+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:20.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:20.917+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:21.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:21.102+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:21.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:21.241+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:21.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:21.928+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:21.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:21.948+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:22.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:22.062+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:22.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:22.226+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:22.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:22.916+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:22.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:22.921+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:23.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:23.060+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:23.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:23.257+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:23.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:23.944+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:23.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:23.963+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:24.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:24.050+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:24.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:24.258+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:24.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:24.956+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:24.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:24.980+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:25.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:25.085+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:25.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:25.262+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:25.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:25.954+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:25.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:25.992+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:26.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:26.060+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:26.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:26.302+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:26.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:26.937+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:27.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:27.011+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:27.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:27.032+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:27.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:27.335+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:27.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:27.923+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:28.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:28.034+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:28.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:28.042+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:28.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:28.334+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:28.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:28.922+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:29.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:28.999+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:29.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:29.089+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:29.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:29.323+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:29.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:29.939+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:30.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:30.037+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:30.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:30.094+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:30.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:30.287+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:30.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:30.905+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:31.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:31.041+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:31.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:31.053+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:31.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:31.282+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:31.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:31.896+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:32.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:32.004+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:32.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:32.072+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:32.182 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:49:32.181+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:49:32.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:32.284+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:32.857 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:32.855+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:33.011 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:33.009+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:33.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:33.119+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:33.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:33.276+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:33.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:33.865+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:33.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:33.997+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:34.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:34.132+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:34.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:34.270+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:34.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:34.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:34.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:34.961+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:35.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:35.164+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:35.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:35.312+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:35.930 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:35.929+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:35.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:35.970+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:36.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:36.175+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:36.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:36.266+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:36.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:36.900+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:36.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:36.934+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:36.957 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:49:36.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:49:37.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:37.213+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:37.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:37.232+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:37.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:37.933+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:37.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:37.940+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:38.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:38.227+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:38.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:38.238+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:38.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:38.900+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:38.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:38.903+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:39.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:39.247+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:39.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:39.261+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:39.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:39.894+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:39.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:39.905+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:40.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:40.259+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:40.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:40.297+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:40.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:40.938+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:40.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:40.938+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:41.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:41.234+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:41.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:41.278+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:41.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:41.891+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:41.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:41.897+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:42.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:42.240+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:42.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:42.275+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:42.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:42.865+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:42.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:42.880+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:43.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:43.248+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:43.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:43.315+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:43.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:43.842+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:43.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:43.852+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:44.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:44.231+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:44.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:44.349+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:44.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:44.850+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:44.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:44.892+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:45.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:45.269+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:45.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:45.302+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:45.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:45.872+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:45.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:45.919+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:46.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:46.261+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:46.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:46.293+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:46.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:46.840+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:46.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:46.954+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:47.195 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:49:47.193+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:49:47.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:47.290+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:47.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:47.303+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:47.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:47.792+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:47.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:47.955+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:48.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:48.279+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:48.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:48.306+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:48.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:48.808+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:48.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:48.910+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:49.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:49.304+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:49.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:49.333+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:49.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:49.770+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:49.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:49.948+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:50.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:50.286+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:50.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:50.315+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:50.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:50.787+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:50.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:50.977+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:51.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:51.281+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:51.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:51.322+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:51.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:51.752+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:51.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:51.948+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:52.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:52.245+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:52.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:52.299+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:52.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:52.801+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:52.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:52.943+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:53.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:53.254+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:53.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:53.293+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:53.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:53.815+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:53.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:53.894+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:54.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:54.275+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:54.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:54.299+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:54.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:54.823+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:54.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:54.926+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:55.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:55.245+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:55.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:55.335+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:55.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:55.790+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:55.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:55.927+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:56.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:56.284+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:56.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:56.370+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:56.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:56.741+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:56.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:56.933+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:57.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:57.293+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:57.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:57.381+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:57.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:57.788+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:57.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:57.910+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:58.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:58.295+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:58.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:58.419+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:58.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:58.767+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:58.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:58.937+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:59.296 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:49:59.295+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:59.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:49:59.423+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:59.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:49:59.736+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:49:59.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:49:59.970+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:00.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:00.252+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:00.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:00.405+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:00.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:00.785+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:00.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:00.939+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:01.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:01.275+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:01.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:01.443+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:01.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:01.779+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:01.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:01.924+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:02.211 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:50:02.209+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:50:02.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:02.315+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:02.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:02.422+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:02.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:02.776+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:02.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:02.908+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:03.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:03.278+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:03.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:03.392+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:03.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:03.776+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:03.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:03.942+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:04.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:04.232+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:04.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:04.350+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:04.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:04.783+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:04.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:04.966+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:05.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:05.202+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:05.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:05.373+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:05.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:05.780+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:05.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:05.962+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:06.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:06.191+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:06.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:06.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:06.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:06.826+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:07.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:07.010+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:07.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:50:07.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:50:07.222 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:07.220+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:07.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:07.340+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:07.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:07.856+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:08.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:08.047+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:08.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:08.222+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:08.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:08.382+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:08.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:08.890+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:09.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:09.072+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:09.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:09.176+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:09.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:09.337+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:09.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:09.931+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:10.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:10.112+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:10.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:10.193+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:10.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:10.360+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:10.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:10.931+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:11.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:11.115+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:11.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:11.148+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:11.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:11.400+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:11.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:11.955+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:12.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:12.109+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:12.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:12.115+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:12.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:12.402+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:12.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:12.965+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:13.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:13.062+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:13.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:13.131+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:13.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:13.364+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:13.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:13.949+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:14.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:14.045+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:14.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:14.134+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:14.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:14.336+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:14.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:14.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:15.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:15.014+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:15.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:15.095+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:15.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:15.374+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:15.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:15.981+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:16.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:15.998+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:16.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:16.133+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:16.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:16.382+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:16.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:16.988+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:17.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:17.023+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:17.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:17.090+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:17.227 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:50:17.224+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:50:17.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:17.412+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:17.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:17.940+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:18.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:18.006+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:18.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:18.104+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:18.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:18.417+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:18.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:18.933+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:19.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:19.040+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:19.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:19.062+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:19.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:19.371+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:19.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:19.982+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:20.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:20.029+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:20.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:20.080+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:20.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:20.391+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:20.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:20.969+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:21.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:21.034+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:21.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:21.059+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:21.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:21.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:21.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:21.961+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:22.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:22.021+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:22.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:22.108+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:22.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:22.370+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:22.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:22.948+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:22.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:22.986+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:23.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:23.121+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:23.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:23.361+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:23.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:23.944+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:23.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:23.980+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:24.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:24.092+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:24.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:24.404+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:24.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:24.904+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:25.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:25.012+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:25.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:25.059+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:25.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:25.419+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:25.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:25.860+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:26.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:26.005+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:26.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:26.019+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:26.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:26.460+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:26.898 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:26.897+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:27.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:27.024+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:27.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:27.045+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:27.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:27.482+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:27.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:27.852+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:28.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:28.011+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:28.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:28.077+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:28.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:28.452+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:28.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:28.848+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:29.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:29.044+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:29.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:29.078+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:29.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:29.475+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:29.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:29.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:30.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:30.073+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:30.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:30.074+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:30.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:30.500+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:30.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:30.891+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:31.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:31.049+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:31.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:31.111+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:31.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:31.459+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:31.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:31.905+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:32.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:32.095+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:32.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:32.109+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:32.231 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:50:32.229+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:50:32.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:32.429+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:32.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:32.899+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:33.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:33.072+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:33.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:33.105+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:33.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:33.475+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:33.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:33.918+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:34.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:34.072+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:34.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:34.092+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:34.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:34.505+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:34.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:34.950+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:35.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:35.038+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:35.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:35.086+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:35.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:35.483+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:35.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:35.949+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:36.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:36.029+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:36.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:36.134+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:36.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:36.527+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:36.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:36.949+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:37.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:37.045+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:37.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:37.118+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:37.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:50:37.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:50:37.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:37.497+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:37.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:37.963+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:38.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:38.035+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:38.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:38.090+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:38.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:38.488+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:38.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:38.978+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:39.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:39.059+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:39.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:39.101+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:39.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:39.470+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:39.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:39.993+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:40.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:40.013+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:40.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:40.087+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:40.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:40.462+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:40.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:40.957+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:41.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:41.021+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:41.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:41.107+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:41.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:41.452+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:41.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:41.948+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:41.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:41.988+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:42.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:42.136+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:42.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:42.434+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:42.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:42.994+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:42.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:42.998+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:43.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:43.102+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:43.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:43.458+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:43.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:43.980+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:43.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:43.987+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:44.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:44.055+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:44.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:44.435+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:44.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:44.955+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:44.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:44.989+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:45.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:45.097+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:45.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:45.389+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:45.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:45.966+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:45.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:45.990+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:46.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:46.094+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:46.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:46.400+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:46.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:46.960+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:46.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:46.995+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:47.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:47.101+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:47.247 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:50:47.245+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:50:47.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:47.373+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:47.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:47.970+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:48.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:48.003+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:48.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:48.149+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:48.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:48.360+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:48.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:48.993+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:48.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:48.997+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:49.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:49.137+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:49.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:49.368+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:49.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:49.952+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:49.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:49.968+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:50.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:50.128+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:50.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:50.344+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:50.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:50.935+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:51.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:51.017+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:51.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:51.174+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:51.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:51.335+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:51.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:51.895+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:52.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:51.999+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:52.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:52.155+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:52.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:52.358+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:52.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:52.872+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:53.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:53.008+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:53.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:53.203+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:53.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:53.318+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:53.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:53.916+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:53.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:53.996+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:54.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:54.254+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:54.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:54.337+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:54.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:54.883+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:54.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:54.958+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:55.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:55.302+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:55.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:55.377+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:55.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:55.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:55.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:55.913+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:56.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:56.305+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:56.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:56.385+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:56.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:56.865+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:56.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:56.889+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:57.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:57.355+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:57.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:57.411+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:57.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:57.866+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:57.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:57.925+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:58.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:58.363+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:58.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:58.398+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:58.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:58.838+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:58.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:58.918+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:59.327 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:50:59.325+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:59.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:50:59.350+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:59.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:50:59.862+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:50:59.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:50:59.931+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:00.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:00.282+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:00.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:00.373+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:00.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:00.817+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:00.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:00.965+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:01.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:01.289+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:01.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:01.375+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:01.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:01.795+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:01.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:01.967+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:02.262 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:51:02.260+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:51:02.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:02.336+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:02.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:02.419+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:02.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:02.829+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:02.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:02.936+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:03.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:03.383+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:03.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:03.424+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:03.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:03.846+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:03.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:03.897+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:04.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:04.399+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:04.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:04.420+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:04.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:04.797+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:04.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:04.867+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:05.383 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:05.381+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:05.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:05.397+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:05.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:05.814+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:05.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:05.889+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:06.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:06.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:06.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:06.401+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:06.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:06.846+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:06.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:06.849+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:07.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:51:07.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:51:07.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:07.409+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:07.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:07.414+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:07.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:07.835+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:07.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:07.874+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:08.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:08.411+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:08.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:08.433+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:08.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:08.787+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:08.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:08.868+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:09.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:09.397+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:09.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:09.402+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:09.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:09.752+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:09.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:09.902+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:10.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:10.362+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:10.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:10.434+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:10.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:10.775+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:10.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:10.892+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:11.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:11.383+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:11.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:11.438+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:11.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:11.780+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:11.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:11.843+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:12.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:12.428+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:12.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:12.433+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:12.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:12.776+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:12.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:12.807+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:13.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:13.428+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:13.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:13.481+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:13.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:13.763+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:13.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:13.787+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:14.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:14.435+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:14.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:14.461+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:14.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:14.731+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:14.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:14.827+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:15.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:15.396+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:15.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:15.477+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:15.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:15.751+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:15.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:15.799+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:16.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:16.438+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:16.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:16.498+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:16.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:16.737+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:16.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:16.817+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:17.278 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:51:17.276+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:51:17.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:17.470+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:17.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:17.481+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:17.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:17.729+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:17.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:17.822+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:18.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:18.498+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:18.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:18.506+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:18.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:18.738+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:18.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:18.847+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:19.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:19.527+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:19.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:19.539+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:19.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:19.772+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:19.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:19.887+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:20.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:20.508+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:20.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:20.522+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:20.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:20.813+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:20.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:20.899+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:21.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:21.530+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:21.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:21.565+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:21.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:21.795+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:21.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:21.923+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:22.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:22.539+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:22.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:22.602+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:22.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:22.787+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:22.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:22.922+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:23.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:23.522+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:23.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:23.583+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:23.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:23.821+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:23.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:23.877+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:24.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:24.481+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:24.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:24.577+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:24.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:24.860+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:24.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:24.895+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:25.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:25.509+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:25.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:25.592+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:25.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:25.853+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:25.868 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:25.867+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:26.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:26.520+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:26.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:26.583+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:26.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:26.805+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:26.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:26.833+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:27.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:27.560+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:27.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:27.626+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:27.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:27.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:27.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:27.787+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:28.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:28.600+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:28.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:28.632+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:28.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:28.788+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:28.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:28.827+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:29.597 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:29.596+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:29.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:29.598+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:29.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:29.829+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:29.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:29.832+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:30.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:30.605+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:30.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:30.632+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:30.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:30.802+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:30.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:30.870+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:31.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:31.639+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:31.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:31.674+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:31.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:31.825+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:31.876 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:31.875+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:32.294 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:51:32.292+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:51:32.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:32.689+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:32.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:32.705+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:32.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:32.821+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:32.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:32.869+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:33.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:33.695+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:33.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:33.709+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:33.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:33.788+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:33.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:33.866+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:34.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:34.665+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:34.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:34.722+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:34.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:34.745+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:34.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:34.863+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:35.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:35.618+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:35.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:35.690+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:35.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:35.741+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:35.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:35.817+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:36.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:36.607+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:36.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:36.724+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:36.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:36.737+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:36.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:36.858+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:37.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:51:37.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:51:37.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:37.643+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:37.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:37.709+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:37.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:37.711+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:37.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:37.816+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:38.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:38.604+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:38.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:38.686+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:38.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:38.696+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:38.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:38.857+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:39.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:39.567+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:39.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:39.715+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:39.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:39.736+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:39.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:39.890+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:40.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:40.555+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:40.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:40.706+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:40.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:40.714+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:40.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:40.918+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:41.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:41.565+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:41.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:41.735+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:41.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:41.759+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:41.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:41.947+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:42.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:42.600+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:42.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:42.725+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:42.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:42.738+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:42.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:42.974+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:43.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:43.568+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:43.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:43.690+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:43.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:43.773+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:43.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:43.937+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:44.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:44.525+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:44.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:44.730+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:44.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:44.765+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:44.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:44.919+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:45.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:45.540+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:45.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:45.735+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:45.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:45.742+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:45.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:45.951+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:46.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:46.495+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:46.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:46.696+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:46.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:46.723+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:46.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:46.940+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:47.310 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:51:47.308+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:51:47.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:47.472+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:47.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:47.669+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:47.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:47.738+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:47.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:47.952+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:48.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:48.423+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:48.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:48.682+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:48.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:48.747+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:48.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:48.987+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:49.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:49.408+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:49.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:49.648+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:49.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:49.784+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:49.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:49.990+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:50.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:50.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:50.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:50.647+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:50.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:50.738+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:50.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:50.981+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:51.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:51.332+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:51.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:51.634+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:51.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:51.764+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:52.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:52.028+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:52.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:52.358+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:52.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:52.651+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:52.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:52.815+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:53.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:53.053+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:53.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:53.327+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:53.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:53.691+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:53.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:53.843+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:54.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:54.034+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:54.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:54.296+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:54.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:54.692+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:54.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:54.840+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:54.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:54.989+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:55.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:55.293+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:55.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:55.647+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:55.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:55.837+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:56.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:56.031+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:56.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:56.264+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:56.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:56.635+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:56.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:56.872+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:57.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:57.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:57.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:57.290+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:57.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:57.587+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:57.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:57.915+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:58.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:58.104+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:58.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:58.283+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:58.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:58.558+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:58.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:58.927+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:59.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:51:59.099+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:59.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:51:59.299+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:59.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:51:59.536+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:51:59.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:51:59.901+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:00.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:00.104+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:00.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:00.285+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:00.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:00.518+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:00.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:00.922+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:01.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:01.056+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:01.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:01.329+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:01.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:01.567+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:01.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:01.891+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:02.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:02.030+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:02.326 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:52:02.324+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:52:02.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:02.325+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:02.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:02.597+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:02.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:02.853+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:03.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:03.043+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:03.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:03.305+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:03.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:03.568+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:03.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:03.816+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:04.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:04.051+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:04.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:04.299+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:04.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:04.580+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:04.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:04.789+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:05.004 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:05.002+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:05.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:05.316+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:05.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:05.619+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:05.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:05.749+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:06.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:06.034+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:06.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:06.305+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:06.624 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:06.622+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:06.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:06.765+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:06.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:06.993+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:07.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:07.271+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:07.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:07.618+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:07.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:52:07.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:52:07.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:07.798+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:08.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:08.018+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:08.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:08.238+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:08.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:08.659+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:08.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:08.801+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:09.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:09.064+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:09.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:09.229+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:09.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:09.660+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:09.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:09.755+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:10.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:10.023+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:10.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:10.208+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:10.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:10.627+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:10.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:10.707+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:10.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:10.997+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:11.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:11.240+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:11.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:11.632+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:11.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:11.676+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:12.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:12.025+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:12.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:12.211+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:12.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:12.609+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:12.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:12.672+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:13.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:13.072+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:13.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:13.171+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:13.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:13.640+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:13.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:13.706+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:14.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:14.061+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:14.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:14.204+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:14.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:14.614+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:14.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:14.743+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:15.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:15.097+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:15.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:15.218+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:15.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:15.599+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:15.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:15.695+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:16.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:16.098+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:16.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:16.261+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:16.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:16.633+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:16.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:16.668+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:17.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:17.148+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:17.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:17.265+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:17.342 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:52:17.339+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:52:17.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:17.585+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:17.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:17.681+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:18.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:18.120+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:18.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:18.296+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:18.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:18.574+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:18.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:18.727+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:19.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:19.168+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:19.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:19.251+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:19.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:19.609+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:19.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:19.753+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:20.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:20.168+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:20.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:20.282+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:20.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:20.618+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:20.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:20.715+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:21.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:21.147+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:21.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:21.274+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:21.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:21.669+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:21.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:21.699+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:22.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:22.128+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:22.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:22.250+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:22.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:22.695+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:22.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:22.740+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:23.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:23.169+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:23.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:23.265+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:23.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:23.702+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:23.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:23.723+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:24.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:24.189+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:24.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:24.293+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:24.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:24.732+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:24.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:24.749+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:25.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:25.156+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:25.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:25.271+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:25.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:25.757+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:25.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:25.796+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:26.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:26.156+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:26.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:26.228+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:26.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:26.774+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:26.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:26.775+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:27.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:27.192+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:27.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:27.214+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:27.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:27.783+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:27.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:27.805+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:28.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:28.189+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:28.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:28.257+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:28.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:28.774+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:28.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:28.786+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:29.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:29.149+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:29.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:29.234+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:29.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:29.810+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:29.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:29.831+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:30.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:30.111+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:30.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:30.265+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:30.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:30.788+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:30.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:30.813+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:31.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:31.101+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:31.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:31.287+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:31.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:31.742+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:31.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:31.804+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:32.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:32.126+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:32.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:32.319+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:32.357 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:52:32.356+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:52:32.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:32.769+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:32.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:32.794+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:33.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:33.173+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:33.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:33.298+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:33.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:33.766+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:33.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:33.782+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:34.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:34.161+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:34.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:34.310+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:34.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:34.718+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:34.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:34.751+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:35.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:35.138+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:35.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:35.312+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:35.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:35.742+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:35.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:35.766+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:36.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:36.177+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:36.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:36.274+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:36.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:36.765+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:36.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:36.772+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:37.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:37.187+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:37.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:37.270+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:37.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:37.758+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:37.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:37.803+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:37.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:52:37.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:52:38.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:38.171+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:38.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:38.221+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:38.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:38.773+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:38.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:38.826+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:39.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:39.188+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:39.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:39.225+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:39.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:39.755+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:39.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:39.868+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:40.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:40.201+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:40.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:40.205+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:40.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:40.719+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:40.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:40.877+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:41.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:41.186+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:41.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:41.249+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:41.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:41.692+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:41.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:41.889+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:42.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:42.138+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:42.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:42.299+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:42.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:42.651+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:42.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:42.854+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:43.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:43.093+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:43.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:43.297+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:43.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:43.614+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:43.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:43.839+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:44.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:44.067+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:44.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:44.340+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:44.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:44.626+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:44.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:44.871+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:45.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:45.082+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:45.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:45.353+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:45.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:45.614+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:45.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:45.915+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:46.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:46.076+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:46.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:46.353+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:46.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:46.612+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:46.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:46.932+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:47.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:47.072+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:47.374 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:52:47.371+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:52:47.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:47.385+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:47.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:47.649+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:47.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:47.905+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:48.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:48.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:48.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:48.414+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:48.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:48.683+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:48.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:48.934+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:49.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:49.038+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:49.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:49.393+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:49.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:49.679+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:49.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:49.939+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:50.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:50.044+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:50.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:50.440+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:50.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:50.697+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:50.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:50.936+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:51.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:51.061+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:51.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:51.449+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:51.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:51.663+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:51.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:51.938+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:52.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:52.015+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:52.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:52.428+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:52.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:52.705+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:52.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:52.970+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:53.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:53.001+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:53.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:53.422+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:53.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:53.677+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:53.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:53.976+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:53.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:53.990+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:54.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:54.435+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:54.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:54.683+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:55.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:55.015+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:55.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:55.037+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:55.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:55.463+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:55.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:55.709+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:56.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:56.019+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:56.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:56.052+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:56.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:56.453+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:56.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:56.666+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:57.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:57.006+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:57.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:57.047+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:57.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:57.447+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:57.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:57.641+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:58.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:58.008+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:58.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:58.009+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:58.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:58.480+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:58.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:58.656+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:59.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:52:59.051+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:59.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:52:59.057+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:59.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:52:59.439+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:52:59.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:52:59.646+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:00.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:00.047+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:00.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:00.055+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:00.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:00.432+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:00.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:00.609+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:01.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:01.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:01.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:01.073+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:01.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:01.450+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:01.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:01.625+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:02.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:02.031+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:02.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:02.057+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:02.389 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:53:02.387+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:53:02.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:02.493+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:02.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:02.623+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:03.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:03.010+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:03.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:03.091+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:03.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:03.488+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:03.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:03.652+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:04.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:04.011+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:04.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:04.066+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:04.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:04.446+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:04.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:04.629+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:04.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:04.998+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:05.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:05.079+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:05.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:05.420+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:05.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:05.665+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:05.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:05.957+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:06.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:06.088+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:06.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:06.383+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:06.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:06.658+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:06.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:06.991+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:07.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:07.118+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:07.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:07.337+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:07.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:07.657+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:07.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:53:07.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:53:07.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:07.979+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:08.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:08.147+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:08.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:08.339+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:08.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:08.668+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:08.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:08.968+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:09.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:09.117+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:09.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:09.346+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:09.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:09.629+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:09.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:09.967+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:10.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:10.087+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:10.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:10.331+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:10.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:10.589+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:10.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:10.979+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:11.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:11.131+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:11.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:11.339+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:11.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:11.597+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:12.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:12.017+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:12.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:12.131+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:12.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:12.367+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:12.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:12.646+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:13.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:13.000+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:13.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:13.162+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:13.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:13.341+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:13.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:13.683+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:14.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:14.012+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:14.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:14.121+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:14.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:14.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:14.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:14.640+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:15.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:15.026+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:15.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:15.156+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:15.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:15.331+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:15.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:15.660+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:16.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:16.055+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:16.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:16.141+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:16.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:16.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:16.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:16.621+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:17.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:17.020+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:17.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:17.113+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:17.405 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:53:17.403+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:53:17.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:17.418+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:17.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:17.612+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:18.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:18.061+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:18.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:18.142+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:18.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:18.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:18.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:18.642+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:19.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:19.100+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:19.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:19.178+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:19.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:19.359+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:19.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:19.623+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:20.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:20.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:20.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:20.194+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:20.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:20.341+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:20.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:20.603+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:21.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:21.154+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:21.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:21.236+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:21.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:21.324+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:21.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:21.590+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:22.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:22.181+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:22.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:22.256+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:22.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:22.309+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:22.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:22.581+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:23.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:23.131+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:23.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:23.262+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:23.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:23.278+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:23.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:23.538+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:24.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:24.127+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:24.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:24.259+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:24.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:24.316+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:24.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:24.503+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:25.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:25.104+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:25.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:25.236+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:25.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:25.324+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:25.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:25.509+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:26.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:26.148+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:26.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:26.195+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:26.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:26.306+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:26.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:26.538+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:27.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:27.105+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:27.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:27.189+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:27.276 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:27.274+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:27.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:27.560+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:28.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:28.080+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:28.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:28.194+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:28.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:28.278+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:28.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:28.511+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:29.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:29.123+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:29.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:29.231+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:29.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:29.314+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:29.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:29.508+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:30.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:30.149+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:30.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:30.206+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:30.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:30.281+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:30.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:30.532+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:31.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:31.179+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:31.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:31.227+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:31.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:31.259+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:31.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:31.531+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:32.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:32.141+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:32.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:32.212+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:32.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:32.279+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:32.421 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:53:32.419+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:53:32.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:32.535+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:33.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:33.118+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:33.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:33.185+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:33.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:33.244+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:33.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:33.532+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:34.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:34.110+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:34.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:34.166+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:34.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:34.281+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:34.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:34.513+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:35.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:35.088+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:35.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:35.167+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:35.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:35.234+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:35.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:35.552+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:36.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:36.085+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:36.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:36.172+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:36.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:36.194+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:36.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:36.602+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:37.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:37.122+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:37.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:37.152+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:37.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:37.181+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:37.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:37.597+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:38.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:53:38.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:53:38.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:38.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:38.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:38.112+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:38.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:38.168+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:38.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:38.578+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:39.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:39.087+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:39.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:39.134+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:39.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:39.165+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:39.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:39.600+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:40.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:40.063+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:40.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:40.159+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:40.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:40.181+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:40.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:40.551+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:41.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:41.067+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:41.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:41.134+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:41.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:41.215+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:41.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:41.521+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:42.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:42.092+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:42.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:42.157+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:42.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:42.168+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:42.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:42.490+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:43.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:43.129+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:43.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:43.135+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:43.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:43.206+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:43.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:43.494+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:44.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:44.103+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:44.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:44.110+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:44.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:44.246+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:44.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:44.481+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:45.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:45.081+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:45.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:45.097+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:45.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:45.253+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:45.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:45.439+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:46.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:46.038+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:46.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:46.098+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:46.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:46.251+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:46.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:46.417+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:47.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:47.045+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:47.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:47.076+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:47.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:47.263+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:47.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:47.411+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:47.436 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:53:47.435+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:53:48.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:48.001+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:48.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:48.048+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:48.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:48.215+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:48.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:48.454+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:49.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:49.010+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:49.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:49.012+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:49.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:49.241+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:49.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:49.440+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:49.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:49.997+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:50.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:50.048+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:50.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:50.254+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:50.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:50.426+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:50.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:50.975+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:51.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:51.019+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:51.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:51.245+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:51.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:51.416+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:52.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:52.004+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:52.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:52.004+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:52.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:52.248+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:52.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:52.376+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:52.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:52.978+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:52.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:52.978+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:53.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:53.292+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:53.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:53.342+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:53.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:53.967+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:54.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:54.010+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:54.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:54.327+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:54.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:54.336+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:54.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:54.963+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:54.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:54.996+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:55.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:55.297+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:55.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:55.375+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:55.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:55.971+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:55.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:55.976+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:56.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:56.290+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:56.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:56.328+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:57.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:57.002+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:57.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:57.011+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:57.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:57.296+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:57.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:57.324+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:58.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:58.019+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:58.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:58.025+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:58.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:58.258+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:58.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:58.319+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:59.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:53:59.028+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:59.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:53:59.048+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:59.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:53:59.229+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:53:59.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:53:59.334+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:00.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:00.000+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:00.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:00.021+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:00.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:00.272+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:00.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:00.342+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:01.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:01.030+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:01.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:01.052+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:01.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:01.233+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:01.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:01.296+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:02.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:02.053+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:02.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:02.092+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:02.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:02.203+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:02.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:02.270+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:02.452 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:54:02.450+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:54:03.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:03.050+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:03.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:03.050+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:03.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:03.181+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:03.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:03.275+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:04.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:04.075+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:04.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:04.098+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:04.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:04.174+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:04.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:04.311+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:05.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:05.081+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:05.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:05.121+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:05.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:05.204+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:05.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:05.266+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:06.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:06.098+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:06.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:06.116+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:06.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:06.183+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:06.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:06.225+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:07.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:07.071+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:07.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:07.142+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:07.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:07.179+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:07.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:07.197+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:08.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:08.109+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:08.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:08.156+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:08.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:08.187+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:08.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:54:08.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:54:08.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:08.212+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:09.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:09.081+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:09.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:09.177+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:09.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:09.188+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:09.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:09.189+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:10.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:10.062+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:10.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:10.142+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:10.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:10.216+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:10.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:10.223+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:11.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:11.062+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:11.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:11.186+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:11.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:11.236+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:11.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:11.255+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:12.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:12.095+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:12.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:12.188+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:12.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:12.194+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:12.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:12.219+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:13.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:13.060+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:13.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:13.148+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:13.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:13.163+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:13.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:13.217+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:14.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:14.092+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:14.137 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:14.135+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:14.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:14.181+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:14.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:14.199+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:15.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:15.123+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:15.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:15.161+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:15.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:15.177+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:15.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:15.206+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:16.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:16.133+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:16.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:16.133+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:16.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:16.198+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:16.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:16.204+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:17.095 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:17.093+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:17.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:17.141+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:17.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:17.172+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:17.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:17.194+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:17.468 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:54:17.466+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:54:18.101 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:18.098+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:18.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:18.112+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:18.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:18.137+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:18.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:18.244+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:19.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:19.076+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:19.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:19.132+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:19.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:19.174+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:19.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:19.291+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:20.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:20.085+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:20.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:20.088+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:20.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:20.173+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:20.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:20.257+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:21.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:21.062+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:21.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:21.107+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:21.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:21.128+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:21.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:21.218+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:22.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:22.084+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:22.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:22.111+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:22.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:22.122+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:22.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:22.244+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:23.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:23.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:23.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:23.079+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:23.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:23.117+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:23.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:23.196+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:24.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:24.026+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:24.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:24.041+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:24.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:24.091+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:24.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:24.150+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:25.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:25.027+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:25.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:25.033+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:25.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:25.100+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:25.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:25.124+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:26.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:26.017+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:26.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:26.048+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:26.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:26.096+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:26.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:26.173+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:27.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:27.016+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:27.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:27.094+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:27.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:27.117+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:27.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:27.150+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:28.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:28.062+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:28.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:28.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:28.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:28.126+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:28.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:28.128+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:29.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:29.016+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:29.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:29.091+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:29.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:29.119+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:29.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:29.148+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:29.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:29.973+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:30.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:30.069+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:30.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:30.140+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:30.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:30.149+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:31.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:31.012+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:31.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:31.100+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:31.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:31.152+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:31.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:31.194+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:31.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:31.987+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:32.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:32.136+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:32.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:32.141+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:32.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:32.176+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:32.484 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:54:32.482+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:54:32.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:32.942+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:33.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:33.096+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:33.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:33.103+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:33.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:33.223+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:33.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:33.973+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:34.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:34.049+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:34.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:34.054+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:34.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:34.234+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:35.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:35.019+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:35.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:35.040+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:35.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:35.067+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:35.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:35.245+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:36.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:36.054+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:36.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:36.056+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:36.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:36.097+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:36.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:36.208+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:37.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:37.049+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:37.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:37.078+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:37.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:37.085+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:37.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:37.213+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:38.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:38.028+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:38.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:38.099+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:38.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:38.117+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:38.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:38.193+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:38.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:54:38.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:54:38.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:38.992+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:39.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:39.093+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:39.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:39.164+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:39.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:39.236+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:39.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:39.955+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:40.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:40.122+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:40.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:40.190+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:40.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:40.202+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:40.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:40.928+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:41.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:41.113+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:41.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:41.157+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:41.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:41.174+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:41.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:41.939+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:42.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:42.096+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:42.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:42.147+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:42.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:42.169+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:42.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:42.933+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:43.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:43.127+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:43.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:43.137+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:43.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:43.184+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:43.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:43.981+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:44.108 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:44.106+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:44.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:44.114+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:44.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:44.188+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:45.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:45.031+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:45.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:45.121+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:45.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:45.150+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:45.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:45.223+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:46.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:46.075+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:46.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:46.087+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:46.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:46.179+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:46.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:46.182+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:47.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:47.118+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:47.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:47.133+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:47.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:47.217+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:47.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:47.228+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:47.500 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:54:47.497+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:54:48.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:48.124+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:48.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:48.132+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:48.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:48.241+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:48.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:48.249+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:49.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:49.123+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:49.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:49.128+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:49.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:49.198+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:49.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:49.281+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:50.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:50.125+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:50.163 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:50.162+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:50.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:50.176+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:50.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:50.307+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:51.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:51.125+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:51.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:51.136+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:51.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:51.211+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:51.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:51.289+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:52.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:52.076+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:52.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:52.115+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:52.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:52.180+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:52.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:52.338+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:53.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:53.112+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:53.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:53.132+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:53.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:53.140+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:53.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:53.327+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:54.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:54.085+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:54.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:54.089+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:54.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:54.144+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:54.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:54.319+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:55.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:55.067+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:55.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:55.114+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:55.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:55.134+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:55.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:55.279+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:56.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:56.022+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:56.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:56.105+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:56.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:56.138+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:56.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:56.315+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:57.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:57.010+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:57.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:57.067+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:57.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:57.138+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:57.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:57.349+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:58.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:58.047+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:58.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:58.060+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:58.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:58.159+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:58.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:58.336+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:59.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:54:59.045+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:59.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:54:59.078+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:59.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:54:59.194+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:54:59.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:54:59.351+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:00.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:00.046+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:00.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:00.053+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:00.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:00.188+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:00.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:00.312+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:01.031 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:01.030+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:01.097 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:01.096+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:01.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:01.220+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:01.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:01.267+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:02.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:02.069+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:02.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:02.122+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:02.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:02.176+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:02.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:02.300+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:02.516 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:55:02.514+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:55:03.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:03.066+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:03.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:03.075+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:03.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:03.134+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:03.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:03.313+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:04.042 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:04.039+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:04.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:04.051+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:04.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:04.098+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:04.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:04.299+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:05.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:05.037+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:05.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:05.088+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:05.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:05.117+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:05.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:05.251+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:06.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:06.072+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:06.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:06.087+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:06.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:06.129+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:06.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:06.257+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:07.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:07.095+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:07.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:07.113+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:07.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:07.153+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:07.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:07.218+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:08.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:08.059+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:08.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:08.150+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:08.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:08.189+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:08.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:08.203+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:08.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:55:08.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:55:09.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:09.080+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:09.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:09.162+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:09.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:09.216+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:09.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:09.239+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:10.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:10.105+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:10.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:10.143+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:10.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:10.171+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:10.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:10.279+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:11.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:11.108+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:11.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:11.110+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:11.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:11.209+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:11.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:11.243+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:12.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:12.106+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:12.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:12.120+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:12.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:12.181+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:12.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:12.200+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:13.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:13.077+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:13.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:13.083+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:13.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:13.174+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:13.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:13.175+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:14.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:14.066+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:14.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:14.089+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:14.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:14.173+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:14.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:14.218+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:15.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:15.065+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:15.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:15.068+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:15.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:15.174+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:15.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:15.178+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:16.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:16.055+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:16.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:16.059+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:16.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:16.144+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:16.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:16.154+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:17.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:17.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:17.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:17.105+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:17.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:17.144+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:17.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:17.157+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:17.532 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:55:17.529+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:55:17.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:17.995+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:18.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:18.121+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:18.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:18.187+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:18.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:18.206+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:18.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:18.988+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:19.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:19.092+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:19.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:19.192+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:19.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:19.226+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:20.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:20.018+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:20.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:20.087+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:20.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:20.195+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:20.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:20.206+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:20.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:20.973+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:21.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:21.050+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:21.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:21.208+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:21.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:21.255+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:22.011 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:22.009+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:22.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:22.022+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:22.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:22.161+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:22.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:22.253+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:22.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:22.960+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:23.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:23.067+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:23.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:23.187+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:23.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:23.251+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:23.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:23.948+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:24.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:24.097+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:24.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:24.212+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:24.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:24.225+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:24.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:24.990+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:25.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:25.088+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:25.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:25.213+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:25.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:25.228+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:25.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:25.985+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:26.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:26.055+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:26.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:26.189+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:26.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:26.217+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:26.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:26.955+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:27.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:27.032+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:27.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:27.183+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:27.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:27.188+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:27.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:27.938+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:28.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:28.071+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:28.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:28.165+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:28.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:28.216+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:28.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:28.906+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:29.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:29.024+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:29.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:29.124+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:29.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:29.175+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:29.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:29.925+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:29.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:29.988+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:30.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:30.148+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:30.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:30.185+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:30.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:30.907+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:30.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:30.995+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:31.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:31.149+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:31.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:31.188+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:31.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:31.934+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:32.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:32.016+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:32.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:32.187+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:32.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:32.228+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:32.547 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:55:32.545+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:55:32.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:32.933+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:33.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:33.050+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:33.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:33.142+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:33.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:33.201+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:33.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:33.912+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:34.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:34.048+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:34.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:34.174+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:34.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:34.178+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:34.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:34.882+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:35.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:35.058+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:35.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:35.147+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:35.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:35.199+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:35.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:35.906+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:36.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:36.104+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:36.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:36.106+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:36.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:36.149+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:36.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:36.873+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:37.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:37.114+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:37.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:37.121+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:37.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:37.188+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:37.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:37.915+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:38.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:38.114+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:38.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:38.139+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:38.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:38.228+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:38.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:55:38.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:55:38.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:38.883+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:39.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:39.149+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:39.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:39.162+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:39.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:39.230+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:39.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:39.928+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:40.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:40.143+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:40.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:40.162+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:40.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:40.193+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:40.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:40.947+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:41.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:41.187+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:41.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:41.199+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:41.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:41.236+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:41.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:41.932+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:42.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:42.161+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:42.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:42.171+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:42.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:42.201+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:42.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:42.910+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:43.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:43.129+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:43.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:43.164+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:43.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:43.184+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:43.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:43.943+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:44.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:44.151+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:44.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:44.209+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:44.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:44.224+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:44.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:44.918+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:45.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:45.164+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:45.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:45.217+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:45.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:45.238+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:45.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:45.919+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:46.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:46.169+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:46.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:46.216+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:46.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:46.227+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:46.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:46.928+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:47.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:47.184+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:47.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:47.238+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:47.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:47.263+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:47.563 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:55:47.561+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:55:47.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:47.961+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:48.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:48.223+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:48.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:48.226+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:48.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:48.252+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:48.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:48.993+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:49.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:49.239+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:49.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:49.247+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:49.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:49.259+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:50.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:50.004+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:50.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:50.262+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:50.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:50.269+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:50.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:50.292+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:51.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:51.051+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:51.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:51.265+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:51.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:51.269+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:51.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:51.277+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:52.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:52.041+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:52.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:52.230+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:52.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:52.269+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:52.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:52.272+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:53.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:53.047+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:53.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:53.203+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:53.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:53.305+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:53.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:53.312+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:54.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:54.079+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:54.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:54.235+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:54.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:54.321+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:54.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:54.332+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:55.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:55.119+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:55.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:55.259+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:55.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:55.293+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:55.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:55.348+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:56.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:56.151+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:56.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:56.254+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:56.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:56.333+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:56.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:56.381+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:57.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:57.196+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:57.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:57.280+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:57.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:57.336+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:57.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:57.390+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:58.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:58.206+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:58.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:58.262+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:58.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:58.317+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:58.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:58.388+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:59.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:55:59.189+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:59.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:55:59.276+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:59.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:55:59.326+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:55:59.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:55:59.413+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:00.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:00.157+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:00.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:00.290+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:00.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:00.306+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:00.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:00.438+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:01.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:01.175+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:01.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:01.278+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:01.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:01.327+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:01.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:01.415+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:02.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:02.162+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:02.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:02.268+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:02.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:02.291+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:02.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:02.445+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:02.579 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:56:02.577+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:56:03.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:03.182+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:03.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:03.305+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:03.319 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:03.317+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:03.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:03.461+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:04.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:04.211+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:04.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:04.282+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:04.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:04.309+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:04.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:04.450+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:05.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:05.188+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:05.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:05.324+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:05.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:05.354+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:05.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:05.479+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:06.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:06.237+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:06.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:06.341+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:06.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:06.355+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:06.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:06.442+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:07.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:07.277+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:07.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:07.337+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:07.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:07.369+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:07.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:07.395+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:08.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:08.240+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:08.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:08.297+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:08.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:08.345+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:08.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:08.416+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:08.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:56:08.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:56:09.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:09.247+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:09.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:09.276+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:09.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:09.378+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:09.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:09.423+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:10.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:10.225+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:10.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:10.269+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:10.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:10.370+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:10.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:10.455+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:11.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:11.241+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:11.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:11.285+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:11.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:11.335+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:11.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:11.415+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:12.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:12.238+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:12.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:12.244+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:12.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:12.316+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:12.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:12.449+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:13.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:13.206+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:13.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:13.209+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:13.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:13.341+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:13.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:13.457+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:14.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:14.188+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:14.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:14.201+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:14.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:14.326+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:14.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:14.473+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:15.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:15.206+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:15.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:15.215+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:15.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:15.280+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:15.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:15.501+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:16.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:16.187+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:16.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:16.219+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:16.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:16.277+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:16.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:16.536+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:17.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:17.139+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:17.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:17.223+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:17.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:17.237+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:17.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:17.511+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:17.595 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:56:17.594+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:56:18.146 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:18.144+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:18.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:18.248+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:18.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:18.267+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:18.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:18.476+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:19.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:19.117+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:19.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:19.224+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:19.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:19.263+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:19.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:19.429+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:20.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:20.098+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:20.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:20.224+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:20.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:20.280+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:20.464 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:20.462+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:21.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:21.141+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:21.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:21.232+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:21.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:21.269+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:21.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:21.471+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:22.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:22.125+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:22.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:22.202+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:22.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:22.303+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:22.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:22.465+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:23.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:23.113+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:23.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:23.250+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:23.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:23.310+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:23.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:23.453+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:24.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:24.090+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:24.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:24.252+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:24.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:24.329+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:24.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:24.444+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:25.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:25.101+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:25.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:25.259+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:25.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:25.356+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:25.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:25.449+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:26.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:26.077+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:26.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:26.307+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:26.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:26.358+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:26.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:26.482+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:27.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:27.047+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:27.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:27.260+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:27.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:27.387+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:27.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:27.529+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:28.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:28.052+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:28.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:28.282+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:28.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:28.398+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:28.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:28.578+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:29.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:29.050+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:29.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:29.280+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:29.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:29.366+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:29.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:29.597+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:30.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:30.028+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:30.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:30.255+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:30.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:30.335+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:30.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:30.602+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:31.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:31.013+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:31.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:31.222+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:31.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:31.320+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:31.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:31.643+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:31.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:31.987+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:32.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:32.269+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:32.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:32.325+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:32.611 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:56:32.609+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:56:32.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:32.678+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:33.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:33.021+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:33.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:33.258+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:33.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:33.323+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:33.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:33.704+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:34.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:34.051+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:34.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:34.283+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:34.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:34.339+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:34.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:34.670+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:35.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:35.054+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:35.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:35.318+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:35.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:35.363+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:35.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:35.624+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:36.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:36.005+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:36.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:36.284+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:36.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:36.381+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:36.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:36.635+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:37.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:37.027+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:37.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:37.309+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:37.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:37.384+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:37.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:37.587+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:38.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:38.069+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:38.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:38.307+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:38.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:38.394+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:38.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:38.560+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:38.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:56:38.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:56:39.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:39.056+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:39.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:39.259+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:39.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:39.364+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:39.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:39.538+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:40.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:40.055+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:40.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:40.302+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:40.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:40.364+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:40.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:40.541+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:41.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:41.073+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:41.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:41.294+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:41.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:41.399+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:41.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:41.542+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:42.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:42.091+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:42.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:42.305+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:42.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:42.388+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:42.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:42.545+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:43.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:43.076+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:43.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:43.313+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:43.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:43.378+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:43.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:43.557+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:44.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:44.057+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:44.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:44.284+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:44.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:44.385+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:44.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:44.563+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:45.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:45.046+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:45.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:45.269+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:45.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:45.356+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:45.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:45.533+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:46.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:46.090+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:46.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:46.303+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:46.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:46.329+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:46.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:46.581+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:47.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:47.125+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:47.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:47.290+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:47.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:47.334+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:47.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:47.544+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:47.626 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:56:47.625+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:56:48.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:48.093+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:48.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:48.273+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:48.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:48.362+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:48.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:48.500+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:49.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:49.072+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:49.302 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:49.300+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:49.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:49.336+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:49.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:49.473+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:50.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:50.091+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:50.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:50.298+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:50.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:50.362+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:50.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:50.523+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:51.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:51.046+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:51.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:51.320+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:51.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:51.370+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:51.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:51.486+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:52.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:52.056+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:52.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:52.275+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:52.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:52.372+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:52.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:52.516+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:53.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:53.037+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:53.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:53.304+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:53.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:53.345+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:53.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:53.555+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:53.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:53.990+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:54.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:54.318+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:54.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:54.349+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:54.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:54.593+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:55.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:55.027+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:55.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:55.312+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:55.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:55.349+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:55.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:55.586+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:55.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:55.979+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:56.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:56.305+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:56.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:56.347+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:56.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:56.572+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:56.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:56.957+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:57.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:57.266+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:57.390 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:57.388+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:57.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:57.564+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:57.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:57.996+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:58.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:58.289+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:58.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:58.381+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:58.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:58.518+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:58.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:58.976+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:59.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:56:59.300+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:59.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:56:59.364+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:59.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:56:59.522+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:56:59.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:56:59.949+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:00.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:00.343+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:00.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:00.353+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:00.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:00.545+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:00.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:00.991+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:01.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:01.308+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:01.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:01.344+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:01.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:01.520+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:02.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:02.018+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:02.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:02.262+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:02.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:02.383+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:02.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:02.535+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:02.642 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:57:02.640+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:57:03.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:02.999+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:03.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:03.244+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:03.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:03.357+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:03.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:03.582+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:04.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:04.031+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:04.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:04.243+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:04.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:04.363+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:04.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:04.631+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:05.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:05.020+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:05.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:05.242+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:05.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:05.317+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:05.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:05.591+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:06.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:05.992+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:06.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:06.258+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:06.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:06.331+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:06.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:06.579+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:06.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:06.965+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:07.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:07.306+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:07.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:07.369+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:07.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:07.617+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:08.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:08.003+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:08.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:08.319+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:08.401 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:08.399+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:08.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:08.630+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:08.984 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:57:08.988 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:57:09.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:09.032+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:09.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:09.290+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:09.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:09.360+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:09.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:09.642+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:09.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:09.997+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:10.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:10.311+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:10.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:10.340+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:10.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:10.650+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:10.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:10.984+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:11.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:11.351+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:11.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:11.370+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:11.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:11.647+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:12.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:12.009+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:12.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:12.349+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:12.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:12.365+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:12.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:12.644+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:12.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:12.964+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:13.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:13.306+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:13.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:13.361+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:13.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:13.650+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:13.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:13.917+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:14.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:14.298+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:14.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:14.390+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:14.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:14.606+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:14.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:14.889+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:15.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:15.275+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:15.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:15.379+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:15.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:15.597+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:15.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:15.916+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:16.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:16.249+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:16.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:16.394+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:16.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:16.581+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:16.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:16.927+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:17.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:17.289+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:17.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:17.392+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:17.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:17.557+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:17.658 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:57:17.656+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:57:17.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:17.954+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:18.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:18.247+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:18.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:18.426+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:18.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:18.552+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:18.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:18.932+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:19.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:19.276+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:19.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:19.423+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:19.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:19.597+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:19.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:19.930+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:20.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:20.299+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:20.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:20.465+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:20.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:20.548+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:20.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:20.913+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:21.322 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:21.321+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:21.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:21.427+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:21.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:21.507+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:21.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:21.960+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:22.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:22.291+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:22.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:22.404+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:22.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:22.512+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:22.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:22.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:23.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:23.310+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:23.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:23.382+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:23.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:23.508+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:23.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:23.997+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:24.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:24.279+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:24.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:24.380+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:24.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:24.496+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:24.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:24.949+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:25.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:25.269+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:25.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:25.358+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:25.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:25.466+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:25.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:25.905+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:26.232 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:26.231+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:26.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:26.387+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:26.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:26.440+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:26.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:26.880+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:27.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:27.271+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:27.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:27.393+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:27.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:27.416+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:27.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:27.902+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:28.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:28.265+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:28.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:28.371+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:28.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:28.373+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:28.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:28.937+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:29.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:29.225+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:29.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:29.347+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:29.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:29.370+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:29.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:29.958+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:30.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:30.196+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:30.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:30.373+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:30.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:30.389+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:30.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:30.927+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:31.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:31.213+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:31.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:31.384+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:31.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:31.395+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:31.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:31.969+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:32.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:32.238+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:32.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:32.356+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:32.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:32.406+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:32.674 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:57:32.672+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:57:32.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:32.950+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:33.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:33.226+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:33.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:33.397+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:33.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:33.441+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:33.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:33.942+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:34.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:34.178+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:34.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:34.404+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:34.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:34.405+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:34.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:34.941+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:35.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:35.228+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:35.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:35.395+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:35.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:35.452+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:35.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:35.896+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:36.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:36.193+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:36.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:36.420+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:36.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:36.424+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:36.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:36.897+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:37.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:37.200+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:37.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:37.457+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:37.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:37.458+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:37.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:37.939+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:38.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:38.216+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:38.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:38.434+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:38.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:38.485+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:38.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:38.924+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:39.113 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:57:39.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:57:39.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:39.191+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:39.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:39.392+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:39.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:39.462+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:39.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:39.971+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:40.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:40.235+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:40.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:40.381+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:40.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:40.483+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:40.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:40.952+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:41.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:41.229+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:41.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:41.403+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:41.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:41.474+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:41.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:41.944+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:42.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:42.224+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:42.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:42.429+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:42.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:42.468+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:42.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:42.984+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:43.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:43.272+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:43.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:43.407+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:43.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:43.491+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:43.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:43.960+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:44.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:44.261+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:44.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:44.411+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:44.465 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:44.463+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:44.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:44.930+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:45.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:45.301+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:45.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:45.388+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:45.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:45.453+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:45.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:45.905+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:46.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:46.316+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:46.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:46.414+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:46.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:46.425+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:46.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:46.883+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:47.340 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:47.338+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:47.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:47.403+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:47.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:47.409+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:47.690 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:57:47.688+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:57:47.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:47.927+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:48.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:48.356+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:48.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:48.360+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:48.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:48.366+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:48.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:48.908+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:49.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:49.314+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:49.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:49.383+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:49.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:49.407+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:49.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:49.881+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:50.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:50.297+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:50.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:50.351+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:50.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:50.433+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:50.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:50.865+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:51.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:51.332+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:51.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:51.346+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:51.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:51.394+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:51.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:51.859+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:52.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:52.298+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:52.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:52.328+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:52.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:52.353+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:52.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:52.830+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:53.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:53.301+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:53.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:53.363+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:53.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:53.385+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:53.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:53.855+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:54.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:54.325+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:54.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:54.399+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:54.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:54.415+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:54.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:54.857+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:55.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:55.292+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:55.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:55.380+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:55.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:55.416+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:55.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:55.848+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:56.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:56.304+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:56.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:56.414+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:56.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:56.417+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:56.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:56.859+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:57.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:57.352+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:57.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:57.388+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:57.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:57.460+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:57.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:57.891+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:58.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:58.367+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:58.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:58.428+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:58.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:58.491+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:58.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:58.873+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:59.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:57:59.321+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:59.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:57:59.432+0000 7f389e18e700 -1 osd.4 116 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:59.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:57:59.531+0000 7f72c425d700 -1 osd.5 116 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:57:59.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:57:59.823+0000 7f596d92c700 -1 osd.6 116 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:00.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:00.301+0000 7f6e44c9f700 -1 osd.7 116 get_health_metrics reporting 53 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:00.362 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T02:58:00.360+0000 7fdb1f3d8700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:58:00.378 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T02:58:00.360+0000 7fdb1f3d8700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T02:58:00.378 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T02:58:00.371+0000 7fdb1ebd7700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T02:58:00.399 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T02:58:00.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:00.500+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 71 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:00.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:00.548+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:00.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:00.777+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:01.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:01.292+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:01.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:01.451+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:01.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:01.570+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:01.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:01.763+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:02.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:02.287+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:02.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:02.420+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:02.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:02.611+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:02.692 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:58:02.691+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:58:02.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:02.740+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:03.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:03.312+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:03.404 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:03.403+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:03.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:03.618+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:03.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:03.724+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:04.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:04.290+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:04.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:04.369+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:04.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:04.577+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:04.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:04.767+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:05.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:05.335+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:05.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:05.419+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:05.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:05.578+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:05.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:05.770+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:06.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:06.384+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:06.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:06.413+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:06.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:06.628+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:06.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:06.748+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:07.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:07.423+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:07.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:07.423+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:07.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:07.629+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:07.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:07.776+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:08.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:08.420+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:08.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:08.439+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:08.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:08.603+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:08.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:08.743+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:09.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:58:09.253 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:58:09.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:09.379+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:09.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:09.429+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:09.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:09.588+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:09.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:09.770+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:10.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:10.353+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:10.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:10.469+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:10.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:10.554+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:10.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:10.769+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:11.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:11.359+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:11.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:11.438+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:11.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:11.577+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:11.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:11.779+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:12.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:12.369+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:12.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:12.488+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:12.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:12.586+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:12.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:12.823+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:13.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:13.392+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:13.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:13.493+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:13.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:13.584+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:13.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:13.848+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:14.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:14.397+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:14.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:14.449+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:14.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:14.563+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:14.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:14.807+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:15.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:15.352+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:15.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:15.416+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:15.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:15.613+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:15.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:15.757+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:16.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:16.343+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:16.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:16.391+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:16.578 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:16.577+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:16.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:16.758+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:17.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:17.355+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:17.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:17.365+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:17.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:17.561+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:17.708 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:58:17.706+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:58:17.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:17.731+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:18.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:18.353+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:18.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:18.354+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:18.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:18.606+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:18.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:18.717+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:19.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:19.316+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:19.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:19.322+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:19.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:19.645+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:19.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:19.699+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:20.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:20.315+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:20.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:20.337+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:20.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:20.671+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:20.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:20.686+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:21.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:21.304+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:21.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:21.375+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:21.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:21.647+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:21.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:21.656+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:22.328 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:22.327+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:22.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:22.425+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:22.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:22.631+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:22.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:22.672+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:23.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:23.349+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:23.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:23.424+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:23.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:23.650+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:23.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:23.662+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:24.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:24.310+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:24.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:24.381+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:24.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:24.654+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:24.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:24.663+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:25.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:25.274+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:25.372 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:25.370+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:25.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:25.617+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:25.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:25.622+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:26.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:26.298+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:26.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:26.353+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:26.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:26.591+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:26.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:26.673+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:27.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:27.252+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:27.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:27.335+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:27.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:27.604+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:27.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:27.636+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:28.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:28.258+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:28.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:28.367+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:28.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:28.564+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:28.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:28.685+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:29.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:29.301+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:29.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:29.411+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:29.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:29.604+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:29.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:29.639+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:30.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:30.293+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:30.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:30.447+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:30.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:30.621+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:30.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:30.629+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:31.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:31.313+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:31.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:31.455+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:31.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:31.615+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:31.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:31.617+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:32.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:32.284+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:32.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:32.447+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:32.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:32.613+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:32.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:32.615+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:32.724 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:58:32.722+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:58:33.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:33.248+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:33.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:33.485+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:33.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:33.580+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:33.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:33.602+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:34.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:34.235+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:34.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:34.437+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:34.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:34.552+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:34.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:34.595+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:35.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:35.275+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:35.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:35.483+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:35.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:35.586+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:35.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:35.602+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:36.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:36.266+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:36.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:36.512+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:36.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:36.560+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:36.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:36.632+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:37.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:37.226+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:37.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:37.516+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:37.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:37.555+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:37.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:37.661+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:38.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:38.177+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:38.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:38.472+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:38.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:38.507+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:38.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:38.633+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:39.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:39.154+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:39.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:58:39.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:58:39.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:39.437+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:39.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:39.485+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:39.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:39.677+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:40.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:40.179+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:40.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:40.394+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:40.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:40.474+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:40.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:40.663+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:41.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:41.181+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:41.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:41.422+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:41.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:41.492+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:41.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:41.689+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:42.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:42.198+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:42.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:42.436+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:42.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:42.499+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:42.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:42.719+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:43.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:43.169+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:43.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:43.473+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:43.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:43.483+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:43.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:43.684+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:44.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:44.148+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:44.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:44.519+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:44.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:44.529+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:44.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:44.681+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:45.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:45.193+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:45.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:45.554+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:45.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:45.557+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:45.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:45.666+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:46.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:46.170+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:46.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:46.537+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:46.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:46.538+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:46.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:46.621+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:47.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:47.146+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:47.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:47.531+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:47.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:47.584+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:47.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:47.584+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:47.740 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:58:47.738+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:58:48.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:48.118+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:48.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:48.489+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:48.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:48.554+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:48.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:48.601+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:49.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:49.099+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:49.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:49.459+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:49.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:49.572+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:49.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:49.596+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:50.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:50.059+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:50.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:50.437+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:50.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:50.540+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:50.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:50.629+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:51.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:51.061+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:51.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:51.390+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:51.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:51.530+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:51.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:51.589+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:52.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:52.058+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:52.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:52.354+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:52.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:52.548+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:52.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:52.630+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:53.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:53.042+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:53.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:53.380+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:53.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:53.566+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:53.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:53.615+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:54.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:54.057+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:54.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:54.366+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:54.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:54.605+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:54.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:54.620+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:55.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:55.033+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:55.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:55.365+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:55.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:55.593+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:55.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:55.593+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:56.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:56.050+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:56.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:56.412+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:56.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:56.578+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:56.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:56.607+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:57.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:57.028+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:57.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:57.400+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:57.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:57.597+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:57.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:57.637+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:58.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:58.030+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:58.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:58.394+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:58.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:58.597+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:58.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:58.643+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:59.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:58:59.057+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:59.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:58:59.399+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:59.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:58:59.550+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:58:59.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:58:59.643+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:00.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:00.076+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:00.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:00.415+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:00.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:00.591+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:00.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:00.604+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:01.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:01.117+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:01.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:01.410+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:01.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:01.546+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:01.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:01.575+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:02.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:02.120+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:02.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:02.446+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:02.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:02.555+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:02.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:02.572+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:02.756 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:59:02.754+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:59:03.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:03.159+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:03.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:03.491+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:03.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:03.527+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:03.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:03.557+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:04.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:04.167+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:04.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:04.485+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:04.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:04.508+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:04.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:04.537+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:05.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:05.193+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:05.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:05.489+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:05.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:05.510+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:05.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:05.521+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:06.184 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:06.183+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:06.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:06.484+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:06.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:06.505+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:06.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:06.531+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:07.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:07.200+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:07.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:07.497+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:07.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:07.504+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:07.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:07.573+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:08.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:08.181+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:08.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:08.460+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:08.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:08.473+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:08.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:08.603+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:09.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:09.144+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:09.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:09.465+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:09.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:09.481+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:09.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:59:09.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:59:09.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:09.640+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:10.141 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:10.140+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:10.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:10.435+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:10.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:10.470+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:10.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:10.621+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:11.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:11.133+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:11.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:11.445+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:11.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:11.491+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:11.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:11.574+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:12.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:12.111+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:12.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:12.411+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:12.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:12.453+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:12.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:12.619+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:13.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:13.127+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:13.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:13.385+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:13.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:13.415+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:13.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:13.665+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:14.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:14.154+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:14.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:14.415+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:14.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:14.428+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:14.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:14.662+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:15.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:15.155+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:15.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:15.371+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:15.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:15.442+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:15.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:15.634+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:16.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:16.155+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:16.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:16.421+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:16.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:16.449+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:16.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:16.614+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:17.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:17.176+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:17.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:17.421+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:17.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:17.442+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:17.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:17.634+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:17.771 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:59:17.770+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:59:18.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:18.172+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:18.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:18.425+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:18.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:18.482+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:18.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:18.618+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:19.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:19.209+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:19.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:19.420+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:19.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:19.457+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:19.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:19.640+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:20.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:20.164+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:20.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:20.434+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:20.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:20.459+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:20.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:20.594+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:21.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:21.201+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:21.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:21.454+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:21.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:21.468+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:21.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:21.619+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:22.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:22.201+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:22.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:22.447+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:22.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:22.507+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:22.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:22.606+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:23.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:23.195+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:23.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:23.411+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:23.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:23.500+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:23.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:23.627+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:24.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:24.168+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:24.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:24.380+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:24.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:24.465+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:24.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:24.625+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:25.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:25.169+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:25.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:25.412+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:25.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:25.454+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:25.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:25.609+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:26.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:26.180+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:26.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:26.389+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:26.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:26.455+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:26.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:26.597+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:27.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:27.158+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:27.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:27.383+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:27.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:27.478+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:27.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:27.591+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:28.129 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:28.127+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:28.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:28.359+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:28.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:28.465+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:28.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:28.582+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:29.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:29.132+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:29.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:29.351+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:29.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:29.456+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:29.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:29.579+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:30.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:30.152+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:30.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:30.368+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:30.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:30.441+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:30.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:30.605+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:31.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:31.111+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:31.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:31.345+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:31.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:31.430+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:31.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:31.586+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:32.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:32.156+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:32.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:32.336+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:32.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:32.418+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:32.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:32.550+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:32.787 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:59:32.785+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:59:33.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:33.158+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:33.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:33.331+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:33.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:33.423+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:33.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:33.520+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:34.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:34.177+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:34.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:34.304+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:34.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:34.375+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:34.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:34.538+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:35.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:35.162+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:35.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:35.300+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:35.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:35.345+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:35.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:35.527+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:36.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:36.171+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:36.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:36.299+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:36.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:36.342+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:36.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:36.531+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:37.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:37.187+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:37.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:37.339+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:37.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:37.373+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:37.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:37.552+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:38.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:38.170+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:38.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:38.325+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:38.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:38.325+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:38.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:38.508+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:39.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:39.124+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:39.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:39.333+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:39.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:39.362+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:39.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:39.536+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:39.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:59:39.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T02:59:40.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:40.133+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:40.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:40.380+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:40.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:40.385+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:40.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:40.554+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:41.175 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:41.172+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:41.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:41.345+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:41.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:41.355+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:41.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:41.534+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:42.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:42.142+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:42.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:42.326+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:42.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:42.392+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:42.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:42.576+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:43.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:43.179+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:43.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:43.342+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:43.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:43.431+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:43.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:43.563+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:44.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:44.158+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:44.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:44.323+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:44.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:44.424+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:44.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:44.535+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:45.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:45.159+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:45.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:45.363+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:45.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:45.448+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:45.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:45.503+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:46.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:46.119+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:46.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:46.325+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:46.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:46.486+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:46.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:46.520+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:47.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:47.143+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:47.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:47.356+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:47.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:47.501+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:47.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:47.532+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:47.803 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T02:59:47.801+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T02:59:48.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:48.100+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:48.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:48.312+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:48.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:48.509+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:48.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:48.535+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:49.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:49.145+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:49.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:49.283+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:49.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:49.508+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:49.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:49.523+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:50.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:50.111+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:50.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:50.312+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:50.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:50.556+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:50.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:50.562+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:51.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:51.115+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:51.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:51.341+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:51.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:51.536+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:51.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:51.590+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:52.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:52.109+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:52.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:52.344+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:52.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:52.539+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:52.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:52.597+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:53.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:53.119+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:53.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:53.303+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:53.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:53.576+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:53.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:53.647+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:54.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:54.148+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:54.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:54.282+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:54.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:54.536+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:54.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:54.639+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:55.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:55.111+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:55.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:55.263+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:55.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:55.559+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:55.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:55.667+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:56.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:56.153+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:56.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:56.228+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:56.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:56.523+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:56.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:56.671+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:57.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:57.135+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:57.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:57.273+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:57.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:57.514+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:57.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:57.685+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:58.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:58.150+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:58.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:58.226+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:58.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:58.492+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:58.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:58.687+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:59.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T02:59:59.111+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:59.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T02:59:59.233+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:59.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T02:59:59.491+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T02:59:59.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T02:59:59.723+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:00.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:00.084+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:00.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:00.200+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:00.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:00.498+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:00.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:00.701+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:01.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:01.039+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:01.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:01.159+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:01.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:01.539+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:01.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:01.743+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:02.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:02.014+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:02.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:02.207+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:02.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:02.551+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:02.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:02.785+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:02.819 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:00:02.817+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:00:03.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:03.028+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:03.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:03.192+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:03.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:03.587+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:03.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:03.813+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:03.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:03.979+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:04.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:04.197+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:04.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:04.579+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:04.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:04.811+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:05.005 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:05.004+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:05.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:05.188+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:05.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:05.585+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:05.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:05.787+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:06.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:06.026+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:06.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:06.222+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:06.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:06.626+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:06.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:06.768+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:07.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:07.073+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:07.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:07.201+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:07.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:07.676+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:07.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:07.728+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:08.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:08.038+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:08.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:08.227+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:08.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:08.692+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:08.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:08.694+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:09.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:09.015+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:09.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:09.209+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:09.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:09.680+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:09.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:09.704+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:09.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:00:09.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:00:10.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:10.029+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:10.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:10.172+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:10.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:10.659+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:10.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:10.730+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:11.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:11.033+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:11.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:11.177+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:11.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:11.657+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:11.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:11.700+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:12.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:12.005+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:12.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:12.180+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:12.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:12.705+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:12.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:12.706+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:13.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:13.027+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:13.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:13.191+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:13.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:13.689+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:13.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:13.736+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:13.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:13.991+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:14.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:14.205+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:14.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:14.698+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:14.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:14.784+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:14.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:14.949+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:15.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:15.197+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:15.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:15.683+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:15.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:15.768+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:15.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:15.959+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:16.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:16.195+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:16.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:16.668+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:16.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:16.734+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:16.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:16.932+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:17.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:17.239+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:17.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:17.620+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:17.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:17.698+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:17.835 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:00:17.833+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:00:17.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:17.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:18.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:18.210+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:18.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:18.644+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:18.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:18.729+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:18.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:18.907+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:19.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:19.188+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:19.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:19.624+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:19.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:19.714+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:19.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:19.896+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:20.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:20.225+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:20.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:20.621+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:20.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:20.689+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:20.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:20.927+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:21.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:21.261+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:21.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:21.612+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:21.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:21.666+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:21.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:21.934+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:22.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:22.231+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:22.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:22.581+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:22.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:22.668+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:22.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:22.917+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:23.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:23.218+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:23.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:23.563+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:23.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:23.694+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:23.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:23.912+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:24.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:24.208+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:24.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:24.567+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:24.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:24.729+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:24.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:24.934+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:25.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:25.208+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:25.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:25.585+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:25.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:25.773+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:25.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:25.934+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:26.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:26.167+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:26.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:26.584+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:26.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:26.811+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:26.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:26.927+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:27.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:27.151+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:27.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:27.590+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:27.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:27.832+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:27.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:27.970+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:28.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:28.148+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:28.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:28.635+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:28.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:28.841+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:28.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:28.989+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:29.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:29.197+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:29.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:29.684+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:29.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:29.805+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:30.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:30.035+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:30.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:30.238+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:30.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:30.716+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:30.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:30.759+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:31.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:31.045+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:31.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:31.225+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:31.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:31.686+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:31.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:31.789+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:32.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:32.000+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:32.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:32.271+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:32.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:32.731+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:32.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:32.832+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:32.850 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:00:32.849+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:00:33.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:33.010+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:33.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:33.297+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:33.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:33.769+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:33.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:33.840+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:34.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:34.029+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:34.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:34.293+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:34.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:34.740+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:34.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:34.890+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:35.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:35.057+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:35.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:35.313+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:35.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:35.748+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:35.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:35.899+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:36.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:36.065+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:36.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:36.294+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:36.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:36.792+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:36.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:36.925+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:37.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:37.079+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:37.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:37.304+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:37.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:37.766+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:37.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:37.902+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:38.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:38.051+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:38.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:38.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:38.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:38.727+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:38.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:38.853+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:39.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:39.013+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:39.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:39.220+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:39.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:39.690+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:39.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:39.826+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:39.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:39.975+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:39.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:00:39.993 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:00:40.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:40.255+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:40.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:40.708+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:40.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:40.796+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:40.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:40.928+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:41.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:41.212+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:41.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:41.691+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:41.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:41.783+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:41.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:41.965+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:42.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:42.240+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:42.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:42.698+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:42.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:42.824+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:42.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:42.940+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:43.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:43.206+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:43.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:43.710+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:43.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:43.794+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:43.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:43.922+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:44.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:44.221+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:44.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:44.731+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:44.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:44.759+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:44.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:44.878+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:45.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:45.235+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:45.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:45.701+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:45.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:45.756+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:45.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:45.917+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:46.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:46.247+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:46.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:46.685+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:46.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:46.710+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:46.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:46.903+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:47.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:47.276+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:47.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:47.660+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:47.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:47.691+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:47.866 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:00:47.864+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:00:47.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:47.881+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:48.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:48.282+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:48.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:48.627+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:48.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:48.649+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:48.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:48.866+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:49.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:49.320+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:49.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:49.633+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:49.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:49.646+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:49.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:49.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:50.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:50.271+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:50.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:50.612+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:50.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:50.674+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:50.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:50.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:51.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:51.239+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:51.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:51.566+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:51.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:51.703+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:51.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:51.879+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:52.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:52.244+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:52.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:52.545+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:52.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:52.689+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:52.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:52.904+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:53.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:53.209+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:53.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:53.512+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:53.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:53.708+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:53.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:53.913+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:54.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:54.223+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:54.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:54.478+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:54.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:54.702+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:54.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:54.908+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:55.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:55.265+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:55.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:55.476+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:55.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:55.666+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:55.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:55.901+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:56.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:56.274+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:56.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:56.501+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:56.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:56.687+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:56.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:56.890+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:57.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:57.307+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:57.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:57.473+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:57.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:57.671+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:57.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:57.879+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:58.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:58.322+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:58.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:58.499+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:58.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:58.689+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:58.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:58.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:59.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:00:59.315+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:59.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:00:59.487+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:59.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:00:59.645+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:00:59.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:00:59.893+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 19 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:00.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:00.286+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:00.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:00.516+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 48 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:00.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:00.631+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:00.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:00.901+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:01.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:01.283+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:01.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:01.532+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:01.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:01.616+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:01.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:01.944+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:02.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:02.319+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:02.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:02.543+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:02.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:02.620+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:02.882 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:01:02.881+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:01:02.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:02.929+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:03.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:03.364+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:03.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:03.580+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:03.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:03.590+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:03.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:03.884+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:04.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:04.339+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:04.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:04.556+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:04.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:04.612+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:04.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:04.910+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:05.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:05.361+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:05.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:05.568+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:05.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:05.653+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:05.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:05.882+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:06.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:06.407+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:06.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:06.578+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:06.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:06.669+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:06.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:06.846+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:07.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:07.432+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:07.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:07.541+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:07.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:07.624+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:07.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:07.850+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:08.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:08.396+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:08.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:08.576+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:08.617 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:08.616+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:08.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:08.876+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:09.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:09.426+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:09.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:09.624+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:09.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:09.637+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:09.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:09.882+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:10.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:01:10.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:01:10.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:10.441+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:10.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:10.604+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:10.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:10.617+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:10.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:10.893+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:11.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:11.430+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:11.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:11.572+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:11.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:11.581+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:11.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:11.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:12.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:12.416+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:12.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:12.555+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:12.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:12.579+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:12.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:12.803+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:13.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:13.382+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:13.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:13.558+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:13.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:13.581+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:13.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:13.841+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:14.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:14.405+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:14.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:14.524+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:14.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:14.611+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:14.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:14.797+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:15.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:15.424+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:15.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:15.568+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:15.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:15.627+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:15.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:15.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:16.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:16.400+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:16.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:16.582+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:16.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:16.654+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:16.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:16.831+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:17.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:17.450+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:17.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:17.603+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:17.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:17.677+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:17.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:17.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:17.898 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:01:17.896+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:01:18.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:18.423+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:18.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:18.587+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:18.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:18.693+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:18.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:18.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:19.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:19.383+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:19.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:19.572+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:19.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:19.671+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:19.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:19.800+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:20.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:20.396+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:20.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:20.594+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:20.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:20.683+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:20.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:20.772+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:21.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:21.432+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:21.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:21.582+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:21.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:21.646+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:21.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:21.801+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:22.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:22.383+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:22.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:22.541+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:22.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:22.673+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:22.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:22.789+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:23.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:23.350+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:23.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:23.572+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:23.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:23.699+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:23.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:23.809+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:24.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:24.345+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:24.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:24.542+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:24.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:24.673+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:24.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:24.780+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:25.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:25.346+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:25.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:25.506+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:25.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:25.683+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:25.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:25.759+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:26.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:26.371+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:26.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:26.488+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:26.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:26.657+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:26.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:26.770+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:27.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:27.340+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:27.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:27.505+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:27.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:27.657+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:27.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:27.811+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:28.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:28.386+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:28.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:28.535+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:28.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:28.613+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:28.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:28.821+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:29.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:29.399+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:29.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:29.509+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:29.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:29.636+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:29.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:29.840+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:30.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:30.401+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:30.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:30.510+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:30.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:30.679+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:30.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:30.803+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:31.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:31.391+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:31.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:31.556+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:31.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:31.710+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:31.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:31.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:32.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:32.429+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:32.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:32.542+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:32.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:32.669+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:32.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:32.828+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:32.914 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:01:32.912+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:01:33.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:33.393+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:33.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:33.562+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:33.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:33.653+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:33.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:33.858+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:34.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:34.423+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:34.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:34.605+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:34.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:34.609+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:34.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:34.809+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:35.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:35.437+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:35.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:35.571+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:35.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:35.595+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:35.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:35.820+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:36.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:36.451+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:36.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:36.592+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:36.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:36.624+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:36.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:36.839+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:37.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:37.494+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:37.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:37.607+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:37.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:37.669+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:37.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:37.811+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:38.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:38.449+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:38.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:38.608+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:38.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:38.627+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:38.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:38.846+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:39.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:39.481+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:39.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:39.597+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:39.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:39.621+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:39.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:39.823+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:40.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:01:40.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:01:40.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:40.519+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:40.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:40.582+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:40.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:40.659+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:40.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:40.857+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:41.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:41.513+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:41.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:41.555+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:41.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:41.678+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:41.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:41.867+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:42.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:42.536+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:42.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:42.561+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:42.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:42.693+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:42.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:42.904+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:43.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:43.544+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:43.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:43.561+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:43.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:43.661+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:43.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:43.946+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:44.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:44.563+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:44.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:44.608+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:44.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:44.621+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:44.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:44.900+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:45.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:45.545+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:45.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:45.575+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:45.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:45.622+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:45.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:45.943+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:46.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:46.548+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:46.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:46.598+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:46.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:46.669+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:46.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:46.960+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:47.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:47.567+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:47.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:47.610+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:47.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:47.668+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:47.930 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:01:47.928+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:01:48.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:48.008+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:48.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:48.549+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:48.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:48.626+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:48.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:48.678+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:48.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:48.963+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:49.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:49.567+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:49.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:49.631+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:49.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:49.707+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:49.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:49.992+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:50.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:50.608+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:50.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:50.641+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:50.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:50.679+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:50.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:50.950+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:51.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:51.594+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:51.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:51.658+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:51.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:51.723+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:51.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:51.912+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:52.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:52.634+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:52.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:52.682+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:52.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:52.726+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:52.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:52.871+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:53.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:53.633+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:53.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:53.657+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:53.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:53.709+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:53.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:53.918+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:54.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:54.639+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:54.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:54.681+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:54.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:54.742+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:54.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:54.946+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:55.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:55.640+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:55.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:55.645+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:55.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:55.789+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:55.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:55.898+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:56.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:56.656+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:56.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:56.691+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:56.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:56.754+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:56.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:56.932+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:57.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:57.661+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:57.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:57.724+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:57.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:57.733+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:57.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:57.972+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:58.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:58.678+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:58.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:58.702+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:58.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:58.778+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:58.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:58.966+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:59.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:01:59.672+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:59.682 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:01:59.680+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:59.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:01:59.794+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:01:59.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:01:59.942+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:00.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:00.643+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:00.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:00.662+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:00.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:00.811+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:00.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:00.898+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:01.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:01.608+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:01.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:01.631+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:01.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:01.780+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:01.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:01.919+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:02.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:02.608+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:02.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:02.654+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:02.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:02.769+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:02.945 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:02:02.943+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:02:02.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:02.955+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:03.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:03.632+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:03.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:03.654+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:03.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:03.772+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:03.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:03.906+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:04.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:04.663+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:04.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:04.665+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:04.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:04.746+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:04.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:04.891+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:05.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:05.637+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:05.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:05.660+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:05.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:05.722+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:05.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:05.843+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:06.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:06.622+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:06.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:06.691+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:06.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:06.751+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:06.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:06.862+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:07.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:07.602+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:07.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:07.701+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:07.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:07.775+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:07.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:07.829+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:08.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:08.592+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:08.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:08.699+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:08.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:08.735+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:08.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:08.861+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:09.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:09.618+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:09.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:09.655+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:09.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:09.733+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:09.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:09.908+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:10.364 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:02:10.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:02:10.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:10.612+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:10.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:10.667+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:10.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:10.724+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:10.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:10.866+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:11.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:11.637+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:11.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:11.639+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:11.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:11.709+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:11.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:11.854+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:12.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:12.662+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:12.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:12.684+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:12.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:12.709+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:12.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:12.872+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:13.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:13.635+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:13.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:13.707+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:13.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:13.724+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:13.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:13.865+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:14.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:14.597+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:14.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:14.661+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:14.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:14.762+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:14.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:14.839+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:15.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:15.590+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:15.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:15.654+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:15.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:15.794+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:15.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:15.837+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:16.604 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:16.602+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:16.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:16.635+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:16.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:16.783+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:16.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:16.844+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:17.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:17.580+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:17.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:17.640+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:17.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:17.801+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:17.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:17.825+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:17.946 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:02:17.945+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:02:18.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:18.530+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:18.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:18.641+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:18.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:18.790+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:18.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:18.803+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:19.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:19.575+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:19.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:19.681+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:19.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:19.756+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:19.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:19.787+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:20.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:20.559+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:20.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:20.698+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:20.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:20.804+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:20.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:20.812+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:21.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:21.513+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:21.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:21.743+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:21.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:21.767+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:21.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:21.798+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:22.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:22.471+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:22.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:22.762+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:22.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:22.764+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:22.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:22.774+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:23.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:23.465+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:23.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:23.745+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:23.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:23.753+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:23.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:23.783+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:24.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:24.422+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:24.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:24.733+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:24.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:24.750+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:24.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:24.812+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:25.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:25.412+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:25.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:25.703+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:25.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:25.761+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:25.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:25.818+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:26.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:26.419+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:26.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:26.704+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:26.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:26.780+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:26.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:26.802+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:27.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:27.405+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:27.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:27.739+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:27.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:27.820+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:27.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:27.826+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:28.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:28.442+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:28.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:28.693+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:28.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:28.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:28.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:28.814+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:29.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:29.487+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:29.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:29.704+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:29.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:29.811+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:29.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:29.851+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:30.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:30.491+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:30.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:30.721+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:30.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:30.765+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:30.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:30.816+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:31.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:31.477+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:31.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:31.696+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:31.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:31.736+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:31.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:31.790+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:32.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:32.519+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:32.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:32.731+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:32.738 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:32.737+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:32.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:32.819+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:32.949 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:02:32.947+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:02:33.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:33.532+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:33.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:33.761+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:33.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:33.769+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:33.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:33.821+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:34.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:34.508+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:34.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:34.719+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:34.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:34.722+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:34.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:34.784+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:35.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:35.542+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:35.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:35.750+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:35.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:35.754+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:35.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:35.765+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:36.553 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:36.552+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:36.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:36.708+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:36.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:36.725+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:36.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:36.733+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:37.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:37.515+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:37.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:37.717+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:37.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:37.738+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:37.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:37.746+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:38.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:38.491+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:38.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:38.687+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:38.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:38.776+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:38.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:38.791+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:39.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:39.514+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:39.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:39.715+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:39.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:39.750+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:39.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:39.831+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:40.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:02:40.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:02:40.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:40.526+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:40.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:40.688+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:40.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:40.757+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:40.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:40.849+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:41.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:41.531+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:41.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:41.712+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:41.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:41.748+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:41.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:41.859+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:42.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:42.526+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:42.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:42.688+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:42.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:42.747+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:42.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:42.864+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:43.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:43.513+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:43.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:43.689+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:43.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:43.700+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:43.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:43.913+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:44.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:44.507+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:44.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:44.648+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:44.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:44.697+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:44.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:44.904+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:45.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:45.506+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:45.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:45.653+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:45.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:45.670+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:45.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:45.866+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:46.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:46.556+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:46.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:46.667+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:46.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:46.668+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:46.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:46.819+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:47.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:47.518+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:47.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:47.626+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:47.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:47.656+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:47.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:47.840+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:47.964 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:02:47.962+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:02:48.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:48.558+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:48.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:48.663+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:48.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:48.670+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:48.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:48.833+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:49.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:49.571+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:49.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:49.630+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:49.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:49.696+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:49.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:49.806+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:50.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:50.603+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:50.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:50.653+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:50.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:50.723+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:50.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:50.814+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:51.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:51.638+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:51.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:51.658+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:51.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:51.706+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:51.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:51.852+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:52.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:52.614+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:52.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:52.668+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:52.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:52.679+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:52.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:52.819+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:53.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:53.568+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:53.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:53.683+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:53.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:53.705+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:53.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:53.837+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:54.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:54.523+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:54.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:54.710+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:54.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:54.743+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:54.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:54.846+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:55.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:55.562+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:55.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:55.683+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:55.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:55.779+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:55.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:55.803+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:56.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:56.535+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:56.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:56.695+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:56.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:56.759+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:56.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:56.817+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:57.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:57.522+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:57.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:57.697+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:57.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:57.794+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:57.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:57.825+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:58.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:58.542+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:58.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:58.743+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:58.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:58.771+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:58.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:58.855+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:59.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:02:59.543+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:59.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:02:59.733+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:59.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:02:59.799+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:02:59.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:02:59.895+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:00.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:00.519+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:00.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:00.769+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:00.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:00.846+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:00.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:00.852+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:01.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:01.531+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:01.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:01.800+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:01.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:01.873+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:01.877 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:01.875+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:02.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:02.504+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:02.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:02.820+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:02.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:02.865+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:02.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:02.912+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:02.980 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:03:02.978+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:03:03.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:03.531+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:03.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:03.794+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:03.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:03.904+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:03.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:03.952+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:04.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:04.495+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:04.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:04.776+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:04.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:04.890+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:04.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:04.983+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:05.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:05.463+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:05.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:05.764+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:05.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:05.878+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:06.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:06.008+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:06.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:06.425+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:06.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:06.721+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:06.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:06.862+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:06.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:06.968+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:07.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:07.404+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:07.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:07.762+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:07.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:07.834+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:07.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:07.965+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:08.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:08.455+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:08.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:08.801+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:08.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:08.879+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:08.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:08.927+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:09.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:09.465+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:09.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:09.781+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:09.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:09.880+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:09.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:09.897+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:10.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:10.463+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:10.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:03:10.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:03:10.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:10.805+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:10.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:10.903+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:10.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:10.919+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:11.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:11.467+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:11.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:11.796+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:11.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:11.875+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:11.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:11.892+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:12.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:12.487+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:12.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:12.835+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:12.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:12.853+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:12.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:12.882+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:13.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:13.490+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:13.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:13.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:13.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:13.867+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:13.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:13.907+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:14.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:14.528+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:14.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:14.785+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:14.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:14.873+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:14.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:14.910+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:15.522 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:15.520+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:15.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:15.743+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:15.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:15.865+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:15.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:15.933+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:16.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:16.521+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:16.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:16.699+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:16.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:16.898+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:16.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:16.946+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:17.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:17.534+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:17.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:17.713+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:17.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:17.858+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:17.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:17.931+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:17.982 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:03:17.980+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:03:18.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:18.542+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:18.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:18.711+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:18.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:18.881+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:18.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:18.965+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:19.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:19.493+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:19.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:19.750+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:19.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:19.928+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:19.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:19.932+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:20.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:20.471+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:20.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:20.763+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:20.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:20.953+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:20.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:20.955+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:21.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:21.490+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:21.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:21.786+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:21.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:21.982+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:21.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:21.982+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:22.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:22.524+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:22.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:22.762+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:22.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:22.960+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:23.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:23.003+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:23.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:23.574+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:23.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:23.730+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:23.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:23.915+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:24.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:24.031+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:24.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:24.616+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:24.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:24.683+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:24.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:24.868+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:25.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:25.061+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:25.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:25.615+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:25.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:25.670+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:25.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:25.882+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:26.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:26.098+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:26.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:26.660+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:26.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:26.702+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:26.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:26.895+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:27.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:27.095+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:27.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:27.616+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:27.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:27.676+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:27.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:27.857+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:28.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:28.097+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:28.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:28.577+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:28.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:28.641+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:28.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:28.898+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:29.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:29.127+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:29.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:29.528+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:29.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:29.603+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:29.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:29.940+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:30.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:30.087+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:30.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:30.556+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:30.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:30.567+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:30.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:30.924+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:31.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:31.079+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:31.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:31.534+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:31.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:31.603+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:31.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:31.910+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:32.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:32.125+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:32.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:32.512+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:32.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:32.646+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:32.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:32.893+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:32.998 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:03:32.997+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:03:33.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:33.173+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:33.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:33.488+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:33.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:33.629+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:33.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:33.887+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:34.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:34.170+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:34.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:34.446+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:34.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:34.616+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:34.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:34.845+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:35.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:35.154+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:35.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:35.435+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:35.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:35.643+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:35.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:35.863+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:36.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:36.128+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:36.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:36.436+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:36.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:36.681+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:36.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:36.912+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:37.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:37.150+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:37.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:37.404+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:37.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:37.729+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:37.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:37.945+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:38.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:38.157+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:38.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:38.406+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:38.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:38.688+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:38.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:38.900+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:39.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:39.154+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:39.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:39.378+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:39.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:39.689+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:39.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:39.855+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:40.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:40.152+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:40.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:40.375+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:40.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:40.715+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:40.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:03:40.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:03:40.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:40.904+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:41.186 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:41.184+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:41.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:41.417+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:41.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:41.707+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:41.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:41.940+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:42.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:42.167+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:42.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:42.398+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:42.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:42.686+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:42.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:42.985+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:43.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:43.188+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:43.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:43.392+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:43.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:43.693+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:44.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:44.001+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:44.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:44.169+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:44.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:44.349+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:44.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:44.697+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:44.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:44.969+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:45.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:45.201+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:45.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:45.339+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:45.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:45.737+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:45.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:45.926+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:46.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:46.218+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:46.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:46.378+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:46.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:46.785+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:46.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:46.888+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:47.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:47.247+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:47.383 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:47.380+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:47.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:47.820+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:47.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:47.871+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:48.016 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:03:48.012+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:03:48.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:48.265+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:48.388 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:48.387+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:48.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:48.817+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:48.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:48.882+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:49.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:49.272+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:49.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:49.429+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:49.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:49.867+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:49.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:49.916+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:50.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:50.249+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:50.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:50.407+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:50.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:50.909+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:50.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:50.959+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:51.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:51.288+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:51.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:51.394+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:51.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:51.862+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:51.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:51.923+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:52.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:52.292+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:52.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:52.363+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:52.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:52.841+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:52.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:52.900+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:53.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:53.325+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:53.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:53.369+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:53.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:53.853+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:53.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:53.894+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:54.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:54.309+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:54.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:54.373+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:54.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:54.806+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:54.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:54.942+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:55.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:55.318+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:55.351 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:55.349+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:55.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:55.799+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:55.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:55.963+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:56.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:56.272+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:56.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:56.334+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:56.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:56.762+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:56.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:56.963+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:57.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:57.238+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:57.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:57.358+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:57.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:57.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:57.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:57.949+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:58.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:58.280+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:58.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:58.375+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:58.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:58.794+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:58.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:58.905+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:59.266 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:03:59.264+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:59.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:03:59.336+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:59.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:03:59.754+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:03:59.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:03:59.925+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:00.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:00.269+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:00.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:00.326+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:00.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:00.750+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:00.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:00.909+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:01.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:01.244+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:01.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:01.325+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:01.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:01.742+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:01.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:01.905+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:02.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:02.204+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:02.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:02.348+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:02.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:02.780+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:02.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:02.944+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:03.030 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:04:03.028+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:04:03.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:03.207+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:03.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:03.330+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:03.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:03.763+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:03.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:03.917+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:04.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:04.213+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:04.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:04.325+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:04.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:04.716+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:04.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:04.957+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:05.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:05.225+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:05.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:05.299+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:05.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:05.695+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:05.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:05.932+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:06.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:06.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:06.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:06.314+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:06.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:06.717+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:06.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:06.906+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:07.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:07.215+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:07.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:07.364+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:07.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:07.681+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:07.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:07.917+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:08.181 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:08.180+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:08.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:08.397+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:08.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:08.702+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:08.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:08.953+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:09.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:09.134+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:09.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:09.432+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:09.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:09.695+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:09.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:09.996+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:10.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:10.121+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:10.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:10.436+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:10.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:10.711+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:10.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:04:10.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:04:11.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:11.000+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:11.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:11.080+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:11.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:11.386+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:11.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:11.759+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:11.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:11.960+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:12.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:12.120+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:12.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:12.385+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:12.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:12.801+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:12.990 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:12.989+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:13.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:13.126+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:13.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:13.361+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:13.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:13.794+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:14.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:14.030+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:14.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:14.142+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:14.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:14.405+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:14.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:14.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:15.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:15.062+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:15.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:15.188+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:15.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:15.360+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:15.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:15.853+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:16.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:16.051+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:16.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:16.173+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:16.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:16.409+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:16.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:16.805+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:17.031 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:17.030+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:17.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:17.169+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:17.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:17.381+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:17.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:17.853+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:18.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:18.043+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:18.045 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:04:18.044+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:04:18.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:18.172+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:18.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:18.379+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:18.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:18.865+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:19.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:19.052+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:19.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:19.192+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:19.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:19.405+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:19.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:19.841+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:20.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:20.052+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:20.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:20.225+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:20.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:20.402+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:20.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:20.873+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:21.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:21.092+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:21.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:21.261+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:21.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:21.373+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:21.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:21.901+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:22.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:22.110+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:22.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:22.282+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:22.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:22.328+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:22.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:22.876+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:23.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:23.067+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:23.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:23.295+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:23.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:23.311+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:23.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:23.833+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:24.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:24.089+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:24.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:24.280+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:24.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:24.343+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:24.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:24.821+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:25.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:25.062+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:25.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:25.276+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:25.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:25.328+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:25.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:25.793+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:26.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:26.030+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:26.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:26.250+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:26.320 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:26.313+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:26.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:26.799+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:26.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:26.994+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:27.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:27.226+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:27.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:27.265+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:27.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:27.754+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:27.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:27.951+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:28.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:28.223+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:28.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:28.246+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:28.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:28.717+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:28.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:28.967+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:29.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:29.238+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:29.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:29.289+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:29.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:29.758+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:29.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:29.995+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:30.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:30.209+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:30.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:30.306+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:30.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:30.790+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:31.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:31.037+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:31.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:31.238+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:31.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:31.324+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:31.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:31.766+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:32.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:32.023+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:32.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:32.248+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:32.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:32.287+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:32.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:32.753+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:32.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:32.988+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:33.061 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:04:33.059+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:04:33.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:33.258+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:33.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:33.283+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:33.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:33.757+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:33.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:33.950+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:34.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:34.249+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:34.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:34.288+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:34.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:34.715+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:34.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:34.937+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:35.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:35.253+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:35.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:35.283+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:35.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:35.676+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:35.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:35.903+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:36.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:36.251+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:36.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:36.262+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:36.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:36.648+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:36.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:36.885+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:37.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:37.275+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:37.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:37.287+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:37.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:37.638+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:37.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:37.842+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:38.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:38.295+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:38.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:38.312+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:38.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:38.675+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:38.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:38.806+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:39.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:39.276+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:39.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:39.325+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:39.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:39.656+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:39.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:39.782+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:40.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:40.245+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:40.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:40.347+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:40.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:40.651+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:40.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:40.790+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:41.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:04:41.007 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:04:41.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:41.259+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:41.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:41.374+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:41.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:41.679+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:41.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:41.777+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:42.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:42.295+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:42.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:42.347+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:42.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:42.650+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:42.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:42.758+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:43.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:43.288+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:43.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:43.363+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:43.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:43.690+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:43.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:43.764+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:44.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:44.333+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:44.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:44.367+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:44.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:44.662+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:44.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:44.777+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:45.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:45.324+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:45.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:45.348+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:45.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:45.700+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:45.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:45.814+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:46.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:46.275+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:46.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:46.360+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:46.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:46.680+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:46.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:46.810+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:47.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:47.227+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:47.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:47.356+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:47.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:47.698+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:47.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:47.845+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:48.070 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:04:48.069+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:04:48.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:48.218+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:48.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:48.333+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:48.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:48.725+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:48.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:48.859+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:49.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:49.254+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:49.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:49.297+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:49.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:49.747+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:49.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:49.860+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:50.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:50.222+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:50.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:50.250+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:50.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:50.710+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:50.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:50.899+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:51.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:51.184+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:51.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:51.294+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:51.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:51.757+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:51.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:51.902+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:52.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:52.178+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:52.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:52.324+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:52.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:52.742+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:52.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:52.935+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:53.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:53.149+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:53.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:53.276+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:53.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:53.694+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:53.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:53.887+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:54.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:54.186+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:54.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:54.295+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:54.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:54.675+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:54.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:54.899+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:55.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:55.156+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:55.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:55.280+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:55.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:55.704+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:55.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:55.871+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:56.161 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:56.160+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:56.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:56.300+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:56.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:56.677+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:56.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:56.884+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:57.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:57.146+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:57.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:57.300+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:57.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:57.701+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:57.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:57.860+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:58.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:58.132+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:58.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:58.327+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:58.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:58.720+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:58.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:58.852+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:59.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:04:59.138+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:59.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:04:59.306+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:59.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:04:59.709+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:04:59.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:04:59.876+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:00.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:00.167+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:00.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:00.267+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:00.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:00.700+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:00.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:00.888+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:01.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:01.133+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:01.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:01.282+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:01.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:01.696+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:01.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:01.921+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:02.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:02.135+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:02.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:02.241+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:02.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:02.744+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:02.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:02.929+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:03.086 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:05:03.084+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:05:03.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:03.158+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:03.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:03.250+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:03.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:03.739+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:03.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:03.979+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:04.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:04.148+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:04.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:04.296+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:04.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:04.756+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:04.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:04.943+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:05.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:05.120+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:05.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:05.267+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:05.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:05.801+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:05.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:05.908+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:06.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:06.140+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:06.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:06.247+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:06.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:06.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:06.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:06.880+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:07.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:07.102+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:07.255 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:07.254+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:07.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:07.871+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:07.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:07.903+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:08.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:08.074+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:08.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:08.206+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:08.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:08.900+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:08.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:08.950+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:09.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:09.078+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:09.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:09.240+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:09.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:09.877+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:09.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:09.944+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:10.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:10.091+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:10.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:10.218+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:10.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:10.875+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:10.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:10.934+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:11.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:05:11.085 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:05:11.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:11.112+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:11.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:11.186+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:11.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:11.925+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:11.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:11.982+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:12.073 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:12.072+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:12.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:12.154+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:12.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:12.876+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:12.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:12.984+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:13.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:13.106+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:13.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:13.114+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:13.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:13.879+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:14.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:14.013+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:14.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:14.075+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:14.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:14.145+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:14.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:14.859+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:15.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:15.034+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:15.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:15.101+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:15.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:15.113+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:15.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:15.816+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:16.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:16.069+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:16.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:16.081+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:16.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:16.138+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:16.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:16.813+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:17.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:17.088+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:17.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:17.092+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:17.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:17.153+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:17.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:17.831+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:18.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:18.048+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:18.102 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:05:18.101+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:05:18.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:18.105+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:18.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:18.172+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:18.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:18.846+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:19.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:19.025+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:19.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:19.147+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:19.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:19.203+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:19.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:19.819+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:20.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:20.050+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:20.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:20.157+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:20.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:20.190+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:20.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:20.867+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:21.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:21.023+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:21.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:21.171+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:21.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:21.178+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:21.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:21.852+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:22.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:22.055+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:22.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:22.139+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:22.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:22.147+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:22.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:22.881+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:23.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:23.059+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:23.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:23.090+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:23.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:23.196+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:23.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:23.888+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:24.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:24.063+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:24.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:24.076+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:24.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:24.148+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:24.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:24.923+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:25.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:25.107+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:25.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:25.120+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:25.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:25.172+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:25.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:25.929+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:26.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:26.106+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:26.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:26.139+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:26.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:26.200+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:26.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:26.906+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:27.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:27.084+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:27.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:27.184+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:27.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:27.242+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:27.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:27.910+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:28.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:28.110+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:28.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:28.195+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:28.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:28.234+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:28.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:28.884+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:29.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:29.084+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:29.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:29.217+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:29.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:29.235+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:29.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:29.848+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:30.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:30.123+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:30.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:30.222+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:30.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:30.279+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:30.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:30.861+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:31.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:31.137+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:31.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:31.194+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:31.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:31.246+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:31.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:31.892+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:32.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:32.146+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:32.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:32.186+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:32.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:32.252+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:32.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:32.866+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:33.118 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:05:33.116+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:05:33.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:33.136+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:33.184 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:33.182+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:33.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:33.272+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:33.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:33.851+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:34.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:34.128+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:34.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:34.160+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:34.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:34.273+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:34.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:34.828+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:35.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:35.132+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:35.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:35.167+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:35.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:35.269+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:35.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:35.854+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:36.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:36.139+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:36.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:36.192+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:36.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:36.310+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:36.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:36.845+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:37.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:37.165+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:37.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:37.235+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:37.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:37.299+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:37.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:37.844+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:38.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:38.118+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:38.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:38.262+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:38.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:38.334+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:38.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:38.842+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:39.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:39.135+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:39.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:39.291+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:39.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:39.308+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:39.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:39.808+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:40.118 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:40.117+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:40.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:40.323+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:40.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:40.330+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:40.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:40.777+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:41.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:41.071+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:41.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:05:41.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:05:41.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:41.279+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:41.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:41.353+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:41.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:41.757+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:42.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:42.034+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:42.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:42.256+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:42.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:42.340+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:42.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:42.747+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:43.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:43.025+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:43.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:43.259+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:43.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:43.303+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:43.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:43.698+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:43.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:43.981+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:44.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:44.235+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:44.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:44.302+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:44.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:44.667+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:45.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:45.019+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:45.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:45.193+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:45.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:45.256+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:45.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:45.668+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:46.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:46.060+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:46.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:46.176+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:46.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:46.281+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:46.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:46.674+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:47.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:47.064+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:47.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:47.140+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:47.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:47.315+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:47.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:47.705+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:48.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:48.065+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:48.134 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:05:48.132+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:05:48.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:48.160+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:48.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:48.337+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:48.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:48.698+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:49.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:49.026+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:49.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:49.180+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:49.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:49.377+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:49.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:49.697+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:49.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:49.992+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:50.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:50.200+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:50.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:50.332+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:50.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:50.713+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:50.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:50.989+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:51.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:51.193+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:51.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:51.327+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:51.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:51.695+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:52.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:52.009+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:52.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:52.160+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:52.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:52.367+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:52.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:52.651+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:53.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:53.028+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:53.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:53.117+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:53.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:53.332+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:53.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:53.692+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:54.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:54.056+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:54.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:54.124+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:54.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:54.286+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:54.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:54.687+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:55.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:55.072+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:55.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:55.102+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:55.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:55.311+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:55.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:55.645+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:56.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:56.072+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:56.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:56.112+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:56.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:56.330+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:56.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:56.602+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:57.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:57.079+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:57.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:57.119+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:57.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:57.341+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:57.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:57.603+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:58.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:58.094+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:58.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:58.109+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:58.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:58.316+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:58.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:58.651+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:59.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:05:59.091+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:59.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:05:59.121+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:59.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:05:59.301+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:05:59.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:05:59.611+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:00.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:00.130+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:00.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:00.144+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:00.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:00.294+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:00.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:00.577+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:01.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:01.173+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:01.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:01.179+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:01.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:01.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:01.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:01.558+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:02.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:02.180+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:02.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:02.217+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:02.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:02.280+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:02.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:02.559+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:03.142 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:06:03.140+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:06:03.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:03.180+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:03.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:03.221+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:03.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:03.305+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:03.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:03.578+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:04.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:04.218+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:04.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:04.257+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:04.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:04.278+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:04.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:04.572+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:05.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:05.189+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:05.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:05.261+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:05.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:05.306+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:05.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:05.528+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:06.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:06.232+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:06.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:06.254+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:06.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:06.345+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:06.505 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:06.503+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:07.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:07.196+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:07.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:07.224+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:07.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:07.390+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:07.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:07.529+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:08.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:08.193+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:08.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:08.203+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:08.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:08.414+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:08.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:08.485+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:09.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:09.169+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:09.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:09.249+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:09.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:09.415+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:09.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:09.535+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:10.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:10.131+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:10.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:10.285+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:10.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:10.439+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:10.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:10.569+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:11.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:11.111+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:11.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:06:11.258 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:06:11.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:11.268+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:11.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:11.450+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:11.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:11.565+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:12.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:12.109+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:12.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:12.316+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:12.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:12.458+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:12.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:12.517+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:13.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:13.097+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:13.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:13.323+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:13.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:13.490+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:13.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:13.502+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:14.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:14.145+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:14.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:14.275+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:14.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:14.470+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:14.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:14.485+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:15.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:15.124+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:15.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:15.311+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:15.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:15.423+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:15.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:15.524+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:16.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:16.165+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:16.267 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:16.265+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:16.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:16.473+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:16.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:16.514+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:17.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:17.182+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:17.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:17.235+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:17.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:17.486+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:17.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:17.535+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:18.158 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:06:18.156+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:06:18.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:18.188+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:18.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:18.201+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:18.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:18.489+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:18.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:18.504+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:19.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:19.178+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:19.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:19.203+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:19.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:19.468+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:19.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:19.497+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:20.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:20.175+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:20.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:20.176+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:20.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:20.496+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:20.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:20.518+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:21.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:21.166+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:21.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:21.182+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:21.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:21.502+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:21.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:21.537+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:22.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:22.134+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:22.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:22.212+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:22.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:22.518+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:22.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:22.523+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:23.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:23.118+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:23.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:23.230+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:23.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:23.488+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:23.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:23.503+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:24.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:24.089+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:24.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:24.278+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:24.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:24.510+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:24.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:24.530+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:25.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:25.080+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:25.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:25.315+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:25.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:25.466+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:25.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:25.562+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:26.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:26.077+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:26.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:26.301+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:26.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:26.461+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:26.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:26.605+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:27.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:27.110+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:27.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:27.330+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:27.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:27.415+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:27.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:27.598+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:28.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:28.150+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:28.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:28.378+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:28.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:28.388+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:28.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:28.632+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:29.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:29.182+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:29.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:29.384+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:29.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:29.426+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:29.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:29.582+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:30.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:30.141+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:30.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:30.395+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:30.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:30.445+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:30.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:30.571+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:31.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:31.152+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:31.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:31.419+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:31.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:31.443+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:31.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:31.531+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:32.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:32.179+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:32.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:32.422+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:32.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:32.430+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:32.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:32.565+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:33.171 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:06:33.170+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:06:33.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:33.186+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:33.386 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:33.384+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:33.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:33.429+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:33.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:33.543+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:34.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:34.205+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:34.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:34.384+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:34.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:34.407+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:34.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:34.578+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:35.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:35.196+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:35.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:35.368+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:35.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:35.411+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:35.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:35.624+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:36.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:36.151+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:36.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:36.405+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:36.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:36.422+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:36.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:36.647+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:37.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:37.135+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:37.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:37.405+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:37.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:37.463+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:37.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:37.626+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:38.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:38.159+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:38.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:38.381+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:38.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:38.502+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:38.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:38.651+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:39.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:39.157+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:39.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:39.344+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:39.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:39.486+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:39.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:39.669+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:40.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:40.174+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:40.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:40.297+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:40.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:40.505+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:40.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:40.695+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:41.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:41.161+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:41.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:41.272+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:41.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:06:41.399 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:06:41.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:41.525+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:41.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:41.650+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:42.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:42.162+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:42.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:42.273+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:42.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:42.493+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:42.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:42.601+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:43.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:43.113+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:43.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:43.246+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:43.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:43.532+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:43.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:43.636+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:44.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:44.064+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:44.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:44.211+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:44.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:44.528+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:44.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:44.632+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:45.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:45.037+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:45.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:45.248+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:45.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:45.519+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:45.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:45.663+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:46.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:46.063+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:46.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:46.219+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:46.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:46.490+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:46.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:46.696+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:47.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:47.050+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:47.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:47.213+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:47.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:47.510+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:47.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:47.703+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:48.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:48.088+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:48.175 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:06:48.173+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:06:48.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:48.189+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:48.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:48.525+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:48.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:48.740+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:49.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:49.094+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:49.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:49.195+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:49.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:49.504+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:49.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:49.725+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:50.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:50.132+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:50.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:50.211+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:50.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:50.527+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:50.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:50.756+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:51.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:51.171+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:51.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:51.184+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:51.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:51.486+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:51.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:51.777+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:52.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:52.177+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:52.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:52.220+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:52.537 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:52.536+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:52.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:52.767+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:53.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:53.186+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:53.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:53.207+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:53.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:53.555+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:53.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:53.806+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:54.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:54.190+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:54.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:54.254+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:54.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:54.573+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:54.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:54.801+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:55.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:55.144+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:55.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:55.287+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:55.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:55.533+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:55.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:55.756+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:56.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:56.145+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:56.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:56.312+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:56.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:56.551+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:56.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:56.722+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:57.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:57.152+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:57.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:57.327+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:57.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:57.533+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:57.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:57.764+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:58.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:58.172+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:58.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:58.294+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:58.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:58.509+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:58.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:58.779+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:59.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:06:59.175+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:59.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:06:59.324+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:59.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:06:59.545+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:06:59.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:06:59.741+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:00.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:00.143+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:00.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:00.286+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:00.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:00.514+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:00.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:00.729+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:01.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:01.113+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:01.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:01.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:01.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:01.485+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:01.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:01.747+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:02.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:02.098+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:02.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:02.281+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:02.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:02.495+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:02.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:02.732+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:03.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:03.072+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:03.179 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:07:03.177+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:07:03.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:03.325+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:03.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:03.481+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:03.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:03.715+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:04.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:04.090+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:04.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:04.340+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:04.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:04.491+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:04.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:04.718+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:05.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:05.055+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:05.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:05.390+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:05.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:05.517+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:05.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:05.757+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:06.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:06.072+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:06.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:06.347+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:06.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:06.512+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:06.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:06.782+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:07.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:07.028+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:07.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:07.332+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:07.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:07.527+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:07.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:07.828+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:08.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:08.040+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:08.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:08.340+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:08.485 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:08.484+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:08.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:08.800+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:09.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:09.006+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:09.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:09.333+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:09.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:09.525+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:09.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:09.756+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:10.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:10.004+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:10.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:10.371+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:10.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:10.553+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:10.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:10.781+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:11.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:11.019+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:11.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:11.357+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:11.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:07:11.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:07:11.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:11.571+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:11.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:11.803+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:12.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:12.000+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:12.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:12.383+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:12.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:12.537+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:12.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:12.823+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:12.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:12.986+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:13.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:13.348+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:13.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:13.543+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:13.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:13.832+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:13.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:13.962+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:14.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:14.358+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:14.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:14.539+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:14.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:14.797+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:14.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:14.997+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:15.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:15.351+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:15.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:15.553+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:15.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:15.831+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:15.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:15.972+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:16.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:16.350+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:16.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:16.517+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:16.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:16.822+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:16.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:16.957+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:17.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:17.335+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:17.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:17.516+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:17.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:17.861+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:17.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:17.922+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:18.195 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:07:18.193+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:07:18.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:18.293+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:18.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:18.526+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:18.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:18.837+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:18.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:18.915+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:19.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:19.293+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:19.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:19.480+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:19.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:19.864+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:19.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:19.905+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:20.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:20.323+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:20.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:20.511+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:20.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:20.829+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:20.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:20.879+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:21.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:21.349+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:21.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:21.501+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:21.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:21.801+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:21.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:21.924+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:22.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:22.312+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:22.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:22.545+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:22.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:22.814+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:22.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:22.926+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:23.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:23.354+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:23.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:23.571+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:23.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:23.857+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:23.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:23.973+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:24.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:24.324+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:24.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:24.591+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:24.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:24.813+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:25.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:25.011+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:25.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:25.365+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:25.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:25.581+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:25.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:25.790+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:25.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:25.996+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:26.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:26.357+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:26.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:26.628+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:26.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:26.773+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:26.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:26.985+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:27.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:27.361+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:27.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:27.608+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:27.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:27.784+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:27.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:27.979+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:28.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:28.384+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:28.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:28.639+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:28.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:28.779+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:28.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:28.972+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:29.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:29.415+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:29.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:29.667+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:29.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:29.802+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:29.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:29.961+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:30.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:30.399+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:30.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:30.682+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:30.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:30.769+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:30.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:30.948+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:31.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:31.380+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:31.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:31.661+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:31.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:31.753+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:31.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:31.916+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:32.381 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:32.379+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:32.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:32.642+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:32.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:32.740+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:32.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:32.944+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:33.211 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:07:33.209+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:07:33.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:33.395+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:33.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:33.609+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:33.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:33.756+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:33.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:33.991+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:34.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:34.409+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:34.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:34.633+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:34.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:34.799+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:34.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:34.990+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:35.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:35.374+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:35.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:35.613+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:35.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:35.804+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:35.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:35.953+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:36.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:36.382+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:36.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:36.581+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:36.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:36.765+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:36.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:36.968+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:37.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:37.389+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:37.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:37.571+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:37.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:37.736+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:37.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:37.962+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:38.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:38.354+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:38.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:38.595+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:38.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:38.784+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:38.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:38.940+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:39.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:39.372+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:39.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:39.619+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:39.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:39.805+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:39.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:39.907+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:40.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:40.415+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:40.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:40.572+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:40.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:40.841+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:40.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:40.918+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:41.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:41.423+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:41.561 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:41.560+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:41.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:07:41.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:07:41.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:41.874+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:41.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:41.950+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:42.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:42.434+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:42.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:42.567+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:42.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:42.860+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:42.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:42.907+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:43.462 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:43.461+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:43.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:43.521+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:43.905 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:43.904+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:43.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:43.951+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:44.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:44.508+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:44.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:44.529+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:44.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:44.899+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:44.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:44.909+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:45.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:45.471+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:45.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:45.534+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:45.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:45.906+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:45.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:45.923+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:46.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:46.507+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:46.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:46.534+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:46.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:46.866+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:46.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:46.901+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:47.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:47.519+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:47.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:47.543+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:47.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:47.852+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:47.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:47.882+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:48.227 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:07:48.226+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:07:48.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:48.546+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:48.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:48.561+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:48.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:48.808+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:48.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:48.913+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:49.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:49.517+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:49.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:49.528+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:49.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:49.786+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:49.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:49.959+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:50.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:50.506+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:50.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:50.557+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:50.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:50.749+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:50.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:50.929+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:51.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:51.492+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:51.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:51.568+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:51.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:51.749+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:51.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:51.914+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:52.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:52.514+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:52.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:52.538+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:52.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:52.757+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:52.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:52.959+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:53.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:53.471+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:53.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:53.504+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:53.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:53.806+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:53.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:53.990+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:54.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:54.465+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:54.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:54.501+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:54.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:54.831+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:54.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:54.972+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:55.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:55.456+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:55.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:55.500+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:55.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:55.867+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:55.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:55.947+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:56.471 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:56.469+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:56.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:56.519+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:56.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:56.908+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:56.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:56.913+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:57.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:57.495+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:57.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:57.498+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:57.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:57.919+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:57.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:57.928+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:58.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:58.465+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:58.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:58.517+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:58.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:58.919+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:58.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:58.936+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:59.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:07:59.432+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:59.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:07:59.511+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:59.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:07:59.871+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:07:59.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:07:59.971+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:00.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:00.412+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:00.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:00.492+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:00.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:00.898+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:01.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:01.015+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:01.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:01.452+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:01.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:01.456+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:01.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:01.861+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:02.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:02.036+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:02.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:02.462+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:02.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:02.464+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:02.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:02.841+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:03.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:03.072+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:03.243 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:08:03.241+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:08:03.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:03.445+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:03.451 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:03.449+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:03.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:03.880+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:04.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:04.067+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:04.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:04.398+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:04.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:04.478+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:04.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:04.880+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:05.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:05.065+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:05.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:05.366+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:05.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:05.470+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:05.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:05.910+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:06.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:06.111+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:06.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:06.353+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:06.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:06.462+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:06.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:06.879+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:07.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:07.134+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:07.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:07.398+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:07.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:07.470+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:07.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:07.851+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:08.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:08.184+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:08.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:08.383+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:08.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:08.437+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:08.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:08.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:09.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:09.141+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:09.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:09.381+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:09.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:09.437+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:09.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:09.761+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:10.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:10.168+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:10.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:10.405+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:10.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:10.443+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:10.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:10.753+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:11.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:11.167+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:11.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:11.401+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:11.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:11.408+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:11.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:08:11.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:08:11.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:11.738+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:12.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:12.155+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:12.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:12.401+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:12.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:12.419+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:12.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:12.731+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:13.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:13.123+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:13.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:13.373+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:13.468 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:13.466+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:13.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:13.732+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:14.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:14.099+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:14.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:14.394+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:14.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:14.449+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:14.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:14.699+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:15.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:15.120+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:15.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:15.403+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:15.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:15.475+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:15.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:15.714+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:16.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:16.091+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:16.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:16.391+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:16.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:16.447+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:16.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:16.686+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:17.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:17.084+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:17.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:17.403+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:17.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:17.465+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:17.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:17.658+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:18.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:18.108+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:18.259 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:08:18.257+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:08:18.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:18.395+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:18.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:18.455+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:18.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:18.651+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:19.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:19.145+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:19.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:19.411+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:19.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:19.445+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:19.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:19.619+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:20.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:20.158+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:20.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:20.404+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:20.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:20.424+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:20.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:20.596+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:21.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:21.180+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:21.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:21.442+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:21.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:21.443+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:21.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:21.562+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:22.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:22.182+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:22.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:22.447+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:22.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:22.473+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:22.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:22.612+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:23.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:23.186+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:23.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:23.436+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:23.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:23.454+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:23.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:23.572+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:24.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:24.185+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:24.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:24.454+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:24.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:24.470+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:24.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:24.542+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:25.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:25.234+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:25.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:25.438+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:25.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:25.493+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:25.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:25.503+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:26.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:26.219+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:26.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:26.431+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:26.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:26.475+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:26.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:26.484+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:27.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:27.263+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:27.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:27.385+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:27.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:27.452+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:27.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:27.501+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:28.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:28.284+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:28.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:28.412+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:28.436 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:28.435+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:28.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:28.461+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:29.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:29.242+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:29.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:29.417+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:29.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:29.424+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:29.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:29.501+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:30.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:30.247+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:30.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:30.371+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:30.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:30.474+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:30.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:30.493+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:31.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:31.204+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:31.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:31.416+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:31.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:31.489+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:31.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:31.499+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:32.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:32.198+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:32.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:32.444+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:32.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:32.447+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:32.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:32.520+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:33.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:33.214+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:33.275 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:08:33.273+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:08:33.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:33.433+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:33.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:33.493+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:33.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:33.570+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:34.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:34.185+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:34.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:34.446+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:34.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:34.485+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:34.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:34.582+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:35.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:35.212+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:35.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:35.398+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:35.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:35.471+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:35.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:35.606+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:36.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:36.209+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:36.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:36.417+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:36.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:36.471+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:36.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:36.636+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:37.244 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:37.242+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:37.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:37.456+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:37.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:37.461+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:37.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:37.669+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:38.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:38.234+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:38.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:38.474+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:38.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:38.504+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:38.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:38.620+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:39.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:39.224+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:39.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:39.459+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:39.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:39.508+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:39.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:39.639+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:40.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:40.253+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:40.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:40.462+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:40.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:40.479+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:40.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:40.635+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:41.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:41.273+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:41.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:41.412+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:41.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:41.512+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:41.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:41.610+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:41.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:08:41.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:08:42.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:42.286+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:42.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:42.407+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:42.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:42.464+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:42.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:42.637+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:43.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:43.287+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:43.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:43.388+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:43.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:43.433+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:43.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:43.602+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:44.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:44.273+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:44.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:44.436+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:44.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:44.438+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:44.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:44.636+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:45.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:45.293+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:45.484 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:45.482+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:45.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:45.485+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:45.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:45.590+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:46.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:46.310+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:46.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:46.488+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:46.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:46.491+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:46.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:46.603+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:47.335 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:47.333+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:47.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:47.506+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:47.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:47.536+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:47.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:47.600+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:48.291 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:08:48.289+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:08:48.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:48.305+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:48.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:48.495+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:48.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:48.539+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:48.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:48.595+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:49.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:49.282+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:49.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:49.509+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:49.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:49.539+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:49.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:49.590+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:50.327 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:50.325+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:50.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:50.459+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:50.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:50.585+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:50.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:50.585+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:51.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:51.374+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:51.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:51.416+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:51.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:51.608+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:51.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:51.617+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:52.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:52.388+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:52.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:52.411+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:52.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:52.587+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:52.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:52.613+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:53.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:53.372+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:53.379 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:53.377+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:53.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:53.554+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:53.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:53.576+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:54.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:54.396+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:54.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:54.409+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:54.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:54.581+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:54.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:54.617+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:55.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:55.350+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:55.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:55.365+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:55.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:55.574+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:55.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:55.639+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:56.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:56.334+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:56.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:56.345+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:56.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:56.577+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:56.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:56.665+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:57.340 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:57.338+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:57.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:57.385+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:57.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:57.550+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:57.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:57.670+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:58.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:58.339+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:58.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:58.341+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:58.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:58.566+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:58.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:58.684+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:59.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:08:59.300+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:59.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:08:59.315+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:59.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:08:59.575+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:08:59.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:08:59.717+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:00.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:00.290+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:00.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:00.335+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:00.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:00.560+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:00.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:00.684+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:01.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:01.308+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:01.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:01.309+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:01.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:01.566+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:01.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:01.710+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:02.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:02.286+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:02.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:02.325+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:02.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:02.548+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:02.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:02.674+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:03.306 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:09:03.305+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:09:03.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:03.310+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:03.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:03.329+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:03.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:03.571+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:03.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:03.646+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:04.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:04.293+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:04.329 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:04.327+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:04.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:04.543+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:04.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:04.682+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:05.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:05.293+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:05.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:05.317+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:05.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:05.511+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:05.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:05.697+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:06.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:06.271+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:06.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:06.308+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:06.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:06.496+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:06.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:06.712+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:07.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:07.233+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:07.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:07.267+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:07.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:07.452+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:07.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:07.672+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:08.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:08.214+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:08.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:08.280+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:08.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:08.412+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:08.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:08.682+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:09.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:09.183+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:09.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:09.307+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:09.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:09.378+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:09.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:09.647+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:10.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:10.204+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:10.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:10.335+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:10.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:10.340+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:10.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:10.633+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:11.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:11.227+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:11.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:11.293+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:11.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:11.310+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:11.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:11.617+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:11.972 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:09:11.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:09:12.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:12.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:12.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:12.277+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:12.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:12.330+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:12.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:12.647+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:13.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:13.233+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:13.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:13.233+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:13.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:13.289+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:13.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:13.673+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:14.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:14.190+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:14.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:14.252+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:14.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:14.336+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:14.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:14.671+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:15.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:15.141+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:15.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:15.302+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:15.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:15.379+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:15.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:15.676+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:16.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:16.129+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:16.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:16.257+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:16.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:16.402+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:16.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:16.639+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:17.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:17.164+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:17.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:17.213+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:17.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:17.417+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:17.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:17.660+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:18.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:18.150+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:18.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:18.188+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:18.322 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:09:18.320+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:09:18.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:18.396+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:18.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:18.670+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:19.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:19.149+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:19.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:19.188+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:19.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:19.356+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:19.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:19.637+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:20.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:20.102+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:20.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:20.192+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:20.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:20.345+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:20.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:20.664+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:21.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:21.092+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:21.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:21.225+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:21.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:21.354+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:21.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:21.696+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:22.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:22.105+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:22.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:22.237+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:22.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:22.387+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:22.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:22.722+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:23.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:23.119+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:23.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:23.241+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:23.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:23.348+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:23.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:23.677+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:24.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:24.169+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:24.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:24.245+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:24.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:24.330+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:24.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:24.712+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:25.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:25.204+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:25.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:25.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:25.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:25.299+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:25.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:25.728+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:26.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:26.161+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:26.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:26.220+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:26.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:26.283+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:26.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:26.740+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:27.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:27.115+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:27.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:27.241+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:27.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:27.310+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:27.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:27.730+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:28.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:28.066+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:28.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:28.237+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:28.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:28.290+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:28.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:28.758+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:29.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:29.070+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:29.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:29.197+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:29.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:29.246+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:29.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:29.745+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:30.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:30.045+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:30.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:30.227+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:30.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:30.284+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:30.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:30.720+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:31.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:31.085+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:31.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:31.255+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:31.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:31.314+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:31.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:31.761+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:32.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:32.123+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:32.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:32.252+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:32.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:32.305+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:32.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:32.770+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:33.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:33.077+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:33.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:33.263+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:33.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:33.281+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:33.338 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:09:33.337+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:09:33.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:33.761+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:34.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:34.035+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:34.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:34.219+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:34.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:34.284+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:34.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:34.760+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:35.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:35.085+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:35.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:35.209+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:35.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:35.301+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:35.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:35.760+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:36.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:36.125+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:36.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:36.238+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:36.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:36.306+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:36.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:36.720+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:37.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:37.168+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:37.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:37.259+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:37.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:37.276+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:37.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:37.742+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:38.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:38.124+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:38.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:38.231+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:38.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:38.271+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:38.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:38.729+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:39.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:39.139+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:39.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:39.194+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:39.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:39.258+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:39.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:39.720+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:40.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:40.134+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:40.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:40.155+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:40.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:40.270+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:40.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:40.727+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:41.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:41.156+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:41.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:41.171+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:41.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:41.251+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:41.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:41.718+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:42.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:09:42.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:09:42.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:42.121+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:42.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:42.184+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:42.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:42.247+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:42.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:42.700+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:43.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:43.141+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:43.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:43.194+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:43.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:43.265+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:43.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:43.687+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:44.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:44.170+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:44.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:44.173+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:44.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:44.274+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:44.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:44.666+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:45.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:45.138+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:45.220 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:45.219+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:45.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:45.233+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:45.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:45.692+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:46.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:46.151+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:46.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:46.200+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:46.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:46.227+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:46.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:46.728+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:47.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:47.131+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:47.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:47.226+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:47.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:47.261+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:47.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:47.760+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:48.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:48.119+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:48.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:48.184+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:48.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:48.307+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:48.354 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:09:48.352+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:09:48.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:48.781+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:49.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:49.167+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:49.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:49.189+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:49.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:49.305+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:49.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:49.776+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:50.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:50.123+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:50.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:50.166+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:50.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:50.260+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:50.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:50.759+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:51.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:51.149+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:51.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:51.156+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:51.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:51.214+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:51.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:51.806+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:52.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:52.153+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:52.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:52.165+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:52.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:52.225+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:52.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:52.759+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:53.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:53.136+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:53.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:53.188+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:53.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:53.209+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:53.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:53.739+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:54.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:54.114+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:54.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:54.212+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:54.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:54.250+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:54.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:54.696+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:55.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:55.070+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:55.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:55.204+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:55.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:55.205+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:55.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:55.736+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:56.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:56.081+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:56.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:56.190+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:56.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:56.221+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:56.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:56.725+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:57.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:57.105+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:57.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:57.180+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:57.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:57.197+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:57.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:57.735+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:58.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:58.102+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:58.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:58.144+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:58.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:58.227+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:58.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:58.751+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:59.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:09:59.077+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:59.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:09:59.171+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:59.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:09:59.196+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:09:59.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:09:59.708+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:00.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:00.049+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:00.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:00.212+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:00.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:00.246+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:00.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:00.736+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:01.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:01.003+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:01.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:01.205+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:01.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:01.210+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:01.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:01.776+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:02.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:02.040+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:02.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:02.163+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:02.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:02.237+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:02.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:02.823+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:03.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:03.011+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:03.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:03.132+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:03.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:03.188+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:03.370 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:10:03.368+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:10:03.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:03.783+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:04.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:04.031+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:04.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:04.126+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:04.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:04.220+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:04.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:04.774+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:04.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:04.996+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:05.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:05.140+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:05.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:05.208+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:05.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:05.776+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:05.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:05.948+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:06.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:06.170+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:06.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:06.234+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:06.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:06.824+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:06.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:06.898+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:07.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:07.151+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:07.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:07.269+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:07.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:07.804+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:07.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:07.900+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:08.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:08.123+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:08.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:08.288+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:08.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:08.807+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:08.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:08.937+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:09.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:09.097+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:09.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:09.250+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:09.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:09.768+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:09.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:09.892+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:10.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:10.131+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:10.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:10.256+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:10.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:10.751+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:10.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:10.871+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:11.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:11.131+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:11.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:11.211+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:11.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:11.739+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:11.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:11.873+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:12.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:12.158+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:12.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:10:12.182 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:10:12.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:12.196+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:12.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:12.784+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:12.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:12.857+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:13.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:13.116+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:13.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:13.241+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:13.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:13.809+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:13.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:13.881+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:14.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:14.081+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:14.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:14.234+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:14.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:14.856+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:14.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:14.869+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:15.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:15.105+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:15.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:15.226+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:15.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:15.812+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:15.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:15.840+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:16.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:16.071+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:16.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:16.220+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:16.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:16.785+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:16.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:16.861+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:17.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:17.091+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:17.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:17.192+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:17.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:17.797+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:17.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:17.905+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:18.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:18.103+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:18.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:18.178+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:18.386 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:10:18.383+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:10:18.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:18.806+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:18.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:18.903+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:19.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:19.078+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:19.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:19.206+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:19.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:19.766+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:19.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:19.854+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:20.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:20.033+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:20.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:20.237+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:20.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:20.768+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:20.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:20.836+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:21.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:21.038+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:21.283 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:21.281+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:21.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:21.745+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:21.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:21.871+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:22.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:22.058+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:22.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:22.307+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:22.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:22.717+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:22.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:22.841+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:23.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:23.054+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:23.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:23.275+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:23.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:23.715+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:23.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:23.825+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:24.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:24.045+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:24.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:24.272+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:24.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:24.706+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:24.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:24.846+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:25.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:25.025+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:25.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:25.244+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:25.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:25.685+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:25.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:25.868+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:26.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:26.014+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:26.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:26.256+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:26.718 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:26.715+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:26.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:26.915+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:26.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:26.971+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:27.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:27.278+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:27.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:27.712+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:27.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:27.947+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:27.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:27.997+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:28.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:28.321+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:28.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:28.762+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:28.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:28.977+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:29.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:29.008+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:29.317 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:29.315+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:29.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:29.811+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:29.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:29.946+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:30.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:30.016+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:30.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:30.272+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:30.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:30.821+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:30.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:30.966+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:31.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:31.049+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:31.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:31.314+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:31.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:31.794+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:32.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:32.004+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:32.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:32.011+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:32.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:32.323+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:32.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:32.749+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:33.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:33.015+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:33.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:33.051+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:33.364 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:33.362+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:33.401 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:10:33.399+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:10:33.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:33.749+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:34.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:34.034+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:34.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:34.040+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:34.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:34.385+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:34.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:34.794+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:35.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:35.036+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:35.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:35.066+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:35.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:35.358+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:35.806 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:35.804+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:36.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:36.018+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:36.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:36.109+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:36.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:36.406+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:36.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:36.805+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:36.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:36.976+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:37.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:37.063+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:37.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:37.361+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:37.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:37.853+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:37.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:37.994+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:38.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:38.065+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:38.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:38.385+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:38.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:38.875+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:39.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:39.000+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:39.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:39.028+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:39.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:39.414+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:39.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:39.901+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:39.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:39.952+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:40.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:40.062+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:40.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:40.403+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:40.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:40.877+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:40.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:40.924+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:41.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:41.019+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:41.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:41.378+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:41.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:41.904+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:41.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:41.965+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:42.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:42.018+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:42.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:10:42.251 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:10:42.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:42.375+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:42.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:42.865+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:42.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:42.993+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:43.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:43.011+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:43.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:43.387+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:43.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:43.827+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:43.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:43.975+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:44.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:44.049+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:44.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:44.431+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:44.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:44.791+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:44.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:44.969+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:45.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:45.043+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:45.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:45.388+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:45.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:45.798+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:45.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:45.947+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:46.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:46.023+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:46.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:46.429+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:46.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:46.841+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:46.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:46.981+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:47.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:47.019+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:47.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:47.435+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:47.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:47.869+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:47.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:47.941+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:47.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:47.979+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:48.417 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:10:48.416+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:10:48.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:48.421+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:48.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:48.830+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:48.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:48.940+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:48.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:48.997+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:49.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:49.379+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:49.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:49.836+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:49.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:49.908+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:50.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:50.015+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:50.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:50.404+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:50.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:50.871+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:50.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:50.953+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:51.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:51.008+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:51.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:51.428+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:51.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:51.866+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:51.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:51.905+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:51.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:51.973+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:52.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:52.474+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:52.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:52.900+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:52.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:52.929+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:52.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:52.954+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:53.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:53.458+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:53.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:53.914+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:53.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:53.937+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:53.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:53.940+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:54.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:54.502+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:54.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:54.935+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:54.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:54.939+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:54.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:54.942+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:55.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:55.530+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:55.895 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:55.893+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:55.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:55.965+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:55.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:55.981+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:56.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:56.509+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:56.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:56.875+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:56.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:56.940+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:57.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:57.007+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:57.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:57.520+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:57.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:57.837+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:57.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:57.893+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:58.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:58.014+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:58.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:58.561+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:58.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:58.804+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:58.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:58.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:59.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:10:59.023+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:59.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:10:59.587+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:59.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:10:59.799+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:10:59.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:10:59.948+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:00.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:00.043+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:00.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:00.634+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:00.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:00.837+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:00.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:00.950+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:01.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:01.031+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:01.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:01.661+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:01.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:01.809+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:01.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:01.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:02.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:02.042+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:02.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:02.637+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:02.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:02.794+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:02.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:02.909+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:03.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:03.089+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:03.433 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:11:03.430+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:11:03.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:03.647+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:03.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:03.802+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:03.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:03.955+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:04.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:04.097+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:04.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:04.630+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:04.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:04.847+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:04.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:04.965+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:05.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:05.148+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:05.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:05.600+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:05.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:05.839+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:05.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:05.986+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:06.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:06.105+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:06.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:06.581+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:06.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:06.842+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:06.949 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:06.948+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:07.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:07.062+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:07.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:07.550+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:07.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:07.822+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:07.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:07.952+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:08.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:08.105+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:08.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:08.503+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:08.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:08.789+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:08.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:08.967+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:09.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:09.110+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:09.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:09.465+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:09.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:09.838+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:09.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:09.950+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:10.115 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:10.113+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:10.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:10.457+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:10.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:10.844+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:10.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:10.976+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:11.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:11.110+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:11.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:11.461+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:11.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:11.797+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:12.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:11.998+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:12.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:12.151+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:12.392 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:11:12.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:11:12.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:12.478+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:12.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:12.839+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:12.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:12.971+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:13.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:13.201+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:13.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:13.486+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:13.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:13.829+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:13.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:13.944+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:14.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:14.195+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:14.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:14.492+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:14.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:14.817+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:14.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:14.964+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:15.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:15.176+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:15.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:15.459+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:15.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:15.841+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:15.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:15.973+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:16.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:16.143+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:16.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:16.465+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:16.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:16.793+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:17.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:17.005+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:17.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:17.095+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:17.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:17.418+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:17.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:17.842+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:18.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:18.044+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:18.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:18.078+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:18.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:18.375+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:18.436 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:11:18.434+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:11:18.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:18.878+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:19.091 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:19.089+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:19.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:19.128+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:19.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:19.421+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:19.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:19.870+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:20.056 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:20.054+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:20.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:20.150+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:20.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:20.406+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:20.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:20.878+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:21.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:21.055+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:21.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:21.168+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:21.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:21.439+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:21.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:21.915+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:22.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:22.024+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:22.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:22.194+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:22.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:22.486+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:22.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:22.900+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:23.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:23.036+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:23.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:23.217+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:23.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:23.442+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:23.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:23.948+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:24.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:24.072+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:24.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:24.217+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:24.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:24.419+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:24.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:24.977+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:25.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:25.055+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:25.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:25.220+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:25.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:25.431+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:25.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:25.939+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:26.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:26.055+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:26.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:26.246+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:26.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:26.410+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:26.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:26.910+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:27.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:27.079+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:27.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:27.219+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:27.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:27.425+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:27.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:27.865+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:28.083 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:28.081+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:28.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:28.246+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:28.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:28.422+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:28.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:28.906+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:29.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:29.044+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:29.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:29.244+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:29.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:29.464+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:29.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:29.877+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:30.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:30.069+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:30.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:30.233+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:30.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:30.420+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:30.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:30.913+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:31.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:31.023+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:31.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:31.263+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:31.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:31.403+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:31.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:31.940+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:32.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:32.016+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:32.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:32.217+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:32.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:32.442+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:32.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:32.903+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:33.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:33.052+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:33.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:33.218+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:33.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:33.404+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:33.452 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:11:33.450+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:11:33.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:33.888+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:34.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:34.092+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:34.269 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:34.268+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:34.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:34.441+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:34.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:34.938+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:35.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:35.056+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:35.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:35.290+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:35.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:35.405+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:35.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:35.901+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:36.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:36.015+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:36.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:36.240+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:36.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:36.364+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:36.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:36.880+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:37.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:37.014+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:37.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:37.214+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:37.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:37.415+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:37.908 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:37.906+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:37.971 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:37.969+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:38.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:38.198+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:38.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:38.454+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:38.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:38.897+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:38.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:38.944+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:39.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:39.246+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:39.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:39.430+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:39.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:39.914+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:39.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:39.946+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:40.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:40.261+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:40.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:40.456+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:40.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:40.934+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:40.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:40.936+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:41.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:41.221+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:41.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:41.416+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:41.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:41.917+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:41.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:41.976+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:42.239 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:42.237+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:42.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:42.418+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:42.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:11:42.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:11:42.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:42.928+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:42.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:42.955+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:43.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:43.198+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:43.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:43.404+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:43.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:43.931+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:43.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:43.939+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:44.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:44.166+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:44.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:44.412+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:44.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:44.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:44.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:44.974+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:45.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:45.184+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:45.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:45.380+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:45.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:45.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:45.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:45.976+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:46.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:46.194+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:46.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:46.418+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:46.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:46.926+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:47.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:47.017+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:47.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:47.181+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:47.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:47.436+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:47.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:47.921+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:47.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:47.981+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:48.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:48.169+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:48.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:48.389+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:48.468 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:11:48.466+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:11:48.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:48.872+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:48.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:48.980+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:49.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:49.170+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:49.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:49.360+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:49.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:49.849+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:49.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:49.965+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:50.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:50.185+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:50.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:50.376+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:50.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:50.865+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:50.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:50.949+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:51.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:51.144+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:51.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:51.378+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:51.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:51.830+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:51.924 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:51.923+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:52.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:52.139+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:52.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:52.381+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:52.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:52.843+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:52.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:52.900+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:53.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:53.140+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:53.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:53.402+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:53.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:53.851+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:53.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:53.927+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:54.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:54.138+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:54.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:54.414+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:54.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:54.884+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:54.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:54.884+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:55.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:55.091+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:55.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:55.436+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:55.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:55.896+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:55.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:55.911+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:56.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:56.087+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:56.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:56.439+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:56.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:56.848+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:56.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:56.875+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:57.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:57.039+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:57.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:57.404+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:57.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:57.846+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:57.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:57.868+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:58.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:58.086+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:58.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:58.386+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:58.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:58.855+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:58.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:58.878+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:59.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:11:59.096+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:59.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:11:59.419+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:59.837 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:11:59.835+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:11:59.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:11:59.898+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:00.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:00.142+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:00.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:00.392+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:00.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:00.815+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:00.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:00.890+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:01.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:01.171+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:01.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:01.376+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:01.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:01.849+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:01.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:01.856+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:02.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:02.145+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:02.410 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:02.408+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:02.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:02.843+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:02.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:02.886+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:03.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:03.135+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:03.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:03.442+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:03.483 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:12:03.482+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:12:03.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:03.840+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:03.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:03.936+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:04.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:04.151+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:04.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:04.491+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:04.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:04.884+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:04.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:04.948+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:05.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:05.126+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:05.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:05.461+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:05.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:05.880+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:05.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:05.998+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:06.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:06.090+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:06.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:06.475+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:06.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:06.916+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:07.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:07.040+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:07.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:07.092+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:07.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:07.499+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:07.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:07.965+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:08.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:08.082+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:08.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:08.089+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:08.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:08.470+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:08.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:08.924+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:09.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:09.054+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:09.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:09.077+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:09.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:09.483+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:09.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:09.900+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:10.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:10.051+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:10.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:10.092+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:10.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:10.439+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:10.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:10.859+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:11.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:11.021+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:11.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:11.102+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:11.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:11.414+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:11.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:11.833+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:11.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:11.987+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:12.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:12.078+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:12.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:12.423+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:12.656 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:12:12.659 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:12:12.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:12.792+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:12.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:12.974+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:13.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:13.052+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:13.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:13.472+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:13.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:13.809+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:13.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:13.933+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:14.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:14.057+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:14.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:14.439+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:14.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:14.829+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:14.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:14.908+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:15.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:15.025+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:15.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:15.460+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:15.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:15.840+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:15.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:15.944+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:16.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:16.014+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:16.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:16.457+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:16.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:16.875+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:16.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:16.943+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:17.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:17.023+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:17.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:17.451+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:17.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:17.844+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:17.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:17.990+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:18.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:18.051+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:18.487 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:12:18.484+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:12:18.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:18.499+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:18.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:18.836+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:19.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:19.036+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:19.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:19.062+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:19.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:19.493+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:19.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:19.793+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:20.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:20.031+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:20.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:20.046+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:20.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:20.539+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:20.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:20.744+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:21.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:21.020+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:21.023 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:21.021+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:21.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:21.502+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:21.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:21.702+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:21.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:21.993+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:22.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:22.052+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:22.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:22.532+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:22.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:22.727+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:23.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:23.010+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:23.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:23.061+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:23.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:23.557+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:23.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:23.708+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:23.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:23.991+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:24.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:24.082+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:24.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:24.534+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:24.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:24.699+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:24.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:24.950+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:25.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:25.084+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:25.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:25.566+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:25.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:25.668+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:25.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:25.987+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:26.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:26.076+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:26.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:26.558+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:26.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:26.630+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:26.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:26.989+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:27.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:27.103+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:27.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:27.599+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:27.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:27.657+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:27.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:27.948+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:28.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:28.150+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:28.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:28.559+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:28.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:28.652+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:28.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:28.910+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:29.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:29.145+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:29.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:29.566+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:29.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:29.641+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:29.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:29.886+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:30.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:30.103+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:30.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:30.535+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:30.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:30.621+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:30.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:30.843+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:31.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:31.144+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:31.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:31.494+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:31.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:31.586+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:31.795 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:31.793+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:32.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:32.115+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:32.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:32.505+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:32.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:32.580+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:32.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:32.844+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:33.131 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:33.129+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:33.503 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:12:33.501+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:12:33.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:33.516+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:33.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:33.578+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:33.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:33.853+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:34.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:34.084+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:34.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:34.529+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:34.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:34.558+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:34.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:34.811+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:35.082 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:35.081+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:35.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:35.486+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:35.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:35.510+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:35.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:35.781+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:36.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:36.096+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:36.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:36.469+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:36.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:36.493+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:36.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:36.827+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:37.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:37.131+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:37.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:37.482+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:37.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:37.493+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:37.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:37.827+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:38.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:38.105+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:38.497 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:38.496+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:38.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:38.502+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:38.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:38.790+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:39.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:39.126+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:39.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:39.523+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:39.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:39.540+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:39.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:39.788+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:40.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:40.133+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:40.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:40.499+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:40.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:40.526+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:40.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:40.806+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:41.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:41.127+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:41.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:41.508+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:41.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:41.509+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:41.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:41.850+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:42.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:42.123+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:42.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:42.465+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:42.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:42.496+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:42.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:12:42.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:12:42.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:42.848+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:43.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:43.123+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:43.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:43.464+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:43.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:43.502+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:43.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:43.848+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:44.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:44.161+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:44.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:44.468+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:44.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:44.525+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:44.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:44.869+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:45.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:45.146+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:45.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:45.429+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:45.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:45.477+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:45.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:45.850+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:46.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:46.112+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:46.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:46.462+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:46.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:46.463+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:46.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:46.899+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:47.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:47.133+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:47.473 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:47.471+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:47.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:47.471+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:47.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:47.890+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:48.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:48.150+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:48.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:48.432+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:48.519 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:12:48.517+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:12:48.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:48.518+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:48.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:48.911+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:49.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:49.155+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:49.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:49.383+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:49.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:49.552+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:49.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:49.870+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:50.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:50.134+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:50.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:50.350+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:50.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:50.548+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:50.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:50.865+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:51.092 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:51.090+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:51.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:51.387+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:51.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:51.500+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:51.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:51.892+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:52.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:52.136+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:52.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:52.411+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:52.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:52.539+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:52.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:52.885+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:53.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:53.142+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:53.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:53.414+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:53.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:53.583+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:53.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:53.898+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:54.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:54.149+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:54.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:54.454+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:54.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:54.555+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:54.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:54.937+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:55.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:55.110+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:55.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:55.455+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:55.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:55.571+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:55.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:55.953+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:56.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:56.067+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:56.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:56.413+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:56.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:56.606+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:56.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:56.972+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:57.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:57.066+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:57.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:57.390+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:57.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:57.571+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:57.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:57.990+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:58.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:58.071+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:58.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:58.371+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:58.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:58.613+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:58.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:58.986+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:59.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:12:59.119+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:59.365 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:12:59.363+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:59.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:12:59.580+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:12:59.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:12:59.994+0000 7f72c425d700 -1 osd.5 117 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:00.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:00.165+0000 7f596d92c700 -1 osd.6 117 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:00.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:00.342+0000 7f389e18e700 -1 osd.4 117 get_health_metrics reporting 73 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:00.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:00.575+0000 7f6e44c9f700 -1 osd.7 117 get_health_metrics reporting 54 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:00.588 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T03:13:00.587+0000 7f7cb70a3700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:13:00.603 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T03:13:00.587+0000 7f7cb70a3700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:13:00.604 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T03:13:00.598+0000 7f7cb68a2700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T03:13:00.626 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T03:13:00.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:00.964+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:01.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:01.189+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:01.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:01.302+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:01.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:01.552+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:01.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:01.948+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:02.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:02.223+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:02.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:02.349+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:02.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:02.575+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:02.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:02.911+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:03.183 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:03.181+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:03.323 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:03.321+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:03.523 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:13:03.521+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:13:03.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:03.568+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:03.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:03.864+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:04.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:04.149+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:04.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:04.292+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:04.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:04.523+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:04.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:04.851+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:05.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:05.166+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:05.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:05.333+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:05.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:05.527+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:05.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:05.870+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:06.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:06.209+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:06.379 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:06.377+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:06.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:06.527+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:06.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:06.864+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:07.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:07.186+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:07.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:07.395+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:07.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:07.554+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:07.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:07.845+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:08.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:08.196+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:08.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:08.376+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:08.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:08.593+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:08.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:08.821+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:09.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:09.163+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:09.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:09.345+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:09.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:09.624+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:09.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:09.819+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:10.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:10.212+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:10.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:10.298+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:10.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:10.576+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:10.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:10.866+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:11.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:11.198+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:11.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:11.346+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:11.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:11.541+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:11.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:11.903+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:12.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:12.170+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:12.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:12.355+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:12.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:12.552+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:12.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:12.929+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:12.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:13:12.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:13:13.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:13.168+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:13.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:13.316+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:13.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:13.575+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:13.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:13.922+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:14.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:14.164+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:14.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:14.283+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:14.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:14.578+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:14.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:14.878+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:15.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:15.137+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:15.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:15.333+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:15.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:15.590+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:15.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:15.887+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:16.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:16.165+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:16.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:16.346+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:16.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:16.581+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:16.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:16.931+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:17.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:17.124+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:17.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:17.310+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:17.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:17.631+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:17.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:17.927+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:18.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:18.085+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:18.337 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:18.335+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:18.542 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:13:18.537+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:13:18.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:18.621+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:18.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:18.924+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:19.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:19.036+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:19.384 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:19.382+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:19.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:19.646+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:19.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:19.876+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:20.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:20.027+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:20.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:20.356+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:20.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:20.682+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:20.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:20.910+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:21.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:21.065+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:21.356 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:21.355+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:21.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:21.701+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:21.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:21.942+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:22.100 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:22.098+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:22.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:22.336+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:22.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:22.715+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:22.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:22.900+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:23.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:23.075+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:23.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:23.361+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:23.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:23.685+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:23.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:23.941+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:24.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:24.100+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:24.315 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:24.312+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:24.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:24.701+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:24.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:24.978+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:25.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:25.066+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:25.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:25.269+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:25.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:25.742+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:25.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:25.931+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:26.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:26.068+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:26.283 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:26.282+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:26.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:26.744+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:26.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:26.956+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:27.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:27.077+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:27.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:27.308+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:27.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:27.736+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:27.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:27.925+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:28.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:28.094+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:28.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:28.263+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:28.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:28.768+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:28.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:28.886+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:29.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:29.065+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:29.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:29.250+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:29.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:29.771+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:29.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:29.874+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:30.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:30.023+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:30.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:30.237+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:30.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:30.802+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:30.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:30.918+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:31.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:31.014+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:31.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:31.276+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:31.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:31.842+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:31.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:31.942+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:31.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:31.979+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:32.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:32.227+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:32.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:32.862+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:32.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:32.908+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:32.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:32.998+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:33.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:33.248+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:33.555 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:13:33.553+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:13:33.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:33.869+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:33.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:33.940+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:34.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:34.021+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:34.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:34.248+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:34.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:34.908+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:34.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:34.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:34.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:34.986+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:35.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:35.261+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:35.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:35.944+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:35.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:35.987+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:35.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:35.992+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:36.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:36.293+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:36.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:36.949+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:36.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:36.992+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:37.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:36.999+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:37.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:37.319+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:37.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:37.928+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:37.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:37.972+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:37.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:37.987+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:38.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:38.324+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:38.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:38.912+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:39.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:39.008+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:39.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:39.020+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:39.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:39.332+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:39.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:39.911+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:40.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:40.025+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:40.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:40.033+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:40.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:40.349+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:40.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:40.956+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:40.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:40.997+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:41.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:41.053+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:41.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:41.379+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:41.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:41.920+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:42.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:42.044+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:42.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:42.058+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:42.395 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:42.393+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:42.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:42.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:43.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:13:43.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:13:43.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:43.021+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:43.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:43.043+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:43.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:43.394+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:43.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:43.946+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:43.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:43.981+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:44.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:44.038+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:44.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:44.422+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:44.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:44.989+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:45.029 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:45.027+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:45.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:45.059+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:45.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:45.425+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:45.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:45.952+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:46.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:46.041+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:46.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:46.049+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:46.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:46.397+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:46.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:46.984+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:47.016 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:47.014+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:47.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:47.067+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:47.383 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:47.381+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:47.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:47.953+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:48.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:48.019+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:48.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:48.089+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:48.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:48.332+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:48.571 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:13:48.570+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:13:48.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:48.972+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:49.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:49.042+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:49.070 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:49.068+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:49.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:49.367+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:50.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:50.009+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:50.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:50.055+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:50.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:50.062+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:50.419 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:50.417+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:50.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:50.980+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:51.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:51.007+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:51.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:51.027+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:51.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:51.431+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:51.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:51.940+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:52.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:52.022+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:52.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:52.051+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:52.481 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:52.479+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:52.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:52.934+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:53.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:53.055+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:53.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:53.054+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:53.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:53.443+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:53.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:53.926+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:54.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:54.046+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:54.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:54.086+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:54.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:54.450+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:54.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:54.886+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:55.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:55.074+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:55.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:55.135+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:55.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:55.418+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:55.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:55.927+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:56.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:56.063+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:56.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:56.159+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:56.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:56.408+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:56.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:56.907+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:57.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:57.053+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:57.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:57.143+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:57.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:57.373+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:57.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:57.948+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:58.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:58.062+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:58.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:58.164+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:58.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:58.371+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:58.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:58.989+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:59.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:13:59.023+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:59.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:13:59.155+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:59.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:13:59.331+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:13:59.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:13:59.943+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:00.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:00.056+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:00.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:00.142+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:00.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:00.289+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:00.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:00.986+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:01.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:01.082+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:01.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:01.138+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:01.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:01.257+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:02.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:01.998+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:02.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:02.118+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:02.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:02.187+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:02.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:02.234+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:03.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:03.039+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:03.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:03.096+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:03.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:03.190+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:03.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:03.222+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:03.587 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:14:03.585+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:14:04.063 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:04.061+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:04.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:04.113+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:04.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:04.168+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:04.225 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:04.223+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:05.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:05.026+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:05.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:05.133+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:05.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:05.160+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:05.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:05.236+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:05.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:05.985+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:06.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:06.112+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:06.210 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:06.208+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:06.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:06.253+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:06.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:06.969+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:07.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:07.093+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:07.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:07.178+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:07.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:07.268+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:07.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:07.970+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:08.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:08.077+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:08.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:08.220+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:08.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:08.265+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:08.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:08.963+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:09.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:09.083+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:09.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:09.237+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:09.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:09.296+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:09.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:09.974+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:10.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:10.087+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:10.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:10.218+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:10.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:10.284+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:10.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:10.990+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:11.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:11.112+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:11.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:11.209+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:11.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:11.255+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:12.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:12.028+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:12.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:12.066+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:12.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:12.251+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:12.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:12.273+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:12.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:12.995+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:13.080 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:13.079+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:13.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:14:13.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:14:13.258 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:13.256+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:13.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:13.286+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:13.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:13.971+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:14.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:14.122+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:14.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:14.263+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:14.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:14.286+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:14.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:14.972+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:15.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:15.164+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:15.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:15.250+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:15.310 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:15.309+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:15.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:15.961+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:16.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:16.192+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:16.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:16.277+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:16.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:16.343+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:16.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:16.967+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:17.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:17.213+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:17.308 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:17.307+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:17.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:17.380+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:17.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:17.981+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:18.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:18.227+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:18.351 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:18.350+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:18.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:18.373+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:18.600 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:14:18.598+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:14:18.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:18.952+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:19.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:19.227+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:19.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:19.366+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:19.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:19.392+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:19.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:19.973+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:20.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:20.269+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:20.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:20.362+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:20.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:20.409+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:20.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:20.937+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:21.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:21.296+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:21.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:21.318+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:21.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:21.411+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:21.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:21.924+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:22.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:22.334+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:22.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:22.337+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:22.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:22.390+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:22.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:22.966+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:23.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:23.373+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:23.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:23.375+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:23.425 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:23.424+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:23.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:23.973+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:24.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:24.360+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:24.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:24.362+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:24.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:24.431+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:24.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:24.936+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:25.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:25.324+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:25.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:25.375+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:25.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:25.444+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:25.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:25.910+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:26.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:26.346+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:26.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:26.348+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:26.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:26.432+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:26.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:26.901+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:27.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:27.316+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:27.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:27.318+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:27.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:27.390+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:27.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:27.941+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:28.334 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:28.332+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:28.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:28.356+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:28.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:28.412+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:28.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:28.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:29.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:29.336+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:29.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:29.362+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:29.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:29.392+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:29.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:29.915+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:30.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:30.351+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:30.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:30.357+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:30.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:30.415+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:30.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:30.886+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:31.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:31.348+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:31.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:31.362+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:31.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:31.369+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:31.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:31.879+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:32.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:32.322+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:32.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:32.326+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:32.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:32.336+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:32.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:32.926+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:33.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:33.298+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:33.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:33.304+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:33.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:33.323+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:33.607 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:14:33.604+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:14:33.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:33.939+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:34.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:34.287+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:34.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:34.304+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:34.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:34.354+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:34.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:34.931+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:35.250 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:35.248+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:35.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:35.256+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:35.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:35.346+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:35.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:35.894+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:36.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:36.214+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:36.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:36.244+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:36.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:36.390+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:36.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:36.849+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:37.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:37.186+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:37.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:37.266+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:37.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:37.347+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:37.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:37.800+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:38.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:38.162+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:38.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:38.233+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:38.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:38.301+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:38.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:38.799+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:39.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:39.209+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:39.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:39.213+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:39.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:39.335+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:39.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:39.756+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:40.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:40.175+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:40.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:40.235+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:40.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:40.369+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:40.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:40.801+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:41.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:41.196+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:41.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:41.252+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:41.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:41.413+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:41.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:41.751+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:42.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:42.204+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:42.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:42.244+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:42.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:42.452+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:42.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:42.770+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:43.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:43.199+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:43.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:43.224+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:43.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:14:43.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:14:43.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:43.435+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:43.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:43.808+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:44.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:44.215+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:44.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:44.241+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:44.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:44.404+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:44.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:44.806+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:45.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:45.233+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:45.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:45.250+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:45.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:45.453+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:45.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:45.854+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:46.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:46.214+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:46.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:46.299+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:46.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:46.431+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:46.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:46.843+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:47.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:47.239+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:47.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:47.318+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:47.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:47.459+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:47.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:47.828+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:48.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:48.213+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:48.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:48.297+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:48.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:48.436+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:48.623 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:14:48.620+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:14:48.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:48.807+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:49.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:49.238+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:49.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:49.282+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:49.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:49.439+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:49.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:49.769+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:50.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:50.261+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:50.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:50.276+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:50.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:50.454+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:50.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:50.776+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:51.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:51.244+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:51.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:51.251+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:51.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:51.453+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:51.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:51.758+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:52.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:52.225+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:52.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:52.273+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:52.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:52.429+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:52.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:52.798+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:53.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:53.222+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:53.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:53.304+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:53.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:53.427+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:53.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:53.767+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:54.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:54.212+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:54.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:54.317+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:54.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:54.443+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:54.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:54.794+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:55.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:55.213+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:55.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:55.359+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:55.428 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:55.426+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:55.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:55.807+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:56.176 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:56.174+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:56.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:56.367+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:56.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:56.449+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:56.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:56.818+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:57.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:57.189+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:57.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:57.411+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:57.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:57.455+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:57.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:57.866+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:58.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:58.220+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:58.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:58.373+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:58.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:58.478+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:58.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:58.866+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:59.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:14:59.184+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:59.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:14:59.324+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:59.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:14:59.496+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:14:59.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:14:59.829+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:00.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:00.147+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:00.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:00.276+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:00.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:00.464+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:00.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:00.824+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:01.116 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:01.114+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:01.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:01.293+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:01.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:01.436+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:01.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:01.827+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:02.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:02.141+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:02.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:02.310+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:02.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:02.447+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:02.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:02.813+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:03.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:03.191+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:03.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:03.298+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:03.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:03.449+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:03.638 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:15:03.637+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:15:03.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:03.787+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:04.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:04.156+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:04.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:04.284+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:04.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:04.413+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:04.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:04.789+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:05.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:05.181+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:05.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:05.324+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:05.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:05.382+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:05.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:05.790+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:06.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:06.149+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:06.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:06.304+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:06.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:06.396+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:06.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:06.840+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:07.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:07.183+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:07.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:07.304+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:07.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:07.443+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:07.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:07.890+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:08.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:08.212+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:08.311 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:08.309+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:08.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:08.464+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:08.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:08.902+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:09.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:09.191+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:09.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:09.359+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:09.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:09.459+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:09.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:09.862+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:10.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:10.172+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:10.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:10.390+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:10.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:10.428+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:10.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:10.841+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:11.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:11.163+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:11.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:11.421+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:11.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:11.466+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:11.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:11.828+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:12.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:12.204+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:12.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:12.453+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:12.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:12.456+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:12.791 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:12.789+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:13.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:13.241+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:13.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:15:13.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:15:13.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:13.458+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:13.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:13.464+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:13.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:13.752+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:14.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:14.200+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:14.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:14.454+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:14.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:14.468+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:14.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:14.724+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:15.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:15.191+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:15.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:15.412+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:15.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:15.506+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:15.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:15.701+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:16.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:16.151+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:16.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:16.460+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:16.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:16.545+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:16.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:16.715+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:17.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:17.196+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:17.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:17.413+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:17.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:17.517+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:17.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:17.689+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:18.241 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:18.240+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:18.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:18.434+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:18.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:18.513+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:18.654 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:15:18.652+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:15:18.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:18.712+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:19.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:19.200+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:19.403 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:19.402+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:19.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:19.492+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:19.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:19.706+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:20.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:20.225+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:20.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:20.407+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:20.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:20.454+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:20.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:20.679+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:21.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:21.216+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:21.414 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:21.412+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:21.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:21.439+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:21.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:21.673+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:22.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:22.189+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:22.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:22.414+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:22.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:22.465+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:22.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:22.703+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:23.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:23.205+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:23.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:23.425+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:23.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:23.468+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:23.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:23.662+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:24.191 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:24.188+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:24.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:24.389+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:24.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:24.485+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:24.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:24.670+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:25.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:25.152+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:25.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:25.437+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:25.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:25.499+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:25.706 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:25.704+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:26.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:26.171+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:26.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:26.431+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:26.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:26.501+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:26.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:26.727+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:27.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:27.211+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:27.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:27.441+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:27.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:27.499+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:27.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:27.774+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:28.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:28.184+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:28.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:28.460+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:28.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:28.517+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:28.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:28.805+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:29.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:29.168+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:29.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:29.411+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:29.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:29.514+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:29.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:29.778+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:30.155 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:30.152+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:30.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:30.445+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:30.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:30.512+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:30.824 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:30.822+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:31.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:31.141+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:31.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:31.439+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:31.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:31.488+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:31.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:31.869+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:32.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:32.173+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:32.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:32.444+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:32.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:32.455+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:32.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:32.846+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:33.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:33.132+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:33.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:33.437+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:33.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:33.458+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:33.670 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:15:33.668+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:15:33.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:33.895+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:34.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:34.177+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:34.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:34.430+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:34.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:34.476+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:34.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:34.926+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:35.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:35.155+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:35.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:35.440+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:35.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:35.471+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:35.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:35.909+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:36.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:36.136+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:36.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:36.454+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:36.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:36.496+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:36.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:36.888+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:37.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:37.119+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:37.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:37.479+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:37.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:37.495+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:37.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:37.934+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:38.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:38.077+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:38.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:38.489+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:38.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:38.544+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:38.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:38.954+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:39.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:39.059+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:39.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:39.504+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:39.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:39.533+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:39.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:39.918+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:40.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:40.020+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:40.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:40.521+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:40.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:40.525+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:40.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:40.923+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:41.019 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:41.018+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:41.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:41.509+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:41.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:41.539+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:41.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:41.923+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:42.035 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:42.032+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:42.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:42.476+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:42.571 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:42.569+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:42.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:42.897+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:43.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:43.063+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:43.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:43.429+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:43.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:43.532+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:43.562 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:15:43.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:15:43.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:43.891+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:44.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:44.045+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:44.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:44.426+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:44.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:44.563+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:44.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:44.937+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:45.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:45.059+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:45.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:45.473+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:45.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:45.574+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:45.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:45.973+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:46.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:46.086+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:46.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:46.486+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:46.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:46.573+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:46.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:46.942+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:47.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:47.058+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:47.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:47.492+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:47.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:47.527+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:47.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:47.990+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:48.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:48.079+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:48.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:48.534+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:48.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:48.544+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:48.680 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:15:48.677+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:15:48.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:48.957+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:49.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:49.067+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:49.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:49.549+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:49.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:49.558+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:49.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:49.953+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:50.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:50.096+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:50.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:50.535+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:50.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:50.579+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:50.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:50.934+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:51.110 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:51.108+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:51.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:51.539+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:51.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:51.567+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:51.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:51.953+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:52.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:52.145+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:52.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:52.575+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:52.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:52.593+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:52.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:52.959+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:53.164 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:53.162+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:53.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:53.571+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:53.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:53.587+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:53.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:53.931+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:54.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:54.208+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:54.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:54.599+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:54.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:54.624+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:54.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:54.947+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:55.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:55.225+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:55.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:55.552+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:55.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:55.649+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:55.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:55.995+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:56.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:56.234+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:56.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:56.596+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:56.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:56.665+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:57.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:57.010+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:57.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:57.185+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:57.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:57.631+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:57.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:57.640+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:58.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:58.005+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:58.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:58.191+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:58.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:58.638+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:58.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:58.671+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:59.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:15:59.028+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:59.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:15:59.180+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:59.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:15:59.668+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:15:59.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:15:59.684+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:00.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:00.069+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:00.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:00.212+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:00.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:00.646+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:00.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:00.675+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 23 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:01.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:01.066+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:01.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:01.233+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:01.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:01.644+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:01.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:01.709+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:02.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:02.028+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:02.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:02.186+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:02.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:02.599+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:02.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:02.678+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:03.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:03.049+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:03.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:03.167+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:03.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:03.631+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:03.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:03.662+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:03.695 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:16:03.693+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:16:04.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:04.080+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:04.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:04.131+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:04.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:04.648+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:04.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:04.684+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:05.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:05.075+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:05.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:05.179+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:05.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:05.635+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:05.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:05.682+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:06.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:06.046+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:06.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:06.222+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:06.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:06.663+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:06.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:06.681+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:07.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:06.999+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:07.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:07.203+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:07.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:07.659+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:07.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:07.667+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:07.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:07.971+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:08.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:08.182+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:08.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:08.672+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:08.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:08.696+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:08.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:08.978+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:09.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:09.162+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:09.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:09.674+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:09.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:09.675+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:09.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:09.945+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:10.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:10.146+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:10.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:10.629+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:10.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:10.685+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:10.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:10.925+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:11.103 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:11.102+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:11.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:11.580+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:11.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:11.712+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:11.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:11.892+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:12.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:12.111+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:12.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:12.609+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:12.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:12.714+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:12.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:12.895+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:13.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:13.085+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:13.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:13.593+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:13.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:16:13.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:16:13.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:13.755+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:13.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:13.927+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:14.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:14.060+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:14.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:14.595+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:14.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:14.717+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:14.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:14.887+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:15.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:15.064+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:15.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:15.626+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:15.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:15.744+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:15.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:15.908+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:16.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:16.066+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:16.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:16.629+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:16.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:16.741+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:16.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:16.894+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:17.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:17.067+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:17.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:17.583+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:17.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:17.740+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:17.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:17.886+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:18.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:18.077+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:18.538 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:18.536+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:18.711 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:16:18.710+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:16:18.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:18.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:18.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:18.890+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:19.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:19.070+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:19.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:19.508+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:19.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:19.713+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:19.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:19.848+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:20.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:20.081+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:20.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:20.484+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:20.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:20.708+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:20.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:20.896+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:21.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:21.041+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:21.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:21.490+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:21.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:21.734+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:21.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:21.870+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:22.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:22.018+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:22.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:22.514+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:22.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:22.696+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:22.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:22.826+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:23.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:23.057+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:23.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:23.537+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:23.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:23.680+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:23.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:23.808+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:24.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:24.025+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:24.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:24.533+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:24.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:24.699+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:24.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:24.807+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:25.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:25.060+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:25.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:25.579+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:25.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:25.731+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:25.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:25.856+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:26.063 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:26.060+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:26.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:26.549+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:26.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:26.730+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:26.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:26.873+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:27.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:27.067+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:27.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:27.571+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:27.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:27.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:27.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:27.838+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:28.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:28.095+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:28.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:28.614+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:28.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:28.792+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:28.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:28.862+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:29.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:29.140+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:29.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:29.599+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:29.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:29.783+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:29.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:29.813+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:30.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:30.148+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:30.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:30.624+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:30.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:30.792+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:30.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:30.803+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:31.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:31.175+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:31.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:31.576+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:31.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:31.744+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:31.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:31.810+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:32.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:32.145+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:32.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:32.607+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:32.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:32.761+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:32.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:32.764+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:33.105 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:33.102+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:33.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:33.596+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:33.714 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:16:33.711+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:16:33.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:33.752+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:33.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:33.768+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:34.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:34.094+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:34.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:34.616+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:34.787 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:34.785+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:34.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:34.802+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:35.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:35.120+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:35.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:35.638+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:35.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:35.749+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:35.790 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:35.788+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:36.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:36.145+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:36.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:36.604+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:36.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:36.723+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:36.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:36.808+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:37.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:37.124+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:37.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:37.571+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:37.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:37.722+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:37.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:37.789+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:38.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:38.122+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:38.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:38.620+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:38.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:38.678+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:38.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:38.828+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:39.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:39.130+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:39.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:39.589+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:39.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:39.711+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:39.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:39.802+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:40.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:40.105+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:40.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:40.633+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:40.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:40.681+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:40.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:40.851+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:41.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:41.149+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:41.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:41.610+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:41.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:41.714+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:41.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:41.853+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:42.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:42.124+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:42.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:42.574+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:42.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:42.674+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:42.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:42.900+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:43.133 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:43.130+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:43.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:43.533+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:43.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:43.636+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:43.835 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:16:43.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:16:43.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:43.921+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:44.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:44.082+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:44.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:44.553+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:44.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:44.623+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:44.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:44.921+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:45.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:45.088+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:45.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:45.598+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:45.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:45.653+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:45.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:45.883+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:46.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:46.115+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:46.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:46.572+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:46.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:46.611+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:46.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:46.932+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:47.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:47.066+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:47.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:47.558+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:47.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:47.629+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:47.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:47.927+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:48.102 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:48.101+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:48.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:48.576+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:48.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:48.580+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:48.726 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:16:48.724+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:16:48.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:48.939+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:49.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:49.105+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:49.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:49.552+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:49.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:49.604+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:49.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:49.963+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:50.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:50.121+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:50.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:50.544+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:50.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:50.618+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:50.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:50.930+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:51.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:51.162+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:51.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:51.524+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:51.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:51.587+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:51.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:51.962+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:52.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:52.183+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:52.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:52.512+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:52.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:52.619+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:52.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:52.920+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:53.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:53.144+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:53.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:53.516+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:53.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:53.595+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:53.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:53.906+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:54.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:54.143+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:54.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:54.484+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:54.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:54.641+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:54.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:54.954+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:55.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:55.128+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:55.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:55.516+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:55.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:55.669+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:55.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:55.978+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:56.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:56.177+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:56.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:56.521+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:56.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:56.683+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:56.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:56.945+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:57.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:57.179+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:57.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:57.555+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:57.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:57.674+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:57.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:57.934+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:58.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:58.217+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:58.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:58.512+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:58.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:58.713+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:58.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:58.953+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:59.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:16:59.208+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:59.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:16:59.521+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:59.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:16:59.717+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:16:59.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:16:59.953+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:00.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:00.228+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:00.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:00.527+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:00.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:00.706+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:01.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:01.001+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:01.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:01.236+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:01.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:01.551+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:01.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:01.717+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:02.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:02.011+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:02.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:02.250+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:02.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:02.583+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:02.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:02.688+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:03.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:03.012+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:03.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:03.227+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:03.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:03.539+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:03.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:03.720+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:03.742 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:17:03.740+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:17:03.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:03.986+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:04.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:04.220+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:04.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:04.556+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:04.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:04.675+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:05.023 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:05.022+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:05.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:05.200+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:05.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:05.548+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:05.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:05.677+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:06.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:06.060+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:06.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:06.234+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:06.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:06.577+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:06.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:06.663+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:07.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:07.086+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:07.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:07.203+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:07.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:07.572+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:07.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:07.700+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:08.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:08.134+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:08.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:08.154+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:08.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:08.572+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:08.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:08.679+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:09.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:09.111+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:09.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:09.189+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:09.570 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:09.567+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:09.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:09.711+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:10.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:10.125+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:10.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:10.173+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:10.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:10.547+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:10.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:10.720+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:11.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:11.159+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:11.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:11.219+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:11.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:11.565+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:11.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:11.700+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:12.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:12.185+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:12.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:12.254+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:12.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:12.562+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:12.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:12.709+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:13.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:13.211+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:13.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:13.301+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:13.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:13.579+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:13.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:13.680+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:13.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:17:14.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:17:14.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:14.163+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:14.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:14.284+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:14.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:14.608+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:14.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:14.665+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:15.155 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:15.152+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:15.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:15.248+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:15.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:15.562+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:15.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:15.685+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:16.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:16.153+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:16.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:16.296+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:16.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:16.522+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:16.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:16.732+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:17.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:17.203+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:17.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:17.342+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:17.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:17.488+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:17.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:17.749+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:18.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:18.221+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:18.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:18.338+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:18.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:18.513+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:18.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:18.701+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:18.758 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:17:18.756+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:17:19.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:19.189+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:19.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:19.340+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:19.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:19.562+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:19.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:19.663+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:20.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:20.228+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:20.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:20.372+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:20.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:20.519+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:20.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:20.680+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:21.231 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:21.228+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:21.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:21.386+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:21.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:21.524+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:21.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:21.671+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:22.202 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:22.199+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:22.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:22.388+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:22.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:22.538+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:22.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:22.625+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:23.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:23.226+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:23.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:23.414+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:23.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:23.501+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:23.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:23.664+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:24.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:24.215+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:24.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:24.376+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:24.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:24.512+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:24.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:24.662+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:25.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:25.253+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:25.380 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:25.378+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:25.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:25.467+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:25.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:25.708+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:26.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:26.211+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:26.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:26.397+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:26.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:26.420+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:26.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:26.707+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:27.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:27.260+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:27.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:27.350+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:27.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:27.459+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:27.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:27.674+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:28.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:28.234+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:28.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:28.356+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:28.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:28.489+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:28.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:28.683+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:29.226 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:29.224+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:29.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:29.377+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:29.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:29.474+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:29.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:29.693+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:30.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:30.257+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:30.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:30.418+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:30.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:30.486+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:30.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:30.743+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:31.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:31.301+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:31.389 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:31.386+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:31.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:31.467+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:31.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:31.721+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:32.344 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:32.342+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:32.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:32.420+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:32.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:32.502+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:32.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:32.766+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:33.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:33.380+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:33.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:33.392+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:33.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:33.473+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:33.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:33.740+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:33.774 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:17:33.772+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:17:34.361 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:34.359+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:34.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:34.363+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:34.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:34.516+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:34.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:34.752+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:35.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:35.310+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:35.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:35.413+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:35.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:35.526+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:35.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:35.734+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:36.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:36.271+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:36.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:36.364+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:36.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:36.504+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:36.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:36.734+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:37.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:37.280+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:37.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:37.390+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:37.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:37.502+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:37.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:37.719+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:38.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:38.246+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:38.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:38.423+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:38.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:38.487+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:38.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:38.756+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:39.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:39.266+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:39.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:39.462+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:39.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:39.488+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:39.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:39.739+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:40.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:40.224+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:40.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:40.448+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:40.482 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:40.481+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:40.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:40.779+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:41.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:41.204+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:41.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:41.467+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:41.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:41.523+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:41.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:41.768+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:42.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:42.194+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:42.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:42.448+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:42.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:42.521+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:42.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:42.805+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:43.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:43.206+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:43.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:43.492+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:43.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:43.520+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:43.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:43.801+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:44.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:17:44.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:17:44.178 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:44.177+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:44.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:44.467+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:44.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:44.499+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:44.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:44.785+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:45.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:45.157+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:45.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:45.469+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:45.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:45.526+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:45.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:45.800+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:46.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:46.163+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:46.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:46.464+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:46.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:46.548+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:46.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:46.797+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:47.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:47.182+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:47.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:47.416+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:47.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:47.591+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:47.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:47.837+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:48.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:48.154+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:48.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:48.421+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:48.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:48.615+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:48.790 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:17:48.788+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:17:48.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:48.837+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:49.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:49.203+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:49.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:49.390+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:49.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:49.661+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:49.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:49.809+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:50.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:50.205+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:50.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:50.386+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:50.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:50.669+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:50.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:50.805+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:51.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:51.204+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:51.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:51.414+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:51.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:51.666+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:51.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:51.797+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:52.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:52.157+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:52.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:52.405+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:52.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:52.679+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:52.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:52.807+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:53.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:53.151+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:53.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:53.428+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:53.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:53.661+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:53.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:53.844+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:54.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:54.170+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:54.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:54.471+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:54.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:54.681+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:54.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:54.839+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:55.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:55.216+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:55.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:55.479+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:55.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:55.713+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:55.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:55.800+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:56.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:56.205+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:56.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:56.501+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:56.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:56.699+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:56.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:56.826+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:57.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:57.185+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:57.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:57.478+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:57.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:57.708+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:57.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:57.798+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:58.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:58.198+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:58.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:58.461+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:58.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:58.728+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:58.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:58.828+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:59.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:17:59.156+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:59.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:17:59.503+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:59.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:17:59.682+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:17:59.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:17:59.842+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:00.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:00.114+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:00.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:00.505+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:00.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:00.689+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:00.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:00.795+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:01.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:01.135+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:01.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:01.482+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:01.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:01.726+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:01.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:01.817+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:02.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:02.180+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:02.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:02.466+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:02.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:02.681+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:02.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:02.778+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:03.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:03.207+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:03.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:03.446+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:03.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:03.691+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:03.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:03.771+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:03.806 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:18:03.804+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:18:04.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:04.230+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:04.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:04.475+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:04.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:04.687+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:04.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:04.742+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:05.205 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:05.203+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:05.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:05.439+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:05.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:05.643+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:05.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:05.735+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:06.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:06.231+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:06.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:06.449+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:06.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:06.625+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:06.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:06.696+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:07.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:07.249+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:07.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:07.489+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:07.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:07.655+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:07.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:07.693+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:08.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:08.292+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:08.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:08.504+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:08.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:08.648+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:08.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:08.684+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:09.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:09.276+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:09.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:09.478+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:09.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:09.680+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:09.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:09.696+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:10.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:10.298+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:10.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:10.457+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:10.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:10.684+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:10.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:10.693+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:11.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:11.296+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:11.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:11.507+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:11.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:11.653+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:11.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:11.706+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:12.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:12.334+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:12.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:12.464+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:12.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:12.657+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:12.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:12.661+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:13.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:13.316+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:13.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:13.487+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:13.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:13.655+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:13.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:13.702+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:14.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:18:14.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:18:14.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:14.295+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:14.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:14.450+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:14.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:14.683+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:14.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:14.697+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:15.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:15.344+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:15.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:15.427+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:15.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:15.707+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:15.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:15.720+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:16.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:16.351+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:16.470 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:16.468+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:16.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:16.755+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:16.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:16.761+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:17.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:17.336+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:17.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:17.435+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:17.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:17.735+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:17.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:17.748+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:18.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:18.330+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:18.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:18.415+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:18.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:18.746+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:18.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:18.765+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:18.821 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:18:18.819+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:18:19.297 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:19.295+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:19.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:19.419+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:19.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:19.705+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:19.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:19.772+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:20.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:20.325+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:20.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:20.403+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:20.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:20.733+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:20.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:20.767+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:21.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:21.339+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:21.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:21.376+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:21.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:21.729+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:21.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:21.732+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:22.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:22.356+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:22.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:22.400+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:22.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:22.727+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:22.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:22.739+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:23.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:23.406+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:23.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:23.450+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:23.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:23.681+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:23.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:23.711+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:24.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:24.429+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:24.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:24.432+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:24.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:24.681+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:24.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:24.758+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:25.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:25.436+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:25.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:25.456+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:25.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:25.698+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:25.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:25.733+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:26.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:26.409+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:26.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:26.478+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:26.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:26.700+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:26.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:26.700+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:27.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:27.455+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:27.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:27.499+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:27.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:27.659+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:27.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:27.679+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:28.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:28.487+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:28.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:28.503+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:28.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:28.652+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:28.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:28.675+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:29.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:29.487+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:29.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:29.490+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:29.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:29.649+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:29.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:29.669+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:30.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:30.477+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:30.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:30.482+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:30.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:30.649+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:30.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:30.674+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:31.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:31.459+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:31.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:31.508+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:31.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:31.612+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:31.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:31.677+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:32.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:32.473+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:32.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:32.478+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:32.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:32.584+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:32.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:32.651+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:33.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:33.439+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:33.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:33.518+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:33.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:33.625+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:33.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:33.694+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:33.826 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:18:33.823+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:18:34.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:34.429+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:34.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:34.526+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:34.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:34.579+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:34.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:34.693+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:35.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:35.420+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:35.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:35.568+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:35.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:35.618+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:35.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:35.714+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:36.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:36.422+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:36.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:36.614+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:36.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:36.662+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:36.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:36.684+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:37.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:37.420+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:37.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:37.624+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:37.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:37.674+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:37.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:37.679+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:38.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:38.437+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:38.594 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:38.593+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:38.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:38.689+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:38.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:38.695+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:39.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:39.447+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:39.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:39.563+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:39.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:39.722+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:39.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:39.725+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:40.459 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:40.458+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:40.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:40.517+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:40.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:40.708+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:40.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:40.748+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:41.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:41.441+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:41.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:41.471+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:41.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:41.716+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:41.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:41.770+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:42.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:42.456+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:42.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:42.495+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:42.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:42.763+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:42.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:42.764+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:43.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:43.442+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:43.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:43.501+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:43.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:43.729+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:43.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:43.751+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:44.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:18:44.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:18:44.400 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:44.399+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:44.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:44.504+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:44.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:44.714+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:44.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:44.757+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:45.410 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:45.408+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:45.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:45.494+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:45.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:45.675+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:45.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:45.784+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:46.417 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:46.415+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:46.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:46.445+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:46.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:46.658+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:46.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:46.765+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:47.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:47.396+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:47.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:47.432+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:47.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:47.675+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:47.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:47.777+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:48.380 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:48.378+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:48.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:48.481+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:48.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:48.677+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:48.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:48.787+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:48.842 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:18:48.839+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:18:49.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:49.382+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:49.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:49.457+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:49.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:49.706+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:49.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:49.793+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:50.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:50.384+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:50.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:50.417+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:50.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:50.662+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:50.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:50.799+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:51.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:51.427+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:51.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:51.454+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:51.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:51.623+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:51.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:51.825+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:52.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:52.410+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:52.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:52.450+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:52.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:52.636+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:52.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:52.829+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:53.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:53.372+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:53.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:53.483+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:53.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:53.645+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:53.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:53.791+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:54.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:54.326+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:54.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:54.532+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:54.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:54.651+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:54.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:54.823+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:55.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:55.290+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:55.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:55.539+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:55.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:55.628+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:55.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:55.782+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:56.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:56.328+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:56.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:56.534+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:56.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:56.670+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:56.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:56.822+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:57.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:57.285+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:57.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:57.535+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:57.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:57.681+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:57.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:57.802+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:58.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:58.333+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:58.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:58.548+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:58.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:58.702+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:58.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:58.799+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:59.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:18:59.369+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:59.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:18:59.578+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:59.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:18:59.750+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:18:59.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:18:59.751+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:00.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:00.366+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:00.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:00.557+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:00.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:00.713+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:00.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:00.799+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:01.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:01.335+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:01.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:01.590+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:01.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:01.697+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:01.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:01.773+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:02.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:02.308+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:02.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:02.568+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:02.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:02.739+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:02.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:02.768+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:03.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:03.277+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:03.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:03.618+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:03.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:03.721+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:03.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:03.801+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:03.850 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:19:03.848+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:19:04.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:04.301+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:04.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:04.656+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:04.716 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:04.714+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:04.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:04.821+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:05.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:05.303+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:05.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:05.627+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:05.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:05.738+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:05.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:05.790+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:06.333 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:06.331+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:06.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:06.650+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:06.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:06.755+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:06.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:06.797+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:07.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:07.319+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:07.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:07.606+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:07.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:07.784+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:07.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:07.825+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:08.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:08.311+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:08.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:08.654+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:08.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:08.783+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:08.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:08.811+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:09.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:09.355+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:09.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:09.666+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:09.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:09.748+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:09.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:09.790+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:10.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:10.382+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:10.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:10.698+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:10.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:10.761+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:10.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:10.823+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:11.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:11.377+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:11.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:11.687+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:11.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:11.781+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:11.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:11.821+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:12.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:12.345+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:12.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:12.735+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:12.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:12.765+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:12.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:12.789+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:13.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:13.374+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:13.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:13.699+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:13.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:13.766+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:13.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:13.815+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:14.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:14.413+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:14.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:19:14.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:19:14.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:14.665+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:14.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:14.760+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:14.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:14.816+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:15.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:15.448+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:15.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:15.670+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:15.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:15.720+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:15.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:15.795+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:16.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:16.472+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:16.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:16.643+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:16.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:16.716+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:16.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:16.755+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:17.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:17.450+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:17.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:17.675+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:17.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:17.735+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:17.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:17.779+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:18.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:18.412+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:18.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:18.695+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:18.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:18.766+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:18.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:18.784+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:18.866 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:19:18.865+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:19:19.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:19.401+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:19.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:19.649+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:19.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:19.718+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:19.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:19.802+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:20.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:20.435+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:20.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:20.695+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:20.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:20.762+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:20.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:20.817+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:21.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:21.407+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:21.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:21.717+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:21.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:21.740+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:21.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:21.826+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:22.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:22.415+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:22.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:22.757+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:22.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:22.786+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:22.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:22.852+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:23.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:23.385+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:23.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:23.748+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:23.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:23.826+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:23.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:23.826+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:24.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:24.354+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:24.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:24.717+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:24.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:24.837+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:24.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:24.859+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:25.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:25.342+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:25.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:25.691+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:25.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:25.861+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:26.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:25.864+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:26.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:26.345+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:26.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:26.681+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:26.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:26.877+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:26.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:26.909+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:27.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:27.331+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:27.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:27.722+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:27.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:27.833+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:27.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:27.861+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:28.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:28.322+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:28.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:28.751+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:28.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:28.823+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:28.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:28.888+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:29.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:29.336+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:29.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:29.784+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:29.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:29.826+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:29.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:29.934+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:30.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:30.371+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:30.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:30.774+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:30.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:30.872+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:30.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:30.917+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:31.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:31.365+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:31.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:31.822+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:31.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:31.895+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:31.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:31.954+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:32.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:32.317+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:32.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:32.818+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:32.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:32.897+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:33.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:33.000+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:33.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:33.281+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:33.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:33.841+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:33.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:33.856+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:33.882 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:19:33.880+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:19:34.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:34.045+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:34.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:34.263+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:34.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:34.816+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:34.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:34.890+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:35.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:35.077+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:35.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:35.279+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:35.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:35.778+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:35.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:35.932+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:36.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:36.070+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:36.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:36.240+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:36.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:36.753+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:36.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:36.923+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:37.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:37.082+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:37.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:37.277+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:37.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:37.727+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:37.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:37.939+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:38.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:38.109+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:38.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:38.275+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:38.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:38.741+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:38.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:38.931+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:39.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:39.124+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:39.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:39.293+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:39.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:39.752+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:39.943 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:39.941+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:40.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:40.150+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:40.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:40.309+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:40.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:40.758+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:40.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:40.907+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:41.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:41.176+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:41.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:41.275+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:41.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:41.746+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:41.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:41.933+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:42.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:42.155+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:42.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:42.235+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:42.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:42.764+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:42.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:42.897+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:43.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:43.204+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:43.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:43.207+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:43.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:43.794+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:43.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:43.877+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:44.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:44.209+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:44.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:44.239+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:44.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:19:44.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:19:44.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:44.828+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:44.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:44.853+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:45.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:45.201+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:45.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:45.252+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:45.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:45.821+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:45.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:45.881+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:46.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:46.213+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:46.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:46.299+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:46.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:46.781+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:46.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:46.870+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:47.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:47.258+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:47.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:47.266+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:47.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:47.765+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:47.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:47.842+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:48.235 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:48.233+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:48.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:48.266+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:48.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:48.729+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:48.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:48.833+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:48.898 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:19:48.896+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:19:49.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:49.202+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:49.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:49.242+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:49.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:49.690+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:49.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:49.847+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:50.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:50.160+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:50.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:50.230+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:50.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:50.721+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:50.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:50.843+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:51.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:51.162+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:51.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:51.196+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:51.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:51.686+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:51.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:51.820+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:52.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:52.181+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:52.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:52.203+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:52.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:52.665+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:52.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:52.796+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:53.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:53.211+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:53.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:53.212+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:53.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:53.669+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:53.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:53.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:54.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:54.208+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:54.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:54.252+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:54.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:54.715+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:54.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:54.774+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:55.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:55.222+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:55.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:55.272+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:55.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:55.753+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:55.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:55.762+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:56.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:56.234+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:56.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:56.318+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:56.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:56.753+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:56.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:56.784+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:57.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:57.268+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:57.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:57.325+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:57.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:57.748+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:57.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:57.816+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:58.321 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:58.318+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:58.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:58.327+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:58.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:58.729+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:58.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:58.856+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:59.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:19:59.321+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:59.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:19:59.358+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:59.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:19:59.755+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:19:59.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:19:59.822+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:00.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:00.368+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:00.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:00.395+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:00.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:00.791+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:00.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:00.794+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:01.346 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:01.343+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:01.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:01.417+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:01.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:01.754+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:01.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:01.796+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:02.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:02.346+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:02.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:02.445+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:02.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:02.728+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:02.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:02.808+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:03.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:03.302+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:03.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:03.417+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:03.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:03.744+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:03.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:03.774+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:03.914 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:20:03.912+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:20:04.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:04.317+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:04.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:04.406+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:04.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:04.773+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:04.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:04.787+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:05.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:05.328+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:05.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:05.431+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:05.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:05.754+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:05.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:05.807+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:06.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:06.373+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:06.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:06.445+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:06.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:06.743+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:06.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:06.811+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:07.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:07.363+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:07.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:07.418+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:07.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:07.783+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:07.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:07.860+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:08.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:08.392+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:08.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:08.404+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:08.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:08.736+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:08.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:08.846+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:09.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:09.364+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:09.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:09.370+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:09.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:09.779+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:09.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:09.845+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:10.354 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:10.352+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:10.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:10.364+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:10.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:10.808+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:10.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:10.894+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:11.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:11.328+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:11.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:11.336+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:11.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:11.817+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:11.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:11.877+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:12.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:12.320+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:12.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:12.369+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:12.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:12.796+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:12.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:12.897+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:13.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:13.347+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:13.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:13.378+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:13.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:13.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:13.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:13.885+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:14.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:14.312+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:14.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:14.388+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:14.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:20:14.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:20:14.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:14.763+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:14.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:14.839+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:15.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:15.340+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:15.424 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:15.423+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:15.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:15.773+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:15.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:15.826+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:16.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:16.375+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:16.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:16.466+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:16.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:16.738+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:16.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:16.866+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:17.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:17.328+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:17.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:17.467+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:17.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:17.726+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:17.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:17.878+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:18.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:18.361+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:18.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:18.503+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:18.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:18.711+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:18.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:18.917+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:18.930 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:20:18.928+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:20:19.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:19.381+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:19.507 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:19.505+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:19.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:19.752+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:19.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:19.937+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:20.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:20.392+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:20.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:20.525+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:20.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:20.756+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:20.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:20.902+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:21.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:21.368+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:21.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:21.517+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:21.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:21.746+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:21.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:21.932+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:22.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:22.390+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:22.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:22.549+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:22.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:22.750+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:22.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:22.909+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:23.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:23.421+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:23.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:23.554+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:23.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:23.722+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:23.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:23.934+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:24.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:24.394+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:24.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:24.589+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:24.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:24.675+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:24.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:24.915+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:25.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:25.434+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:25.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:25.606+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:25.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:25.673+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:25.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:25.891+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:26.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:26.413+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:26.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:26.614+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:26.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:26.661+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:26.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:26.849+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:27.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:27.402+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:27.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:27.606+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:27.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:27.621+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:27.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:27.858+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:28.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:28.434+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:28.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:28.638+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:28.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:28.657+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:28.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:28.816+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:29.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:29.443+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:29.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:29.671+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:29.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:29.671+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:29.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:29.802+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:30.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:30.448+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:30.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:30.643+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:30.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:30.701+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:30.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:30.847+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:31.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:31.436+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:31.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:31.668+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:31.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:31.692+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:31.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:31.847+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:32.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:32.405+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:32.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:32.698+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:32.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:32.736+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:32.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:32.809+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:33.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:33.386+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:33.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:33.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:33.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:33.785+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:33.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:33.856+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:33.946 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:20:33.944+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:20:34.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:34.349+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:34.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:34.680+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:34.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:34.780+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:34.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:34.834+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:35.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:35.374+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:35.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:35.659+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:35.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:35.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:35.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:35.843+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:36.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:36.410+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:36.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:36.613+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:36.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:36.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:36.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:36.864+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:37.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:37.441+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:37.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:37.654+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:37.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:37.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:37.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:37.822+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:38.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:38.478+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:38.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:38.607+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:38.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:38.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:38.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:38.801+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:39.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:39.471+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:39.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:39.614+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:39.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:39.770+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:39.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:39.835+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:40.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:40.469+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:40.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:40.589+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:40.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:40.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:40.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:40.857+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:41.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:41.444+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:41.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:41.599+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:41.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:41.746+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:41.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:41.836+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:42.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:42.437+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:42.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:42.626+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:42.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:42.756+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:42.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:42.884+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:43.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:43.411+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:43.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:43.604+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:43.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:43.792+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:43.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:43.851+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:44.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:44.398+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:44.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:44.645+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:44.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:44.782+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:44.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:20:44.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:20:44.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:44.866+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:45.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:45.440+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:45.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:45.694+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:45.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:45.800+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:45.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:45.843+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:46.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:46.461+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:46.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:46.661+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:46.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:46.773+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:46.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:46.847+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:47.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:47.425+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:47.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:47.637+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:47.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:47.780+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:47.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:47.861+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:48.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:48.472+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:48.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:48.686+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:48.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:48.771+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:48.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:48.869+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:48.961 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:20:48.958+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:20:49.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:49.506+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:49.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:49.732+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:49.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:49.748+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:49.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:49.879+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:50.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:50.504+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:50.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:50.712+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:50.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:50.729+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:50.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:50.894+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:51.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:51.480+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:51.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:51.674+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:51.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:51.709+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:51.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:51.890+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:52.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:52.495+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:52.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:52.685+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:52.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:52.702+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:52.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:52.885+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:53.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:53.508+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:53.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:53.671+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:53.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:53.726+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:53.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:53.839+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:54.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:54.511+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:54.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:54.716+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:54.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:54.730+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:54.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:54.861+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:55.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:55.513+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:55.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:55.709+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:55.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:55.736+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:55.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:55.888+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:56.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:56.548+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:56.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:56.726+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:56.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:56.746+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:56.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:56.911+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:57.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:57.589+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:57.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:57.711+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:57.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:57.785+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:57.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:57.925+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:58.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:58.605+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:58.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:58.682+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:58.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:58.764+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:58.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:58.965+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:59.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:20:59.603+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:59.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:20:59.679+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:59.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:20:59.748+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:20:59.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:20:59.935+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:00.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:00.596+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:00.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:00.660+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:00.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:00.738+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:00.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:00.955+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:01.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:01.594+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:01.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:01.657+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:01.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:01.706+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:01.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:01.916+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:02.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:02.630+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:02.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:02.646+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:02.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:02.671+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:02.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:02.887+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:03.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:03.636+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:03.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:03.636+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:03.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:03.673+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:03.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:03.897+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:03.976 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:21:03.975+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:21:04.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:04.612+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:04.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:04.650+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:04.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:04.662+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:04.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:04.946+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:05.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:05.572+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:05.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:05.613+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:05.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:05.622+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:05.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:05.936+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:06.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:06.586+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:06.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:06.591+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:06.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:06.613+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:06.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:06.970+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:07.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:07.610+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:07.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:07.633+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:07.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:07.636+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:07.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:07.931+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:08.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:08.568+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:08.642 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:08.641+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:08.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:08.666+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:08.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:08.890+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:09.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:09.524+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:09.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:09.664+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:09.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:09.683+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:09.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:09.938+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:10.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:10.527+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:10.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:10.618+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:10.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:10.710+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:10.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:10.940+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:11.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:11.538+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:11.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:11.583+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:11.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:11.674+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:11.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:11.990+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:12.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:12.501+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:12.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:12.616+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:12.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:12.680+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:12.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:12.998+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:13.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:13.502+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:13.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:13.577+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:13.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:13.679+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:13.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:13.964+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:14.545 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:14.543+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:14.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:14.597+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:14.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:14.709+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:14.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:21:14.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:21:14.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:14.957+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:15.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:15.590+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:15.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:15.616+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:15.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:15.755+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:15.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:15.995+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:16.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:16.599+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:16.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:16.620+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:16.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:16.803+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:17.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:17.041+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:17.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:17.581+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:17.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:17.638+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:17.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:17.853+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:18.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:18.026+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:18.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:18.611+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:18.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:18.681+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:18.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:18.882+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:18.992 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:21:18.990+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:21:19.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:19.013+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:19.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:19.634+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:19.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:19.659+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:19.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:19.877+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:20.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:20.012+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:20.588 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:20.586+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:20.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:20.706+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:20.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:20.920+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:20.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:20.978+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:21.603 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:21.600+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:21.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:21.696+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:21.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:21.917+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:21.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:21.995+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:22.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:22.632+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:22.728 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:22.726+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:22.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:22.926+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:23.034 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:23.031+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:23.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:23.606+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:23.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:23.700+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:23.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:23.897+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:24.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:24.016+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:24.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:24.606+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:24.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:24.743+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:24.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:24.889+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:25.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:25.048+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:25.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:25.628+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:25.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:25.778+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:25.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:25.889+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:26.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:26.046+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:26.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:26.655+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:26.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:26.793+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:26.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:26.851+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:27.081 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:27.079+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:27.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:27.609+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:27.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:27.836+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:27.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:27.897+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:28.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:28.065+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:28.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:28.641+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:28.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:28.836+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:28.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:28.871+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:29.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:29.039+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:29.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:29.656+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:29.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:29.853+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:29.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:29.880+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:30.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:30.063+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:30.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:30.697+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:30.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:30.817+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:30.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:30.857+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:31.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:31.048+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:31.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:31.686+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:31.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:31.773+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:31.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:31.900+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:32.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:32.013+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:32.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:32.708+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:32.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:32.806+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:32.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:32.877+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:33.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:33.047+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:33.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:33.731+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:33.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:33.811+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:33.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:33.838+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:34.008 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:21:34.006+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:21:34.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:34.062+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:34.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:34.772+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:34.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:34.773+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:34.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:34.790+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:35.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:35.093+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:35.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:35.741+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:35.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:35.786+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:35.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:35.793+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:36.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:36.053+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:36.741 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:36.739+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:36.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:36.768+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:36.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:36.788+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:37.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:37.021+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:37.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:37.773+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:37.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:37.777+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:37.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:37.791+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:38.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:38.056+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:38.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:38.752+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:38.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:38.754+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:38.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:38.768+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:39.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:39.063+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:39.719 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:39.716+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:39.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:39.733+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:39.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:39.750+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:40.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:40.025+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:40.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:40.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:40.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:40.758+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:40.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:40.782+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:41.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:41.038+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:41.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:41.689+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:41.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:41.752+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:41.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:41.780+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:42.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:42.010+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:42.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:42.677+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:42.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:42.788+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:42.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:42.826+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:42.974 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:42.972+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:43.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:43.718+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:43.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:43.829+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:43.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:43.836+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:43.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:43.978+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:44.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:44.674+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:44.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:44.803+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:44.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:44.861+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:44.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:44.974+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:45.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:21:45.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:21:45.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:45.669+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:45.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:45.813+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:45.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:45.881+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:46.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:46.014+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:46.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:46.628+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:46.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:46.781+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:46.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:46.876+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:47.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:47.015+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:47.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:47.671+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:47.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:47.803+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:47.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:47.868+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:47.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:47.975+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:48.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:48.695+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:48.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:48.841+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:48.903 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:48.900+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:48.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:48.968+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:49.024 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:21:49.021+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:21:49.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:49.722+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:49.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:49.840+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:49.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:49.886+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:49.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:49.990+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:50.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:50.724+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:50.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:50.864+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:50.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:50.934+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:51.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:50.998+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:51.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:51.696+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:51.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:51.844+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:51.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:51.960+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:52.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:52.011+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:52.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:52.677+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:52.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:52.867+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:52.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:52.943+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:52.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:52.971+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:53.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:53.659+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:53.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:53.831+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:53.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:53.907+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:53.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:53.992+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:54.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:54.699+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:54.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:54.842+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:54.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:54.954+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:55.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:54.999+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:55.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:55.711+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:55.890 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:55.888+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:55.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:55.963+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:55.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:55.974+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:56.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:56.691+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:56.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:56.876+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:56.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:56.927+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:56.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:56.974+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:57.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:57.701+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:57.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:57.899+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:57.910 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:57.908+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:57.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:57.944+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:58.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:58.705+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:58.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:58.893+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:58.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:58.914+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:58.967 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:58.965+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:59.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:21:59.681+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:59.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:21:59.919+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:59.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:21:59.924+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:21:59.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:21:59.953+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:00.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:00.684+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:00.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:00.881+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:00.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:00.945+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:00.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:00.954+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:01.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:01.662+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:01.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:01.833+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:01.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:01.946+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:01.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:01.974+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:02.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:02.684+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:02.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:02.832+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:02.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:02.907+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:02.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:02.976+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:03.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:03.653+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:03.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:03.794+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:03.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:03.894+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:03.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:03.998+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:04.040 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:22:04.037+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:22:04.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:04.649+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:04.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:04.778+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:04.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:04.894+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:04.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:04.972+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:05.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:05.616+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:05.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:05.826+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:05.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:05.871+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:05.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:05.985+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:06.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:06.640+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:06.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:06.811+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:06.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:06.823+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:07.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:07.005+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:07.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:07.642+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:07.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:07.775+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:07.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:07.782+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:08.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:08.018+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:08.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:08.681+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:08.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:08.800+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:08.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:08.804+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:09.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:09.026+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:09.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:09.722+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:09.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:09.814+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:09.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:09.836+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:10.076 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:10.075+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:10.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:10.697+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:10.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:10.789+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:10.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:10.830+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:11.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:11.121+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:11.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:11.649+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:11.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:11.753+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:11.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:11.864+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:12.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:12.143+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:12.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:12.659+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:12.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:12.740+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:12.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:12.871+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:13.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:13.129+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:13.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:13.638+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:13.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:13.716+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:13.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:13.847+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:14.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:14.178+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:14.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:14.634+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:14.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:14.692+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:14.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:14.875+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:15.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:15.174+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:15.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:22:15.188 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:22:15.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:15.606+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:15.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:15.733+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:15.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:15.870+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:16.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:16.145+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:16.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:16.633+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:16.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:16.721+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:16.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:16.838+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:17.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:17.158+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:17.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:17.585+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:17.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:17.683+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:17.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:17.837+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:18.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:18.137+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:18.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:18.541+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:18.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:18.665+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:18.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:18.813+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:19.055 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:22:19.054+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:22:19.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:19.092+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:19.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:19.533+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:19.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:19.705+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:19.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:19.844+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:20.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:20.072+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:20.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:20.537+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:20.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:20.668+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:20.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:20.809+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:21.084 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:21.082+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:21.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:21.576+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:21.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:21.689+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:21.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:21.769+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:22.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:22.077+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:22.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:22.565+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:22.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:22.701+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:22.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:22.752+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:23.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:23.062+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:23.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:23.518+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:23.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:23.665+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:23.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:23.759+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:24.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:24.066+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:24.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:24.481+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:24.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:24.681+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:24.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:24.747+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:25.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:25.045+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:25.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:25.453+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:25.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:25.637+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:25.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:25.781+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:26.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:26.086+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:26.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:26.451+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:26.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:26.680+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:26.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:26.812+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:27.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:27.048+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:27.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:27.449+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:27.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:27.703+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:27.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:27.816+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:28.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:28.080+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:28.494 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:28.492+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:28.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:28.686+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:28.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:28.830+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:29.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:29.116+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:29.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:29.499+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:29.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:29.656+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:29.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:29.871+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:30.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:30.103+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:30.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:30.506+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:30.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:30.697+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:30.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:30.877+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:31.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:31.077+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:31.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:31.505+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:31.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:31.669+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:31.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:31.882+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:32.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:32.065+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:32.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:32.514+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:32.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:32.634+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:32.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:32.844+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:33.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:33.035+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:33.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:33.522+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:33.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:33.626+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:33.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:33.862+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:34.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:34.048+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:34.071 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:22:34.069+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:22:34.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:34.504+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:34.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:34.615+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:34.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:34.905+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:35.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:35.011+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:35.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:35.513+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:35.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:35.598+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:35.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:35.954+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:35.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:35.989+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:36.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:36.541+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:36.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:36.646+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:36.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:36.968+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:36.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:36.982+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:37.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:37.578+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:37.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:37.691+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:37.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:37.968+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:37.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:37.975+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:38.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:38.624+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:38.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:38.668+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:38.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:38.978+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:39.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:39.003+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:39.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:39.630+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:39.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:39.653+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:39.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:39.963+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:40.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:40.048+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:40.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:40.632+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:40.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:40.658+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:40.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:40.951+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:41.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:40.999+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:41.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:41.610+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:41.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:41.638+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:41.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:41.963+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:41.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:41.984+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:42.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:42.635+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:42.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:42.665+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:42.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:42.969+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:43.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:43.009+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:43.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:43.670+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:43.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:43.685+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:43.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:43.921+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:43.965 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:43.963+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:44.637 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:44.635+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:44.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:44.693+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:44.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:44.920+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:44.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:44.960+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:45.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:22:45.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:22:45.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:45.602+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:45.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:45.649+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:45.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:45.941+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:45.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:45.956+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:46.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:46.561+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:46.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:46.610+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:46.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:46.952+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:46.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:46.966+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:47.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:47.600+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:47.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:47.601+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:47.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:47.935+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:47.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:47.986+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:48.564 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:48.562+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:48.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:48.589+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:48.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:48.920+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:48.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:48.958+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:49.087 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:22:49.085+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:22:49.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:49.574+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:49.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:49.639+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:49.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:49.908+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:49.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:49.978+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:50.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:50.530+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:50.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:50.625+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:50.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:50.906+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:50.957 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:50.955+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:51.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:51.549+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:51.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:51.623+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:51.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:51.903+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:51.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:51.908+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:52.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:52.541+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:52.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:52.587+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:52.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:52.879+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:52.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:52.893+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:53.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:53.558+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:53.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:53.583+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:53.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:53.876+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:53.887 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:53.886+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:54.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:54.592+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:54.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:54.608+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:54.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:54.853+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:54.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:54.869+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:55.634 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:55.632+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:55.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:55.651+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:55.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:55.824+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:55.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:55.859+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:56.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:56.663+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:56.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:56.697+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:56.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:56.834+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:56.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:56.899+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:57.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:57.639+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:57.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:57.684+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:57.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:57.862+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:57.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:57.943+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:58.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:58.612+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:58.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:58.714+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:58.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:58.842+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:58.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:58.934+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:59.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:22:59.592+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:59.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:22:59.732+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:59.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:22:59.843+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:22:59.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:22:59.948+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:00.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:00.629+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:00.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:00.687+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:00.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:00.841+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:00.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:00.982+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:01.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:01.579+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:01.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:01.700+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:01.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:01.798+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:02.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:02.020+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:02.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:02.559+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:02.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:02.684+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:02.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:02.775+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:03.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:03.056+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:03.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:03.594+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:03.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:03.682+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:03.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:03.726+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:04.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:04.074+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:04.103 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:23:04.100+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:23:04.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:04.559+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:04.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:04.723+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:04.742 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:04.740+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:05.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:05.066+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:05.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:05.582+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:05.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:05.693+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:05.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:05.779+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:06.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:06.094+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:06.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:06.619+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:06.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:06.671+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:06.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:06.812+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:07.068 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:07.065+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:07.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:07.655+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:07.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:07.713+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:07.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:07.849+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:08.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:08.090+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:08.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:08.625+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:08.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:08.717+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:08.894 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:08.892+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:09.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:09.046+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:09.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:09.617+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:09.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:09.678+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:09.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:09.865+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:10.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:10.059+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:10.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:10.650+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:10.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:10.727+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:10.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:10.895+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:11.077 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:11.074+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:11.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:11.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:11.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:11.695+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:11.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:11.876+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:12.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:12.098+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:12.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:12.650+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:12.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:12.705+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:12.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:12.875+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:13.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:13.071+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:13.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:13.631+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:13.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:13.737+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:13.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:13.911+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:14.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:14.112+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:14.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:14.655+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:14.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:14.729+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:14.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:14.952+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:15.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:15.102+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:15.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:23:15.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:23:15.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:15.690+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:15.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:15.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:16.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:16.001+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:16.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:16.072+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:16.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:16.671+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:16.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:16.687+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:17.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:16.998+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:17.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:17.055+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:17.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:17.644+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:17.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:17.695+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:18.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:18.042+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:18.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:18.044+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:18.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:18.648+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:18.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:18.720+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:19.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:19.005+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:19.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:19.088+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:19.118 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:23:19.116+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:23:19.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:19.684+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:19.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:19.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:20.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:20.023+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:20.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:20.125+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:20.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:20.643+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:20.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:20.705+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:21.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:21.058+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:21.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:21.149+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:21.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:21.641+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:21.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:21.697+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:22.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:22.031+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:22.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:22.181+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:22.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:22.617+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:22.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:22.687+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:23.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:23.075+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:23.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:23.158+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:23.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:23.648+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:23.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:23.654+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:24.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:24.037+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:24.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:24.167+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:24.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:24.653+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:24.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:24.689+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:25.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:25.048+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:25.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:25.216+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:25.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:25.673+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:25.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:25.677+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:26.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:26.080+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:26.186 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:26.184+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:26.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:26.636+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:26.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:26.642+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:27.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:27.121+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:27.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:27.214+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:27.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:27.625+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:27.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:27.638+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:28.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:28.103+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:28.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:28.170+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:28.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:28.634+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:28.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:28.670+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:29.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:29.142+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:29.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:29.166+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:29.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:29.602+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:29.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:29.635+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:30.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:30.135+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:30.163 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:30.161+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:30.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:30.577+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:30.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:30.679+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:31.116 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:31.114+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:31.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:31.120+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:31.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:31.598+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:31.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:31.683+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:32.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:32.078+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:32.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:32.141+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:32.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:32.586+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:32.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:32.656+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:33.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:33.029+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:33.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:33.096+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:33.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:33.611+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:33.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:33.703+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:34.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:34.076+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:34.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:34.104+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:34.134 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:23:34.133+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:23:34.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:34.615+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:34.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:34.702+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:35.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:35.078+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:35.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:35.111+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:35.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:35.615+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:35.742 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:35.740+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:36.123 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:36.121+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:36.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:36.129+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:36.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:36.644+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:36.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:36.756+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:37.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:37.108+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:37.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:37.146+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:37.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:37.640+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:37.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:37.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:38.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:38.108+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:38.119 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:38.118+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:38.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:38.667+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:38.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:38.737+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:39.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:39.110+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:39.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:39.155+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:39.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:39.677+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:39.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:39.785+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:40.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:40.123+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:40.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:40.178+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:40.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:40.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:40.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:40.778+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:41.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:41.129+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:41.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:41.141+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:41.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:41.712+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:41.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:41.785+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:42.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:42.109+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:42.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:42.141+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:42.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:42.754+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:42.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:42.791+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:43.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:43.095+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:43.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:43.111+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:43.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:43.706+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:43.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:43.758+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:44.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:44.085+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:44.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:44.146+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:44.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:44.743+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:44.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:44.767+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:45.094 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:45.093+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:45.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:45.176+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:45.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:23:45.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:23:45.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:45.778+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:45.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:45.780+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:46.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:46.120+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:46.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:46.156+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:46.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:46.744+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:46.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:46.758+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:47.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:47.152+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:47.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:47.192+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:47.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:47.735+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:47.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:47.781+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:48.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:48.137+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:48.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:48.146+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:48.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:48.726+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:48.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:48.822+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:49.137 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:23:49.134+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:23:49.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:49.150+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:49.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:49.158+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:49.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:49.764+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:49.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:49.855+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:50.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:50.133+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:50.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:50.179+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:50.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:50.797+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:50.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:50.855+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:51.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:51.140+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:51.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:51.209+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:51.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:51.789+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:51.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:51.854+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:52.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:52.110+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:52.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:52.231+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:52.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:52.780+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:52.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:52.846+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:53.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:53.133+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:53.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:53.281+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:53.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:53.794+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:53.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:53.817+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:54.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:54.140+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:54.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:54.289+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:54.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:54.828+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:54.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:54.829+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:55.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:55.153+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:55.274 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:55.272+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:55.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:55.790+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:55.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:55.798+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:56.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:56.112+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:56.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:56.308+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:56.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:56.784+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:56.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:56.801+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:57.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:57.073+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:57.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:57.348+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:57.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:57.813+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:57.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:57.813+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:58.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:58.050+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:58.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:58.348+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:58.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:58.773+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:58.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:58.791+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:59.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:59.014+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:59.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:23:59.343+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:59.753 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:23:59.751+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:59.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:23:59.800+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:23:59.967 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:23:59.965+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:00.337 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:00.335+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:00.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:00.766+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:00.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:00.786+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:01.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:01.001+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:01.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:01.298+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:01.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:01.777+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:01.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:01.818+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:01.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:01.975+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:02.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:02.319+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:02.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:02.747+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:02.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:02.799+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:02.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:02.972+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:03.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:03.274+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:03.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:03.769+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:03.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:03.769+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:03.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:03.928+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:04.141 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:24:04.140+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:24:04.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:04.259+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:04.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:04.739+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:04.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:04.800+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:04.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:04.905+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:05.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:05.245+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:05.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:05.697+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:05.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:05.766+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:05.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:05.884+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:06.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:06.221+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:06.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:06.659+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:06.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:06.728+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:06.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:06.927+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:07.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:07.190+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:07.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:07.678+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:07.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:07.695+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:07.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:07.935+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:08.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:08.146+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:08.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:08.670+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:08.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:08.733+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:08.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:08.950+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:09.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:09.195+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:09.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:09.650+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:09.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:09.698+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:09.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:09.919+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:10.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:10.168+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:10.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:10.626+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:10.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:10.692+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:10.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:10.936+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:11.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:11.120+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:11.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:11.611+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:11.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:11.699+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:11.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:11.942+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:12.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:12.136+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:12.622 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:12.619+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:12.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:12.713+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:12.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:12.948+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:13.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:13.140+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:13.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:13.607+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:13.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:13.709+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:13.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:13.955+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:14.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:14.165+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:14.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:14.627+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:14.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:14.741+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:14.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:14.943+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:15.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:15.205+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:15.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:15.673+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:15.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:24:15.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:24:15.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:15.693+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:15.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:15.914+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:16.222 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:16.220+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:16.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:16.653+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:16.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:16.721+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:16.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:16.877+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:17.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:17.170+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:17.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:17.702+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:17.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:17.731+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:17.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:17.836+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:18.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:18.208+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:18.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:18.672+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:18.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:18.762+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:18.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:18.881+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:19.153 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:24:19.150+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:24:19.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:19.238+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:19.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:19.712+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:19.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:19.731+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:19.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:19.862+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:20.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:20.248+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:20.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:20.762+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:20.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:20.776+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:20.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:20.830+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:21.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:21.223+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:21.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:21.772+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:21.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:21.824+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:21.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:21.844+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:22.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:22.221+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:22.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:22.795+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:22.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:22.801+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:22.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:22.855+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:23.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:23.185+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:23.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:23.830+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:23.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:23.844+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:23.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:23.873+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:24.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:24.151+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:24.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:24.864+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:24.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:24.872+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:24.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:24.884+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:25.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:25.163+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:25.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:25.852+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:25.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:25.858+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:25.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:25.894+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:26.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:26.147+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:26.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:26.817+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:26.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:26.894+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:26.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:26.944+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:27.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:27.177+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:27.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:27.846+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:27.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:27.905+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:27.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:27.954+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:28.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:28.146+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:28.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:28.828+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:28.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:28.895+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:28.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:28.969+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:29.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:29.191+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:29.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:29.783+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:29.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:29.943+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:30.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:29.998+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:30.159 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:30.157+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:30.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:30.798+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:30.982 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:30.981+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:30.983 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:30.981+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:31.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:31.161+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:31.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:31.819+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:31.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:31.939+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:31.981 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:31.980+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:32.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:32.140+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:32.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:32.810+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:32.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:32.919+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:33.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:33.025+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:33.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:33.140+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:33.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:33.831+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:33.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:33.941+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:34.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:34.028+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:34.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:34.096+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:34.159 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:24:34.156+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:24:34.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:34.823+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:34.939 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:34.937+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:35.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:35.070+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:35.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:35.095+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:35.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:35.818+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:35.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:35.987+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:36.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:36.084+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:36.090 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:36.089+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:36.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:36.770+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:37.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:37.037+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:37.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:37.047+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:37.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:37.110+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:37.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:37.759+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:38.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:38.000+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:38.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:38.016+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:38.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:38.069+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:38.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:38.757+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:39.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:39.011+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:39.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:39.026+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:39.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:39.083+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:39.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:39.762+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:40.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:40.004+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:40.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:40.048+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:40.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:40.115+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:40.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:40.773+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:41.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:41.022+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:41.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:41.045+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:41.067 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:41.066+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:41.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:41.820+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:41.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:41.981+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:42.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:42.029+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:42.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:42.039+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:42.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:42.819+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:42.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:42.940+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:43.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:43.038+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:43.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:43.057+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:43.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:43.826+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:43.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:43.924+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:44.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:44.019+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:44.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:44.073+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:44.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:44.860+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:44.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:44.947+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:44.997 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:44.995+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:45.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:45.086+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:45.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:24:45.772 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:24:45.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:45.899+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:45.906 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:45.904+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:45.974 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:45.972+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:46.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:46.059+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:46.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:46.872+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:46.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:46.919+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:47.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:47.014+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:47.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:47.028+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:47.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:47.880+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:47.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:47.912+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:47.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:47.982+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:47.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:47.995+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:48.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:48.879+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:48.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:48.926+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:48.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:48.967+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:49.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:49.011+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:49.164 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:24:49.162+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:24:49.881 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:49.879+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:49.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:49.937+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:49.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:49.942+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:49.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:49.971+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:50.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:50.877+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:50.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:50.923+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:50.938 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:50.935+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:50.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:50.984+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:51.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:51.842+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:51.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:51.876+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:51.896 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:51.893+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:51.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:51.953+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:52.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:52.861+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:52.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:52.902+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:52.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:52.924+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:52.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:52.926+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:53.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:53.881+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:53.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:53.910+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:53.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:53.946+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:53.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:53.950+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:54.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:54.915+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:54.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:54.922+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:54.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:54.928+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:54.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:54.948+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:55.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:55.886+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:55.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:55.905+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:55.944 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:55.941+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:55.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:55.966+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:56.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:56.877+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:56.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:56.907+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:56.948 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:56.945+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:56.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:56.948+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:57.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:57.873+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:57.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:57.921+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:57.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:57.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:57.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:57.992+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:58.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:58.863+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:58.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:58.935+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:58.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:58.949+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:59.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:24:59.018+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:59.869 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:24:59.867+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:59.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:24:59.926+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:24:59.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:24:59.931+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:00.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:00.045+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:00.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:00.878+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:00.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:00.915+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:00.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:00.945+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:01.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:01.081+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:01.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:01.868+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:01.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:01.903+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:01.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:01.982+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:02.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:02.048+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:02.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:02.870+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:02.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:02.942+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:02.981 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:02.979+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:03.089 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:03.087+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:03.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:03.848+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:03.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:03.931+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:03.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:03.967+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:04.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:04.054+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:04.180 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:25:04.177+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:25:04.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:04.831+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:04.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:04.909+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:04.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:04.990+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:05.022 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:05.021+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:05.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:05.795+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:05.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:05.889+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:06.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:06.004+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:06.061 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:06.059+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:06.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:06.828+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:06.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:06.891+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:06.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:06.959+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:07.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:07.064+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:07.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:07.798+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:07.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:07.856+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:07.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:07.950+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:08.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:08.062+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:08.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:08.797+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:08.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:08.830+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:08.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:08.938+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:09.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:09.016+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:09.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:09.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:09.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:09.805+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:09.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:09.986+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:10.018 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:10.016+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:10.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:10.770+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:10.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:10.811+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:10.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:10.975+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:11.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:11.003+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:11.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:11.726+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:11.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:11.832+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:11.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:11.982+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:12.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:12.000+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:12.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:12.691+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:12.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:12.862+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:13.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:12.998+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:13.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:13.031+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:13.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:13.672+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:13.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:13.858+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:13.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:13.982+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:14.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:14.001+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:14.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:14.701+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:14.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:14.833+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:14.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:14.960+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:14.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:14.963+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:15.732 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:15.730+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:15.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:15.799+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:15.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:25:15.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:25:15.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:15.951+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:15.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:15.970+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:16.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:16.755+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:16.810 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:16.809+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:16.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:16.921+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:16.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:16.926+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:17.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:17.705+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:17.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:17.799+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:17.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:17.900+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:17.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:17.950+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:18.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:18.660+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:18.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:18.824+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:18.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:18.870+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:18.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:18.984+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:19.196 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:25:19.194+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:25:19.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:19.647+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:19.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:19.844+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:19.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:19.859+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:20.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:20.028+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:20.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:20.673+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:20.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:20.818+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:20.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:20.891+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:21.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:21.065+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:21.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:21.680+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:21.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:21.827+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:21.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:21.849+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:22.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:22.090+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:22.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:22.722+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:22.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:22.804+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:22.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:22.869+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:23.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:23.075+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:23.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:23.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:23.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:23.787+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:23.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:23.863+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:24.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:24.119+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:24.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:24.732+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:24.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:24.810+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:24.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:24.825+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:25.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:25.159+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:25.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:25.712+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:25.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:25.773+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:25.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:25.826+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:26.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:26.160+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:26.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:26.754+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:26.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:26.760+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:26.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:26.820+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:27.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:27.148+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:27.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:27.729+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:27.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:27.775+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:27.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:27.803+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:28.179 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:28.177+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:28.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:28.736+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:28.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:28.797+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:28.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:28.838+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:29.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:29.210+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:29.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:29.697+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:29.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:29.750+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:29.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:29.848+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:30.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:30.189+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:30.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:30.732+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:30.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:30.756+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:30.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:30.883+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:31.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:31.151+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:31.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:31.724+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:31.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:31.760+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:31.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:31.922+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:32.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:32.159+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:32.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:32.714+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:32.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:32.784+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:32.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:32.932+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:33.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:33.187+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:33.694 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:33.692+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:33.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:33.787+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:33.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:33.903+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:34.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:34.163+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:34.197 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:25:34.194+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:25:34.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:34.646+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:34.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:34.755+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:34.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:34.873+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:35.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:35.152+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:35.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:35.642+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:35.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:35.746+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:35.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:35.873+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:36.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:36.119+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:36.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:36.639+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:36.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:36.748+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:36.914 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:36.912+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:37.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:37.164+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:37.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:37.638+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:37.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:37.778+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:37.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:37.932+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:38.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:38.182+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:38.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:38.669+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:38.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:38.797+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:38.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:38.902+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:39.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:39.165+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:39.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:39.693+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:39.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:39.805+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:39.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:39.927+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:40.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:40.183+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:40.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:40.720+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:40.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:40.769+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:40.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:40.924+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:41.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:41.230+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:41.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:41.700+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:41.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:41.768+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:41.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:41.923+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:42.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:42.263+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:42.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:42.750+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:42.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:42.808+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:42.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:42.902+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:43.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:43.299+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:43.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:43.706+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:43.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:43.794+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:43.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:43.885+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:44.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:44.295+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:44.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:44.729+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:44.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:44.816+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:44.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:44.911+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:45.342 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:45.340+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:45.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:45.708+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:45.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:45.820+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:45.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:45.883+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:46.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:25:46.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:25:46.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:46.378+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:46.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:46.722+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:46.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:46.799+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:46.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:46.860+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:47.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:47.394+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:47.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:47.715+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:47.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:47.756+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:47.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:47.811+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:48.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:48.406+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:48.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:48.735+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:48.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:48.738+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:48.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:48.788+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:49.212 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:25:49.209+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:25:49.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:49.414+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:49.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:49.708+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:49.722 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:49.720+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:49.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:49.775+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:50.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:50.452+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:50.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:50.746+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:50.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:50.759+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:50.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:50.790+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:51.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:51.466+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:51.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:51.717+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:51.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:51.772+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:51.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:51.815+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:52.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:52.475+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:52.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:52.691+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:52.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:52.769+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:52.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:52.775+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:53.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:53.500+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:53.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:53.724+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:53.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:53.778+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:53.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:53.809+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:54.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:54.490+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:54.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:54.723+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:54.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:54.805+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:54.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:54.837+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:55.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:55.443+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:55.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:55.765+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:55.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:55.771+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:55.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:55.802+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:56.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:56.455+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:56.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:56.722+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:56.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:56.791+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:56.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:56.816+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:57.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:57.499+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:57.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:57.714+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:57.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:57.756+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:57.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:57.861+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:58.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:58.545+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:58.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:58.708+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:58.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:58.733+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:58.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:58.902+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:59.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:25:59.531+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:59.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:25:59.676+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:59.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:25:59.770+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:25:59.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:25:59.898+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:00.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:00.561+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:00.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:00.711+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:00.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:00.755+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:00.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:00.877+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:01.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:01.545+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:01.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:01.742+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:01.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:01.743+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:01.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:01.855+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:02.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:02.574+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:02.726 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:02.724+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:02.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:02.793+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:02.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:02.852+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:03.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:03.537+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:03.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:03.698+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:03.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:03.841+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:03.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:03.885+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:04.228 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:26:04.225+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:26:04.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:04.518+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:04.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:04.701+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:04.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:04.795+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:04.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:04.909+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:05.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:05.507+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:05.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:05.675+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:05.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:05.756+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:05.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:05.958+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:06.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:06.467+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:06.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:06.668+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:06.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:06.773+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:06.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:06.944+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:07.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:07.509+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:07.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:07.710+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:07.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:07.775+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:07.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:07.989+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:08.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:08.513+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:08.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:08.693+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:08.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:08.785+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:08.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:08.977+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:09.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:09.531+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:09.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:09.698+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:09.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:09.755+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:09.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:09.977+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:10.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:10.550+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:10.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:10.677+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:10.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:10.751+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:10.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:10.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:11.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:11.519+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:11.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:11.649+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:11.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:11.714+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:11.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:11.964+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:12.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:12.515+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:12.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:12.661+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:12.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:12.743+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:12.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:12.988+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:13.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:13.474+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:13.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:13.648+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:13.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:13.737+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:14.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:14.017+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:14.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:14.511+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:14.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:14.644+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:14.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:14.721+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:14.969 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:14.968+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:15.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:15.486+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:15.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:15.630+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:15.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:15.728+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:15.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:15.992+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:16.219 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:26:16.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:26:16.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:16.442+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:16.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:16.639+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:16.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:16.754+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:17.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:16.999+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:17.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:17.429+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:17.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:17.604+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:17.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:17.757+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:17.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:17.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:18.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:18.411+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:18.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:18.635+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:18.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:18.716+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:18.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:18.975+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:19.243 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:26:19.241+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:26:19.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:19.456+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:19.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:19.679+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:19.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:19.682+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:20.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:20.019+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:20.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:20.452+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:20.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:20.657+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:20.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:20.716+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:20.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:20.979+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:21.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:21.417+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:21.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:21.635+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:21.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:21.707+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:21.941 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:21.940+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:22.396 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:22.394+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:22.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:22.600+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:22.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:22.673+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:22.953 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:22.952+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:23.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:23.411+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:23.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:23.592+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:23.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:23.656+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:23.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:23.940+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:24.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:24.428+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:24.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:24.559+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:24.652 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:24.650+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:24.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:24.961+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:25.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:25.401+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:25.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:25.593+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:25.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:25.636+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:25.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:25.923+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:26.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:26.441+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:26.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:26.575+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:26.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:26.619+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:26.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:26.960+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:27.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:27.445+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:27.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:27.564+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:27.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:27.616+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:27.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:27.935+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:28.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:28.482+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:28.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:28.579+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:28.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:28.661+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:28.902 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:28.899+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:29.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:29.530+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:29.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:29.555+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:29.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:29.693+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:29.873 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:29.871+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:30.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:30.509+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:30.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:30.518+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:30.649 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:30.646+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:30.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:30.825+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:31.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:31.514+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:31.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:31.566+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:31.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:31.630+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:31.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:31.787+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:32.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:32.495+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:32.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:32.537+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:32.593 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:32.590+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:32.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:32.738+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:33.466 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:33.464+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:33.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:33.524+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:33.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:33.597+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:33.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:33.781+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:34.259 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:26:34.258+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:26:34.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:34.438+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:34.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:34.565+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:34.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:34.596+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:34.808 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:34.806+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:35.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:35.430+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:35.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:35.557+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:35.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:35.564+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:35.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:35.764+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:36.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:36.462+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:36.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:36.529+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:36.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:36.574+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:36.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:36.811+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:37.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:37.469+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:37.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:37.516+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:37.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:37.601+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:37.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:37.797+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:38.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:38.506+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:38.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:38.518+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:38.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:38.626+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:38.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:38.803+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:39.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:39.480+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:39.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:39.498+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:39.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:39.590+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:39.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:39.804+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:40.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:40.459+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:40.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:40.475+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:40.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:40.572+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:40.856 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:40.854+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:41.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:41.458+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:41.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:41.501+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:41.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:41.570+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:41.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:41.896+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:42.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:42.476+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:42.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:42.504+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:42.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:42.540+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:42.928 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:42.922+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:43.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:43.454+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:43.550 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:43.548+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:43.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:43.549+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:43.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:43.924+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:44.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:44.414+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:44.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:44.521+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:44.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:44.587+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:44.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:44.971+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:45.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:45.396+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:45.535 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:45.532+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:45.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:45.605+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:45.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:45.963+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:46.305 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:26:46.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:26:46.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:46.427+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:46.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:46.486+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:46.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:46.595+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:46.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:46.953+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:47.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:47.466+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:47.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:47.490+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:47.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:47.584+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:47.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:47.936+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:48.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:48.477+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:48.539 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:48.537+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:48.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:48.571+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:48.907 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:48.905+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:49.269 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:26:49.266+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:26:49.464 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:49.462+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:49.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:49.531+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:49.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:49.546+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:49.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:49.938+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:50.454 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:50.452+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:50.550 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:50.549+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:50.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:50.585+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:50.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:50.970+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:51.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:51.439+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:51.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:51.544+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:51.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:51.559+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:51.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:51.936+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:52.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:52.431+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:52.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:52.541+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:52.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:52.541+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:52.945 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:52.942+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:53.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:53.385+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:53.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:53.546+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:53.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:53.552+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:53.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:53.904+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:54.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:54.360+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:54.516 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:54.514+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:54.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:54.540+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:54.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:54.865+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:55.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:55.395+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:55.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:55.503+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:55.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:55.522+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:55.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:55.844+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:56.382 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:56.379+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:56.477 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:56.475+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:56.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:56.529+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:56.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:56.856+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:57.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:57.331+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:57.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:57.436+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:57.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:57.481+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:57.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:57.811+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:58.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:58.370+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:58.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:58.479+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:58.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:58.503+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:58.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:58.828+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:59.360 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:26:59.358+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:59.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:26:59.528+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:59.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:26:59.543+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:26:59.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:26:59.849+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:00.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:00.384+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:00.512 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:00.511+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:00.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:00.524+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:00.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:00.814+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:01.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:01.372+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:01.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:01.469+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:01.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:01.550+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:01.850 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:01.849+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:02.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:02.395+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:02.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:02.488+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:02.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:02.512+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:02.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:02.890+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:03.381 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:03.380+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:03.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:03.486+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:03.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:03.557+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:03.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:03.853+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:04.285 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:27:04.283+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:27:04.425 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:04.423+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:04.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:04.519+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:04.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:04.557+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:04.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:04.820+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:05.430 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:05.428+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:05.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:05.545+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:05.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:05.577+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:05.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:05.796+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:06.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:06.471+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:06.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:06.525+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:06.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:06.585+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:06.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:06.839+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:07.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:07.488+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:07.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:07.524+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:07.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:07.549+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:07.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:07.803+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:08.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:08.486+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:08.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:08.507+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:08.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:08.533+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:08.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:08.758+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:09.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:09.482+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:09.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:09.512+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:09.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:09.580+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:09.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:09.725+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:10.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:10.494+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:10.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:10.511+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:10.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:10.607+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:10.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:10.682+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:11.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:11.487+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:11.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:11.554+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:11.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:11.653+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:11.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:11.675+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:12.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:12.477+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:12.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:12.603+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:12.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:12.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:12.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:12.720+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:13.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:13.508+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:13.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:13.582+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:13.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:13.717+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:13.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:13.769+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:14.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:14.480+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:14.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:14.551+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:14.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:14.707+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:14.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:14.778+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:15.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:15.456+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:15.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:15.536+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:15.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:15.739+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:15.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:15.804+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:16.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:27:16.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:27:16.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:16.459+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:16.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:16.530+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:16.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:16.785+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:16.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:16.846+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:17.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:17.413+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:17.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:17.575+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:17.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:17.737+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:17.828 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:17.826+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:18.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:18.366+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:18.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:18.592+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:18.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:18.693+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:18.871 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:18.869+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:19.301 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:27:19.298+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:27:19.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:19.392+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:19.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:19.642+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:19.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:19.722+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:19.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:19.831+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:20.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:20.439+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:20.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:20.595+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:20.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:20.747+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:20.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:20.864+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:21.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:21.473+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:21.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:21.619+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:21.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:21.703+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:21.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:21.880+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:22.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:22.500+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:22.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:22.614+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:22.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:22.677+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:22.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:22.868+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:23.543 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:23.541+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:23.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:23.640+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:23.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:23.704+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:23.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:23.857+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:24.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:24.586+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:24.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:24.611+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:24.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:24.729+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:24.878 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:24.876+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:25.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:25.566+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:25.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:25.567+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:25.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:25.762+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:25.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:25.917+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:26.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:26.560+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:26.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:26.600+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:26.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:26.758+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:26.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:26.898+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:27.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:27.535+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:27.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:27.607+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:27.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:27.782+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:27.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:27.924+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:28.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:28.562+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:28.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:28.582+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:28.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:28.737+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:28.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:28.914+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:29.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:29.516+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:29.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:29.621+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:29.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:29.712+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:29.920 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:29.918+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:30.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:30.525+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:30.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:30.611+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:30.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:30.709+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:30.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:30.870+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:31.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:31.539+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:31.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:31.583+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:31.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:31.702+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:31.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:31.863+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:32.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:32.549+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:32.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:32.550+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:32.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:32.745+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:32.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:32.855+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:33.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:33.506+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:33.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:33.527+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:33.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:33.710+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:33.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:33.887+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:34.303 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:27:34.300+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:27:34.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:34.467+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:34.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:34.541+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:34.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:34.756+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:34.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:34.889+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:35.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:35.430+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:35.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:35.576+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:35.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:35.732+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:35.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:35.859+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:36.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:36.456+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:36.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:36.568+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:36.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:36.690+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:36.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:36.845+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:37.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:37.422+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:37.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:37.561+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:37.709 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:37.707+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:37.879 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:37.877+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:38.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:38.398+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:38.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:38.596+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:38.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:38.674+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:38.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:38.897+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:39.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:39.425+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:39.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:39.611+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:39.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:39.680+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:39.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:39.849+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:40.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:40.415+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:40.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:40.622+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:40.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:40.718+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:40.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:40.830+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:41.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:41.388+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:41.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:41.659+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:41.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:41.688+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:41.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:41.822+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:42.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:42.395+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:42.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:42.699+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:42.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:42.725+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:42.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:42.794+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:43.408 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:43.402+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:43.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:43.684+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:43.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:43.716+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:43.827 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:43.825+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:44.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:44.418+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:44.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:44.704+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:44.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:44.710+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:44.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:44.870+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:45.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:45.428+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:45.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:45.664+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:45.698 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:45.696+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:45.886 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:45.883+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:46.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:46.460+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:46.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:27:46.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:27:46.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:46.669+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:46.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:46.711+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:46.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:46.867+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:47.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:47.459+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:47.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:47.636+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:47.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:47.734+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:47.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:47.913+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:48.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:48.438+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:48.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:48.620+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:48.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:48.727+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:48.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:48.923+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:49.318 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:27:49.317+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:27:49.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:49.456+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:49.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:49.618+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:49.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:49.722+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:49.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:49.902+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:50.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:50.418+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:50.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:50.619+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:50.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:50.745+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:50.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:50.871+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:51.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:51.383+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:51.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:51.594+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:51.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:51.743+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:51.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:51.899+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:52.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:52.372+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:52.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:52.615+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:52.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:52.763+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:52.860 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:52.858+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:53.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:53.330+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:53.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:53.653+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:53.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:53.780+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:53.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:53.881+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:54.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:54.354+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:54.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:54.618+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:54.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:54.770+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:54.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:54.891+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:55.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:55.340+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:55.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:55.608+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:55.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:55.801+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:55.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:55.932+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:56.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:56.329+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:56.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:56.567+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:56.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:56.773+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:56.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:56.948+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:57.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:57.316+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:57.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:57.554+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:57.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:57.743+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:57.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:57.945+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:58.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:58.347+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:58.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:58.548+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:58.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:58.708+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:58.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:58.969+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:59.378 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:27:59.376+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:59.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:27:59.549+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:59.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:27:59.693+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:27:59.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:27:59.936+0000 7f72c425d700 -1 osd.5 118 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:00.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:00.356+0000 7f596d92c700 -1 osd.6 118 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:00.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:00.578+0000 7f389e18e700 -1 osd.4 118 get_health_metrics reporting 75 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:00.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:00.683+0000 7f6e44c9f700 -1 osd.7 118 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:00.822 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T03:28:00.821+0000 7fcb8ce41700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:28:00.837 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T03:28:00.821+0000 7fcb8ce41700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:28:00.858 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T03:28:00.919 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:00.912+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:01.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:01.354+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:01.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:01.577+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:01.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:01.697+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:01.961 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:01.960+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:02.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:02.328+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:02.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:02.612+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:02.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:02.712+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:02.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:02.950+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:03.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:03.366+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:03.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:03.581+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:03.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:03.687+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:03.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:03.977+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:04.323 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:28:04.320+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:28:04.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:04.388+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:04.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:04.572+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:04.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:04.735+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:05.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:05.006+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:05.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:05.382+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:05.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:05.622+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:05.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:05.781+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:05.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:05.967+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:06.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:06.408+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:06.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:06.607+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:06.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:06.781+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:07.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:07.002+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:07.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:07.450+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:07.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:07.603+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:07.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:07.782+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:08.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:08.035+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:08.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:08.489+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:08.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:08.590+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:08.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:08.810+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:09.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:09.076+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:09.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:09.538+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:09.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:09.632+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:09.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:09.784+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:10.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:10.121+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:10.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:10.559+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:10.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:10.631+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:10.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:10.804+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:11.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:11.086+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:11.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:11.560+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:11.664 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:11.661+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:11.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:11.786+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:12.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:12.044+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:12.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:12.516+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:12.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:12.645+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:12.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:12.835+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:13.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:13.022+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:13.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:13.513+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:13.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:13.678+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:13.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:13.870+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:13.995 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:13.993+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:14.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:14.515+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:14.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:14.671+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:14.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:14.892+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:15.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:15.043+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:15.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:15.482+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:15.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:15.651+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:15.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:15.911+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:16.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:16.003+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:16.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:16.484+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:16.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:28:16.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:28:16.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:16.648+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:16.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:16.958+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:16.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:16.988+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:17.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:17.511+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:17.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:17.612+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:17.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:17.965+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:17.975 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:17.972+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:18.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:18.513+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:18.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:18.648+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:18.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:18.994+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:19.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:18.999+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:19.339 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:28:19.336+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:28:19.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:19.552+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:19.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:19.656+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:19.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:19.957+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:20.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:20.019+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:20.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:20.567+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:20.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:20.613+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:20.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:20.976+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:21.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:21.032+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:21.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:21.542+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:21.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:21.624+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:21.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:21.939+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:22.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:22.052+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:22.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:22.543+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:22.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:22.663+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:22.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:22.922+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:23.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:23.046+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:23.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:23.589+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:23.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:23.682+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:23.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:23.899+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:24.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:24.034+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:24.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:24.575+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:24.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:24.718+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:24.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:24.878+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:24.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:24.987+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:25.610 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:25.608+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:25.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:25.682+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:25.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:25.851+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:25.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:25.984+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:26.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:26.635+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:26.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:26.651+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:26.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:26.878+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:27.011 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:27.008+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:27.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:27.613+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:27.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:27.670+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:27.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:27.832+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:28.003 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:28.001+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:28.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:28.565+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:28.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:28.718+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:28.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:28.795+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:28.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:28.990+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:29.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:29.605+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:29.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:29.692+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:29.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:29.817+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:29.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:29.958+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:30.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:30.586+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:30.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:30.695+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:30.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:30.858+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:30.914 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:30.912+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:31.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:31.566+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:31.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:31.676+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:31.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:31.905+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:31.942 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:31.940+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:32.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:32.531+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:32.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:32.685+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:32.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:32.883+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:32.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:32.919+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:33.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:33.564+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:33.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:33.716+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:33.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:33.880+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:33.931 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:33.928+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:34.355 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:28:34.352+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:28:34.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:34.582+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:34.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:34.675+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:34.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:34.861+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:34.889 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:34.887+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:35.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:35.547+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:35.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:35.672+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:35.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:35.879+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:35.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:35.904+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:36.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:36.589+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:36.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:36.699+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:36.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:36.875+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:36.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:36.932+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:37.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:37.561+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:37.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:37.748+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:37.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:37.895+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:37.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:37.911+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:38.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:38.561+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:38.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:38.738+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:38.900 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:38.899+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:38.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:38.947+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:39.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:39.544+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:39.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:39.721+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:39.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:39.855+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:39.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:39.916+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:40.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:40.566+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:40.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:40.711+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:40.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:40.806+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:40.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:40.943+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:41.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:41.545+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:41.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:41.746+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:41.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:41.824+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:41.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:41.920+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:42.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:42.575+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:42.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:42.786+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:42.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:42.874+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:42.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:42.917+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:43.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:43.607+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:43.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:43.770+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:43.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:43.921+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:43.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:43.962+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:44.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:44.587+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:44.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:44.821+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:44.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:44.934+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:44.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:44.982+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:45.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:45.599+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:45.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:45.869+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:45.933 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:45.932+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:45.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:45.935+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:46.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:46.623+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:46.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:28:46.745 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:28:46.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:46.836+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:46.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:46.943+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:46.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:46.953+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:47.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:47.622+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:47.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:47.843+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:47.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:47.936+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:47.952 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:47.951+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:48.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:48.584+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:48.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:48.874+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:48.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:48.907+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:48.985 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:48.984+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:49.360 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:28:49.357+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:28:49.624 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:49.623+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:49.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:49.891+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:49.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:49.909+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:50.006 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:50.004+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:50.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:50.666+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:50.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:50.849+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:50.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:50.955+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:51.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:51.039+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:51.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:51.680+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:51.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:51.840+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:51.984 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:51.983+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:52.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:52.055+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:52.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:52.687+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:52.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:52.809+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:52.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:52.984+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:53.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:53.103+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:53.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:53.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:53.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:53.855+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:53.972 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:53.971+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:54.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:54.081+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:54.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:54.613+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:54.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:54.879+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:54.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:54.972+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:55.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:55.068+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:55.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:55.645+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:55.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:55.878+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:55.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:55.964+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:56.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:56.107+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:56.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:56.595+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:56.857 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:56.855+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:57.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:57.011+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:57.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:57.150+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:57.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:57.561+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:57.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:57.824+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:58.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:58.002+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:58.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:58.132+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:58.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:58.564+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:58.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:58.849+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:59.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:28:59.015+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:59.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:28:59.122+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:59.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:28:59.609+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:28:59.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:28:59.842+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:00.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:00.056+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:00.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:00.111+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:00.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:00.624+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:00.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:00.808+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:01.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:01.055+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:01.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:01.088+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:01.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:01.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:01.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:01.763+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:02.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:02.064+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:02.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:02.067+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:02.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:02.653+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:02.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:02.773+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:03.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:03.055+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:03.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:03.083+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:03.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:03.658+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:03.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:03.726+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:04.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:04.040+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:04.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:04.112+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:04.375 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:29:04.374+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:29:04.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:04.631+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:04.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:04.713+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:05.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:05.080+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:05.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:05.150+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:05.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:05.614+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:05.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:05.754+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:06.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:06.128+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:06.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:06.199+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:06.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:06.617+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:06.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:06.741+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:07.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:07.163+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:07.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:07.235+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:07.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:07.573+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:07.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:07.785+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:08.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:08.203+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:08.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:08.284+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:08.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:08.576+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:08.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:08.781+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:09.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:09.163+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:09.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:09.301+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:09.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:09.621+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:09.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:09.743+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:10.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:10.128+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:10.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:10.269+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:10.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:10.589+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:10.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:10.731+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:11.090 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:11.088+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:11.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:11.237+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:11.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:11.601+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:11.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:11.685+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:12.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:12.042+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:12.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:12.261+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:12.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:12.637+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:12.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:12.703+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:13.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:13.066+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:13.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:13.296+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:13.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:13.682+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:13.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:13.682+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:14.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:14.063+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:14.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:14.277+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:14.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:14.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:14.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:14.694+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:15.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:15.075+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:15.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:15.250+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:15.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:15.645+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:15.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:15.688+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:16.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:16.115+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:16.279 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:16.277+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:16.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:16.596+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:16.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:16.684+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:16.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:29:16.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:29:17.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:17.107+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:17.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:17.271+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:17.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:17.579+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:17.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:17.714+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:18.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:18.062+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:18.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:18.299+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:18.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:18.593+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:18.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:18.682+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:19.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:19.023+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:19.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:19.323+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:19.384 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:29:19.382+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:29:19.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:19.610+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:19.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:19.708+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:20.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:20.040+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:20.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:20.287+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:20.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:20.567+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:20.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:20.672+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:21.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:21.031+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:21.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:21.288+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:21.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:21.584+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:21.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:21.682+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:22.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:22.065+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:22.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:22.241+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:22.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:22.587+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:22.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:22.673+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:23.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:23.026+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:23.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:23.254+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:23.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:23.569+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:23.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:23.626+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:24.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:24.035+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:24.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:24.217+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:24.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:24.598+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:24.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:24.601+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:25.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:25.038+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:25.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:25.213+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:25.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:25.623+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:25.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:25.646+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:26.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:26.053+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:26.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:26.174+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:26.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:26.648+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:26.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:26.689+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:27.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:27.103+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:27.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:27.216+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:27.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:27.641+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:27.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:27.667+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:28.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:28.059+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:28.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:28.190+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:28.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:28.598+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:28.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:28.624+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:29.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:29.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:29.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:29.147+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:29.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:29.604+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:29.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:29.650+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:30.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:30.056+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:30.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:30.127+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:30.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:30.620+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:30.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:30.658+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:31.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:31.008+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:31.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:31.141+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:31.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:31.601+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:31.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:31.700+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:32.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:32.037+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:32.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:32.125+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:32.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:32.565+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:32.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:32.681+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:33.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:33.012+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:33.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:33.081+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:33.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:33.544+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:33.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:33.710+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:34.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:34.025+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:34.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:34.071+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:34.400 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:29:34.398+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:29:34.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:34.579+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:34.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:34.755+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:34.986 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:34.984+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:35.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:35.032+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:35.551 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:35.550+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:35.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:35.736+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:36.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:36.001+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:36.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:36.033+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:36.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:36.514+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:36.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:36.733+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:37.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:37.020+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:37.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:37.075+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:37.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:37.487+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:37.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:37.737+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:38.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:38.068+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:38.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:38.108+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:38.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:38.496+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:38.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:38.734+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:39.092 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:39.091+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:39.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:39.096+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:39.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:39.469+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:39.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:39.748+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:40.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:40.051+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:40.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:40.112+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:40.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:40.483+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:40.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:40.760+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:41.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:41.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:41.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:41.087+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:41.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:41.458+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:41.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:41.794+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:42.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:42.038+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:42.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:42.042+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:42.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:42.478+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:42.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:42.832+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:43.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:43.017+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:43.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:43.037+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:43.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:43.491+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:43.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:43.814+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:43.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:43.974+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:44.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:44.035+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:44.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:44.481+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:44.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:44.863+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:44.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:44.950+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:45.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:45.052+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:45.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:45.506+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:45.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:45.893+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:45.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:45.956+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:46.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:46.005+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:46.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:46.455+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:46.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:46.939+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:46.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:46.991+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:46.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:29:47.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:29:47.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:47.051+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:47.410 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:47.408+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:47.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:47.943+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:48.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:48.038+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:48.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:48.071+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:48.451 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:48.449+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:48.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:48.980+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:49.033 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:49.031+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:49.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:49.114+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:49.415 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:29:49.412+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:29:49.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:49.430+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:50.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:50.018+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:50.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:50.018+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:50.087 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:50.085+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:50.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:50.446+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:50.978 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:50.976+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:50.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:50.990+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:51.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:51.040+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:51.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:51.405+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:52.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:52.023+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:52.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:52.023+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:52.044 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:52.041+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:52.437 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:52.435+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:52.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:52.975+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:53.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:53.049+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:53.060 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:53.057+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:53.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:53.481+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:53.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:53.991+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:54.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:54.013+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:54.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:54.029+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:54.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:54.464+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:54.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:54.979+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:55.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:55.018+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:55.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:55.049+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:55.499 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:55.496+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:56.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:56.006+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:56.020 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:56.017+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:56.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:56.046+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:56.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:56.517+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:57.022 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:57.020+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:57.026 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:57.024+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:57.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:57.043+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:57.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:57.493+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:58.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:57.997+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:58.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:58.009+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:58.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:58.064+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:58.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:58.534+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:58.970 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:58.968+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:59.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:29:59.041+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:59.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:29:59.100+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:59.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:29:59.583+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:29:59.987 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:29:59.985+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:00.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:00.069+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:00.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:00.134+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:00.554 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:00.551+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:01.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:01.022+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:01.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:01.101+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:01.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:01.103+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:01.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:01.515+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:02.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:02.005+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:02.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:02.070+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:02.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:02.115+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:02.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:02.501+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:03.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:03.004+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:03.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:03.031+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:03.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:03.130+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:03.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:03.540+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:03.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:03.970+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:04.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:04.053+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:04.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:04.081+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:04.431 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:30:04.428+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:30:04.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:04.527+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:04.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:04.930+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:05.015 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:05.013+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:05.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:05.091+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:05.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:05.560+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:05.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:05.890+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:05.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:05.992+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:06.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:06.064+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:06.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:06.519+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:06.884 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:06.882+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:07.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:07.006+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:07.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:07.056+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:07.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:07.487+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:07.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:07.868+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:07.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:07.986+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:08.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:08.067+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:08.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:08.509+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:08.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:08.851+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:08.989 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:08.987+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:09.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:09.112+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:09.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:09.529+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:09.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:09.816+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:09.988 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:09.985+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:10.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:10.092+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:10.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:10.495+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:10.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:10.775+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:10.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:10.942+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:11.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:11.129+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:11.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:11.452+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:11.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:11.800+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:11.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:11.938+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:12.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:12.093+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:12.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:12.492+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:12.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:12.818+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:12.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:12.967+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:13.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:13.076+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:13.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:13.457+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:13.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:13.769+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:13.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:13.963+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:14.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:14.043+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:14.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:14.453+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:14.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:14.812+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:15.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:15.008+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:15.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:15.049+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:15.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:15.433+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:15.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:15.796+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:15.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:15.978+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:16.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:16.076+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:16.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:16.453+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:16.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:16.796+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:16.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:16.972+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:17.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:17.038+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:17.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:30:17.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:30:17.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:17.440+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:17.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:17.761+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:18.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:18.020+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:18.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:18.044+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:18.489 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:18.486+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:18.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:18.722+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:19.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:19.043+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:19.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:19.093+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:19.447 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:30:19.444+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:30:19.448 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:19.446+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:19.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:19.685+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:20.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:20.061+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:20.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:20.085+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:20.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:20.426+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:20.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:20.691+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:21.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:21.021+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:21.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:21.129+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:21.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:21.476+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:21.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:21.672+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:21.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:21.980+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:22.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:22.163+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:22.452 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:22.451+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:22.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:22.703+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:22.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:22.972+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:23.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:23.122+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:23.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:23.485+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:23.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:23.677+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:23.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:23.995+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:24.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:24.089+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:24.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:24.437+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:24.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:24.691+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:25.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:25.038+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:25.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:25.129+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:25.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:25.409+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:25.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:25.730+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:26.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:26.080+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:26.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:26.082+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:26.409 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:26.407+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:26.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:26.687+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:27.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:27.092+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:27.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:27.118+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:27.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:27.394+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:27.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:27.711+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:28.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:28.062+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:28.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:28.120+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:28.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:28.396+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:28.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:28.684+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:29.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:29.086+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:29.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:29.088+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:29.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:29.415+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:29.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:29.687+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:30.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:30.082+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:30.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:30.125+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:30.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:30.421+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:30.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:30.673+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:31.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:31.092+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:31.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:31.122+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:31.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:31.428+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:31.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:31.671+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:32.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:32.060+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:32.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:32.117+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:32.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:32.393+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:32.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:32.688+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:33.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:33.081+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:33.112 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:33.111+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:33.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:33.430+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:33.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:33.649+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:34.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:34.084+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:34.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:34.117+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:34.463 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:30:34.460+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:30:34.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:34.463+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:34.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:34.640+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:35.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:35.085+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:35.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:35.119+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:35.458 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:35.456+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:35.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:35.676+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:36.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:36.090+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:36.158 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:36.157+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:36.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:36.464+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:36.674 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:36.672+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:37.100 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:37.098+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:37.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:37.119+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:37.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:37.461+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:37.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:37.655+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:38.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:38.094+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:38.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:38.154+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:38.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:38.427+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:38.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:38.616+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:39.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:39.130+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:39.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:39.176+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:39.424 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:39.422+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:39.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:39.593+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:40.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:40.161+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:40.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:40.186+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:40.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:40.413+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:40.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:40.580+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:41.200 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:41.198+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:41.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:41.198+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:41.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:41.430+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:41.589 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:41.587+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:42.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:42.168+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:42.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:42.237+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:42.414 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:42.412+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:42.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:42.546+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:43.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:43.131+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:43.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:43.256+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:43.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:43.423+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:43.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:43.519+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:44.136 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:44.133+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:44.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:44.233+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:44.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:44.398+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:44.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:44.470+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:45.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:45.157+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:45.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:45.216+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:45.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:45.364+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:45.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:45.454+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:46.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:46.182+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:46.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:46.249+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:46.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:46.354+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:46.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:46.462+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:47.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:30:47.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:30:47.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:47.190+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:47.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:47.298+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:47.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:47.310+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:47.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:47.438+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:48.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:48.154+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:48.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:48.282+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:48.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:48.342+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:48.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:48.464+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:49.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:49.167+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:49.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:49.252+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:49.392 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:49.390+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:49.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:49.416+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:49.478 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:30:49.477+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:30:50.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:50.195+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:50.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:50.290+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:50.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:50.426+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:50.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:50.463+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:51.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:51.163+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:51.243 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:51.241+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:51.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:51.414+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:51.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:51.509+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:52.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:52.180+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:52.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:52.227+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:52.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:52.433+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:52.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:52.555+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:53.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:53.137+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:53.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:53.272+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:53.449 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:53.447+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:53.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:53.587+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:54.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:54.093+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:54.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:54.290+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:54.439 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:54.437+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:54.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:54.589+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:55.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:55.132+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:55.249 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:55.247+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:55.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:55.468+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:55.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:55.563+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:56.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:56.164+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:56.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:56.288+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:56.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:56.505+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:56.571 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:56.569+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:57.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:57.204+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:57.261 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:57.259+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:57.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:57.460+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:57.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:57.525+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:58.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:58.174+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:58.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:58.263+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:58.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:58.442+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:58.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:58.502+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:59.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:30:59.176+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:59.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:30:59.237+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:59.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:30:59.417+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:30:59.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:30:59.462+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:00.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:00.199+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 52 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:00.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:00.232+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 38 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:00.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:00.372+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:00.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:00.427+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:01.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:01.232+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:01.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:01.261+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:01.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:01.363+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:01.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:01.437+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:02.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:02.189+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:02.267 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:02.265+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:02.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:02.395+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:02.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:02.404+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:03.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:03.152+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:03.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:03.286+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:03.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:03.356+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:03.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:03.413+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:04.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:04.114+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:04.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:04.333+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:04.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:04.336+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:04.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:04.458+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:04.494 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:31:04.492+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:31:05.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:05.157+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:05.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:05.340+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:05.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:05.383+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:05.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:05.414+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:06.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:06.124+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:06.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:06.321+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:06.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:06.386+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:06.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:06.406+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:07.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:07.118+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:07.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:07.288+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:07.369 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:07.367+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:07.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:07.393+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:08.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:08.152+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:08.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:08.251+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:08.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:08.325+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:08.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:08.363+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:09.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:09.103+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:09.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:09.294+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:09.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:09.319+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:09.361 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:09.359+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:10.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:10.120+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:10.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:10.250+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:10.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:10.357+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:10.371 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:10.370+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:11.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:11.155+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:11.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:11.244+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:11.338 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:11.336+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:11.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:11.376+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:12.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:12.167+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:12.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:12.272+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:12.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:12.310+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:12.376 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:12.374+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:13.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:13.130+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:13.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:13.299+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:13.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:13.328+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:13.348 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:13.347+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:14.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:14.167+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:14.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:14.299+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:14.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:14.322+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:14.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:14.334+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:15.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:15.164+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:15.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:15.299+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:15.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:15.311+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:15.320 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:15.319+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:16.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:16.201+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:16.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:16.315+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:16.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:16.315+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:16.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:16.331+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:17.237 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:17.235+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:17.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:31:17.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:31:17.312 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:17.310+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:17.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:17.322+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:17.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:17.325+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:18.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:18.260+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:18.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:18.263+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:18.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:18.289+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:18.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:18.305+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:19.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:19.215+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:19.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:19.243+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:19.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:19.267+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:19.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:19.295+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:19.510 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:31:19.508+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:31:20.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:20.181+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:20.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:20.261+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:20.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:20.290+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:20.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:20.293+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:21.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:21.133+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:21.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:21.247+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:21.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:21.264+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:21.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:21.327+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:22.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:22.158+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:22.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:22.214+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:22.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:22.276+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:22.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:22.288+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:23.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:23.141+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:23.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:23.238+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:23.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:23.243+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:23.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:23.270+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:24.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:24.110+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:24.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:24.227+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:24.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:24.236+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:24.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:24.249+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:25.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:25.095+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:25.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:25.188+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:25.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:25.199+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:25.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:25.249+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:26.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:26.082+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:26.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:26.225+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:26.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:26.248+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:26.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:26.295+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:27.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:27.048+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:27.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:27.255+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:27.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:27.288+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:27.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:27.332+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:28.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:28.002+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:28.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:28.274+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:28.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:28.298+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:28.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:28.303+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:29.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:29.003+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:29.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:29.291+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:29.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:29.331+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:29.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:29.334+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:30.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:30.033+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:30.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:30.322+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:30.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:30.335+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:30.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:30.347+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:31.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:31.066+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:31.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:31.317+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:31.331 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:31.329+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:31.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:31.343+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:32.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:32.017+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:32.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:32.304+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:32.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:32.330+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:32.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:32.376+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:33.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:33.013+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:33.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:33.297+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:33.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:33.339+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:33.346 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:33.343+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:33.995 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:33.993+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:34.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:34.323+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:34.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:34.365+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:34.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:34.385+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:34.526 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:31:34.524+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:31:35.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:35.042+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:35.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:35.308+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:35.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:35.410+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:35.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:35.433+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:36.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:36.056+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:36.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:36.268+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:36.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:36.404+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:36.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:36.417+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:37.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:37.063+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:37.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:37.250+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:37.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:37.395+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:37.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:37.440+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:38.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:38.112+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:38.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:38.237+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:38.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:38.434+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:38.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:38.457+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:39.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:39.107+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:39.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:39.212+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:39.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:39.415+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:39.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:39.475+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:40.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:40.072+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:40.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:40.170+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:40.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:40.386+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:40.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:40.476+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:41.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:41.035+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:41.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:41.212+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:41.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:41.338+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:41.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:41.514+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:42.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:42.009+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:42.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:42.166+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:42.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:42.334+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:42.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:42.480+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:42.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:42.997+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:43.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:43.181+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:43.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:43.360+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:43.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:43.514+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:43.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:43.956+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:44.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:44.186+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:44.313 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:44.311+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:44.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:44.521+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:44.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:44.908+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:45.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:45.201+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:45.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:45.300+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:45.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:45.553+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:45.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:45.933+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:46.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:46.214+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:46.276 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:46.274+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:46.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:46.576+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:46.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:46.948+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:47.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:47.229+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:47.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:47.243+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:47.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:31:47.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:31:47.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:47.541+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:47.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:47.967+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:48.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:48.230+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:48.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:48.265+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:48.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:48.517+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:48.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:48.945+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:49.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:49.248+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:49.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:49.276+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:49.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:49.494+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:49.542 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:31:49.539+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:31:49.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:49.903+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:50.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:50.201+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:50.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:50.322+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:50.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:50.521+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:50.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:50.911+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:51.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:51.231+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:51.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:51.285+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:51.485 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:51.483+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:51.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:51.948+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:52.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:52.257+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:52.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:52.271+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:52.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:52.504+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:52.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:52.988+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:53.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:53.253+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:53.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:53.291+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:53.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:53.468+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:53.996 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:53.993+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:54.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:54.242+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:54.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:54.312+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:54.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:54.469+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:55.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:55.039+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:55.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:55.205+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:55.312 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:55.310+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:55.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:55.507+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:56.027 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:56.025+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:56.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:56.156+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:56.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:56.284+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:56.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:56.556+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:57.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:57.016+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:57.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:57.124+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:57.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:57.306+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:57.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:57.588+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:58.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:58.028+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:58.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:58.128+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:58.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:58.351+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:58.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:58.633+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:59.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:31:59.044+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:59.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:31:59.122+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:59.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:31:59.396+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:31:59.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:31:59.618+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:00.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:00.065+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:00.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:00.120+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:00.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:00.439+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:00.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:00.626+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:01.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:01.031+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:01.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:01.120+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:01.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:01.481+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:01.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:01.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:02.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:02.001+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:02.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:02.116+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:02.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:02.529+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:02.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:02.633+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:02.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:02.982+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:03.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:03.134+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:03.533 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:03.531+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:03.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:03.651+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:03.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:03.947+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:04.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:04.158+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:04.558 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:32:04.556+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:32:04.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:04.577+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:04.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:04.664+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:04.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:04.940+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:05.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:05.135+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:05.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:05.590+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:05.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:05.693+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:05.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:05.946+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:06.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:06.134+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:06.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:06.598+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:06.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:06.737+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:06.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:06.930+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:07.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:07.151+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:07.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:07.626+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:07.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:07.706+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:07.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:07.917+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:08.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:08.142+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:08.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:08.669+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:08.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:08.674+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:08.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:08.957+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:09.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:09.187+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:09.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:09.685+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:09.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:09.702+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:09.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:09.944+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:10.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:10.212+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:10.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:10.644+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:10.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:10.660+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:10.967 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:10.965+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:11.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:11.167+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:11.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:11.611+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:11.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:11.679+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:12.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:12.013+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:12.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:12.190+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:12.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:12.595+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:12.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:12.721+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:13.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:13.046+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:13.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:13.207+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:13.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:13.641+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:13.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:13.766+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:14.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:14.085+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:14.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:14.195+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:14.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:14.616+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:14.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:14.816+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:15.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:15.131+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:15.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:15.227+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:15.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:15.663+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:15.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:15.812+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:16.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:16.175+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:16.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:16.246+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:16.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:16.636+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:16.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:16.849+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:17.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:17.158+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:17.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:17.258+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:17.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:32:17.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:32:17.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:17.686+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:17.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:17.844+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:18.155 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:18.152+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:18.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:18.221+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:18.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:18.656+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:18.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:18.836+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:19.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:19.122+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:19.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:19.234+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:19.574 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:32:19.571+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:32:19.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:19.673+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:19.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:19.855+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:20.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:20.149+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:20.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:20.279+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:20.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:20.662+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:20.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:20.850+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:21.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:21.191+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:21.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:21.272+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:21.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:21.671+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:21.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:21.839+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:22.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:22.222+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:22.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:22.303+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:22.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:22.675+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:22.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:22.796+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:23.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:23.254+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:23.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:23.263+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:23.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:23.720+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:23.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:23.812+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:24.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:24.230+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:24.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:24.299+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:24.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:24.716+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:24.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:24.763+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:25.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:25.217+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:25.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:25.286+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:25.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:25.716+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:25.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:25.780+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:26.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:26.202+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:26.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:26.318+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:26.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:26.679+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:26.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:26.802+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:27.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:27.250+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:27.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:27.357+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:27.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:27.728+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:27.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:27.776+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:28.215 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:28.213+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:28.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:28.404+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:28.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:28.717+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:28.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:28.797+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:29.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:29.210+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:29.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:29.449+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:29.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:29.724+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:29.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:29.834+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:30.191 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:30.188+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:30.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:30.419+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:30.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:30.689+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:30.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:30.881+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:31.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:31.227+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:31.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:31.373+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:31.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:31.737+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:31.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:31.895+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:32.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:32.240+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:32.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:32.405+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:32.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:32.731+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:32.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:32.940+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:33.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:33.250+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:33.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:33.414+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:33.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:33.706+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:33.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:33.896+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:34.265 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:34.263+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:34.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:34.383+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:34.589 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:32:34.587+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:32:34.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:34.678+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:34.881 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:34.878+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:35.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:35.222+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:35.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:35.398+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:35.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:35.651+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:35.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:35.900+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:36.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:36.240+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:36.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:36.380+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:36.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:36.689+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:36.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:36.918+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:37.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:37.275+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:37.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:37.390+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:37.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:37.710+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:37.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:37.966+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:38.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:38.317+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:38.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:38.372+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:38.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:38.760+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:38.964 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:38.962+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:39.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:39.276+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:39.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:39.332+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:39.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:39.742+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:39.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:39.982+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:40.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:40.247+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:40.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:40.351+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:40.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:40.753+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:40.949 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:40.947+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:41.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:41.267+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:41.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:41.382+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:41.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:41.726+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:41.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:41.979+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:42.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:42.254+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:42.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:42.392+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:42.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:42.687+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:42.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:42.957+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:43.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:43.260+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:43.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:43.422+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:43.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:43.718+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:43.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:43.929+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:44.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:44.295+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:44.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:44.400+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:44.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:44.711+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:44.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:44.915+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:45.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:45.269+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:45.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:45.389+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:45.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:45.674+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:45.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:45.916+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:46.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:46.275+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:46.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:46.416+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:46.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:46.717+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:46.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:46.894+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:47.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:47.259+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:47.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:47.405+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:47.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:32:47.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:32:47.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:47.693+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:47.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:47.847+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:48.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:48.248+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:48.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:48.391+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:48.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:48.698+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:48.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:48.856+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:49.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:49.238+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:49.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:49.413+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:49.605 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:32:49.603+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:32:49.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:49.676+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:49.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:49.896+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:50.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:50.288+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:50.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:50.370+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:50.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:50.649+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:50.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:50.915+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:51.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:51.290+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:51.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:51.366+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:51.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:51.656+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:51.888 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:51.886+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:52.333 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:52.331+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:52.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:52.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:52.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:52.706+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:52.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:52.837+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:53.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:53.324+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:53.350 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:53.349+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:53.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:53.719+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:53.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:53.800+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:54.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:54.330+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:54.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:54.377+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:54.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:54.672+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:54.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:54.781+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:55.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:55.356+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:55.376 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:55.375+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:55.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:55.633+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:55.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:55.828+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:56.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:56.317+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:56.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:56.351+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:56.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:56.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:56.831 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:56.829+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:57.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:57.313+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:57.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:57.393+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:57.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:57.641+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:57.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:57.878+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:58.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:58.318+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:58.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:58.422+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:58.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:58.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:58.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:58.879+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:59.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:32:59.279+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:59.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:32:59.403+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:59.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:32:59.592+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:32:59.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:32:59.925+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:00.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:00.305+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:00.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:00.368+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:00.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:00.588+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:00.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:00.941+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:01.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:01.329+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:01.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:01.417+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:01.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:01.567+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:01.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:01.906+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:02.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:02.350+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:02.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:02.439+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:02.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:02.597+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:02.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:02.870+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:03.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:03.304+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:03.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:03.473+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:03.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:03.610+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:03.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:03.840+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:04.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:04.281+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:04.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:04.443+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:04.610 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:33:04.608+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:33:04.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:04.640+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:04.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:04.822+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:05.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:05.330+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:05.398 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:05.397+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:05.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:05.631+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:05.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:05.841+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:06.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:06.366+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:06.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:06.445+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:06.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:06.620+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:06.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:06.858+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:07.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:07.341+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:07.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:07.432+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:07.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:07.637+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:07.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:07.822+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:08.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:08.357+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:08.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:08.440+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:08.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:08.661+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:08.849 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:08.847+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:09.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:09.336+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:09.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:09.434+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:09.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:09.623+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:09.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:09.846+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:10.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:10.317+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:10.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:10.446+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:10.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:10.657+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:10.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:10.856+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:11.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:11.294+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:11.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:11.438+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:11.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:11.693+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:11.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:11.842+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:12.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:12.283+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:12.458 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:12.456+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:12.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:12.724+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:12.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:12.885+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:13.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:13.307+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:13.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:13.436+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:13.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:13.735+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:13.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:13.913+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:14.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:14.304+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:14.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:14.452+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:14.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:14.760+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:14.941 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:14.939+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:15.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:15.307+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:15.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:15.465+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:15.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:15.775+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:15.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:15.951+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:16.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:16.292+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:16.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:16.466+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:16.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:16.817+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:16.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:16.956+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:17.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:17.277+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:17.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:17.456+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:17.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:33:17.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:33:17.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:17.827+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:17.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:17.934+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:18.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:18.228+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:18.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:18.408+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:18.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:18.855+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:18.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:18.950+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:19.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:19.225+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:19.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:19.411+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:19.626 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:33:19.625+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:33:19.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:19.846+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:19.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:19.951+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:20.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:20.181+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:20.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:20.403+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:20.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:20.875+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:20.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:20.985+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:21.138 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:21.136+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:21.406 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:21.403+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:21.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:21.887+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:22.009 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:22.007+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:22.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:22.128+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:22.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:22.418+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:22.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:22.879+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:22.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:22.996+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:23.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:23.153+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:23.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:23.429+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:23.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:23.906+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:23.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:23.968+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:24.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:24.152+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:24.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:24.430+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:24.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:24.876+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:24.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:24.957+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:25.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:25.175+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:25.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:25.435+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:25.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:25.853+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:25.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:25.942+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:26.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:26.136+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:26.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:26.424+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:26.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:26.839+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:26.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:26.984+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:27.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:27.153+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:27.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:27.405+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:27.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:27.874+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:27.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:27.992+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:28.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:28.196+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:28.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:28.415+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:28.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:28.861+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:28.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:28.994+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:29.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:29.215+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:29.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:29.443+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:29.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:29.817+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:30.020 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:30.018+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:30.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:30.219+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:30.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:30.421+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:30.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:30.863+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:31.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:30.997+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:31.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:31.251+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:31.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:31.466+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:31.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:31.896+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:31.972 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:31.970+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:32.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:32.297+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:32.462 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:32.460+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:32.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:32.923+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:33.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:33.013+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:33.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:33.307+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:33.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:33.499+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:33.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:33.878+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:33.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:33.971+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:34.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:34.286+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:34.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:34.494+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:34.640 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:33:34.637+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:33:34.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:34.915+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:34.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:34.928+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:35.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:35.237+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:35.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:35.525+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:35.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:35.940+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:35.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:35.955+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:36.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:36.275+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:36.493 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:36.490+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:36.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:36.912+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:36.992 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:36.990+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:37.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:37.259+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:37.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:37.467+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:37.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:37.890+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:38.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:38.013+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:38.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:38.234+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:38.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:38.511+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:38.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:38.847+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:39.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:39.000+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:39.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:39.252+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:39.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:39.554+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:39.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:39.806+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:39.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:39.952+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:40.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:40.283+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:40.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:40.599+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:40.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:40.784+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:41.001 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:40.999+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:41.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:41.249+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:41.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:41.588+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:41.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:41.830+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:42.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:42.026+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:42.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:42.299+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:42.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:42.575+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:42.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:42.839+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:43.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:43.048+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:43.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:43.308+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:43.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:43.559+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:43.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:43.852+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:44.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:44.057+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:44.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:44.314+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:44.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:44.577+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:44.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:44.894+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:45.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:45.085+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:45.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:45.320+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:45.537 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:45.536+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:45.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:45.882+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:46.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:46.093+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:46.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:46.330+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:46.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:46.578+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:46.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:46.867+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:47.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:47.140+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:47.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:47.368+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:47.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:47.539+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:47.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:47.832+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:47.862 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:33:47.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:33:48.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:48.113+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:48.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:48.402+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:48.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:48.510+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:48.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:48.830+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:49.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:49.128+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:49.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:49.404+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:49.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:49.485+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:49.656 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:33:49.654+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:33:49.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:49.866+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:50.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:50.151+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:50.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:50.374+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:50.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:50.486+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:50.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:50.873+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:51.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:51.200+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:51.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:51.329+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:51.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:51.501+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:51.854 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:51.852+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:52.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:52.205+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:52.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:52.327+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:52.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:52.503+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:52.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:52.869+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:53.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:53.207+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:53.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:53.335+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:53.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:53.552+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:53.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:53.851+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:54.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:54.191+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:54.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:54.306+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:54.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:54.533+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:54.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:54.822+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:55.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:55.159+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:55.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:55.269+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:55.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:55.507+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:55.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:55.824+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:56.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:56.160+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:56.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:56.225+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:56.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:56.467+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:56.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:56.829+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:57.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:57.195+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:57.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:57.199+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:57.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:57.497+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:57.848 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:57.847+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:58.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:58.216+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:58.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:58.216+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:58.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:58.456+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:58.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:58.833+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:59.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:33:59.177+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:59.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:33:59.233+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:59.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:33:59.409+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:33:59.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:33:59.836+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:00.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:00.144+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:00.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:00.229+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:00.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:00.393+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:00.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:00.873+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:01.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:01.179+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:01.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:01.221+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:01.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:01.423+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:01.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:01.865+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:02.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:02.137+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:02.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:02.178+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:02.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:02.463+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:02.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:02.835+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:03.160 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:03.158+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:03.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:03.170+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:03.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:03.439+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:03.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:03.810+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:04.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:04.140+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:04.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:04.218+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:04.401 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:04.399+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:04.660 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:34:04.658+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:34:04.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:04.831+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:05.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:05.156+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:05.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:05.174+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:05.359 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:05.357+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:05.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:05.814+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:06.121 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:06.119+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:06.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:06.203+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:06.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:06.358+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:06.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:06.802+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:07.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:07.137+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:07.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:07.245+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:07.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:07.341+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:07.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:07.764+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:08.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:08.109+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:08.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:08.284+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:08.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:08.354+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:08.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:08.742+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:09.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:09.139+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:09.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:09.298+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:09.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:09.359+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:09.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:09.771+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:10.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:10.126+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:10.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:10.278+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:10.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:10.387+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:10.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:10.786+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:11.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:11.164+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:11.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:11.276+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:11.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:11.383+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:11.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:11.779+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:12.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:12.163+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:12.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:12.267+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:12.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:12.410+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:12.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:12.781+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:13.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:13.163+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:13.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:13.274+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:13.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:13.421+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:13.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:13.820+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:14.205 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:14.202+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:14.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:14.233+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:14.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:14.419+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:14.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:14.847+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:15.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:15.197+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:15.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:15.201+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:15.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:15.470+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:15.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:15.829+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:16.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:16.153+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:16.177 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:16.175+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:16.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:16.509+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:16.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:16.795+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:17.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:17.149+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:17.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:17.187+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:17.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:17.479+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:17.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:17.812+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:17.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:34:17.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:34:18.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:18.170+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:18.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:18.195+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:18.482 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:18.480+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:18.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:18.781+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:19.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:19.204+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:19.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:19.221+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:19.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:19.436+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:19.676 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:34:19.673+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:34:19.802 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:19.799+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:20.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:20.174+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:20.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:20.186+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:20.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:20.484+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:20.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:20.835+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:21.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:21.198+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:21.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:21.212+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:21.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:21.530+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:21.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:21.831+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:22.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:22.166+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:22.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:22.223+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:22.559 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:22.557+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:22.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:22.853+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:23.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:23.125+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:23.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:23.247+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:23.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:23.566+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:23.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:23.818+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:24.111 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:24.108+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:24.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:24.259+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:24.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:24.541+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:24.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:24.836+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:25.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:25.062+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:25.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:25.279+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:25.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:25.590+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:25.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:25.812+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:26.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:26.036+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:26.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:26.289+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:26.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:26.585+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:26.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:26.842+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:27.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:27.043+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:27.256 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:27.254+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:27.620 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:27.618+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:27.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:27.892+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:28.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:28.014+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:28.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:28.259+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:28.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:28.647+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:28.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:28.865+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:29.055 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:29.053+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:29.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:29.232+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:29.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:29.615+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:29.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:29.823+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:30.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:30.062+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:30.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:30.253+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:30.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:30.586+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:30.843 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:30.840+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:31.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:31.095+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:31.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:31.235+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:31.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:31.600+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:31.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:31.834+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:32.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:32.078+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:32.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:32.226+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:32.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:32.564+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:32.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:32.881+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:33.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:33.045+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:33.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:33.199+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:33.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:33.600+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:33.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:33.925+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:34.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:34.052+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:34.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:34.232+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:34.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:34.580+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:34.692 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:34:34.689+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:34:34.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:34.910+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:35.029 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:35.027+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:35.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:35.237+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:35.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:35.602+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:35.925 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:35.923+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:36.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:36.057+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:36.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:36.200+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:36.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:36.645+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:36.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:36.924+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:37.076 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:37.075+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:37.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:37.164+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:37.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:37.665+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:37.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:37.890+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:38.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:38.065+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:38.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:38.189+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:38.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:38.697+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:38.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:38.855+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:39.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:39.062+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:39.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:39.189+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:39.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:39.670+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:39.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:39.839+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:40.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:40.107+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:40.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:40.222+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:40.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:40.662+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:40.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:40.832+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:41.075 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:41.073+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:41.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:41.183+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:41.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:41.647+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:41.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:41.882+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:42.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:42.059+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:42.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:42.180+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:42.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:42.612+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:42.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:42.901+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:43.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:43.093+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:43.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:43.182+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:43.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:43.571+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:43.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:43.933+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:44.094 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:44.093+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:44.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:44.171+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:44.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:44.562+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:44.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:44.908+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:45.062 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:45.061+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:45.155 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:45.153+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:45.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:45.578+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:45.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:45.873+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:46.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:46.057+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:46.178 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:46.177+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:46.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:46.588+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:46.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:46.866+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:47.109 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:47.108+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:47.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:47.158+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:47.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:47.600+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:47.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:47.843+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:48.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:34:48.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:34:48.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:48.117+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:48.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:48.139+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:48.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:48.595+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:48.862 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:48.861+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:49.101 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:49.100+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:49.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:49.123+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:49.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:49.546+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:49.708 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:34:49.705+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:34:49.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:49.895+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:50.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:50.125+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:50.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:50.135+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:50.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:50.524+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:50.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:50.911+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:51.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:51.138+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:51.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:51.148+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:51.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:51.482+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:51.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:51.947+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:52.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:52.101+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:52.117 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:52.114+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:52.445 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:52.443+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:52.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:52.958+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:53.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:53.066+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:53.143 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:53.141+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:53.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:53.478+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:53.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:53.915+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:54.057 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:54.055+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:54.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:54.161+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:54.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:54.502+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:54.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:54.897+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:55.097 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:55.095+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:55.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:55.170+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:55.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:55.542+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:55.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:55.877+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:56.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:56.108+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:56.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:56.219+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:56.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:56.587+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:56.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:56.903+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:57.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:57.121+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:57.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:57.172+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:57.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:57.581+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:57.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:57.882+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:58.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:58.132+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:58.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:58.142+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:58.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:58.572+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:58.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:58.863+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:59.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:34:59.120+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:59.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:34:59.181+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:59.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:34:59.556+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:34:59.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:34:59.896+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:00.125 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:00.122+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:00.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:00.162+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:00.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:00.558+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:00.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:00.857+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:01.099 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:01.096+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:01.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:01.177+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:01.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:01.556+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:01.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:01.868+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:02.057 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:02.055+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:02.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:02.162+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:02.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:02.529+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:02.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:02.871+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:03.069 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:03.066+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:03.133 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:03.130+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:03.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:03.558+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:03.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:03.837+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:04.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:04.084+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:04.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:04.095+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:04.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:04.595+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:04.724 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:35:04.722+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:35:04.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:04.841+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:05.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:05.077+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:05.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:05.093+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:05.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:05.560+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:05.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:05.867+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:06.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:06.029+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:06.054 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:06.052+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:06.518 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:06.516+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:06.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:06.818+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:07.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:07.005+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:07.097 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:07.094+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:07.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:07.537+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:07.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:07.808+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:08.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:08.010+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:08.147 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:08.144+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:08.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:08.558+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:08.793 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:08.790+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:09.032 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:09.030+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:09.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:09.181+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:09.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:09.598+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:09.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:09.773+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:10.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:10.036+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:10.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:10.225+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:10.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:10.643+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:10.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:10.823+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:11.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:11.004+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:11.179 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:11.177+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:11.693 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:11.691+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:11.814 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:11.811+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:12.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:12.034+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:12.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:12.171+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:12.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:12.732+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:12.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:12.823+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:12.998 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:12.996+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:13.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:13.172+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:13.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:13.702+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:13.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:13.827+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:14.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:14.023+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:14.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:14.217+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:14.696 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:14.694+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:14.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:14.856+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:15.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:15.010+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:15.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:15.204+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:15.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:15.731+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:15.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:15.897+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:16.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:16.052+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:16.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:16.168+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:16.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:16.744+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:16.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:16.920+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:17.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:17.014+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:17.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:17.176+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:17.707 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:17.704+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:17.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:17.882+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:18.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:18.045+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:18.172 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:35:18.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:35:18.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:18.183+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:18.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:18.662+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:18.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:18.849+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:19.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:19.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:19.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:19.194+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:19.680 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:19.675+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:19.740 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:35:19.737+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:35:19.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:19.884+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:20.086 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:20.084+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:20.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:20.175+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:20.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:20.718+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:20.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:20.875+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:21.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:21.103+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:21.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:21.139+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:21.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:21.710+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:21.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:21.919+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:22.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:22.136+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:22.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:22.147+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:22.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:22.702+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:22.875 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:22.873+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:23.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:23.155+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:23.198 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:23.195+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:23.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:23.661+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:23.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:23.916+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:24.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:24.154+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:24.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:24.245+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:24.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:24.668+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:24.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:24.932+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:25.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:25.164+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:25.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:25.271+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:25.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:25.647+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:25.900 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:25.898+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:26.136 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:26.135+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:26.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:26.261+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:26.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:26.634+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:26.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:26.919+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:27.122 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:27.120+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:27.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:27.304+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:27.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:27.587+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:27.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:27.876+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:28.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:28.157+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:28.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:28.299+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:28.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:28.563+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:28.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:28.887+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:29.172 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:29.170+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:29.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:29.298+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:29.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:29.553+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:29.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:29.840+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:30.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:30.144+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:30.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:30.313+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:30.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:30.600+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:30.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:30.799+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:31.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:31.152+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:31.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:31.279+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:31.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:31.565+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:31.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:31.816+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:32.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:32.179+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:32.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:32.328+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:32.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:32.541+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:32.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:32.861+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:33.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:33.183+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:33.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:33.298+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:33.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:33.493+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:33.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:33.883+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:34.201 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:34.199+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:34.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:34.301+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:34.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:34.525+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:34.755 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:35:34.753+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:35:34.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:34.932+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:35.178 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:35.177+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:35.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:35.295+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:35.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:35.574+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:35.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:35.896+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:36.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:36.218+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:36.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:36.329+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:36.605 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:36.604+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:36.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:36.913+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:37.209 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:37.208+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:37.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:37.322+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:37.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:37.599+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:37.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:37.885+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:38.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:38.200+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:38.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:38.356+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:38.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:38.610+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:38.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:38.932+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:39.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:39.200+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:39.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:39.309+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:39.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:39.588+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:39.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:39.930+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:40.207 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:40.205+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:40.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:40.329+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:40.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:40.616+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:40.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:40.922+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:41.181 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:41.179+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:41.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:41.279+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:41.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:41.658+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:41.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:41.919+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:42.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:42.209+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:42.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:42.230+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:42.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:42.628+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:42.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:42.879+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:43.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:43.170+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:43.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:43.226+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:43.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:43.596+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:43.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:43.925+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:44.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:44.143+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:44.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:44.270+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:44.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:44.564+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:44.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:44.938+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:45.190 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:45.188+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:45.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:45.255+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:45.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:45.610+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:45.934 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:45.932+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:46.174 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:46.172+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:46.210 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:46.207+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:46.612 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:46.609+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:46.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:46.901+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:47.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:47.185+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:47.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:47.213+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:47.579 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:47.576+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:47.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:47.930+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:48.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:48.192+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:48.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:48.212+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:48.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:35:48.295 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:35:48.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:48.611+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:48.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:48.884+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:49.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:49.163+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:49.249 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:49.246+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:49.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:49.607+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:49.771 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:35:49.769+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:35:49.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:49.901+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:50.120 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:50.117+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:50.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:50.292+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:50.648 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:50.646+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:50.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:50.897+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:51.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:51.108+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:51.303 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:51.301+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:51.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:51.645+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:51.919 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:51.916+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:52.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:52.080+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:52.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:52.314+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:52.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:52.636+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:52.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:52.936+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:53.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:53.081+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:53.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:53.348+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:53.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:53.644+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:53.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:53.946+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:54.070 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:54.067+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:54.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:54.326+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:54.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:54.634+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:54.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:54.975+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:55.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:55.032+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:55.352 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:55.349+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:55.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:55.622+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:55.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:55.960+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:56.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:56.018+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:56.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:56.308+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:56.649 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:56.647+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:56.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:56.967+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:57.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:57.000+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:57.299 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:57.297+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:57.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:57.597+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:57.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:57.939+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:57.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:57.974+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:58.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:58.322+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:58.578 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:58.576+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:58.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:58.906+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:59.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:35:59.020+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:59.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:35:59.309+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:59.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:35:59.609+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:35:59.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:35:59.869+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:00.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:00.056+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:00.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:00.331+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:00.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:00.612+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:00.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:00.846+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:01.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:01.022+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:01.341 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:01.339+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:01.661 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:01.658+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:01.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:01.877+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:02.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:02.044+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:02.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:02.312+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:02.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:02.674+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:02.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:02.846+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:03.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:03.037+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:03.320 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:03.318+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:03.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:03.629+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:03.855 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:03.853+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:04.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:04.043+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:04.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:04.362+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:04.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:04.643+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:04.784 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:36:04.781+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:36:04.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:04.825+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:05.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:05.059+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:05.385 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:05.382+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:05.678 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:05.676+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:05.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:05.780+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:06.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:06.025+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:06.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:06.353+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:06.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:06.697+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:06.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:06.760+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:07.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:07.000+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:07.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:07.337+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:07.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:07.693+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:07.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:07.758+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:08.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:08.048+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:08.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:08.363+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:08.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:08.697+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:08.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:08.764+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:09.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:09.083+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:09.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:09.386+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:09.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:09.661+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:09.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:09.748+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:10.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:10.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:10.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:10.362+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:10.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:10.685+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:10.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:10.777+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:11.045 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:11.043+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:11.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:11.376+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:11.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:11.720+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:11.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:11.794+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:12.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:12.091+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:12.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:12.351+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:12.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:12.723+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:12.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:12.779+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:13.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:13.096+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:13.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:13.324+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:13.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:13.753+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:13.824 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:13.823+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:14.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:14.146+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:14.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:14.328+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:14.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:14.793+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:14.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:14.856+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:15.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:15.156+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:15.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:15.341+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:15.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:15.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:15.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:15.856+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:16.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:16.129+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:16.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:16.298+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:16.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:16.818+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:16.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:16.871+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:17.112 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:17.111+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:17.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:17.295+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:17.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:17.784+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:17.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:17.863+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:18.111 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:18.109+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:18.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:18.277+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:18.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:36:18.405 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:36:18.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:18.759+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:18.833 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:18.832+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:19.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:19.138+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:19.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:19.305+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:19.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:19.732+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:19.799 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:36:19.798+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:36:19.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:19.865+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:20.104 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:20.103+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:20.328 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:20.327+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:20.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:20.692+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:20.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:20.879+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:21.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:21.069+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:21.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:21.279+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:21.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:21.649+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:21.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:21.908+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:22.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:22.080+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:22.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:22.295+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:22.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:22.655+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:22.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:22.926+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:23.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:23.126+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:23.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:23.332+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:23.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:23.681+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:23.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:23.927+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:24.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:24.169+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:24.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:24.364+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:24.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:24.648+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:24.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:24.880+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:25.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:25.192+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:25.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:25.374+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:25.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:25.681+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:25.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:25.887+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:26.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:26.143+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:26.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:26.357+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:26.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:26.658+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:26.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:26.907+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:27.124 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:27.122+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:27.381 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:27.380+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:27.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:27.631+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:27.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:27.950+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:28.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:28.105+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:28.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:28.429+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:28.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:28.608+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:28.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:28.901+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:29.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:29.111+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:29.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:29.415+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:29.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:29.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:29.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:29.898+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:30.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:30.113+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:30.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:30.395+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:30.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:30.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:30.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:30.907+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:31.079 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:31.077+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:31.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:31.353+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:31.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:31.589+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:31.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:31.908+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:32.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:32.048+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:32.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:32.373+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:32.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:32.612+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:32.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:32.893+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:33.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:33.016+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:33.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:33.400+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:33.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:33.568+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:33.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:33.877+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:34.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:34.047+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:34.412 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:34.409+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:34.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:34.603+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:34.815 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:36:34.813+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:36:34.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:34.918+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:35.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:35.074+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:35.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:35.410+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:35.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:35.598+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:35.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:35.900+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:36.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:36.063+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:36.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:36.443+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:36.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:36.563+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:36.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:36.878+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:37.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:37.048+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:37.450 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:37.447+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:37.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:37.542+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:37.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:37.919+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:38.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:38.047+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:38.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:38.457+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:38.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:38.532+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:38.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:38.915+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:39.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:39.003+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:39.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:39.485+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:39.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:39.561+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:39.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:39.896+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:39.956 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:39.954+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:40.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:40.529+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:40.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:40.604+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:40.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:40.901+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:40.974 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:40.971+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:41.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:41.508+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:41.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:41.636+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:41.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:41.865+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:41.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:41.955+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:42.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:42.519+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:42.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:42.648+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:42.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:42.853+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:42.948 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:42.946+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:43.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:43.554+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:43.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:43.614+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:43.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:43.822+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:43.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:43.911+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:44.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:44.580+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:44.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:44.636+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:44.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:44.838+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:44.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:44.886+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:45.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:45.571+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:45.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:45.669+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:45.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:45.806+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:45.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:45.859+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:46.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:46.561+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:46.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:46.664+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:46.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:46.817+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:46.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:46.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:47.603 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:47.600+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:47.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:47.677+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:47.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:47.776+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:47.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:47.778+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:48.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:36:48.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:36:48.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:48.603+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:48.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:48.640+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:48.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:48.750+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:48.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:48.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:49.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:49.598+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:49.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:49.641+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:49.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:49.773+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:49.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:49.789+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:49.817 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:36:49.815+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:36:50.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:50.612+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:50.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:50.619+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:50.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:50.783+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:50.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:50.787+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:51.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:51.596+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:51.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:51.600+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:51.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:51.746+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:51.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:51.768+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:52.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:52.594+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:52.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:52.609+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:52.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:52.771+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:52.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:52.775+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:53.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:53.560+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:53.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:53.649+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:53.727 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:53.725+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:53.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:53.779+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:54.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:54.512+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:54.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:54.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:54.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:54.730+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:54.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:54.768+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:55.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:55.500+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:55.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:55.620+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:55.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:55.766+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:55.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:55.804+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:56.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:56.472+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:56.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:56.629+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:56.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:56.722+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:56.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:56.828+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:57.472 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:57.470+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:57.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:57.612+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:57.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:57.770+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:57.798 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:57.796+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:58.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:58.454+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:58.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:58.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:58.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:58.758+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:58.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:58.839+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:59.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:36:59.416+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:59.694 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:36:59.692+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:59.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:36:59.761+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:36:59.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:36:59.794+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:00.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:00.420+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:00.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:00.645+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:00.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:00.728+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:00.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:00.754+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:01.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:01.442+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:01.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:01.669+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:01.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:01.731+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:01.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:01.775+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:02.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:02.427+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:02.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:02.642+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:02.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:02.745+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:02.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:02.749+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:03.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:03.417+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:03.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:03.647+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:03.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:03.772+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:03.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:03.772+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:04.382 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:04.379+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:04.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:04.633+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:04.774 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:04.772+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:04.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:04.819+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:04.832 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:37:04.830+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:37:05.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:05.351+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:05.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:05.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:05.776 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:05.774+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:05.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:05.816+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:06.357 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:06.355+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:06.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:06.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:06.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:06.812+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:06.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:06.812+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:07.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:07.354+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:07.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:07.615+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:07.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:07.796+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:07.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:07.829+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:08.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:08.323+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:08.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:08.656+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:08.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:08.755+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:08.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:08.807+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:09.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:09.294+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:09.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:09.661+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:09.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:09.771+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:09.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:09.779+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:10.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:10.291+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:10.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:10.679+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:10.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:10.744+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:10.802 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:10.800+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:11.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:11.285+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:11.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:11.644+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:11.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:11.762+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:11.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:11.804+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:12.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:12.332+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:12.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:12.640+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:12.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:12.803+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:12.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:12.853+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:13.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:13.331+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:13.606 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:13.605+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:13.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:13.786+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:13.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:13.843+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:14.309 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:14.307+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:14.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:14.564+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:14.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:14.778+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:14.849 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:14.848+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:15.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:15.337+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:15.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:15.598+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:15.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:15.782+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:15.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:15.895+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:16.323 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:16.322+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:16.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:16.608+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:16.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:16.810+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:16.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:16.880+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:17.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:17.310+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:17.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:17.602+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:17.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:17.784+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:17.912 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:17.911+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:18.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:18.345+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:18.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:18.646+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:18.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:37:18.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:37:18.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:18.808+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:18.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:18.953+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:19.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:19.309+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:19.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:19.679+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:19.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:19.841+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:19.848 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:37:19.846+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:37:19.935 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:19.933+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:20.326 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:20.325+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:20.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:20.707+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:20.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:20.798+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:20.973 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:20.972+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:21.310 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:21.308+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:21.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:21.753+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:21.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:21.773+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:22.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:22.004+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:22.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:22.258+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:22.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:22.762+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:22.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:22.777+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:22.959 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:22.956+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:23.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:23.254+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:23.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:23.749+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:23.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:23.814+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:23.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:23.975+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:24.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:24.221+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:24.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:24.743+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:24.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:24.840+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:24.972 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:24.970+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:25.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:25.213+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:25.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:25.752+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:25.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:25.872+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:26.021 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:26.019+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:26.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:26.222+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:26.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:26.718+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:26.923 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:26.921+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:27.059 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:27.057+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:27.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:27.173+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:27.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:27.705+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:27.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:27.890+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:28.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:28.058+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:28.163 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:28.160+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:28.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:28.727+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:28.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:28.841+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:29.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:29.024+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:29.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:29.178+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:29.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:29.763+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:29.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:29.883+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:30.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:30.005+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:30.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:30.166+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:30.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:30.783+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:30.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:30.924+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:31.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:31.027+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:31.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:31.185+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:31.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:31.773+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:31.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:31.903+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:32.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:32.041+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:32.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:32.152+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:32.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:32.756+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:32.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:32.896+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:33.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:33.041+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:33.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:33.125+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:33.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:33.799+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:33.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:33.914+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:33.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:33.994+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:34.158 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:34.156+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:34.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:34.766+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:34.850 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:37:34.848+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:37:34.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:34.897+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:35.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:35.023+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:35.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:35.184+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:35.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:35.738+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:35.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:35.858+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:36.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:35.999+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:36.192 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:36.189+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:36.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:36.716+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:36.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:36.834+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:37.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:37.014+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:37.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:37.221+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:37.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:37.728+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:37.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:37.876+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:38.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:38.050+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:38.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:38.204+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:38.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:38.772+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:38.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:38.871+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:39.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:39.045+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:39.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:39.229+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:39.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:39.810+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:39.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:39.831+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:40.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:40.063+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:40.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:40.225+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:40.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:40.777+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:40.849 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:40.847+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:41.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:41.019+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:41.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:41.227+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:41.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:41.786+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:41.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:41.859+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:42.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:42.035+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:42.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:42.269+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:42.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:42.768+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:42.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:42.833+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:43.000 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:42.998+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:43.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:43.227+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:43.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:43.787+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:43.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:43.833+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:44.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:44.044+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:44.238 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:44.236+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:44.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:44.787+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:44.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:44.829+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:45.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:45.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:45.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:45.200+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:45.783 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:45.781+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:45.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:45.819+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:46.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:46.066+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:46.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:46.172+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:46.743 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:46.741+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:46.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:46.789+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:47.099 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:47.096+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:47.162 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:47.160+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:47.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:47.744+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:47.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:47.795+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:48.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:48.080+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:48.130 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:48.128+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:48.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:48.709+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:48.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:37:48.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:37:48.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:48.840+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:49.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:49.075+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:49.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:49.093+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:49.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:49.707+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:49.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:49.806+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:49.865 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:37:49.863+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:37:50.053 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:50.051+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:50.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:50.070+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:50.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:50.668+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:50.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:50.825+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:51.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:51.034+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:51.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:51.057+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:51.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:51.622+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:51.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:51.854+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:52.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:52.056+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:52.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:52.085+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:52.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:52.578+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:52.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:52.839+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:53.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:53.034+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:53.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:53.111+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:53.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:53.615+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:53.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:53.829+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:54.049 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:54.047+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:54.145 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:54.143+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:54.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:54.659+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:54.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:54.826+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:55.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:55.043+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:55.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:55.182+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:55.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:55.641+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:55.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:55.806+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:56.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:56.011+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:56.219 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:56.218+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:56.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:56.676+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:56.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:56.826+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:57.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:57.059+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:57.254 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:57.253+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:57.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:57.658+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:57.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:57.799+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:58.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:58.080+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:58.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:58.229+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:58.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:58.631+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:58.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:58.765+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:59.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:37:59.126+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:59.275 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:37:59.274+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:59.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:37:59.606+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:37:59.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:37:59.769+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:00.085 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:00.083+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:00.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:00.297+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:00.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:00.578+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:00.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:00.764+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:01.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:01.039+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:01.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:01.330+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:01.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:01.622+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:01.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:01.780+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:02.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:02.008+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:02.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:02.353+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:02.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:02.618+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:02.767 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:02.766+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:03.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:03.024+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:03.403 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:03.402+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:03.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:03.607+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:03.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:03.760+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:03.979 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:03.978+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:04.421 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:04.420+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:04.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:04.559+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:04.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:04.771+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:04.881 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:38:04.880+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:38:05.012 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:05.010+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:05.422 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:05.420+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:05.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:05.579+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:05.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:05.732+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:06.004 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:06.003+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:06.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:06.388+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:06.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:06.588+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:06.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:06.720+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:07.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:07.030+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:07.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:07.383+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:07.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:07.618+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:07.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:07.761+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:08.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:08.059+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:08.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:08.412+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:08.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:08.585+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:08.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:08.811+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:09.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:09.079+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:09.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:09.368+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:09.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:09.570+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:09.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:09.795+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:10.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:10.036+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:10.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:10.401+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:10.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:10.538+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:10.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:10.784+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:11.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:11.056+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:11.394 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:11.393+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:11.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:11.554+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:11.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:11.768+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:12.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:12.033+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:12.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:12.366+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:12.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:12.549+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:12.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:12.806+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:13.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:13.011+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:13.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:13.368+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:13.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:13.573+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:13.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:13.826+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:14.031 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:14.029+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:14.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:14.366+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:14.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:14.530+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:14.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:14.814+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:15.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:15.066+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:15.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:15.360+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:15.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:15.566+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:15.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:15.795+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:16.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:16.050+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:16.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:16.369+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:16.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:16.523+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:16.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:16.797+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:17.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:17.037+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:17.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:17.410+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:17.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:17.524+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:17.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:17.813+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:18.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:18.050+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:18.428 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:18.425+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:18.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:18.493+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:18.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:18.822+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:18.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:38:18.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:38:19.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:19.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:19.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:19.473+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:19.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:19.521+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:19.788 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:19.786+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:19.886 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:38:19.883+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:38:20.126 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:20.123+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:20.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:20.491+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:20.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:20.492+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:20.826 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:20.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:21.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:21.146+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:21.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:21.453+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:21.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:21.539+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:21.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:21.782+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:22.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:22.165+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:22.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:22.405+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:22.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:22.493+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:22.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:22.807+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:23.145 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:23.142+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:23.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:23.371+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:23.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:23.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:23.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:23.810+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:24.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:24.185+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:24.329 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:24.327+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:24.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:24.556+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:24.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:24.838+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:25.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:25.166+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:25.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:25.315+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:25.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:25.547+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:25.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:25.882+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:26.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:26.187+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:26.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:26.266+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:26.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:26.525+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:26.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:26.928+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:27.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:27.177+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:27.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:27.305+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:27.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:27.504+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:27.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:27.978+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:28.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:28.222+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:28.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:28.270+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:28.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:28.530+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:29.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:29.028+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:29.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:29.247+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:29.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:29.268+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:29.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:29.528+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:30.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:30.058+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:30.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:30.251+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:30.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:30.263+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:30.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:30.514+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:31.037 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:31.035+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:31.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:31.248+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:31.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:31.292+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:31.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:31.517+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:32.002 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:31.999+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:32.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:32.237+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:32.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:32.332+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:32.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:32.487+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:33.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:33.014+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:33.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:33.203+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:33.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:33.377+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:33.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:33.477+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:34.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:34.018+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:34.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:34.177+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:34.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:34.411+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:34.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:34.497+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:34.902 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:38:34.899+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:38:35.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:35.052+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:35.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:35.191+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:35.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:35.382+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:35.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:35.509+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:36.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:36.088+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:36.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:36.221+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:36.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:36.423+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:36.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:36.509+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:37.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:37.083+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:37.232 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:37.230+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:37.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:37.456+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:37.551 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:37.549+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:38.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:38.095+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:38.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:38.218+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:38.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:38.500+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:38.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:38.545+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:39.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:39.053+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:39.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:39.231+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:39.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:39.454+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:39.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:39.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:40.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:40.048+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:40.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:40.254+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:40.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:40.464+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:40.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:40.550+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:41.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:41.097+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:41.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:41.290+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:41.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:41.442+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:41.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:41.538+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:42.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:42.119+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:42.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:42.314+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:42.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:42.433+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:42.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:42.552+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:43.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:43.080+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:43.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:43.288+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:43.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:43.473+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:43.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:43.507+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:44.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:44.064+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:44.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:44.277+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:44.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:44.438+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:44.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:44.510+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:45.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:45.079+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:45.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:45.252+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:45.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:45.486+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:45.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:45.535+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:46.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:46.063+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:46.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:46.295+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:46.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:46.438+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:46.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:46.542+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:47.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:47.053+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:47.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:47.315+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:47.423 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:47.420+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:47.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:47.534+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:48.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:48.098+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:48.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:48.353+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:48.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:48.462+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:48.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:48.566+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:48.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:38:48.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:38:49.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:49.131+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:49.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:49.328+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:49.417 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:49.415+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:49.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:49.540+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:49.918 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:38:49.915+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:38:50.119 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:50.117+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:50.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:50.307+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:50.387 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:50.386+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:50.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:50.502+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:51.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:51.089+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:51.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:51.287+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:51.340 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:51.339+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:51.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:51.478+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:52.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:52.139+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:52.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:52.319+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:52.325 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:52.324+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:52.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:52.466+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:53.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:53.136+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:53.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:53.276+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:53.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:53.339+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:53.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:53.466+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:54.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:54.111+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:54.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:54.241+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:54.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:54.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:54.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:54.512+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:55.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:55.119+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:55.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:55.210+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:55.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:55.400+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:55.521 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:55.519+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:56.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:56.169+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:56.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:56.215+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:56.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:56.424+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:56.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:56.553+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:57.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:57.192+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:57.248 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:57.247+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:57.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:57.468+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:57.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:57.517+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:58.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:58.185+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:58.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:58.269+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:58.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:58.452+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:58.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:58.531+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:59.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:38:59.219+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:59.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:38:59.265+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:59.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:38:59.447+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:38:59.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:38:59.549+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:00.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:00.203+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:00.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:00.259+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:00.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:00.473+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:00.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:00.545+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:01.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:01.171+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:01.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:01.212+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:01.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:01.504+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:01.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:01.514+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:02.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:02.202+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:02.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:02.257+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:02.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:02.497+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:02.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:02.534+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:03.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:03.162+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:03.268 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:03.267+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:03.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:03.520+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:03.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:03.562+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:04.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:04.137+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:04.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:04.259+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:04.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:04.512+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:04.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:04.567+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:04.934 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:39:04.931+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:39:05.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:05.093+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:05.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:05.257+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:05.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:05.557+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:05.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:05.542+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:06.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:06.103+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:06.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:06.281+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:06.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:06.521+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:06.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:06.577+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:07.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:07.087+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:07.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:07.254+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:07.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:07.525+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:07.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:07.566+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:08.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:08.108+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:08.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:08.287+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:08.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:08.526+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:08.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:08.577+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:09.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:09.113+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:09.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:09.289+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:09.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:09.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:09.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:09.541+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:10.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:10.066+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:10.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:10.276+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:10.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:10.509+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:10.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:10.544+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:11.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:11.056+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:11.324 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:11.322+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:11.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:11.559+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:11.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:11.591+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:12.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:12.017+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:12.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:12.366+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:12.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:12.588+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:12.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:12.595+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:12.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:12.969+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:13.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:13.374+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:13.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:13.549+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:13.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:13.607+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:14.020 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:14.018+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:14.331 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:14.328+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:14.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:14.500+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:14.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:14.558+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:15.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:15.005+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:15.314 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:15.311+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:15.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:15.525+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:15.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:15.536+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:16.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:16.050+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:16.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:16.281+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:16.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:16.524+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:16.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:16.582+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:17.073 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:17.070+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:17.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:17.250+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:17.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:17.548+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:17.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:17.585+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:18.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:18.102+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:18.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:18.227+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:18.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:18.565+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:18.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:18.579+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:19.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:39:19.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:39:19.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:19.139+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:19.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:19.257+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:19.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:19.541+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:19.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:19.562+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:19.949 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:39:19.948+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:39:20.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:20.103+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:20.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:20.276+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:20.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:20.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:20.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:20.582+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:21.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:21.105+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:21.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:21.261+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:21.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:21.538+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:21.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:21.550+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:22.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:22.103+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:22.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:22.241+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:22.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:22.549+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:22.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:22.584+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:23.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:23.118+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:23.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:23.259+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:23.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:23.501+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:23.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:23.611+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:24.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:24.121+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:24.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:24.213+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:24.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:24.545+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:24.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:24.603+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:25.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:25.090+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:25.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:25.254+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:25.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:25.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:25.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:25.622+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:26.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:26.049+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:26.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:26.228+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:26.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:26.525+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:26.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:26.616+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:27.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:27.020+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:27.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:27.193+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:27.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:27.552+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:27.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:27.643+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:28.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:28.007+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:28.148 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:28.146+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:28.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:28.582+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:28.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:28.605+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:28.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:28.989+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:29.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:29.154+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:29.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:29.617+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:29.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:29.641+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:30.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:30.010+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:30.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:30.150+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:30.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:30.577+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:30.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:30.670+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:31.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:31.037+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:31.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:31.185+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:31.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:31.589+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:31.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:31.627+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:31.994 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:31.992+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:32.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:32.154+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:32.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:32.602+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:32.612 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:32.610+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:32.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:32.952+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:33.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:33.135+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:33.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:33.562+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:33.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:33.609+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:33.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:33.946+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:34.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:34.104+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:34.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:34.528+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:34.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:34.616+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:34.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:34.916+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:34.955 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:39:34.953+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:39:35.106 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:35.104+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:35.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:35.528+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:35.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:35.619+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:35.908 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:35.906+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:36.084 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:36.082+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:36.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:36.498+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:36.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:36.630+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:36.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:36.953+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:37.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:37.125+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:37.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:37.526+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:37.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:37.581+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:37.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:37.909+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:38.132 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:38.130+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:38.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:38.498+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:38.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:38.573+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:38.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:38.883+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:39.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:39.084+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:39.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:39.489+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:39.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:39.551+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:39.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:39.922+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:40.087 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:40.085+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:40.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:40.477+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:40.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:40.539+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:40.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:40.872+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:41.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:41.105+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:41.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:41.514+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:41.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:41.528+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:41.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:41.838+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:42.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:42.132+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:42.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:42.529+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:42.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:42.565+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:42.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:42.828+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:43.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:43.179+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:43.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:43.522+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:43.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:43.540+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:43.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:43.781+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:44.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:44.133+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:44.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:44.493+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:44.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:44.557+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:44.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:44.748+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:45.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:45.178+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:45.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:45.444+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:45.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:45.541+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:45.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:45.729+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:46.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:46.133+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:46.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:46.484+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:46.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:46.551+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:46.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:46.702+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:47.153 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:47.151+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:47.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:47.475+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:47.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:47.513+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:47.731 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:47.729+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:48.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:48.122+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:48.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:48.426+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:48.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:48.513+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:48.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:48.713+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:49.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:39:49.145 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:39:49.154 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:49.153+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:49.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:49.391+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:49.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:49.513+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:49.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:49.670+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:49.960 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:39:49.957+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:39:50.127 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:50.125+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:50.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:50.385+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:50.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:50.497+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:50.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:50.693+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:51.119 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:51.118+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:51.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:51.381+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:51.478 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:51.476+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:51.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:51.716+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:52.093 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:52.091+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:52.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:52.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:52.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:52.516+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:52.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:52.743+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:53.066 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:53.064+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:53.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:53.356+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:53.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:53.528+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:53.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:53.742+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:54.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:54.044+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:54.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:54.355+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:54.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:54.532+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:54.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:54.697+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:54.996 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:54.993+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:55.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:55.359+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:55.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:55.516+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:55.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:55.708+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:55.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:55.969+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:56.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:56.345+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:56.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:56.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:56.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:56.729+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:56.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:56.976+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:57.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:57.300+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:57.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:57.565+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:57.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:57.725+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:58.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:58.005+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:58.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:58.331+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:58.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:58.520+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:58.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:58.734+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:58.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:39:58.978+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:59.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:39:59.341+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:59.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:39:59.533+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:39:59.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:39:59.717+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:00.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:00.003+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:00.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:00.328+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:00.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:00.491+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:00.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:00.671+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:00.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:00.981+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:01.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:01.323+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:01.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:01.523+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:01.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:01.692+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:02.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:01.997+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:02.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:02.346+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:02.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:02.569+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:02.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:02.727+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:03.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:03.006+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:03.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:03.338+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:03.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:03.573+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:03.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:03.690+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:04.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:04.024+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:04.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:04.330+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:04.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:04.527+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:04.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:04.686+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:04.972 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:40:04.969+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:40:05.048 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:05.046+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:05.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:05.324+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:05.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:05.541+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:05.686 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:05.684+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:06.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:06.006+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:06.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:06.365+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:06.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:06.589+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:06.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:06.734+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:06.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:06.987+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:07.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:07.396+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:07.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:07.598+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:07.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:07.723+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:07.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:07.966+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:08.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:08.419+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:08.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:08.617+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:08.751 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:08.749+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:08.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:08.945+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:09.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:09.387+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:09.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:09.599+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:09.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:09.767+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:09.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:09.985+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:10.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:10.386+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:10.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:10.628+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:10.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:10.764+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:10.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:10.949+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:11.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:11.348+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:11.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:11.591+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:11.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:11.795+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:11.904 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:11.902+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:12.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:12.302+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:12.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:12.581+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:12.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:12.817+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:12.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:12.856+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:13.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:13.332+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:13.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:13.535+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:13.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:13.829+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:13.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:13.872+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:14.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:14.378+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:14.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:14.561+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:14.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:14.809+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:14.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:14.892+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:15.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:15.409+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:15.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:15.594+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:15.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:15.814+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:15.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:15.877+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:16.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:16.384+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:16.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:16.564+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:16.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:16.802+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:16.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:16.866+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:17.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:17.373+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:17.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:17.585+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:17.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:17.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:17.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:17.830+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:18.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:18.343+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:18.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:18.572+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:18.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:18.857+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:18.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:18.870+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:19.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:40:19.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:40:19.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:19.314+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:19.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:19.567+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:19.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:19.831+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:19.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:19.865+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:19.988 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:40:19.985+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:40:20.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:20.342+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:20.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:20.569+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:20.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:20.828+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:20.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:20.874+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:21.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:21.310+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:21.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:21.530+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:21.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:21.819+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:21.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:21.881+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:22.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:22.268+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:22.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:22.545+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:22.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:22.803+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:22.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:22.927+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:23.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:23.292+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:23.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:23.553+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:23.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:23.802+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:23.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:23.905+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:24.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:24.312+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:24.550 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:24.548+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:24.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:24.761+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:24.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:24.889+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:25.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:25.269+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:25.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:25.538+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:25.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:25.712+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:25.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:25.854+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:26.223 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:26.220+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:26.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:26.586+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:26.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:26.735+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:26.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:26.834+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:27.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:27.264+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:27.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:27.538+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:27.784 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:27.782+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:27.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:27.792+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:28.273 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:28.272+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:28.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:28.549+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:28.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:28.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:28.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:28.841+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:29.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:29.260+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:29.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:29.587+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:29.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:29.855+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:29.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:29.863+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:30.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:30.217+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:30.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:30.554+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:30.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:30.868+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:30.879 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:30.877+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:31.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:31.173+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:31.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:31.603+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:31.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:31.874+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:31.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:31.918+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:32.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:32.156+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:32.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:32.593+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:32.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:32.916+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:32.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:32.948+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:33.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:33.181+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:33.622 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:33.621+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:33.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:33.890+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:33.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:33.973+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:34.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:34.216+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:34.577 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:34.576+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:34.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:34.884+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:34.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:34.998+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:35.003 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:40:35.001+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:40:35.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:35.174+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:35.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:35.605+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:35.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:35.838+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:36.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:36.015+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:36.191 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:36.189+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:36.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:36.616+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:36.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:36.805+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:36.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:36.981+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:37.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:37.235+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:37.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:37.633+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:37.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:37.824+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:37.953 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:37.952+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:38.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:38.225+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:38.615 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:38.614+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:38.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:38.792+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:38.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:38.913+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:39.236 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:39.235+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:39.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:39.657+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:39.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:39.836+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:39.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:39.938+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:40.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:40.202+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:40.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:40.660+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:40.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:40.798+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:40.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:40.901+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:41.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:41.190+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:41.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:41.664+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:41.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:41.770+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:41.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:41.899+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:42.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:42.199+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:42.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:42.672+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:42.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:42.790+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:42.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:42.912+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:43.158 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:43.156+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:43.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:43.645+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:43.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:43.795+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:43.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:43.864+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:44.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:44.192+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:44.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:44.666+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:44.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:44.836+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:44.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:44.842+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:45.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:45.149+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:45.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:45.689+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:45.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:45.820+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:45.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:45.875+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:46.113 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:46.110+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:46.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:46.699+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:46.862 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:46.859+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:46.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:46.876+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:47.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:47.064+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:47.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:47.741+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:47.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:47.861+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:47.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:47.914+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:48.106 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:48.104+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:48.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:48.733+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:48.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:48.905+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:48.911 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:48.909+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:49.140 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:49.137+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:49.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:40:49.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:40:49.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:49.698+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:49.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:49.861+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:49.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:49.925+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:50.015 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:40:50.012+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:40:50.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:50.124+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:50.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:50.656+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:50.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:50.838+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:50.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:50.932+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:51.081 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:51.078+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:51.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:51.634+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:51.818 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:51.815+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:51.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:51.890+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:52.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:52.062+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:52.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:52.644+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:52.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:52.772+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:52.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:52.893+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:53.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:53.068+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:53.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:53.693+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:53.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:53.819+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:53.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:53.929+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:54.066 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:54.063+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:54.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:54.649+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:54.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:54.863+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:54.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:54.952+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:55.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:55.045+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:55.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:55.614+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:55.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:55.893+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:55.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:55.986+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:56.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:56.070+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:56.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:56.617+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:56.885 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:56.883+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:56.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:56.978+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:57.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:57.036+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:57.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:57.664+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:57.860 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:57.857+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:57.938 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:57.936+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:58.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:58.023+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:58.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:58.629+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:58.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:58.816+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:58.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:58.891+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:59.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:40:59.040+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:59.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:40:59.630+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:59.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:40:59.805+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:40:59.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:40:59.867+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:00.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:00.055+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:00.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:00.672+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:00.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:00.843+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:00.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:00.859+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:01.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:01.027+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:01.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:01.705+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:01.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:01.815+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:01.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:01.891+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:02.042 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:02.040+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:02.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:02.695+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:02.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:02.833+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:02.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:02.923+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:03.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:03.058+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:03.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:03.710+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:03.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:03.847+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:03.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:03.971+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:04.027 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:04.025+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:04.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:04.697+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:04.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:04.809+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:04.991 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:04.989+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:04.997 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:04.995+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:05.023 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:41:05.021+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:41:05.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:05.671+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:05.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:05.836+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:05.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:05.949+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:06.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:06.031+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:06.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:06.713+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:06.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:06.846+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:06.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:06.944+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:07.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:07.076+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:07.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:07.678+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:07.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:07.884+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:07.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:07.950+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:08.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:08.034+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:08.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:08.672+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:08.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:08.874+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:08.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:08.953+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:09.061 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:09.058+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:09.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:09.641+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:09.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:09.906+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:09.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:09.912+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:10.107 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:10.105+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:10.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:10.640+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:10.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:10.898+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:10.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:10.938+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:11.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:11.075+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:11.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:11.670+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:11.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:11.872+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:11.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:11.959+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:12.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:12.041+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:12.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:12.707+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:12.902 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:12.900+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:12.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:12.976+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:13.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:13.055+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:13.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:13.708+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:13.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:13.861+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:13.952 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:13.949+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:14.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:14.039+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:14.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:14.725+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:14.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:14.870+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:14.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:14.981+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:15.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:15.006+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:15.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:15.738+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:15.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:15.854+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:15.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:15.965+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:16.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:16.056+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:16.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:16.749+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:16.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:16.813+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:16.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:16.954+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:17.018 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:17.016+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:17.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:17.755+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:17.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:17.776+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:17.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:17.943+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:18.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:18.027+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:18.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:18.774+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:18.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:18.816+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:18.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:18.960+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:19.069 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:19.067+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:19.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:41:19.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:41:19.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:19.773+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:19.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:19.819+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:19.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:19.931+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:20.039 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:41:20.036+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:41:20.117 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:20.115+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:20.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:20.735+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:20.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:20.860+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:20.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:20.932+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:21.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:21.126+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:21.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:21.744+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:21.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:21.828+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:21.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:21.982+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:22.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:22.173+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:22.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:22.713+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:22.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:22.792+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:23.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:23.005+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:23.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:23.212+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:23.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:23.670+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:23.820 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:23.819+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:23.979 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:23.978+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:24.251 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:24.250+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:24.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:24.684+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:24.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:24.811+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:25.010 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:25.008+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:25.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:25.250+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:25.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:25.682+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:25.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:25.800+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:26.017 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:26.016+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:26.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:26.233+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:26.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:26.728+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:26.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:26.786+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:26.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:26.997+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:27.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:27.186+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:27.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:27.713+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:27.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:27.747+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:27.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:27.956+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:28.185 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:28.184+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:28.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:28.723+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:28.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:28.764+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:28.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:28.954+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:29.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:29.166+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:29.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:29.719+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:29.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:29.763+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:29.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:29.926+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:30.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:30.209+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:30.739 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:30.738+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:30.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:30.768+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:30.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:30.956+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:31.169 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:31.167+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:31.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:31.741+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:31.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:31.753+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:31.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:31.914+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:32.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:32.187+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:32.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:32.760+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:32.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:32.801+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:32.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:32.965+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:33.235 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:33.233+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:33.720 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:33.718+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:33.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:33.831+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:34.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:33.999+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:34.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:34.247+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:34.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:34.738+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:34.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:34.784+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:34.976 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:34.974+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:35.055 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:41:35.052+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:41:35.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:35.281+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:35.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:35.727+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:35.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:35.825+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:35.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:35.966+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:36.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:36.255+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:36.753 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:36.751+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:36.795 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:36.792+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:37.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:37.003+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:37.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:37.282+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:37.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:37.789+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:37.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:37.832+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:38.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:38.001+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:38.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:38.258+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:38.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:38.790+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:38.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:38.864+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:38.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:38.959+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:39.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:39.303+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:39.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:39.784+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:39.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:39.823+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:39.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:39.948+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:40.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:40.328+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:40.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:40.742+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:40.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:40.834+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:40.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:40.931+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:41.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:41.344+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:41.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:41.697+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:41.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:41.808+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:41.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:41.882+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:42.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:42.389+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:42.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:42.746+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:42.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:42.803+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:42.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:42.861+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:43.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:43.415+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:43.713 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:43.711+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:43.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:43.788+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:43.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:43.864+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:44.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:44.383+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:44.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:44.732+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:44.765 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:44.762+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:44.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:44.863+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:45.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:45.362+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:45.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:45.755+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:45.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:45.775+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:45.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:45.898+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:46.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:46.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:46.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:46.743+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:46.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:46.772+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:46.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:46.875+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:47.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:47.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:47.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:47.758+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:47.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:47.815+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:47.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:47.865+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:48.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:48.386+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:48.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:48.735+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:48.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:48.836+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:48.858 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:48.855+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:49.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:49.415+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:49.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:41:49.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:41:49.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:49.767+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:49.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:49.848+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:49.887 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:49.885+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:50.062 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:41:50.059+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:41:50.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:50.442+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:50.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:50.730+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:50.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:50.799+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:50.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:50.836+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:51.419 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:51.417+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:51.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:51.777+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:51.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:51.808+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:51.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:51.837+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:52.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:52.397+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:52.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:52.774+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:52.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:52.785+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:52.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:52.826+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:53.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:53.358+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:53.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:53.768+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:53.856 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:53.797+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:53.870 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:53.867+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:54.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:54.404+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:54.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:54.805+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:54.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:54.805+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:54.822 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:54.820+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:55.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:55.446+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:55.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:55.794+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:55.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:55.831+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:55.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:55.839+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:56.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:56.431+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:56.794 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:56.792+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:56.826 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:56.823+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:56.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:56.835+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:57.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:57.393+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:57.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:57.762+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:57.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:57.815+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:57.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:57.816+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:58.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:58.433+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:58.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:58.753+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:58.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:58.773+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:58.818 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:58.816+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:59.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:41:59.415+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:59.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:41:59.782+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:59.800 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:41:59.798+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:41:59.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:41:59.818+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:00.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:00.368+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:00.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:00.770+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:00.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:00.803+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:00.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:00.832+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:01.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:01.407+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:01.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:01.761+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:01.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:01.788+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:01.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:01.788+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:02.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:02.374+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:02.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:02.744+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:02.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:02.754+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:02.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:02.784+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:03.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:03.416+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:03.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:03.718+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:03.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:03.787+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:03.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:03.818+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:04.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:04.394+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:04.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:04.815+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:04.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:04.708+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:04.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:04.849+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:05.078 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:42:05.075+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:42:05.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:05.349+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:05.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:05.684+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:05.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:05.840+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:05.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:05.867+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:06.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:06.376+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:06.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:06.680+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:06.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:06.821+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:06.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:06.830+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:07.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:07.344+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:07.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:07.720+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:07.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:07.830+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:07.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:07.842+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:08.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:08.325+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:08.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:08.684+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:08.796 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:08.794+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:08.825 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:08.823+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:09.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:09.350+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:09.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:09.653+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:09.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:09.778+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:09.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:09.844+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:10.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:10.344+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:10.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:10.643+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:10.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:10.783+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:10.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:10.880+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:11.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:11.310+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:11.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:11.644+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:11.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:11.821+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:11.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:11.849+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:12.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:12.300+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:12.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:12.662+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:12.843 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:12.841+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:12.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:12.857+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:13.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:13.343+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:13.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:13.638+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:13.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:13.818+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:13.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:13.861+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:14.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:14.370+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:14.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:14.612+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:14.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:14.840+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:14.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:14.869+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:15.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:15.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:15.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:15.566+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:15.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:15.846+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:15.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:15.904+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:16.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:16.358+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:16.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:16.592+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:16.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:16.878+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:16.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:16.886+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:17.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:17.333+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:17.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:17.619+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:17.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:17.852+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:17.893 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:17.891+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:18.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:18.325+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:18.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:18.592+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:18.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:18.838+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:18.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:18.909+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:19.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:19.364+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:19.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:19.637+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:19.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:42:19.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:42:19.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:19.860+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:19.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:19.943+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:20.094 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:42:20.092+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:42:20.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:20.337+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:20.642 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:20.640+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:20.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:20.832+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:20.983 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:20.981+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:21.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:21.296+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:21.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:21.644+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:21.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:21.821+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:21.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:21.969+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:22.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:22.307+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:22.609 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:22.607+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:22.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:22.870+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:22.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:22.926+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:23.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:23.336+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:23.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:23.647+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:23.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:23.844+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:23.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:23.913+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:24.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:24.361+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:24.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:24.694+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:24.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:24.805+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:24.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:24.905+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:25.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:25.312+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:25.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:25.737+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:25.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:25.798+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:25.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:25.904+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:26.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:26.352+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:26.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:26.728+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:26.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:26.846+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:26.939 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:26.936+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:27.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:27.323+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:27.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:27.735+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:27.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:27.843+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:27.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:27.978+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:28.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:28.348+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:28.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:28.713+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:28.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:28.825+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:28.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:28.965+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:29.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:29.333+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:29.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:29.730+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:29.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:29.875+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:29.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:29.957+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:30.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:30.342+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:30.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:30.732+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:30.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:30.830+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:30.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:30.960+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:31.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:31.387+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:31.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:31.704+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:31.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:31.791+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:31.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:31.938+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:32.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:32.343+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:32.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:32.716+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:32.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:32.767+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:32.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:32.913+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:33.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:33.363+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:33.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:33.704+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:33.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:33.810+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:33.884 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:33.881+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:34.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:34.376+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:34.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:34.688+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:34.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:34.771+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:34.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:34.929+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:35.096 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:42:35.093+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:42:35.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:35.399+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:35.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:35.660+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:35.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:35.747+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:35.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:35.889+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:36.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:36.375+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:36.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:36.634+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:36.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:36.708+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:36.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:36.923+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:37.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:37.356+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:37.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:37.665+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:37.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:37.727+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:37.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:37.883+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:38.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:38.351+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:38.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:38.625+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:38.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:38.765+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:38.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:38.860+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:39.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:39.314+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:39.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:39.596+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:39.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:39.749+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:39.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:39.814+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:40.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:40.290+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:40.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:40.641+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:40.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:40.793+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:40.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:40.794+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:41.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:41.287+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:41.597 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:41.595+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:41.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:41.770+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:41.794 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:41.791+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:42.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:42.251+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:42.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:42.571+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:42.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:42.733+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:42.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:42.743+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:43.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:43.216+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:43.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:43.606+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:43.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:43.730+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:43.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:43.735+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:44.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:44.214+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:44.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:44.576+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:44.688 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:44.686+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:44.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:44.764+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:45.201 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:45.199+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:45.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:45.557+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:45.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:45.700+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:45.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:45.726+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:46.222 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:46.220+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:46.513 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:46.510+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:46.708 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:46.706+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:46.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:46.721+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:47.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:47.218+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:47.538 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:47.535+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:47.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:47.701+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:47.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:47.707+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:48.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:48.172+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:48.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:48.509+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:48.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:48.692+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:48.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:48.722+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:49.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:49.194+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:49.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:49.484+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:49.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:49.709+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:49.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:49.715+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:49.834 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:42:49.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:42:50.112 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:42:50.109+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:42:50.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:50.222+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:50.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:50.478+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:50.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:50.686+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:50.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:50.747+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:51.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:51.216+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:51.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:51.525+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:51.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:51.639+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:51.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:51.764+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:52.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:52.261+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:52.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:52.504+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:52.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:52.663+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:52.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:52.802+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:53.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:53.294+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:53.501 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:53.498+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:53.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:53.632+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:53.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:53.761+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:54.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:54.247+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:54.540 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:54.537+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:54.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:54.600+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:54.787 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:54.785+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:55.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:55.279+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:55.495 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:55.492+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:55.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:55.567+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:55.816 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:55.814+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:56.276 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:56.274+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:56.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:56.461+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:56.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:56.571+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:56.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:56.776+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:57.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:57.228+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:57.445 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:57.443+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:57.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:57.528+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:57.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:57.787+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:58.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:58.186+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:58.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:58.407+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:58.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:58.515+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:58.805 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:58.802+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:59.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:42:59.159+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:59.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:42:59.373+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:59.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:42:59.503+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:42:59.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:42:59.790+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:00.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:00.160+0000 7f72c425d700 -1 osd.5 119 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:00.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:00.385+0000 7f389e18e700 -1 osd.4 119 get_health_metrics reporting 77 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:00.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:00.536+0000 7f596d92c700 -1 osd.6 119 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:00.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:00.789+0000 7f6e44c9f700 -1 osd.7 119 get_health_metrics reporting 56 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:01.008 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T03:43:01.006+0000 7fd50f583700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:43:01.023 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T03:43:01.006+0000 7fd50f583700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:43:01.045 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T03:43:01.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:01.223+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:01.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:01.414+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:01.493 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:01.491+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:01.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:01.799+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:02.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:02.240+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:02.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:02.433+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:02.483 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:02.481+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:02.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:02.783+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:03.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:03.238+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:03.447 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:03.446+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:03.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:03.468+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:03.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:03.811+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:04.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:04.247+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:04.420 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:04.418+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:04.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:04.467+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:04.821 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:04.820+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:05.115 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:43:05.113+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:43:05.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:05.260+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:05.434 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:05.433+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:05.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:05.517+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:05.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:05.839+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:06.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:06.386+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:06.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:06.283+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:06.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:06.506+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:06.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:06.806+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:07.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:07.303+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:07.356 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:07.355+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:07.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:07.487+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:07.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:07.762+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:08.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:08.261+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:08.343 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:08.342+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:08.504 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:08.502+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:08.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:08.757+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:09.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:09.239+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:09.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:09.358+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:09.532 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:09.531+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:09.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:09.784+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:10.255 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:10.253+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:10.391 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:10.389+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:10.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:10.516+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:10.765 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:10.763+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:11.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:11.251+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:11.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:11.352+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:11.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:11.470+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:11.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:11.794+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:12.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:12.223+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:12.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:12.304+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:12.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:12.436+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:12.749 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:12.748+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:13.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:13.232+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:13.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:13.284+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:13.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:13.438+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:13.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:13.703+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:14.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:14.255+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:14.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:14.258+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:14.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:14.466+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:14.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:14.716+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:15.292 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:15.291+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:15.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:15.294+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:15.487 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:15.486+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:15.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:15.671+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:16.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:16.260+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:16.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:16.291+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:16.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:16.450+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:16.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:16.663+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:17.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:17.224+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:17.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:17.279+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:17.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:17.467+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:17.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:17.649+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:18.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:18.183+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:18.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:18.320+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:18.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:18.515+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:18.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:18.658+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:19.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:19.158+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:19.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:19.295+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:19.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:19.508+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:19.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:19.672+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:19.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:43:19.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:43:20.131 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:43:20.129+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:43:20.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:20.164+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:20.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:20.292+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:20.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:20.558+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:20.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:20.663+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:21.126 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:21.123+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:21.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:21.334+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:21.589 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:21.586+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:21.639 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:21.636+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:22.175 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:22.172+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:22.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:22.308+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:22.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:22.568+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:22.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:22.680+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:23.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:23.154+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:23.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:23.272+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:23.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:23.611+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:23.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:23.667+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:24.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:24.200+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:24.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:24.244+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:24.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:24.599+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:24.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:24.716+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:25.213 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:25.210+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:25.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:25.273+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:25.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:25.608+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:25.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:25.689+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:26.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:26.243+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:26.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:26.270+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:26.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:26.560+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:26.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:26.676+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:27.198 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:27.195+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:27.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:27.257+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:27.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:27.532+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:27.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:27.713+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:28.156 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:28.154+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:28.247 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:28.245+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:28.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:28.555+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:28.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:28.710+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:29.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:29.134+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:29.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:29.280+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:29.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:29.588+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:29.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:29.741+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:30.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:30.110+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:30.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:30.271+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:30.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:30.543+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:30.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:30.733+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:31.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:31.147+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:31.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:31.247+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:31.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:31.573+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:31.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:31.768+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:32.139 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:32.137+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:32.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:32.295+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:32.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:32.543+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:32.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:32.784+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:33.150 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:33.148+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:33.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:33.317+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:33.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:33.541+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:33.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:33.773+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:34.137 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:34.135+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:34.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:34.317+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:34.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:34.591+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:34.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:34.787+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:35.147 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:43:35.146+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:43:35.166 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:35.164+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:35.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:35.363+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:35.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:35.575+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:35.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:35.826+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:36.167 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:36.165+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:36.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:36.328+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:36.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:36.566+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:36.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:36.845+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:37.171 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:37.169+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:37.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:37.325+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:37.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:37.535+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:37.861 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:37.858+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:38.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:38.185+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:38.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:38.296+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:38.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:38.583+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:38.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:38.869+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:39.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:39.142+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:39.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:39.261+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:39.558 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:39.556+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:39.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:39.850+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:40.104 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:40.101+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:40.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:40.304+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:40.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:40.513+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:40.815 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:40.813+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:41.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:41.149+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:41.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:41.284+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:41.515 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:41.513+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:41.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:41.779+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:42.180 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:42.178+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:42.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:42.261+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:42.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:42.523+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:42.828 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:42.826+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:43.200 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:43.198+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:43.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:43.268+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:43.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:43.561+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:43.791 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:43.789+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:44.170 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:44.168+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:44.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:44.312+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:44.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:44.600+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:44.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:44.756+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:45.177 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:45.175+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:45.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:45.304+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:45.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:45.552+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:45.763 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:45.761+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:46.212 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:46.210+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:46.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:46.304+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:46.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:46.584+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:46.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:46.803+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:47.169 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:47.166+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:47.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:47.282+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:47.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:47.546+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:47.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:47.767+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:48.142 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:48.140+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:48.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:48.324+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:48.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:48.567+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:48.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:48.739+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:49.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:49.126+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:49.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:49.354+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:49.552 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:49.549+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:49.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:49.731+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:50.149 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:50.147+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:50.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:43:50.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:43:50.163 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:43:50.160+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:43:50.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:50.351+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:50.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:50.596+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:50.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:50.723+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:51.182 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:51.180+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:51.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:51.385+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:51.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:51.627+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:51.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:51.754+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:52.188 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:52.186+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:52.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:52.355+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:52.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:52.669+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:52.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:52.760+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:53.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:53.137+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:53.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:53.369+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:53.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:53.657+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:53.726 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:53.725+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:54.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:54.112+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:54.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:54.354+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:54.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:54.697+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:54.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:54.699+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:55.095 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:55.093+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:55.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:55.322+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:55.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:55.655+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:55.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:55.709+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:56.098 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:56.096+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:56.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:56.299+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:56.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:56.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:56.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:56.688+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:57.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:57.071+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:57.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:57.315+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:57.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:57.636+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:57.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:57.729+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:58.042 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:58.040+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:58.322 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:58.320+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:58.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:58.600+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:58.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:58.701+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:58.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:58.994+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:59.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:43:59.300+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:59.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:43:59.596+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:59.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:43:59.674+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:43:59.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:43:59.949+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:00.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:00.294+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:00.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:00.591+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:00.673 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:00.671+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:00.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:00.964+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:01.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:01.344+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:01.623 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:01.622+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:01.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:01.689+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:01.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:01.982+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:02.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:02.311+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:02.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:02.599+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:02.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:02.723+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:02.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:02.971+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:03.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:03.333+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:03.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:03.562+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:03.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:03.700+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:03.925 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:03.923+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:04.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:04.348+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:04.546 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:04.544+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:04.680 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:04.678+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:04.886 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:04.884+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:05.179 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:44:05.176+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:44:05.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:05.334+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:05.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:05.516+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:05.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:05.663+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:05.923 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:05.922+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:06.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:06.326+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:06.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:06.519+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:06.660 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:06.658+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:06.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:06.933+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:07.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:07.322+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:07.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:07.564+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:07.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:07.706+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:07.953 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:07.952+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:08.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:08.285+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:08.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:08.526+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:08.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:08.723+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:08.982 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:08.980+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:09.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:09.243+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:09.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:09.484+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:09.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:09.699+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:09.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:09.976+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:10.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:10.210+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:10.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:10.532+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:10.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:10.673+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:10.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:10.966+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:11.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:11.204+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:11.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:11.495+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:11.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:11.643+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:11.920 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:11.918+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:12.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:12.252+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:12.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:12.507+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:12.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:12.616+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:12.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:12.919+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:13.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:13.290+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:13.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:13.539+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:13.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:13.635+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:13.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:13.901+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:14.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:14.257+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:14.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:14.510+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:14.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:14.623+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:14.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:14.923+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:15.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:15.301+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:15.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:15.512+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:15.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:15.589+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:15.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:15.919+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:16.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:16.298+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:16.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:16.471+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:16.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:16.563+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:16.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:16.875+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:17.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:17.276+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:17.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:17.501+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:17.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:17.522+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:17.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:17.827+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:18.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:18.321+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:18.512 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:18.510+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:18.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:18.550+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:18.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:18.823+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:19.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:19.363+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:19.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:19.488+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:19.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:19.517+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:19.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:19.829+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:20.195 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:44:20.192+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:44:20.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:44:20.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:44:20.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:20.326+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:20.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:20.475+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:20.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:20.483+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:20.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:20.812+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:21.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:21.309+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:21.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:21.498+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:21.520 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:21.517+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:21.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:21.801+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:22.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:22.346+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:22.472 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:22.469+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:22.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:22.514+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:22.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:22.806+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:23.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:23.365+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:23.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:23.439+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:23.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:23.470+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:23.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:23.768+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:24.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:24.346+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:24.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:24.469+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:24.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:24.470+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:24.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:24.758+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:25.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:25.337+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:25.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:25.426+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:25.462 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:25.460+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:25.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:25.791+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:26.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:26.382+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:26.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:26.397+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:26.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:26.496+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:26.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:26.792+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:27.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:27.403+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:27.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:27.416+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:27.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:27.527+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:27.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:27.789+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:28.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:28.413+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:28.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:28.432+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:28.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:28.533+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:28.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:28.827+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:29.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:29.375+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:29.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:29.428+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:29.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:29.515+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:29.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:29.856+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:30.396 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:30.394+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:30.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:30.409+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:30.530 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:30.528+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:30.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:30.888+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:31.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:31.375+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:31.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:31.419+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:31.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:31.532+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:31.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:31.860+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:32.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:32.387+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:32.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:32.444+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:32.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:32.548+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:32.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:32.905+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:33.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:33.367+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:33.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:33.456+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:33.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:33.553+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:33.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:33.866+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:34.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:34.336+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:34.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:34.469+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:34.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:34.579+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:34.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:34.856+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:35.198 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:44:35.195+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:44:35.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:35.352+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:35.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:35.488+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:35.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:35.579+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:35.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:35.818+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:36.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:36.384+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:36.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:36.533+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:36.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:36.562+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:36.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:36.819+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:37.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:37.422+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:37.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:37.555+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:37.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:37.559+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:37.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:37.799+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:38.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:38.441+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:38.578 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:38.576+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:38.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:38.580+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:38.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:38.821+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:39.404 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:39.401+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:39.555 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:39.553+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:39.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:39.565+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:39.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:39.845+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:40.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:40.447+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:40.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:40.571+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:40.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:40.599+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:40.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:40.880+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:41.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:41.478+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:41.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:41.559+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:41.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:41.584+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:41.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:41.862+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:42.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:42.495+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:42.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:42.522+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:42.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:42.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:42.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:42.890+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:43.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:43.507+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:43.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:43.563+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:43.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:43.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:43.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:43.910+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:44.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:44.512+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:44.566 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:44.565+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:44.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:44.665+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:44.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:44.863+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:45.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:45.482+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:45.541 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:45.540+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:45.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:45.691+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:45.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:45.824+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:46.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:46.462+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:46.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:46.589+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:46.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:46.735+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:46.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:46.870+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:47.491 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:47.489+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:47.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:47.546+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:47.748 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:47.746+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:47.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:47.826+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:48.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:48.505+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:48.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:48.531+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:48.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:48.722+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:48.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:48.807+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:49.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:49.495+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:49.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:49.496+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:49.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:49.689+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:49.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:49.757+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:50.211 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:44:50.209+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:44:50.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:44:50.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:44:50.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:50.473+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:50.478 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:50.476+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:50.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:50.679+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:50.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:50.768+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:51.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:51.474+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:51.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:51.503+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:51.717 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:51.715+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:51.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:51.773+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:52.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:52.475+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:52.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:52.486+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:52.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:52.714+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:52.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:52.727+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:53.443 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:53.442+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:53.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:53.474+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:53.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:53.685+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:53.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:53.739+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:54.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:54.411+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:54.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:54.442+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:54.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:54.643+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:54.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:54.729+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:55.434 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:55.432+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:55.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:55.451+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:55.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:55.678+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:55.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:55.698+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:56.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:56.408+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:56.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:56.442+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:56.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:56.679+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:56.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:56.693+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:57.421 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:57.419+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:57.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:57.437+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:57.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:57.663+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:57.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:57.679+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:58.431 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:58.430+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:58.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:58.454+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:58.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:58.677+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:58.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:58.712+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:59.441 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:44:59.438+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:59.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:44:59.502+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:59.727 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:44:59.725+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:44:59.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:44:59.730+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:00.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:00.412+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:00.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:00.501+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:00.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:00.704+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:00.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:00.709+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:01.455 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:01.452+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:01.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:01.498+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:01.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:01.690+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:01.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:01.754+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:02.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:02.471+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:02.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:02.481+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:02.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:02.657+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:02.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:02.773+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:03.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:03.487+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:03.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:03.498+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:03.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:03.669+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:03.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:03.743+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:04.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:04.446+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:04.497 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:04.495+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:04.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:04.640+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:04.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:04.783+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:05.227 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:45:05.224+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:45:05.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:05.426+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:05.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:05.472+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:05.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:05.675+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:05.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:05.744+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:06.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:06.426+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:06.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:06.432+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:06.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:06.649+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:06.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:06.710+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:07.403 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:07.400+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:07.440 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:07.437+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:07.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:07.600+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:07.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:07.662+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:08.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:08.415+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:08.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:08.434+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:08.587 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:08.584+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:08.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:08.682+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:09.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:09.420+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:09.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:09.424+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:09.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:09.553+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:09.681 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:09.678+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:10.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:10.396+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:10.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:10.464+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:10.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:10.581+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:10.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:10.645+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:11.359 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:11.357+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:11.486 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:11.484+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:11.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:11.546+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:11.670 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:11.668+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:12.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:12.323+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:12.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:12.497+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:12.542 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:12.539+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:12.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:12.695+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:13.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:13.362+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:13.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:13.450+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:13.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:13.561+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:13.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:13.649+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:14.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:14.375+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:14.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:14.474+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:14.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:14.595+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:14.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:14.639+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:15.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:15.383+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:15.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:15.444+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:15.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:15.619+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:15.687 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:15.685+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:16.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:16.335+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:16.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:16.434+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:16.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:16.575+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:16.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:16.734+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:17.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:17.316+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:17.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:17.464+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:17.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:17.565+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:17.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:17.735+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:18.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:18.303+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:18.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:18.486+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:18.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:18.515+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:18.729 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:18.727+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:19.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:19.291+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:19.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:19.477+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:19.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:19.564+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:19.695 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:19.693+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:20.242 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:45:20.240+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:45:20.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:20.292+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:20.433 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:20.431+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:20.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:45:20.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:20.572+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:20.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:20.669+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:20.868 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:45:21.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:21.322+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:21.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:21.473+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:21.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:21.558+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:21.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:21.625+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:22.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:22.323+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:22.481 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:22.478+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:22.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:22.514+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:22.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:22.629+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:23.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:23.280+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:23.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:23.524+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:23.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:23.527+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:23.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:23.585+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:24.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:24.318+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:24.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:24.536+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:24.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:24.571+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:24.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:24.629+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:25.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:25.314+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:25.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:25.537+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:25.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:25.580+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:25.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:25.618+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:26.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:26.285+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:26.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:26.551+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:26.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:26.563+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:26.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:26.575+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:27.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:27.285+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:27.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:27.582+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:27.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:27.601+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:27.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:27.607+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:28.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:28.290+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:28.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:28.625+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:28.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:28.630+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:28.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:28.630+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:29.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:29.281+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:29.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:29.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:29.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:29.630+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:29.659 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:29.658+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:30.268 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:30.265+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:30.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:30.583+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:30.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:30.598+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:30.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:30.609+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:31.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:31.234+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:31.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:31.579+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:31.640 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:31.638+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:31.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:31.645+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:32.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:32.272+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:32.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:32.586+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:32.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:32.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:32.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:32.677+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:33.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:33.287+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:33.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:33.536+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:33.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:33.612+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:33.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:33.657+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:34.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:34.325+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:34.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:34.508+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:34.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:34.595+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:34.611 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:34.610+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:35.249 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:45:35.246+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:45:35.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:35.299+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:35.541 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:35.540+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:35.599 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:35.598+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:35.643 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:35.641+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:36.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:36.304+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:36.524 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:36.523+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:36.637 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:36.636+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:36.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:36.666+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:37.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:37.337+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:37.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:37.523+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:37.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:37.608+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:37.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:37.651+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:38.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:38.297+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:38.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:38.558+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:38.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:38.624+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:38.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:38.631+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:39.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:39.276+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:39.563 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:39.561+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:39.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:39.631+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:39.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:39.641+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:40.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:40.262+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:40.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:40.594+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:40.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:40.601+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:40.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:40.615+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:41.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:41.240+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:41.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:41.572+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:41.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:41.580+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:41.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:41.645+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:42.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:42.208+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:42.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:42.531+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:42.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:42.613+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:42.676 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:42.675+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:43.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:43.257+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:43.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:43.499+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:43.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:43.575+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:43.718 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:43.716+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:44.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:44.304+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:44.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:44.458+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:44.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:44.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:44.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:44.681+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:45.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:45.317+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:45.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:45.502+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:45.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:45.641+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:45.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:45.678+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:46.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:46.363+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:46.535 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:46.534+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:46.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:46.677+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:46.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:46.681+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:47.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:47.350+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:47.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:47.509+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:47.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:47.650+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:47.653 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:47.652+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:48.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:48.361+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:48.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:48.504+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:48.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:48.609+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:48.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:48.612+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:49.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:49.407+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:49.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:49.550+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:49.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:49.600+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:49.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:49.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:50.264 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:45:50.261+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:45:50.432 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:50.430+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:50.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:50.554+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:50.579 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:50.577+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:50.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:50.630+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:50.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:45:50.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:45:51.387 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:51.385+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:51.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:51.563+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:51.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:51.581+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:51.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:51.587+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:52.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:52.410+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:52.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:52.582+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:52.607 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:52.605+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:52.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:52.607+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:53.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:53.383+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:53.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:53.563+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:53.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:53.605+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:53.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:53.632+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:54.343 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:54.340+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:54.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:54.540+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:54.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:54.616+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:54.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:54.647+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:55.310 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:55.307+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:55.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:55.492+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:55.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:55.599+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:55.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:55.607+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:56.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:56.319+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:56.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:56.488+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:56.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:56.646+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:56.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:56.649+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:57.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:57.365+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:57.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:57.527+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:57.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:57.639+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:57.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:57.679+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:58.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:58.352+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:58.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:58.554+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:58.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:58.656+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:58.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:58.709+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:59.353 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:45:59.351+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:59.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:45:59.583+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:59.611 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:45:59.608+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:45:59.734 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:45:59.731+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:00.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:00.330+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 44 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:00.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:00.580+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 28 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:00.626 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:00.624+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:00.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:00.736+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:01.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:01.285+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:01.569 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:01.566+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:01.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:01.648+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:01.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:01.698+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:02.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:02.296+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:02.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:02.572+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:02.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:02.677+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:02.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:02.745+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:03.273 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:03.271+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:03.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:03.583+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:03.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:03.690+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:03.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:03.707+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:04.253 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:04.251+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:04.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:04.570+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:04.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:04.712+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:04.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:04.716+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:05.276 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:05.273+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:05.280 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:46:05.278+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:46:05.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:05.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:05.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:05.693+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:05.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:05.736+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:06.306 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:06.304+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:06.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:06.662+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:06.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:06.717+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:06.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:06.761+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:07.260 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:07.258+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:07.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:07.624+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:07.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:07.691+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:07.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:07.774+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:08.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:08.275+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:08.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:08.641+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:08.660 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:08.658+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:08.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:08.807+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:09.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:09.274+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:09.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:09.599+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:09.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:09.639+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:09.789 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:09.787+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:10.244 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:10.241+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:10.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:10.607+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:10.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:10.657+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:10.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:10.800+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:11.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:11.276+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:11.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:11.639+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:11.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:11.657+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:11.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:11.841+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:12.265 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:12.262+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:12.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:12.633+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:12.670 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:12.668+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:12.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:12.832+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:13.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:13.298+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:13.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:13.637+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:13.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:13.644+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:13.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:13.826+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:14.339 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:14.337+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:14.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:14.591+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:14.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:14.636+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:14.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:14.844+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:15.352 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:15.350+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:15.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:15.599+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:15.615 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:15.612+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:15.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:15.842+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:16.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:16.345+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:16.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:16.611+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:16.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:16.656+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:16.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:16.842+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:17.314 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:17.312+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:17.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:17.569+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:17.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:17.608+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:17.872 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:17.870+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:18.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:18.327+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:18.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:18.550+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:18.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:18.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:18.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:18.837+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:19.336 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:19.334+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:19.530 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:19.527+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:19.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:19.648+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:19.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:19.810+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:20.296 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:46:20.293+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:46:20.375 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:20.372+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:20.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:20.500+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:20.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:20.654+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:20.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:20.766+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:21.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:46:21.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:46:21.367 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:21.365+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:21.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:21.534+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:21.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:21.661+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:21.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:21.748+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:22.413 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:22.411+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:22.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:22.485+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:22.666 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:22.663+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:22.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:22.702+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:23.411 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:23.409+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:23.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:23.447+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:23.700 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:23.698+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:23.714 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:23.711+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:24.448 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:24.446+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:24.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:24.464+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:24.677 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:24.675+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:24.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:24.734+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:25.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:25.456+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:25.458 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:25.456+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:25.657 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:25.655+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:25.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:25.767+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:26.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:26.422+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:26.444 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:26.443+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:26.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:26.681+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:26.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:26.781+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:27.409 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:27.407+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:27.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:27.408+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:27.710 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:27.709+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:27.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:27.809+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:28.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:28.432+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:28.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:28.433+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:28.669 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:28.668+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:28.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:28.815+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:29.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:29.391+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:29.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:29.412+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:29.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:29.709+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:29.837 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:29.835+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:30.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:30.440+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:30.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:30.457+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:30.757 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:30.755+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:30.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:30.819+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:31.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:31.475+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:31.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:31.491+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:31.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:31.743+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:31.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:31.789+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:32.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:32.495+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:32.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:32.530+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:32.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:32.753+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:32.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:32.825+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:33.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:33.473+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:33.574 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:33.573+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:33.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:33.777+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:33.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:33.812+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:34.494 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:34.492+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:34.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:34.595+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:34.742 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:34.740+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:34.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:34.803+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:35.311 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:46:35.310+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:46:35.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:35.499+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:35.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:35.553+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:35.722 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:35.720+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:35.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:35.759+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:36.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:36.470+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:36.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:36.577+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:36.701 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:36.699+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:36.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:36.793+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:37.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:37.474+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:37.557 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:37.556+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:37.704 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:37.703+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:37.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:37.789+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:38.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:38.499+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:38.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:38.573+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:38.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:38.739+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:38.819 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:38.817+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:39.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:39.477+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:39.552 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:39.550+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:39.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:39.733+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:39.780 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:39.778+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:40.435 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:40.430+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:40.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:40.540+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:40.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:40.760+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:40.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:40.802+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:41.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:41.433+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:41.563 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:41.561+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:41.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:41.788+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:41.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:41.793+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:42.427 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:42.425+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:42.519 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:42.517+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:42.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:42.747+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:42.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:42.829+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:43.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:43.462+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:43.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:43.505+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:43.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:43.749+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:43.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:43.844+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:44.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:44.447+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:44.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:44.544+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:44.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:44.726+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:44.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:44.844+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:45.429 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:45.426+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:45.500 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:45.497+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:45.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:45.765+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:45.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:45.850+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:46.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:46.446+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:46.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:46.534+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:46.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:46.746+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:46.863 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:46.861+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:47.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:47.453+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:47.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:47.578+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:47.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:47.768+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:47.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:47.890+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:48.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:48.466+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:48.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:48.594+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:48.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:48.750+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:48.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:48.844+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:49.492 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:49.489+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:49.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:49.626+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:49.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:49.707+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:49.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:49.810+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:50.327 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:46:50.325+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:46:50.463 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:50.461+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:50.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:50.676+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:50.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:50.702+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:50.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:50.771+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:51.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:46:51.271 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:46:51.497 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:51.495+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:51.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:51.658+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:51.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:51.726+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:51.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:51.735+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:52.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:52.545+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:52.665 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:52.663+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:52.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:52.682+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:52.744 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:52.742+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:53.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:53.552+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:53.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:53.623+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:53.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:53.663+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:53.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:53.744+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:54.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:54.580+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:54.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:54.661+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:54.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:54.695+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:54.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:54.776+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:55.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:55.573+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:55.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:55.674+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:55.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:55.676+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:55.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:55.753+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:56.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:56.568+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:56.655 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:56.653+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:56.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:56.712+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:56.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:56.797+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:57.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:57.568+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:57.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:57.681+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:57.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:57.716+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:57.778 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:57.776+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:58.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:58.528+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:58.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:58.646+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:58.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:58.689+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:58.737 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:58.735+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:59.568 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:46:59.566+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:59.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:46:59.694+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:59.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:46:59.712+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:46:59.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:46:59.760+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:00.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:00.527+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:00.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:00.667+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:00.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:00.708+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:00.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:00.723+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:01.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:01.489+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:01.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:01.662+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:01.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:01.749+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:01.766 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:01.764+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:02.493 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:02.490+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:02.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:02.694+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:02.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:02.722+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:02.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:02.778+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:03.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:03.534+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:03.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:03.668+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:03.759 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:03.757+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:03.790 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:03.788+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:04.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:04.535+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:04.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:04.621+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:04.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:04.752+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:04.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:04.783+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:05.338 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:47:05.335+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:47:05.555 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:05.552+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:05.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:05.616+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:05.764 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:05.762+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:05.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:05.825+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:06.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:06.590+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:06.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:06.597+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:06.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:06.805+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:06.811 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:06.809+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:07.562 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:07.560+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:07.605 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:07.603+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:07.797 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:07.795+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:07.846 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:07.843+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:08.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:08.546+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:08.567 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:08.566+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:08.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:08.747+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:08.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:08.813+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:09.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:09.517+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:09.576 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:09.574+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:09.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:09.771+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:09.851 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:09.849+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:10.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:10.530+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:10.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:10.577+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:10.758 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:10.756+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:10.814 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:10.812+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:11.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:11.521+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:11.579 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:11.577+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:11.733 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:11.730+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:11.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:11.852+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:12.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:12.489+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:12.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:12.585+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:12.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:12.740+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:12.848 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:12.846+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:13.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:13.518+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:13.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:13.552+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:13.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:13.721+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:13.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:13.852+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:14.495 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:14.493+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:14.544 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:14.542+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:14.762 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:14.761+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:14.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:14.855+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:15.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:15.515+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:15.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:15.572+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:15.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:15.807+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:15.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:15.895+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:16.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:16.493+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:16.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:16.581+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:16.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:16.768+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:16.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:16.874+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:17.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:17.518+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:17.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:17.560+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:17.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:17.760+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:17.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:17.880+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:18.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:18.479+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:18.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:18.593+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:18.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:18.755+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:18.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:18.912+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:19.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:19.498+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:19.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:19.591+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:19.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:19.800+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:19.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:19.915+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:20.354 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:47:20.351+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:47:20.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:20.502+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:20.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:20.563+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:20.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:20.760+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:20.937 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:20.935+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:21.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:47:21.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:47:21.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:21.517+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:21.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:21.518+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:21.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:21.802+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:21.921 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:21.919+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:22.498 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:22.496+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:22.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:22.513+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:22.801 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:22.799+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:22.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:22.891+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:23.479 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:23.477+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:23.498 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:23.497+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:23.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:23.835+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:23.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:23.844+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:24.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:24.515+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:24.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:24.520+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:24.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:24.819+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:24.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:24.870+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:25.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:25.472+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:25.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:25.559+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:25.772 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:25.771+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:25.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:25.822+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:26.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:26.463+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:26.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:26.560+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:26.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:26.784+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:26.851 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:26.849+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:27.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:27.477+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:27.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:27.597+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:27.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:27.764+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:27.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:27.851+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:28.454 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:28.452+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:28.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:28.642+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:28.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:28.785+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:28.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:28.865+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:29.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:29.465+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:29.607 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:29.605+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:29.792 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:29.790+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:29.855 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:29.854+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:30.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:30.513+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:30.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:30.644+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:30.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:30.834+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:30.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:30.890+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:31.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:31.508+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:31.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:31.669+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:31.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:31.829+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:31.904 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:31.902+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:32.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:32.507+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:32.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:32.654+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:32.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:32.837+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:32.875 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:32.872+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:33.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:33.544+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:33.635 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:33.633+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:33.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:33.804+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:33.865 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:33.863+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:34.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:34.556+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:34.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:34.588+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:34.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:34.803+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:34.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:34.908+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:35.369 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:47:35.367+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:47:35.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:35.563+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:35.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:35.634+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:35.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:35.791+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:35.937 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:35.934+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:36.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:36.608+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:36.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:36.685+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:36.761 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:36.759+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:36.944 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:36.942+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:37.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:37.636+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:37.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:37.643+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:37.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:37.737+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:37.962 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:37.959+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:38.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:38.641+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:38.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:38.637+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:38.692 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:38.690+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:38.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:38.984+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:39.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:39.621+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:39.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:39.630+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:39.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:39.728+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:40.009 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:40.007+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:40.578 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:40.576+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:40.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:40.582+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:40.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:40.684+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:41.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:41.011+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:41.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:41.605+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:41.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:41.612+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:41.660 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:41.658+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:41.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:41.966+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:42.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:42.605+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:42.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:42.645+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:42.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:42.674+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:42.982 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:42.979+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:43.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:43.591+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:43.618 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:43.616+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:43.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:43.670+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:43.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:43.947+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:44.573 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:44.570+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:44.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:44.583+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:44.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:44.659+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:44.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:44.968+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:45.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:45.579+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:45.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:45.592+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:45.687 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:45.685+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:45.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:45.995+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:46.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:46.620+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:46.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:46.630+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:46.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:46.699+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:46.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:46.983+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:47.596 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:47.593+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:47.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:47.658+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:47.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:47.709+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:47.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:47.982+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:48.584 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:48.581+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:48.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:48.655+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:48.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:48.727+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:49.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:48.997+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:49.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:49.546+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:49.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:49.617+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:49.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:49.699+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:49.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:49.972+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:50.371 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:47:50.369+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:47:50.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:50.580+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:50.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:50.621+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:50.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:50.688+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:50.976 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:50.973+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:51.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:47:51.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:47:51.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:51.536+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:51.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:51.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:51.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:51.671+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:51.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:51.967+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:52.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:52.535+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:52.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:52.572+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:52.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:52.681+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:52.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:52.983+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:53.537 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:53.534+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:53.592 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:53.591+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:53.657 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:53.655+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:54.001 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:53.999+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:54.524 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:54.522+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:54.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:54.573+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:54.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:54.696+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:54.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:54.962+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:55.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:55.523+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:55.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:55.611+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:55.730 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:55.727+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:55.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:55.926+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:56.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:56.504+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:56.662 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:56.659+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:56.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:56.701+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:56.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:56.934+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:57.517 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:57.514+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:57.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:57.692+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:57.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:57.732+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:57.892 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:57.890+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:58.557 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:58.555+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:58.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:58.671+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:58.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:58.712+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:58.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:58.893+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:59.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:47:59.580+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:59.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:47:59.639+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:59.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:47:59.730+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:47:59.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:47:59.852+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:00.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:00.583+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:00.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:00.662+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:00.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:00.717+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:00.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:00.833+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:01.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:01.590+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:01.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:01.698+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:01.765 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:01.764+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:01.842 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:01.839+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:02.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:02.617+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:02.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:02.741+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:02.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:02.799+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:02.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:02.828+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:03.632 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:03.630+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:03.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:03.750+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:03.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:03.764+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:03.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:03.806+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:04.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:04.654+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:04.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:04.735+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:04.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:04.752+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:04.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:04.834+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:05.387 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:48:05.384+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:48:05.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:05.695+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:05.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:05.737+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:05.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:05.775+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:05.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:05.874+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:06.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:06.682+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:06.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:06.738+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:06.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:06.759+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:06.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:06.913+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:07.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:07.704+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:07.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:07.733+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:07.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:07.800+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:07.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:07.888+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:08.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:08.656+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:08.734 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:08.733+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:08.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:08.843+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:08.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:08.889+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:09.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:09.635+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:09.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:09.753+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:09.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:09.804+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:09.914 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:09.871+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:10.661 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:10.659+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:10.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:10.710+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:10.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:10.835+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:10.852 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:10.851+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:11.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:11.680+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:11.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:11.688+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:11.812 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:11.810+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:11.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:11.850+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:12.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:12.648+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:12.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:12.656+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:12.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:12.837+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:12.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:12.848+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:13.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:13.607+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:13.706 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:13.705+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:13.815 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:13.813+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:13.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:13.835+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:14.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:14.604+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:14.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:14.752+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:14.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:14.789+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:14.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:14.805+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:15.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:15.622+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:15.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:15.738+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:15.806 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:15.804+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:15.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:15.832+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:16.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:16.644+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:16.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:16.732+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:16.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:16.831+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:16.850 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:16.847+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:17.602 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:17.601+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:17.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:17.750+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:17.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:17.803+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:17.834 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:17.832+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:18.641 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:18.639+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:18.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:18.788+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:18.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:18.794+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:18.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:18.843+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:19.610 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:19.608+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:19.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:19.760+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:19.764 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:19.762+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:19.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:19.846+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:20.402 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:48:20.400+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:48:20.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:20.581+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:20.777 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:20.775+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:20.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:20.807+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:20.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:20.831+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:21.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:21.580+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:21.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:48:21.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:48:21.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:21.758+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:21.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:21.779+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:21.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:21.812+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:22.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:22.590+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:22.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:22.725+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:22.789 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:22.786+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:22.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:22.857+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:23.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:23.564+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:23.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:23.700+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:23.790 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:23.787+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:23.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:23.844+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:24.581 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:24.578+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:24.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:24.745+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:24.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:24.750+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:24.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:24.891+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:25.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:25.625+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:25.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:25.706+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:25.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:25.777+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:25.926 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:25.923+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:26.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:26.660+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:26.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:26.726+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:26.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:26.768+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:26.943 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:26.940+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:27.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:27.640+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:27.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:27.772+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:27.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:27.791+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:27.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:27.927+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:28.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:28.649+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:28.728 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:28.725+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:28.773 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:28.770+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:28.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:28.970+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:29.628 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:29.625+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:29.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:29.745+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:29.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:29.770+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:29.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:29.921+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:30.645 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:30.642+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:30.755 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:30.753+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:30.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:30.791+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:30.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:30.944+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:31.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:31.688+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:31.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:31.713+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:31.792 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:31.789+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:31.905 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:31.902+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:32.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:32.669+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:32.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:32.675+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:32.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:32.754+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:32.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:32.874+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:33.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:33.621+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:33.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:33.712+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:33.725 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:33.722+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:33.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:33.878+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:34.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:34.659+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:34.739 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:34.736+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:34.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:34.759+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:34.844 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:34.841+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:35.419 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:48:35.416+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:48:35.671 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:35.669+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:35.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:35.760+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:35.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:35.774+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:35.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:35.855+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:36.713 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:36.711+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:36.796 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:36.793+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:36.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:36.807+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:36.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:36.887+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:37.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:37.725+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:37.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:37.796+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:37.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:37.798+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:37.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:37.892+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:38.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:38.712+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:38.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:38.820+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:38.836 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:38.834+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:38.882 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:38.880+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:39.695 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:39.693+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:39.838 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:39.836+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:39.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:39.837+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:39.922 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:39.921+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:40.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:40.695+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:40.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:40.871+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:40.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:40.877+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:40.956 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:40.954+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:41.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:41.679+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:41.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:41.850+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:41.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:41.903+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:42.000 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:41.998+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:42.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:42.688+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:42.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:42.834+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:42.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:42.889+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:43.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:43.021+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:43.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:43.691+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:43.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:43.840+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:43.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:43.903+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:43.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:43.993+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:44.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:44.671+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:44.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:44.823+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:44.912 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:44.910+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:44.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:44.966+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:45.627 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:45.624+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:45.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:45.820+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:45.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:45.897+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:45.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:45.984+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:46.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:46.674+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:46.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:46.861+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:46.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:46.892+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:47.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:47.023+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:47.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:47.712+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:47.889 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:47.887+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:47.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:47.926+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:48.038 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:48.036+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:48.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:48.670+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:48.910 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:48.907+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:48.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:48.918+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:49.004 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:49.001+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:49.639 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:49.637+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:49.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:49.864+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:49.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:49.960+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:49.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:49.960+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:50.434 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:48:50.432+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:48:50.608 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:50.606+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:50.830 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:50.828+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:50.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:50.949+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:50.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:50.958+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:51.582 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:51.580+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:51.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:48:51.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:48:51.867 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:51.865+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:51.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:51.983+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:51.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:51.997+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:52.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:52.539+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:52.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:52.905+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:52.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:52.994+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:53.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:53.020+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:53.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:53.524+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:53.947 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:53.944+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:53.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:53.948+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:54.060 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:54.058+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:54.573 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:54.570+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:54.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:54.939+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:54.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:54.947+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:55.046 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:55.044+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:55.572 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:55.569+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:55.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:55.906+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:55.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:55.924+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:56.006 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:56.004+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:56.556 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:56.555+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:56.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:56.890+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:56.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:56.930+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:56.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:56.977+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:57.580 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:57.578+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:57.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:57.890+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:57.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:57.926+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:57.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:57.952+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:58.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:58.628+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:58.907 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:58.906+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:58.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:58.914+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:58.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:58.920+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:59.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:48:59.629+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:59.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:48:59.905+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:59.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:48:59.916+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:48:59.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:48:59.927+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:00.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:00.599+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:00.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:00.867+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:00.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:00.878+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:00.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:00.948+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:01.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:01.594+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:01.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:01.891+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:01.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:01.898+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:02.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:01.998+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:02.579 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:02.578+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:02.916 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:02.915+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:02.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:02.926+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:02.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:02.962+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:03.624 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:03.622+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:03.903 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:03.902+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:03.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:03.923+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:03.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:03.936+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:04.590 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:04.589+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:04.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:04.899+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:04.940 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:04.939+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:04.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:04.953+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:05.445 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:49:05.443+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:49:05.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:05.591+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:05.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:05.895+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:05.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:05.923+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:05.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:05.939+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:06.564 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:06.562+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:06.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:06.891+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:06.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:06.917+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:06.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:06.956+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:07.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:07.603+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:07.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:07.923+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:07.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:07.949+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:07.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:07.956+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:08.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:08.558+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:08.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:08.907+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:08.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:08.949+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:08.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:08.978+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:09.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:09.564+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:09.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:09.865+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:09.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:09.923+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:09.931 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:09.930+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:10.542 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:10.540+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:10.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:10.885+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:10.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:10.924+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:10.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:10.946+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:11.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:11.524+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:11.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:11.869+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:11.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:11.898+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:11.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:11.955+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:12.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:12.489+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:12.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:12.850+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:12.856 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:12.854+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:13.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:13.004+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:13.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:13.469+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:13.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:13.832+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:13.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:13.847+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:14.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:14.010+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:14.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:14.456+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:14.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:14.838+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:14.882 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:14.880+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:14.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:14.974+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:15.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:15.499+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:15.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:15.795+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:15.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:15.873+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:16.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:16.011+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:16.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:16.488+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:16.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:16.813+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:16.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:16.893+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:16.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:16.968+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:17.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:17.478+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:17.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:17.793+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:17.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:17.876+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:17.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:17.929+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:18.444 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:18.441+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:18.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:18.746+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:18.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:18.872+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:18.958 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:18.956+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:19.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:19.412+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:19.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:19.773+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:19.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:19.871+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:19.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:19.978+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:20.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:20.443+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:20.461 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:49:20.458+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:49:20.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:20.746+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:20.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:20.908+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:20.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:20.947+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:21.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:21.417+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:21.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:21.698+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:21.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:21.869+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:21.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:49:21.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:49:21.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:21.963+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:22.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:22.421+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:22.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:22.696+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:22.864 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:22.861+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:22.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:22.934+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:23.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:23.405+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:23.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:23.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:23.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:23.843+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:23.973 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:23.970+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:24.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:24.364+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:24.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:24.667+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:24.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:24.864+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:24.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:24.948+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:25.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:25.361+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:25.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:25.679+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:25.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:25.844+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:25.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:25.909+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:26.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:26.410+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:26.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:26.689+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:26.850 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:26.848+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:26.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:26.910+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:27.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:27.374+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:27.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:27.723+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:27.824 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:27.822+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:27.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:27.949+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:28.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:28.347+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:28.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:28.747+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:28.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:28.774+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:28.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:28.985+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:29.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:29.344+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:29.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:29.752+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:29.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:29.752+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:29.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:29.997+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:30.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:30.361+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:30.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:30.719+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:30.774 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:30.772+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:31.035 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:31.032+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:31.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:31.318+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:31.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:31.708+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:31.755 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:31.752+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:32.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:32.052+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:32.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:32.323+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:32.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:32.709+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:32.799 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:32.796+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:33.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:33.007+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:33.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:33.363+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:33.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:33.713+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:33.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:33.814+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:34.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:34.022+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:34.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:34.319+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:34.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:34.694+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:34.783 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:34.780+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:34.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:34.982+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:35.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:35.319+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:35.477 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:49:35.474+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:49:35.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:35.662+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:35.761 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:35.759+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:35.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:35.974+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:36.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:36.303+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:36.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:36.659+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:36.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:36.721+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:37.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:37.024+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:37.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:37.307+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:37.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:37.633+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:37.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:37.681+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:38.038 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:38.035+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:38.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:38.293+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:38.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:38.639+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:38.711 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:38.709+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:38.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:38.988+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:39.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:39.301+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:39.659 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:39.657+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:39.747 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:39.745+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:40.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:40.007+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:40.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:40.289+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:40.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:40.703+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:40.740 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:40.738+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:40.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:40.982+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:41.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:41.285+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:41.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:41.677+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:41.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:41.766+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:41.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:41.945+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:42.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:42.295+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:42.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:42.725+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:42.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:42.728+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:42.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:42.978+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:43.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:43.298+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:43.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:43.681+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:43.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:43.771+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:43.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:43.954+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:44.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:44.298+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:44.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:44.642+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:44.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:44.726+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:44.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:44.915+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:45.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:45.252+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:45.668 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:45.666+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:45.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:45.725+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:45.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:45.911+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:46.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:46.265+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:46.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:46.695+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:46.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:46.754+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:46.902 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:46.900+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:47.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:47.232+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:47.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:47.687+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:47.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:47.750+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:47.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:47.951+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:48.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:48.275+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:48.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:48.671+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:48.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:48.706+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:48.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:48.997+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:49.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:49.233+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:49.690 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:49.688+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:49.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:49.753+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:50.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:50.006+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:50.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:50.272+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:50.478 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:49:50.475+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:49:50.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:50.692+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:50.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:50.732+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:51.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:51.047+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:51.243 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:51.242+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:51.732 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:51.730+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:51.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:51.775+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:52.094 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:52.092+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:52.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:49:52.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:49:52.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:52.273+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:52.685 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:52.683+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:52.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:52.733+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:53.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:53.131+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:53.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:53.323+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:53.647 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:53.646+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:53.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:53.722+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:54.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:54.127+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:54.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:54.313+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:54.625 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:54.624+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:54.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:54.731+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:55.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:55.100+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:55.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:55.328+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:55.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:55.613+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:55.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:55.724+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:56.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:56.114+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:56.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:56.343+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:56.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:56.662+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:56.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:56.765+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:57.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:57.150+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:57.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:57.384+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:57.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:57.617+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:57.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:57.790+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:58.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:58.185+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:58.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:58.390+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:58.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:58.584+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:58.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:58.823+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:59.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:49:59.209+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:59.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:49:59.416+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:59.590 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:49:59.589+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:49:59.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:49:59.810+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:00.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:00.181+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:00.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:00.401+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:00.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:00.604+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:00.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:00.852+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:01.181 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:01.179+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:01.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:01.376+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:01.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:01.619+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:01.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:01.837+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:02.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:02.198+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:02.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:02.380+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:02.584 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:02.582+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:02.870 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:02.869+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:03.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:03.170+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:03.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:03.408+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:03.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:03.576+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:03.823 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:03.821+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:04.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:04.192+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:04.421 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:04.418+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:04.577 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:04.574+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:04.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:04.812+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:05.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:05.178+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:05.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:05.458+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:05.486 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:50:05.484+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:50:05.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:05.557+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:05.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:05.844+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:06.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:06.179+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:06.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:06.410+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:06.558 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:06.555+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:06.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:06.810+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:07.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:07.201+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:07.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:07.438+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:07.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:07.521+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:07.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:07.766+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:08.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:08.179+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:08.475 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:08.473+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:08.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:08.499+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:08.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:08.759+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:09.215 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:09.213+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:09.499 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:09.497+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:09.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:09.513+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:09.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:09.728+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:10.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:10.186+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:10.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:10.461+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:10.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:10.519+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:10.740 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:10.737+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:11.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:11.206+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:11.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:11.435+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:11.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:11.558+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:11.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:11.772+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:12.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:12.192+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:12.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:12.395+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:12.527 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:12.525+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:12.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:12.775+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:13.212 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:13.176+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:13.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:13.412+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:13.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:13.545+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:13.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:13.774+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:14.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:14.216+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:14.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:14.410+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:14.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:14.502+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:14.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:14.773+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:15.213 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:15.210+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:15.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:15.409+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:15.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:15.504+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:15.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:15.757+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:16.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:16.214+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:16.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:16.436+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:16.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:16.460+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:16.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:16.710+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:17.206 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:17.203+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:17.437 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:17.435+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:17.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:17.439+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:17.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:17.737+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:18.236 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:18.233+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:18.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:18.433+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:18.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:18.465+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:18.708 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:18.706+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:19.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:19.194+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:19.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:19.451+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:19.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:19.494+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:19.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:19.670+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:20.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:20.217+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:20.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:20.451+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:20.485 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:20.483+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:20.502 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:50:20.500+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:50:20.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:20.682+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:21.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:21.187+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:21.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:21.412+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:21.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:21.451+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:21.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:21.661+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:22.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:50:22.239 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:22.237+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:22.242 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:50:22.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:22.414+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:22.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:22.443+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:22.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:22.693+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:23.230 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:23.227+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:23.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:23.428+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:23.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:23.470+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:23.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:23.687+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:24.191 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:24.188+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:24.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:24.391+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:24.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:24.517+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:24.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:24.709+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:25.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:25.227+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:25.369 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:25.367+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:25.548 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:25.546+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:25.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:25.671+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:26.190 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:26.187+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:26.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:26.380+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:26.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:26.506+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:26.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:26.640+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:27.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:27.231+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:27.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:27.362+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:27.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:27.511+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:27.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:27.624+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:28.233 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:28.231+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:28.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:28.313+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:28.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:28.515+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:28.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:28.605+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:29.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:29.185+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:29.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:29.268+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:29.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:29.483+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:29.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:29.613+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:30.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:30.173+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:30.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:30.286+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:30.480 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:30.477+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:30.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:30.641+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:31.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:31.201+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:31.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:31.264+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:31.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:31.437+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:31.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:31.657+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:32.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:32.216+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:32.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:32.269+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:32.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:32.487+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:32.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:32.609+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:33.189 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:33.187+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:33.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:33.261+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:33.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:33.461+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:33.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:33.629+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:34.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:34.214+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:34.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:34.292+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:34.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:34.509+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:34.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:34.642+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:35.224 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:35.222+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:35.262 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:35.260+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:35.505 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:50:35.503+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:50:35.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:35.549+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:35.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:35.614+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:36.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:36.192+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:36.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:36.252+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:36.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:36.522+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:36.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:36.618+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:37.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:37.168+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:37.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:37.285+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:37.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:37.542+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:37.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:37.640+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:38.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:38.197+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:38.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:38.295+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:38.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:38.496+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:38.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:38.599+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:39.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:39.177+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:39.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:39.256+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:39.536 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:39.533+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:39.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:39.649+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:40.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:40.153+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:40.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:40.305+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:40.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:40.553+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:40.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:40.613+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:41.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:41.121+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:41.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:41.351+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:41.562 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:41.560+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:41.645 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:41.643+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:42.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:42.154+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:42.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:42.391+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:42.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:42.523+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:42.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:42.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:43.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:43.130+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:43.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:43.386+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:43.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:43.566+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:43.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:43.638+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:44.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:44.085+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:44.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:44.408+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:44.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:44.611+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:44.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:44.622+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:45.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:45.108+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:45.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:45.391+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:45.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:45.571+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:45.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:45.657+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:46.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:46.139+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:46.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:46.351+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:46.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:46.572+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:46.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:46.664+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:47.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:47.164+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:47.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:47.340+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:47.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:47.592+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:47.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:47.708+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:48.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:48.119+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:48.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:48.317+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:48.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:48.551+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:48.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:48.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:49.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:49.085+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:49.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:49.337+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:49.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:49.552+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:49.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:49.718+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:50.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:50.128+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:50.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:50.351+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:50.521 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:50:50.519+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:50:50.600 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:50.598+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:50.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:50.713+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:51.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:51.136+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:51.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:51.400+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:51.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:51.626+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:51.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:51.726+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:52.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:52.129+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:52.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:50:52.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:50:52.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:52.380+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:52.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:52.636+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:52.727 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:52.725+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:53.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:53.091+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:53.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:53.368+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:53.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:53.615+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:53.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:53.727+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:54.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:54.119+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:54.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:54.414+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:54.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:54.611+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:54.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:54.734+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:55.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:55.092+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:55.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:55.426+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:55.585 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:55.583+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:55.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:55.776+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:56.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:56.119+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:56.448 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:56.445+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:56.587 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:56.584+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:56.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:56.787+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:57.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:57.130+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:57.400 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:57.397+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:57.598 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:57.595+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:57.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:57.818+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:58.180 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:58.178+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:58.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:58.358+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:58.631 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:58.629+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:58.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:58.823+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:59.229 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:50:59.227+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:59.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:50:59.370+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:59.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:50:59.655+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:50:59.832 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:50:59.830+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:00.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:00.251+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:00.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:00.381+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:00.650 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:00.647+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:00.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:00.858+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:01.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:01.267+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:01.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:01.367+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:01.697 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:01.695+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:01.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:01.888+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:02.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:02.313+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:02.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:02.415+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:02.667 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:02.664+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:02.866 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:02.864+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:03.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:03.361+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:03.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:03.427+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:03.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:03.626+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:03.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:03.832+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:04.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:04.385+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:04.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:04.397+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:04.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:04.625+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:04.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:04.821+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:05.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:05.341+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:05.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:05.390+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:05.537 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:51:05.534+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:51:05.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:05.625+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:05.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:05.862+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:06.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:06.331+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:06.422 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:06.419+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:06.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:06.673+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:06.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:06.896+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:07.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:07.336+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:07.438 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:07.435+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:07.724 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:07.721+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:07.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:07.942+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:08.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:08.348+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:08.468 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:08.465+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:08.698 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:08.696+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:08.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:08.937+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:09.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:09.328+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:09.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:09.447+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:09.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:09.733+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:09.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:09.932+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:10.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:10.311+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:10.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:10.413+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:10.786 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:10.783+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:10.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:10.888+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:11.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:11.293+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:11.424 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:11.421+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:11.814 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:11.811+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:11.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:11.866+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:12.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:12.290+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:12.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:12.444+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:12.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:12.802+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:12.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:12.831+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:13.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:13.268+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:13.452 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:13.450+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:13.837 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:13.834+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:13.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:13.881+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:14.237 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:14.235+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:14.416 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:14.414+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:14.847 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:14.844+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:14.856 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:14.854+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:15.267 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:15.264+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:15.426 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:15.424+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:15.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:15.827+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:15.897 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:15.894+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:16.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:16.282+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:16.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:16.451+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:16.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:16.832+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:16.876 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:16.874+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:17.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:17.263+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:17.503 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:17.500+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:17.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:17.851+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:17.921 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:17.919+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:18.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:18.308+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:18.531 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:18.528+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:18.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:18.819+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:18.955 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:18.952+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:19.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:19.347+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:19.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:19.500+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:19.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:19.784+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:19.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:19.961+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:20.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:20.350+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:20.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:20.488+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:20.553 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:51:20.550+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:51:20.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:20.831+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:20.968 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:20.966+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:21.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:21.321+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:21.474 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:21.472+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:21.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:21.834+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:21.933 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:21.931+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:22.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:22.332+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:22.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:51:22.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:51:22.439 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:22.437+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:22.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:22.797+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:22.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:22.911+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:23.312 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:23.310+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:23.490 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:23.488+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:23.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:23.799+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:23.899 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:23.896+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:24.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:24.295+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:24.539 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:24.536+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:24.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:24.824+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:24.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:24.943+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:25.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:25.251+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:25.554 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:25.551+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:25.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:25.841+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:25.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:25.949+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:26.280 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:26.278+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:26.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:26.580+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:26.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:26.793+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:26.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:26.995+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:27.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:27.305+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:27.613 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:27.611+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:27.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:27.751+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:28.032 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:28.030+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:28.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:28.276+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:28.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:28.657+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:28.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:28.772+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:29.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:29.057+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:29.323 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:29.321+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:30.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:29.650+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:30.003 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:29.733+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:30.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:30.011+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:30.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:30.343+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:30.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:30.656+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:30.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:30.702+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:31.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:31.015+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:31.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:31.325+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:31.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:31.678+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:31.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:31.700+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:32.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:32.048+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:32.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:32.299+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:32.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:32.680+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:32.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:32.720+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:33.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:33.064+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:33.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:33.318+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:33.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:33.675+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:33.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:33.688+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:34.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:34.090+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:34.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:34.301+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:34.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:34.678+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:34.734 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:34.733+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:35.082 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:35.080+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:35.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:35.290+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:35.569 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:51:35.566+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:51:35.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:35.697+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:35.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:35.726+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:36.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:36.044+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:36.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:36.251+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:36.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:36.733+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:36.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:36.768+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:37.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:37.014+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:37.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:37.251+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:37.733 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:37.731+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:37.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:37.808+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:37.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:37.985+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:38.209 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:38.207+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:38.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:38.730+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:38.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:38.770+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:38.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:38.962+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:39.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:39.188+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:39.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:39.773+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:39.822 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:39.820+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:40.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:40.012+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:40.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:40.187+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:40.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:40.770+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:40.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:40.861+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:41.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:41.033+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:41.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:41.154+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:41.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:41.721+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:41.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:41.827+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:42.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:42.044+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:42.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:42.150+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:42.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:42.757+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:42.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:42.812+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:43.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:43.093+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:43.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:43.104+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:43.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:43.717+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:43.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:43.812+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:44.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:44.075+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:44.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:44.104+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:44.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:44.695+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:44.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:44.767+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:45.045 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:45.044+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:45.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:45.128+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:45.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:45.684+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:45.781 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:45.779+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:46.003 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:46.000+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:46.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:46.170+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:46.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:46.693+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:46.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:46.820+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:47.006 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:47.004+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:47.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:47.170+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:47.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:47.719+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:47.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:47.822+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:47.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:47.968+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:48.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:48.187+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:48.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:48.673+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:48.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:48.782+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:49.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:49.005+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:49.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:49.231+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:49.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:49.705+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:49.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:49.795+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:50.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:50.019+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:50.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:50.209+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:50.585 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:51:50.582+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:51:50.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:50.666+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:50.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:50.775+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:51.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:51.008+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:51.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:51.208+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:51.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:51.664+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:51.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:51.730+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:52.016 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:52.014+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:52.205 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:52.202+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:52.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:51:52.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:51:52.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:52.668+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:52.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:52.776+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:53.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:53.061+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:53.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:53.189+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:53.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:53.631+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:53.819 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:53.816+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:54.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:54.079+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:54.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:54.173+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:54.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:54.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:54.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:54.829+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:55.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:55.086+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:55.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:55.134+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:55.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:55.629+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:55.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:55.784+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:56.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:56.117+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:56.151 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:56.149+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:56.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:56.673+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:56.748 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:56.746+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:57.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:57.082+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:57.154 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:57.151+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:57.633 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:57.631+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:57.788 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:57.785+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:58.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:58.084+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:58.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:58.159+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:58.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:58.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:58.837 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:58.834+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:59.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:51:59.041+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:59.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:51:59.187+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:59.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:51:59.709+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:51:59.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:51:59.837+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:00.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:00.074+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:00.180 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:00.177+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:00.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:00.742+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:00.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:00.840+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:01.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:01.115+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:01.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:01.146+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:01.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:01.742+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:01.860 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:01.857+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:02.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:02.157+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:02.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:02.179+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:02.707 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:02.705+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:02.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:02.857+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:03.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:03.131+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:03.160 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:03.157+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:03.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:03.693+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:03.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:03.855+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:04.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:04.110+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:04.122 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:04.120+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:04.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:04.722+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:04.887 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:04.884+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:05.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:05.125+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:05.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:05.138+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:05.601 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:52:05.599+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:52:05.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:05.712+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:05.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:05.908+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:06.118 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:06.116+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:06.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:06.140+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:06.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:06.734+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:06.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:06.895+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:07.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:07.093+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:07.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:07.129+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:07.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:07.699+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:07.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:07.897+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:08.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:08.135+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:08.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:08.155+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:08.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:08.746+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:08.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:08.856+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:09.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:09.150+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:09.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:09.175+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:09.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:09.740+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:09.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:09.838+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:10.197 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:10.194+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:10.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:10.197+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:10.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:10.763+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:10.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:10.837+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:11.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:11.215+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:11.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:11.234+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:11.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:11.733+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:11.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:11.798+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:12.211 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:12.209+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:12.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:12.271+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:12.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:12.758+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:12.762 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:12.760+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:13.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:13.171+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:13.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:13.267+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:13.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:13.772+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:13.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:13.782+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:14.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:14.204+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:14.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:14.250+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:14.786 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:14.784+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:14.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:14.787+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:15.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:15.195+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:15.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:15.267+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:15.773 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:15.771+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:15.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:15.813+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:16.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:16.222+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:16.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:16.230+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:16.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:16.756+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:16.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:16.814+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:17.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:17.272+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:17.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:17.278+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:17.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:17.761+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:17.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:17.766+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:18.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:18.244+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:18.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:18.244+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:18.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:18.780+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:18.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:18.812+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:19.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:19.236+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:19.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:19.254+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:19.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:19.774+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:19.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:19.799+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:20.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:20.220+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:20.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:20.280+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:20.617 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:52:20.614+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:52:20.769 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:20.767+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:20.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:20.775+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:21.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:21.173+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:21.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:21.315+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:21.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:21.759+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:21.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:21.814+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:22.205 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:22.203+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:22.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:22.304+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:22.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:52:22.720 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:52:22.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:22.741+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:22.831 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:22.829+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:23.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:23.186+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:23.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:23.256+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:23.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:23.713+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:23.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:23.790+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:24.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:24.224+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:24.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:24.230+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:24.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:24.733+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:24.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:24.754+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:25.187 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:25.185+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:25.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:25.219+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:25.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:25.713+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:25.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:25.766+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:26.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:26.138+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:26.204 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:26.202+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:26.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:26.683+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:26.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:26.802+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:27.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:27.145+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:27.213 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:27.211+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:27.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:27.721+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:27.800 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:27.798+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:28.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:28.138+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:28.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:28.225+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:28.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:28.757+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:28.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:28.835+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:29.162 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:29.160+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:29.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:29.210+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:29.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:29.724+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:29.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:29.862+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:30.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:30.168+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:30.200 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:30.199+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:30.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:30.771+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:30.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:30.837+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:31.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:31.163+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:31.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:31.181+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:31.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:31.766+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:31.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:31.803+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:32.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:32.133+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:32.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:32.206+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:32.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:32.730+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:32.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:32.841+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:33.139 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:33.137+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:33.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:33.215+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:33.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:33.694+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:33.825 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:33.824+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:34.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:34.097+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:34.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:34.256+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:34.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:34.719+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:34.798 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:34.797+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:35.054 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:35.053+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:35.216 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:35.215+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:35.619 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:52:35.617+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:52:35.705 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:35.704+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:35.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:35.809+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:36.005 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:36.004+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:36.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:36.188+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:36.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:36.700+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:36.796 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:36.793+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:36.966 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:36.963+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:37.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:37.144+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:37.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:37.722+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:37.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:37.780+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:38.016 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:38.014+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:38.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:38.192+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:38.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:38.680+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:38.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:38.770+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:39.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:39.038+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:39.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:39.169+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:39.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:39.656+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:39.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:39.733+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:40.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:39.999+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:40.124 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:40.121+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:40.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:40.668+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:40.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:40.698+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:40.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:40.955+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:41.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:41.167+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:41.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:41.629+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:41.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:41.650+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:41.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:41.969+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:42.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:42.178+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:42.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:42.599+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:42.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:42.668+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:42.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:42.979+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:43.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:43.212+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:43.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:43.599+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:43.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:43.625+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:43.968 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:43.966+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:44.185 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:44.183+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:44.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:44.573+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:44.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:44.651+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:44.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:44.930+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:45.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:45.208+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:45.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:45.581+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:45.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:45.606+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:45.932 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:45.929+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:46.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:46.239+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:46.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:46.581+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:46.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:46.608+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:46.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:46.911+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:47.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:47.190+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:47.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:47.535+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:47.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:47.597+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:47.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:47.900+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:48.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:48.142+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:48.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:48.523+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:48.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:48.631+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:48.861 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:48.858+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:49.137 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:49.135+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:49.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:49.511+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:49.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:49.660+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:49.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:49.891+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:50.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:50.162+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:50.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:50.526+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:50.635 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:52:50.633+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:52:50.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:50.667+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:50.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:50.936+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:51.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:51.162+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:51.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:51.525+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:51.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:51.681+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:51.950 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:51.948+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:52.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:52.200+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:52.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:52.565+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:52.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:52.694+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:52.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:52:52.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:52:52.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:52.922+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:53.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:53.166+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:53.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:53.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:53.666 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:53.664+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:53.949 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:53.946+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:54.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:54.188+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:54.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:54.583+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:54.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:54.693+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:54.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:54.955+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:55.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:55.204+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:55.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:55.557+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:55.647 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:55.645+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:55.984 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:55.982+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:56.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:56.210+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:56.573 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:56.571+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:56.598 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:56.596+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:56.958 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:56.955+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:57.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:57.259+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:57.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:57.543+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:57.644 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:57.642+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:57.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:57.914+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:58.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:58.283+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:58.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:58.505+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:58.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:58.650+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:58.897 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:58.895+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:59.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:52:59.273+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:59.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:52:59.534+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:59.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:52:59.660+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:52:59.943 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:52:59.941+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:00.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:00.226+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:00.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:00.516+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:00.703 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:00.701+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:00.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:00.903+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:01.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:01.205+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:01.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:01.504+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:01.669 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:01.667+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:01.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:01.890+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:02.225 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:02.223+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:02.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:02.475+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:02.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:02.699+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:02.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:02.888+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:03.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:03.248+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:03.444 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:03.442+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:03.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:03.719+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:03.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:03.850+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:04.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:04.260+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:04.460 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:04.458+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:04.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:04.760+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:04.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:04.874+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:05.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:05.221+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:05.500 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:05.498+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:05.651 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:53:05.649+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:53:05.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:05.715+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:05.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:05.865+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:06.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:06.210+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:06.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:06.516+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:06.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:06.668+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:06.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:06.890+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:07.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:07.178+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:07.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:07.567+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:07.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:07.688+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:07.923 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:07.921+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:08.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:08.178+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:08.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:08.518+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:08.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:08.677+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:08.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:08.921+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:09.175 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:09.172+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:09.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:09.518+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:09.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:09.677+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:09.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:09.904+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:10.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:10.156+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:10.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:10.530+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:10.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:10.705+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:10.875 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:10.874+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:11.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:11.150+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:11.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:11.546+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:11.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:11.717+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:11.876 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:11.875+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:12.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:12.173+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:12.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:12.543+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:12.740 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:12.739+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:12.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:12.858+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:13.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:13.131+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:13.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:13.572+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:13.791 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:13.789+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:13.859 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:13.857+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:14.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:14.136+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:14.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:14.605+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:14.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:14.783+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:14.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:14.834+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:15.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:15.181+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:15.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:15.612+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:15.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:15.755+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:15.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:15.868+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:16.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:16.196+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:16.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:16.581+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:16.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:16.744+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:16.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:16.897+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:17.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:17.246+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:17.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:17.615+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:17.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:17.745+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:17.863 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:17.861+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:18.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:18.290+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:18.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:18.631+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:18.787 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:18.785+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:18.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:18.869+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:19.308 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:19.307+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:19.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:19.640+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:19.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:19.787+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:19.833 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:19.831+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:20.311 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:20.310+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:20.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:20.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:20.667 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:53:20.665+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:53:20.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:20.750+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:20.865 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:20.863+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:21.344 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:21.343+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:21.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:21.580+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:21.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:21.775+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:21.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:21.910+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:22.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:22.368+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:22.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:22.595+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:22.757 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:22.755+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:22.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:22.860+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:22.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:53:22.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:53:23.326 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:23.325+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:23.547 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:23.546+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:23.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:23.744+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:23.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:23.841+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:24.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:24.305+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:24.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:24.563+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:24.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:24.770+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:24.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:24.843+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:25.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:25.339+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:25.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:25.612+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:25.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:25.802+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:25.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:25.873+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:26.337 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:26.335+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:26.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:26.646+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:26.771 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:26.770+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:26.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:26.825+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:27.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:27.296+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:27.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:27.607+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:27.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:27.776+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:27.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:27.798+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:28.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:28.312+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:28.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:28.572+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:28.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:28.758+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:28.816 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:28.813+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:29.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:29.278+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:29.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:29.563+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:29.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:29.751+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:29.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:29.817+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:30.286 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:30.283+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:30.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:30.602+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:30.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:30.736+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:30.782 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:30.780+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:31.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:31.286+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:31.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:31.644+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:31.761 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:31.759+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:31.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:31.790+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:32.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:32.304+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:32.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:32.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:32.731 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:32.728+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:32.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:32.833+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:33.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:33.275+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:33.641 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:33.638+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:33.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:33.723+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:33.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:33.856+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:34.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:34.288+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:34.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:34.679+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:34.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:34.703+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:34.809 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:34.807+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:35.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:35.298+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:35.683 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:53:35.680+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:53:35.694 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:35.692+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:35.738 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:35.735+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:35.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:35.778+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:36.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:36.257+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:36.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:36.675+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:36.757 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:36.754+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:36.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:36.765+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:37.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:37.271+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:37.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:37.678+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:37.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:37.720+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:37.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:37.737+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:38.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:38.297+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:38.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:38.654+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:38.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:38.720+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:38.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:38.763+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:39.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:39.257+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:39.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:39.648+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:39.711 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:39.709+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:39.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:39.717+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:40.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:40.251+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:40.605 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:40.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:40.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:40.695+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:40.718 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:40.715+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:41.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:41.224+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:41.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:41.578+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:41.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:41.718+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:41.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:41.735+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:42.202 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:42.199+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:42.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:42.609+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:42.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:42.713+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:42.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:42.726+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:43.199 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:43.196+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:43.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:43.579+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:43.679 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:43.677+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:43.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:43.691+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:44.241 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:44.238+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:44.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:44.554+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:44.684 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:44.681+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:44.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:44.713+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:45.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:45.287+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:45.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:45.563+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:45.693 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:45.690+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:45.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:45.712+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:46.322 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:46.319+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:46.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:46.542+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:46.672 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:46.669+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:46.727 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:46.724+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:47.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:47.368+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:47.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:47.553+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:47.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:47.685+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:47.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:47.714+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:48.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:48.374+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:48.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:48.584+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:48.639 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:48.636+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:48.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:48.695+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:49.345 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:49.343+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:49.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:49.536+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:49.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:49.687+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:49.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:49.698+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:50.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:50.354+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:50.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:50.583+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:50.668 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:50.665+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:50.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:50.690+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:50.692 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:53:50.690+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:53:51.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:51.338+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:51.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:51.556+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:51.625 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:51.622+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:51.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:51.733+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:52.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:52.351+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:52.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:52.507+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:52.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:52.587+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:52.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:52.746+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:53.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:53:53.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:53:53.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:53.322+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:53.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:53.525+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:53.571 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:53.569+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:53.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:53.709+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:54.324 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:54.322+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:54.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:54.543+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:54.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:54.602+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:54.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:54.704+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:55.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:55.341+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:55.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:55.555+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:55.583 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:55.581+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:55.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:55.722+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:56.382 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:56.380+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:56.538 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:56.535+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:56.587 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:56.584+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:56.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:56.687+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:57.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:57.339+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:57.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:57.531+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:57.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:57.573+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:57.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:57.647+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:58.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:58.376+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:58.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:58.579+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:58.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:58.603+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:58.623 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:58.620+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:59.377 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:53:59.375+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:59.591 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:53:59.588+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:59.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:53:59.593+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:53:59.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:53:59.621+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:00.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:00.328+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:00.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:00.581+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:00.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:00.607+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:00.660 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:00.658+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:01.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:01.365+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:01.547 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:01.545+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:01.611 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:01.609+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:01.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:01.619+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:02.368 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:02.367+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:02.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:02.564+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:02.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:02.575+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:02.657 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:02.656+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:03.390 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:03.389+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:03.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:03.519+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:03.532 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:03.531+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:03.651 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:03.650+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:04.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:04.346+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:04.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:04.516+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:04.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:04.564+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:04.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:04.693+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:05.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:05.368+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:05.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:05.474+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:05.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:05.553+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:05.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:05.669+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:05.708 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:54:05.705+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:54:06.384 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:06.382+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:06.435 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:06.434+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:06.561 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:06.560+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:06.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:06.712+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:07.423 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:07.421+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:07.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:07.466+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:07.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:07.582+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:07.720 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:07.719+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:08.427 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:08.426+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:08.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:08.486+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:08.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:08.557+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:08.689 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:08.687+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:09.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:09.453+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:09.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:09.504+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:09.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:09.529+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:09.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:09.663+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:10.469 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:10.468+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:10.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:10.483+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:10.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:10.501+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:10.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:10.688+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:11.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:11.434+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:11.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:11.482+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:11.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:11.548+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:11.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:11.711+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:12.435 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:12.433+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:12.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:12.454+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:12.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:12.513+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:12.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:12.735+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:13.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:13.384+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:13.506 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:13.504+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:13.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:13.521+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:13.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:13.693+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:14.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:14.374+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:14.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:14.500+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:14.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:14.506+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:14.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:14.674+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:15.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:15.360+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:15.514 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:15.513+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:15.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:15.538+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:15.662 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:15.660+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:16.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:16.395+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:16.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:16.476+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:16.527 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:16.526+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:16.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:16.671+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:17.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:17.416+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:17.441 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:17.439+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:17.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:17.483+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:17.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:17.636+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:18.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:18.414+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:18.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:18.455+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:18.521 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:18.518+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:18.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:18.655+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:19.465 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:19.462+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:19.507 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:19.504+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:19.548 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:19.545+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:19.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:19.647+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:20.463 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:20.461+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:20.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:20.519+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:20.540 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:20.537+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:20.654 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:20.652+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:20.724 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:54:20.721+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:54:21.502 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:21.499+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:21.505 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:21.502+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:21.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:21.506+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:21.610 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:21.607+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:22.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:22.479+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:22.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:22.500+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:22.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:22.524+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:22.631 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:22.628+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:23.193 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:54:23.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:54:23.509 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:23.506+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:23.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:23.512+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:23.536 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:23.533+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:23.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:23.668+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:24.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:24.457+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:24.472 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:24.469+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:24.520 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:24.517+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:24.629 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:24.627+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:25.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:25.482+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:25.508 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:25.506+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:25.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:25.516+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:25.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:25.636+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:26.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:26.452+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:26.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:26.521+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:26.527 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:26.525+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:26.646 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:26.643+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:27.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:27.414+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:27.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:27.481+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:27.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:27.538+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:27.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:27.618+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:28.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:28.439+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:28.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:28.490+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:28.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:28.579+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:28.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:28.667+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:29.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:29.440+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:29.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:29.487+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:29.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:29.620+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:29.650 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:29.648+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:30.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:30.416+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:30.485 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:30.482+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:30.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:30.582+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:30.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:30.654+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:31.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:31.449+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:31.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:31.462+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:31.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:31.612+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:31.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:31.684+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:32.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:32.408+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:32.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:32.459+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:32.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:32.595+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:32.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:32.669+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:33.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:33.433+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:33.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:33.504+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:33.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:33.644+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:33.716 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:33.714+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:34.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:34.439+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:34.508 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:34.506+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:34.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:34.689+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:34.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:34.699+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:35.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:35.441+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:35.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:35.530+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:35.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:35.721+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:35.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:35.733+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:35.739 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:54:35.738+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:54:36.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:36.411+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:36.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:36.521+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:36.710 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:36.708+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:36.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:36.722+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:37.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:37.364+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:37.493 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:37.491+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:37.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:37.700+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:37.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:37.715+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:38.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:38.364+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:38.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:38.493+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:38.699 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:38.697+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:38.729 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:38.727+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:39.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:39.378+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:39.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:39.501+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:39.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:39.738+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:39.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:39.776+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:40.365 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:40.363+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:40.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:40.500+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:40.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:40.707+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:40.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:40.808+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:41.332 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:41.330+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:41.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:41.548+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:41.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:41.741+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:41.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:41.779+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:42.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:42.321+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:42.541 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:42.539+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:42.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:42.747+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:42.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:42.768+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:43.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:43.302+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:43.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:43.529+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:43.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:43.776+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:43.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:43.795+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:44.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:44.266+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:44.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:44.560+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:44.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:44.767+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:44.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:44.801+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:45.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:45.221+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:45.566 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:45.564+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:45.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:45.724+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:45.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:45.798+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:46.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:46.178+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:46.538 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:46.536+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:46.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:46.762+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:46.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:46.763+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:47.229 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:47.226+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:47.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:47.512+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:47.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:47.720+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:47.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:47.746+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:48.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:48.190+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:48.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:48.522+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:48.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:48.696+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:48.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:48.716+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:49.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:49.179+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:49.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:49.531+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:49.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:49.667+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:49.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:49.680+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:50.221 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:50.219+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:50.554 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:50.551+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:50.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:50.634+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:50.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:50.708+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:50.755 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:54:50.753+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:54:51.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:51.259+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:51.505 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:51.503+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:51.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:51.643+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:51.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:51.673+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:52.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:52.275+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:52.526 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:52.524+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:52.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:52.636+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:52.695 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:52.693+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:53.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:53.278+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:53.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:54:53.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:54:53.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:53.483+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:53.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:53.683+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:53.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:53.713+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:54.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:54.316+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:54.447 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:54.445+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:54.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:54.668+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:54.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:54.723+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:55.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:55.327+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:55.488 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:55.486+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:55.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:55.685+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:55.697 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:55.696+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:56.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:56.303+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:56.514 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:56.513+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:56.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:56.712+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:56.721 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:56.720+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:57.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:57.288+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:57.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:57.468+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:57.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:57.684+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:57.691 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:57.689+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:58.334 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:58.332+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:58.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:58.422+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:58.653 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:58.652+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:58.687 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:58.686+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:59.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:54:59.299+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:59.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:54:59.465+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:59.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:54:59.668+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:54:59.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:54:59.673+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:00.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:00.321+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:00.480 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:00.479+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:00.675 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:00.674+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:00.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:00.699+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:01.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:01.329+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:01.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:01.434+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:01.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:01.653+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:01.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:01.676+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:02.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:02.321+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:02.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:02.412+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:02.615 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:02.613+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:02.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:02.682+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:03.343 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:03.342+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:03.392 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:03.390+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:03.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:03.636+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:03.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:03.639+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:04.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:04.374+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:04.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:04.386+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:04.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:04.620+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:04.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:04.663+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:05.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:05.338+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:05.378 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:05.377+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:05.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:05.592+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:05.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:05.670+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:05.771 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:55:05.770+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:55:06.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:06.300+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:06.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:06.356+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:06.626 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:06.624+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:06.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:06.662+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:07.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:07.252+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:07.312 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:07.310+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:07.655 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:07.653+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:07.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:07.699+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:08.261 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:08.259+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:08.319 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:08.316+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:08.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:08.660+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:08.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:08.672+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:09.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:09.304+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:09.318 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:09.316+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:09.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:09.629+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:09.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:09.708+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:10.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:10.272+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:10.366 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:10.363+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:10.591 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:10.588+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:10.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:10.682+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:11.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:11.318+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:11.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:11.344+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:11.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:11.633+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:11.658 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:11.656+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:12.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:12.297+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:12.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:12.346+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:12.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:12.669+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:12.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:12.703+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:13.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:13.297+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:13.316 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:13.314+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:13.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:13.647+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:13.659 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:13.657+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:14.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:14.274+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:14.280 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:14.278+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:14.606 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:14.603+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:14.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:14.673+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:15.316 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:15.314+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:15.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:15.325+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:15.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:15.621+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:15.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:15.675+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:16.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:16.324+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:16.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:16.358+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:16.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:16.638+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:16.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:16.710+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:17.361 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:17.359+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:17.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:17.364+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:17.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:17.665+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:17.719 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:17.717+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:18.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:18.329+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:18.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:18.402+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:18.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:18.661+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:18.724 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:18.722+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:19.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:19.327+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:19.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:19.425+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:19.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:19.653+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:19.699 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:19.696+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:20.379 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:20.368+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:20.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:20.411+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:20.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:20.676+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:20.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:20.744+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:20.787 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:55:20.785+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:55:21.362 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:21.360+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:21.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:21.437+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:21.663 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:21.661+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:21.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:21.772+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:22.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:22.333+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:22.461 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:22.459+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:22.628 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:22.625+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:22.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:22.789+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:23.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:23.301+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:23.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:55:23.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:55:23.492 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:23.489+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:23.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:23.624+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:23.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:23.747+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:24.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:24.289+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:24.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:24.496+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:24.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:24.663+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:24.770 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:24.768+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:25.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:25.248+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:25.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:25.494+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:25.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:25.623+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:25.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:25.814+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:26.256 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:26.253+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:26.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:26.475+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:26.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:26.600+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:26.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:26.790+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:27.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:27.289+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:27.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:27.522+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:27.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:27.580+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:27.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:27.831+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:28.278 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:28.276+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:28.533 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:28.531+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:28.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:28.544+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:28.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:28.808+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:29.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:29.248+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:29.525 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:29.523+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:29.540 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:29.538+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:29.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:29.855+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:30.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:30.296+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:30.568 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:30.565+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:30.580 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:30.577+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:30.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:30.835+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:31.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:31.280+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:31.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:31.565+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:31.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:31.622+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:31.881 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:31.878+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:32.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:32.239+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:32.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:32.557+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:32.634 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:32.632+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:32.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:32.876+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:33.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:33.245+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:33.543 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:33.541+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:33.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:33.667+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:33.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:33.925+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:34.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:34.236+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:34.496 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:34.493+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:34.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:34.687+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:34.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:34.881+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:35.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:35.236+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:35.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:35.454+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:35.723 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:35.721+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:35.803 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:55:35.801+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:55:35.874 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:35.872+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:36.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:36.268+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:36.490 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:36.487+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:36.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:36.746+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:36.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:36.869+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:37.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:37.272+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:37.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:37.509+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:37.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:37.774+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:37.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:37.827+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:38.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:38.275+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:38.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:38.475+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:38.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:38.795+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:38.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:38.799+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:39.243 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:39.240+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:39.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:39.438+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:39.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:39.776+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:39.779 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:39.776+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:40.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:40.258+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:40.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:40.444+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:40.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:40.733+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:40.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:40.823+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:41.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:41.301+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:41.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:41.428+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:41.710 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:41.708+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:41.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:41.806+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:42.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:42.298+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:42.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:42.408+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:42.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:42.715+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:42.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:42.762+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:43.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:43.280+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:43.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:43.366+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:43.713 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:43.712+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:43.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:43.812+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:44.252 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:44.250+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:44.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:44.342+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:44.670 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:44.669+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:44.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:44.769+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:45.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:45.216+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:45.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:45.335+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:45.665 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:45.663+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:45.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:45.793+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:46.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:46.215+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:46.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:46.305+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:46.640 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:46.638+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:46.753 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:46.751+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:47.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:47.172+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:47.303 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:47.301+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:47.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:47.628+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:47.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:47.773+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:48.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:48.193+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:48.282 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:48.281+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:48.674 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:48.672+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:48.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:48.823+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:49.183 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:49.181+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:49.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:49.324+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:49.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:49.635+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:49.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:49.818+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:50.230 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:50.229+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:50.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:50.334+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:50.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:50.599+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:50.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:50.781+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:50.808 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:55:50.805+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:55:51.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:51.230+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:51.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:51.326+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:51.621 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:51.619+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:51.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:51.809+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:52.254 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:52.252+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:52.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:52.365+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:52.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:52.626+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:52.798 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:52.796+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:53.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:53.240+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:53.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:53.386+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:53.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:55:53.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:55:53.667 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:53.666+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:53.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:53.797+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:54.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:54.227+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:54.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:54.426+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:54.707 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:54.706+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:54.848 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:54.847+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:55.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:55.274+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:55.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:55.404+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:55.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:55.751+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:55.852 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:55.850+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:56.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:56.323+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:56.414 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:56.413+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:56.775 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:56.773+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:56.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:56.846+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:57.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:57.314+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:57.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:57.392+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:57.818 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:57.816+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:57.838 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:57.836+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:58.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:58.271+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:58.441 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:58.439+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:58.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:58.808+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:58.846 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:58.844+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:59.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:55:59.255+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:59.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:55:59.450+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:59.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:55:59.817+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:55:59.832 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:55:59.830+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:00.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:00.230+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:00.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:00.455+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:00.804 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:00.801+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:00.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:00.817+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:01.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:01.262+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:01.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:01.431+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:01.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:01.774+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:01.843 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:01.841+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:02.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:02.295+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:02.466 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:02.463+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:02.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:02.811+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:02.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:02.890+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:03.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:03.296+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:03.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:03.456+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:03.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:03.826+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:03.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:03.905+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:04.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:04.328+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:04.449 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:04.447+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:04.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:04.854+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:04.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:04.865+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:05.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:05.301+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:05.476 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:05.474+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:05.824 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:56:05.821+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:56:05.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:05.883+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:05.889 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:05.886+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:06.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:06.255+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:06.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:06.453+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:06.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:06.851+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:06.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:06.900+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:07.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:07.265+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:07.482 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:07.479+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:07.883 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:07.881+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:07.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:07.889+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:08.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:08.265+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:08.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:08.471+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:08.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:08.917+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:08.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:08.930+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:09.247 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:09.244+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:09.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:09.510+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:09.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:09.910+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:09.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:09.934+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:10.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:10.257+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:10.544 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:10.541+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:10.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:10.915+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:10.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:10.934+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:11.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:11.247+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:11.536 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:11.533+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:11.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:11.909+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:11.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:11.915+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:12.249 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:12.247+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:12.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:12.547+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:12.895 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:12.892+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:12.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:12.915+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:13.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:13.250+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:13.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:13.593+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:13.909 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:13.907+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:13.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:13.945+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:14.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:14.272+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:14.558 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:14.556+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:14.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:14.937+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:14.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:14.939+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:15.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:15.232+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:15.595 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:15.593+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:15.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:15.931+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:15.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:15.982+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:16.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:16.204+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:16.592 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:16.590+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:16.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:16.933+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:17.032 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:17.030+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:17.223 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:17.220+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:17.583 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:17.581+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:17.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:17.912+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:18.040 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:18.038+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:18.201 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:18.198+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:18.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:18.582+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:18.885 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:18.883+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:18.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:18.991+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:19.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:19.207+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:19.562 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:19.560+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:19.935 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:19.933+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:19.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:19.967+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:20.167 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:20.164+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:20.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:20.598+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:20.840 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:56:20.838+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:56:20.931 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:20.930+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:20.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:20.957+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:21.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:21.166+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:21.623 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:21.621+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:21.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:21.911+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:22.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:21.991+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:22.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:22.141+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:22.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:22.664+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:22.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:22.863+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:22.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:22.944+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:23.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:23.112+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:23.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:56:23.620 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:56:23.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:23.630+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:23.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:23.818+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:23.897 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:23.895+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:24.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:24.067+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:24.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:24.591+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:24.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:24.801+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:24.858 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:24.855+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:25.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:25.104+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:25.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:25.632+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:25.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:25.758+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:25.861 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:25.858+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:26.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:26.073+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:26.635 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:26.633+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:26.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:26.745+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:26.853 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:26.850+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:27.109 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:27.107+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:27.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:27.676+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:27.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:27.757+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:27.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:27.814+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:28.146 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:28.143+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:28.680 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:28.677+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:28.782 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:28.780+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:28.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:28.780+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:29.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:29.160+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:29.650 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:29.648+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:29.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:29.801+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:29.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:29.802+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:30.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:30.169+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:30.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:30.683+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:30.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:30.761+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:30.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:30.790+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:31.132 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:31.130+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:31.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:31.676+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:31.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:31.785+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:31.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:31.799+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:32.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:32.150+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:32.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:32.720+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:32.778 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:32.776+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:32.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:32.814+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:33.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:33.175+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:33.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:33.739+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:33.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:33.748+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:33.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:33.852+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:34.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:34.150+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:34.705 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:34.703+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:34.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:34.734+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:34.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:34.884+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:35.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:35.137+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:35.683 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:35.681+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:35.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:35.701+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:35.856 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:56:35.853+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:56:35.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:35.900+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:36.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:36.172+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:36.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:36.643+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:36.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:36.703+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:36.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:36.944+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:37.193 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:37.158+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:37.643 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:37.642+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:37.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:37.747+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:37.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:37.944+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:38.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:38.141+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:38.617 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:38.615+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:38.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:38.727+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:38.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:38.968+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:39.106 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:39.104+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:39.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:39.601+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:39.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:39.730+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:40.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:40.012+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:40.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:40.106+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:40.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:40.603+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:40.768 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:40.767+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:41.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:41.062+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:41.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:41.125+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:41.628 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:41.627+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:41.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:41.731+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:42.059 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:42.057+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:42.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:42.150+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:42.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:42.579+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:42.770 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:42.769+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:43.083 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:43.081+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:43.184 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:43.183+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:43.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:43.570+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:43.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:43.725+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:44.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:44.084+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:44.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:44.231+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:44.534 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:44.532+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:44.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:44.743+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:45.113 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:45.111+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:45.198 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:45.197+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:45.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:45.505+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:45.715 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:45.714+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:46.161 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:46.160+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:46.239 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:46.238+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:46.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:46.467+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:46.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:46.696+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:47.151 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:47.150+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:47.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:47.281+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:47.506 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:47.505+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:47.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:47.736+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:48.157 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:48.156+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:48.299 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:48.297+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:48.508 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:48.507+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:48.705 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:48.703+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:49.108 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:49.107+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:49.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:49.291+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:49.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:49.501+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:49.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:49.700+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:50.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:50.070+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:50.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:50.279+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:50.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:50.479+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:50.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:50.701+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:50.872 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:56:50.870+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:56:51.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:51.022+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:51.253 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:51.251+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:51.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:51.484+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:51.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:51.688+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:51.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:51.975+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:52.212 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:52.209+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:52.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:52.468+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:52.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:52.645+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:52.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:52.963+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:53.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:53.249+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:53.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:53.441+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:53.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:53.681+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:53.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:56:53.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:56:53.945 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:53.943+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:54.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:54.291+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:54.486 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:54.483+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:54.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:54.642+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:54.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:54.968+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:55.292 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:55.290+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:55.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:55.515+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:55.609 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:55.606+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:55.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:55.972+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:56.325 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:56.323+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:56.510 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:56.507+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:56.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:56.617+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:56.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:56.958+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:57.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:57.294+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:57.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:57.462+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:57.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:57.598+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:57.950 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:57.948+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:58.338 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:58.336+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:58.420 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:58.418+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:58.621 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:58.619+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:58.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:56:58.996+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:59.348 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:56:59.345+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:59.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:56:59.435+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:56:59.577 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:56:59.575+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:00.007 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:00.004+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:00.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:00.371+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:00.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:00.466+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:00.549 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:00.546+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:00.998 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:00.995+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:01.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:01.389+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:01.428 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:01.425+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:01.593 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:01.590+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:02.037 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:02.035+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:02.393 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:02.391+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:02.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:02.401+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:02.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:02.562+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:03.002 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:02.999+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:03.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:03.420+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:03.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:03.447+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:03.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:03.526+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:03.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:03.969+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:04.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:04.397+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:04.408 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:04.405+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:04.512 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:04.510+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:05.013 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:05.010+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:05.395 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:05.392+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:05.398 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:05.396+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:05.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:05.507+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:05.888 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:57:05.885+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:57:06.027 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:06.025+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:06.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:06.368+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:06.373 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:06.370+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:06.524 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:06.521+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:07.065 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:07.063+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:07.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:07.364+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:07.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:07.384+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:07.495 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:07.493+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:08.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:08.085+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:08.396 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:08.394+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:08.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:08.401+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:08.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:08.505+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:09.039 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:09.036+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:09.368 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:09.366+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:09.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:09.417+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:09.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:09.553+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:10.050 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:10.047+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:10.364 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:10.362+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:10.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:10.409+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:10.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:10.598+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:11.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:11.023+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:11.349 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:11.347+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:11.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:11.372+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:11.565 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:11.562+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:11.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:11.988+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:12.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:12.323+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:12.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:12.392+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:12.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:12.530+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:12.977 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:12.975+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:13.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:13.352+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:13.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:13.403+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:13.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:13.501+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:13.951 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:13.949+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:14.313 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:14.311+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:14.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:14.408+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:14.506 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:14.504+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:14.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:14.922+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:15.317 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:15.315+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:15.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:15.458+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:15.498 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:15.496+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:15.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:15.930+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:16.325 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:16.323+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:16.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:16.412+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:16.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:16.469+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:16.960 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:16.957+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:17.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:17.300+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:17.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:17.368+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:17.474 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:17.472+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:17.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:17.967+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:18.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:18.278+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:18.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:18.395+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:18.511 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:18.509+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:18.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:18.922+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:19.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:19.267+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:19.381 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:19.379+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:19.487 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:19.485+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:19.970 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:19.968+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:20.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:20.288+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:20.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:20.418+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:20.518 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:20.516+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:20.903 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:57:20.901+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:57:20.946 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:20.944+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:21.277 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:21.274+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:21.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:21.397+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:21.501 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:21.499+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:21.973 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:21.971+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:22.292 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:22.290+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:22.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:22.446+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:22.489 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:22.487+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:22.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:22.997+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:23.264 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:23.262+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:23.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:23.445+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:23.517 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:23.516+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:23.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:57:23.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:57:23.969 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:23.967+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:24.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:24.302+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:24.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:24.458+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:24.522 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:24.521+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:24.988 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:24.986+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:25.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:25.296+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:25.436 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:25.435+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:25.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:25.514+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:26.015 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:26.013+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:26.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:26.256+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:26.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:26.438+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:26.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:26.548+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:26.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:26.997+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:27.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:27.232+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:27.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:27.447+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:27.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:27.558+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:27.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:27.954+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:28.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:28.268+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:28.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:28.477+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:28.528 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:28.527+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:28.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:28.992+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:29.248 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:29.247+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:29.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:29.516+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:29.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:29.545+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:30.033 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:30.031+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:30.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:30.289+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:30.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:30.476+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:30.596 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:30.594+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:31.049 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:31.048+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:31.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:31.297+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:31.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:31.489+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:31.636 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:31.635+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:32.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:32.089+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:32.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:32.260+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:32.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:32.499+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:32.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:32.665+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:33.079 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:33.078+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:33.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:33.285+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:33.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:33.459+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:33.700 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:33.698+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:34.107 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:34.106+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:34.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:34.277+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:34.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:34.430+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:34.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:34.730+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:35.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:35.076+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:35.304 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:35.303+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:35.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:35.431+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:35.747 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:35.745+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:35.920 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:57:35.918+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:57:36.064 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:36.062+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:36.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:36.283+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:36.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:36.408+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:36.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:36.750+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:37.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:37.035+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:37.245 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:37.243+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:37.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:37.439+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:37.799 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:37.797+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:38.045 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:38.043+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:38.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:38.245+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:38.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:38.417+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:38.803 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:38.802+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:39.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:39.010+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:39.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:39.209+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:39.387 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:39.386+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:39.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:39.799+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:40.051 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:40.050+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:40.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:40.169+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:40.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:40.428+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:40.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:40.828+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:41.074 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:41.071+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:41.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:41.150+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:41.393 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:41.390+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:41.872 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:41.870+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:42.044 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:42.042+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:42.145 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:42.143+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:42.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:42.400+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:42.847 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:42.845+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:43.058 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:43.056+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:43.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:43.118+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:43.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:43.397+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:43.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:43.804+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:44.043 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:44.040+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:44.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:44.118+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:44.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:44.438+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:44.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:44.834+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:45.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:45.025+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:45.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:45.110+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:45.486 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:45.483+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:45.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:45.833+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:45.995 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:45.992+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:46.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:46.141+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:46.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:46.514+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:46.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:46.823+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:46.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:46.977+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:47.160 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:47.158+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:47.468 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:47.466+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:47.821 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:47.818+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:47.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:47.934+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:48.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:48.184+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:48.447 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:48.445+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:48.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:48.820+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:48.971 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:48.968+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:49.220 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:49.217+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:49.481 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:49.479+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:49.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:49.787+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:49.963 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:49.960+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:50.240 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:50.238+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:50.502 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:50.499+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:50.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:50.794+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:50.935 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:57:50.933+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:57:50.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:50.982+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:51.211 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:51.209+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:51.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:51.471+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:51.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:51.780+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:51.961 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:51.959+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:52.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:52.162+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:52.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:52.486+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:52.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:52.747+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:52.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:52.952+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:53.176 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:53.174+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:53.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:53.453+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:53.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:53.714+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:53.933 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:53.931+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:53.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:57:53.946 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:57:54.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:54.148+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:54.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:54.499+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:54.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:54.723+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:54.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:54.917+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:55.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:55.129+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:55.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:55.498+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:55.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:55.709+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:55.932 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:55.930+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:56.168 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:56.165+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:56.535 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:56.533+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:56.726 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:56.723+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:56.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:56.936+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:57.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:57.134+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:57.543 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:57.541+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:57.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:57.708+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:57.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:57.898+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:58.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:58.096+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:58.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:58.532+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:58.697 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:58.695+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:58.885 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:58.883+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:59.111 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:57:59.109+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:59.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:57:59.540+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:59.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:57:59.662+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:57:59.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:57:59.889+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:00.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:00.108+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:00.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:00.521+0000 7f6e44c9f700 -1 osd.7 120 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:00.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:00.699+0000 7f72c425d700 -1 osd.5 120 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:00.927 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:00.924+0000 7f596d92c700 -1 osd.6 120 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:01.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:01.111+0000 7f389e18e700 -1 osd.4 120 get_health_metrics reporting 79 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:01.278 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T03:58:01.275+0000 7f46ad60d700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:58:01.293 INFO:tasks.ceph.mds.b.smithi117.stderr: -1> 2022-04-04T03:58:01.275+0000 7f46ad60d700 -1 MDSIOContextBase: failed with -110, restarting... 2022-04-04T03:58:01.293 INFO:tasks.ceph.mds.b.smithi117.stderr:2022-04-04T03:58:01.276+0000 7f46ace0c700 -1 log_channel(cluster) log [ERR] : failed to read JournalPointer: -110 ((110) Connection timed out) 2022-04-04T03:58:01.315 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2022-04-04T03:58:01.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:01.482+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 57 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:01.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:01.716+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:01.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:01.957+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:02.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:02.144+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:02.528 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:02.526+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:02.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:02.691+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:02.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:02.987+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:03.105 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:03.102+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:03.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:03.489+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:03.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:03.652+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:03.986 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:03.983+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:04.120 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:04.118+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:04.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:04.536+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:04.683 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:04.681+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:04.980 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:04.978+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:05.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:05.121+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:05.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:05.540+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:05.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:05.676+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:05.941 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:58:05.939+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:58:05.968 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:05.965+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:06.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:06.112+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:06.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:06.494+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:06.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:06.636+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:06.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:06.944+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:07.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:07.088+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:07.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:07.508+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:07.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:07.641+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:07.991 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:07.990+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:08.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:08.111+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:08.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:08.501+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:08.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:08.685+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:08.954 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:08.952+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:09.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:09.107+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:09.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:09.538+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:09.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:09.725+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:09.978 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:09.976+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:10.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:10.136+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:10.501 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:10.499+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:10.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:10.684+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:10.981 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:10.978+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:11.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:11.107+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:11.453 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:11.451+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:11.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:11.661+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:11.959 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:11.957+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:12.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:12.121+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:12.489 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:12.487+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:12.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:12.673+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:12.989 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:12.987+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:13.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:13.074+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:13.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:13.496+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:13.663 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:13.661+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:14.036 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:14.034+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:14.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:14.063+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:14.511 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:14.509+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:14.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:14.676+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:15.021 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:15.019+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:15.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:15.050+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:15.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:15.467+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:15.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:15.710+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:15.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:15.991+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:16.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:16.097+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:16.487 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:16.485+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:16.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:16.752+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:16.984 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:16.982+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:17.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:17.083+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:17.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:17.514+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:17.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:17.707+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:17.955 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:17.954+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:18.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:18.073+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:18.498 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:18.496+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:18.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:18.757+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:18.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:18.956+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:19.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:19.092+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:19.506 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:19.504+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:19.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:19.795+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:19.987 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:19.985+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:20.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:20.106+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:20.553 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:20.552+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:20.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:20.779+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:20.950 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:58:20.947+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:58:20.993 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:20.992+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:21.072 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:21.071+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:21.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:21.532+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:21.732 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:21.730+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:21.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:21.983+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:22.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:22.107+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:22.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:22.502+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:22.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:22.780+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:23.014 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:23.013+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:23.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:23.102+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:23.495 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:23.494+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:23.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:23.818+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:23.966 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:23.965+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:24.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:58:24.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:58:24.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:24.072+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:24.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:24.444+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:24.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:24.823+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:24.983 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:24.982+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:25.037 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:25.036+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:25.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:25.458+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:25.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:25.794+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:25.958 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:25.956+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:26.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:26.045+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:26.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:26.459+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:26.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:26.811+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:26.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:26.937+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:26.999 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:26.997+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:27.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:27.450+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:27.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:27.842+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:27.913 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:27.911+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:28.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:28.029+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:28.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:28.415+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:28.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:28.796+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:28.877 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:28.875+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:29.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:29.042+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:29.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:29.429+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:29.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:29.760+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:29.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:29.867+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:29.996 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:29.994+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:30.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:30.392+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:30.779 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:30.777+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:30.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:30.874+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:30.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:30.988+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:31.404 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:31.402+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:31.753 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:31.751+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:31.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:31.863+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:31.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:31.981+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:32.392 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:32.390+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:32.717 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:32.714+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:32.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:32.821+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:33.002 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:32.999+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:33.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:33.409+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:33.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:33.764+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:33.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:33.844+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:34.018 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:34.016+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:34.380 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:34.377+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:34.797 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:34.794+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:34.812 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:34.810+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:34.994 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:34.992+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:35.360 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:35.357+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:35.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:35.793+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:35.813 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:35.811+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:35.966 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:58:35.963+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:58:36.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:36.028+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:36.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:36.397+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:36.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:36.773+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:36.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:36.805+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:37.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:37.066+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:37.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:37.406+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:37.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:37.740+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:37.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:37.822+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:38.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:38.038+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:38.454 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:38.452+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:38.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:38.760+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:38.832 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:38.830+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:39.042 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:39.039+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:39.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:39.444+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:39.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:39.769+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:39.785 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:39.783+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:40.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:40.052+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:40.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:40.413+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:40.745 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:40.742+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:40.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:40.807+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:41.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:41.063+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:41.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:41.398+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:41.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:41.747+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:41.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:41.825+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:42.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:42.106+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:42.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:42.365+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:42.784 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:42.782+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:42.867 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:42.865+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:43.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:43.072+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:43.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:43.392+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:43.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:43.753+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:43.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:43.837+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:44.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:44.041+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:44.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:44.429+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:44.773 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:44.771+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:44.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:44.825+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:45.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:45.053+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:45.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:45.420+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:45.793 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:45.790+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:45.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:45.825+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:46.099 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:46.096+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:46.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:46.443+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:46.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:46.839+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:46.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:46.862+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:47.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:47.135+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:47.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:47.450+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:47.794 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:47.791+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:47.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:47.834+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:48.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:48.155+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:48.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:48.497+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:48.780 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:48.778+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:48.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:48.801+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:49.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:49.163+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:49.534 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:49.532+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:49.763 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:49.760+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:49.836 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:49.834+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:50.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:50.180+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:50.576 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:50.573+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:50.721 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:50.718+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:50.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:50.874+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:50.976 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:58:50.975+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:58:51.187 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:51.184+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:51.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:51.608+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:51.708 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:51.706+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:51.897 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:51.894+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:52.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:52.155+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:52.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:52.573+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:52.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:52.696+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:52.924 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:52.922+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:53.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:53.177+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:53.594 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:53.591+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:53.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:53.649+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:53.934 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:53.932+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:54.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:54.159+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:54.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:58:54.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:58:54.567 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:54.565+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:54.677 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:54.675+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:54.919 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:54.916+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:55.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:55.117+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:55.565 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:55.563+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:55.643 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:55.641+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:55.930 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:55.928+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:56.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:56.144+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:56.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:56.543+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:56.600 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:56.598+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:56.962 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:56.961+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:57.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:57.181+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:57.547 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:57.545+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:57.598 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:57.596+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:57.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:57.913+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:58.192 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:58.190+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:58.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:58.558+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:58.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:58.631+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:58.912 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:58.910+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:59.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:58:59.141+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:59.608 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:58:59.606+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:59.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:58:59.673+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:58:59.868 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:58:59.866+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:00.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:00.110+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:00.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:00.607+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:00.633 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:00.630+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:00.827 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:00.825+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:01.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:01.146+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:01.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:01.629+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:01.659 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:01.656+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:01.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:01.823+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:02.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:02.115+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:02.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:02.665+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:02.683 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:02.681+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:02.841 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:02.839+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:03.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:03.125+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:03.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:03.633+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:03.693 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:03.691+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:03.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:03.845+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:04.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:04.119+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:04.645 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:04.643+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:04.688 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:04.686+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:04.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:04.839+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:05.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:05.075+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:05.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:05.616+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:05.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:05.718+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:05.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:05.845+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:05.992 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:59:05.989+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:59:06.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:06.056+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:06.621 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:06.619+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:06.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:06.699+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:06.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:06.809+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:07.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:07.073+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:07.636 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:07.634+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:07.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:07.660+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:07.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:07.765+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:08.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:08.069+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:08.647 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:08.646+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:08.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:08.677+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:08.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:08.734+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:09.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:09.042+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:09.635 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:09.633+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:09.667 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:09.665+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:09.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:09.781+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:10.076 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:10.075+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:10.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:10.594+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:10.666 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:10.665+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:10.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:10.822+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:11.086 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:11.084+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:11.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:11.582+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:11.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:11.648+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:11.829 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:11.827+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:12.122 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:12.121+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:12.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:12.569+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:12.690 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:12.688+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:12.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:12.780+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:13.144 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:13.142+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:13.601 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:13.599+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:13.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:13.729+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:13.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:13.773+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:14.179 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:14.178+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:14.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:14.593+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:14.736 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:14.734+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:14.748 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:14.747+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:15.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:15.172+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:15.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:15.582+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:15.766 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:15.765+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:15.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:15.774+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:16.137 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:16.136+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:16.626 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:16.624+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:16.807 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:16.805+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:16.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:16.820+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:17.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:17.102+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:17.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:17.628+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:17.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:17.788+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:17.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:17.791+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:18.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:18.060+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:18.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:18.672+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:18.820 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:18.819+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:18.825 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:18.824+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:19.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:19.014+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:19.641 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:19.640+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:19.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:19.799+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:19.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:19.800+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:19.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:19.982+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:20.597 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:20.596+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:20.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:20.809+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:20.818 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:20.817+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:20.950 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:20.949+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:21.004 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:59:21.002+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:59:21.588 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:21.587+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:21.792 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:21.790+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:21.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:21.799+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:21.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:21.974+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:22.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:22.537+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:22.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:22.753+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:22.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:22.822+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:22.945 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:22.943+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:23.544 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:23.541+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:23.743 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:23.741+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:23.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:23.793+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:23.955 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:23.953+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:24.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:59:24.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:59:24.589 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:24.587+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:24.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:24.702+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:24.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:24.807+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:24.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:24.934+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:25.592 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:25.590+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:25.702 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:25.699+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:25.834 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:25.832+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:25.939 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:25.936+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:26.614 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:26.611+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:26.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:26.711+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:26.883 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:26.880+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:26.942 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:26.939+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:27.570 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:27.568+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:27.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:27.753+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:27.880 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:27.877+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:27.944 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:27.941+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:28.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:28.537+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:28.783 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:28.780+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:28.892 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:28.890+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:28.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:28.912+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:29.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:29.554+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:29.798 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:29.795+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:29.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:29.859+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:29.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:29.962+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:30.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:30.520+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:30.822 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:30.820+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:30.839 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:30.837+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:30.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:30.957+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:31.503 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:31.500+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:31.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:31.852+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:31.882 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:31.880+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:31.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:31.983+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:32.496 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:32.493+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:32.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:32.843+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:32.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:32.867+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:32.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:32.959+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:33.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:33.463+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:33.864 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:33.861+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:33.893 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:33.890+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:34.008 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:34.005+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:34.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:34.438+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:34.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:34.828+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:34.901 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:34.898+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:35.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:35.050+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:35.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:35.397+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:35.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:35.855+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:35.866 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:35.864+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:36.008 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:59:36.006+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:59:36.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:36.034+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:36.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:36.392+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:36.842 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:36.839+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:36.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:36.904+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:37.046 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:37.043+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:37.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:37.414+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:37.854 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:37.852+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:37.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:37.892+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:38.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:38.028+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:38.373 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:38.370+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:38.868 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:38.866+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:38.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:38.939+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:39.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:39.036+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:39.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:39.411+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:39.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:39.871+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:39.947 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:39.944+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:40.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:40.063+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:40.460 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:40.457+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:40.896 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:40.893+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:40.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:40.899+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:41.030 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:41.027+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:41.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:41.427+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:41.853 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:41.851+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:41.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:41.934+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:42.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:42.037+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:42.455 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:42.452+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:42.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:42.823+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:42.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:42.894+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:43.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:43.047+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:43.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:43.486+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:43.836 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:43.834+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:43.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:43.849+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:44.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:44.050+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:44.513 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:44.511+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:44.803 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:44.801+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:44.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:44.879+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:45.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:45.042+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:45.549 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:45.546+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:45.807 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:45.804+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:45.841 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:45.839+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:46.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:46.091+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:46.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:46.561+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:46.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:46.767+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:46.797 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:46.794+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:47.095 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:47.093+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:47.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:47.554+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:47.749 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:47.747+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:47.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:47.757+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:48.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:48.133+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:48.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:48.573+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:48.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:48.708+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:48.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:48.784+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:49.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:49.129+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:49.595 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:49.592+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:49.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:49.714+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:49.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:49.740+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:50.174 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:50.172+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:50.616 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:50.613+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:50.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:50.701+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:50.740 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:50.738+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:51.024 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T03:59:51.022+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T03:59:51.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:51.186+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:51.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:51.579+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:51.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:51.666+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:51.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:51.698+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:52.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:52.181+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:52.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:52.626+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:52.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:52.696+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:52.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:52.711+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:53.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:53.226+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:53.596 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:53.594+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:53.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:53.654+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:53.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:53.720+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:54.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:54.261+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:54.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:59:54.384 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T03:59:54.556 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:54.554+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:54.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:54.644+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:54.764 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:54.761+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:55.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:55.250+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:55.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:55.600+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:55.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:55.679+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:55.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:55.797+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:56.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:56.281+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:56.633 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:56.631+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:56.662 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:56.659+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:56.804 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:56.802+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:57.263 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:57.261+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:57.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:57.618+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:57.638 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:57.637+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:57.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:57.757+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:58.288 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:58.286+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:58.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:58.608+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:58.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:58.624+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:58.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:58.748+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:59.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T03:59:59.287+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:59.620 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T03:59:59.618+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:59.628 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T03:59:59.627+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T03:59:59.738 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T03:59:59.736+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:00.319 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:00.318+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:00.605 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:00.604+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:00.673 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:00.672+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:00.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:00.750+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:01.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:01.278+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:01.629 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:01.628+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:01.644 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:01.642+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:01.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:01.742+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:02.305 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:02.303+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:02.631 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:02.629+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:02.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:02.673+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:02.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:02.774+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:03.256 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:03.255+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:03.655 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:03.654+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:03.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:03.678+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:03.726 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:03.725+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:04.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:04.260+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:04.607 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:04.605+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:04.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:04.680+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:04.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:04.706+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:05.217 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:05.215+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:05.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:05.573+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:05.669 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:05.667+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:05.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:05.679+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:06.045 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:00:06.037+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:00:06.227 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:06.226+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:06.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:06.602+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:06.642 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:06.640+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:06.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:06.657+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:07.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:07.193+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:07.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:07.599+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:07.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:07.652+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:07.703 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:07.701+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:08.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:08.197+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:08.614 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:08.613+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:08.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:08.670+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:08.682 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:08.681+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:09.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:09.195+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:09.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:09.568+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:09.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:09.694+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:09.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:09.702+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:10.204 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:10.202+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:10.606 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:10.604+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:10.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:10.645+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:10.694 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:10.693+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:11.182 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:11.180+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:11.569 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:11.568+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:11.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:11.613+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:11.675 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:11.674+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:12.219 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:12.217+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:12.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:12.585+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:12.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:12.598+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:12.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:12.697+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:13.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:13.231+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:13.546 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:13.543+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:13.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:13.595+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:13.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:13.713+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:14.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:14.257+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:14.585 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:14.583+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:14.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:14.586+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:14.689 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:14.686+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:15.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:15.295+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:15.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:15.556+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:15.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:15.632+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:15.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:15.700+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:16.278 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:16.276+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:16.513 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:16.510+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:16.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:16.616+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:16.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:16.676+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:17.246 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:17.243+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:17.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:17.542+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:17.586 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:17.584+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:17.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:17.650+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:18.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:18.260+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:18.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:18.567+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:18.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:18.628+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:18.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:18.663+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:19.300 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:19.298+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:19.588 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:19.585+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:19.619 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:19.617+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:19.675 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:19.672+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:20.289 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:20.287+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:20.556 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:20.553+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:20.632 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:20.630+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:20.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:20.670+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:21.056 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:00:21.053+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:00:21.275 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:21.272+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:21.515 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:21.513+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:21.627 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:21.624+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:21.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:21.708+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:22.290 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:22.287+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:22.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:22.482+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:22.658 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:22.655+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:22.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:22.728+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:23.257 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:23.255+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:23.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:23.463+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:23.665 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:23.662+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:23.725 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:23.723+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:24.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:24.298+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:24.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:24.415+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:24.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:00:24.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:00:24.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:24.703+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:24.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:24.710+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:25.252 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:25.249+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:25.374 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:25.371+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:25.728 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:25.726+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:25.736 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:25.734+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:26.251 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:26.249+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:26.369 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:26.366+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:26.685 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:26.683+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:26.743 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:26.740+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:27.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:27.232+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:27.332 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:27.329+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:27.733 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:27.731+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:27.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:27.783+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:28.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:28.257+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:28.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:28.309+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:28.686 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:28.684+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:28.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:28.830+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:29.209 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:29.207+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:29.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:29.277+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:29.673 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:29.671+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:29.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:29.839+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:30.186 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:30.184+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:30.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:30.237+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:30.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:30.659+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:30.795 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:30.793+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:31.167 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:31.164+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:31.234 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:31.232+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:31.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:31.649+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:31.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:31.829+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:32.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:32.167+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:32.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:32.245+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:32.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:32.652+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:32.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:32.791+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:33.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:33.125+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:33.232 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:33.229+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:33.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:33.679+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:33.754 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:33.752+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:34.153 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:34.151+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:34.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:34.264+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:34.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:34.647+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:34.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:34.709+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:35.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:35.146+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:35.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:35.263+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:35.664 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:35.661+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:35.712 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:35.710+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:36.072 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:00:36.070+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:00:36.195 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:36.193+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:36.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:36.249+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:36.712 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:36.710+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:36.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:36.721+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:37.225 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:37.222+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:37.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:37.233+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:37.700 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:37.698+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:37.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:37.754+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:38.202 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:38.200+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:38.208 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:38.206+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:38.692 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:38.690+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:38.786 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:38.784+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:39.172 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:39.170+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:39.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:39.208+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:39.706 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:39.703+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:39.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:39.787+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:40.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:40.131+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:40.217 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:40.215+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:40.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:40.728+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:40.781 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:40.778+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:41.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:41.131+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:41.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:41.216+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:41.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:41.712+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:41.748 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:41.746+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:42.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:42.120+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:42.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:42.263+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:42.758 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:42.756+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:42.760 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:42.758+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:43.171 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:43.169+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:43.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:43.258+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:43.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:43.737+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:43.793 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:43.792+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:44.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:44.130+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:44.235 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:44.233+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:44.707 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:44.705+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:44.807 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:44.805+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:45.173 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:45.170+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:45.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:45.244+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:45.710 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:45.708+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:45.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:45.839+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:46.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:46.149+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:46.245 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:46.242+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:46.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:46.659+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:46.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:46.861+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:47.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:47.148+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:47.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:47.283+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:47.654 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:47.652+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:47.854 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:47.851+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:48.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:48.111+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:48.282 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:48.281+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:48.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:48.698+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:48.874 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:48.873+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:49.136 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:49.135+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:49.290 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:49.289+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:49.701 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:49.699+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:49.895 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:49.894+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:50.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:50.119+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:50.277 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:50.276+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:50.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:50.718+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:50.886 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:50.884+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:51.088 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:00:51.085+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:00:51.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:51.168+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:51.242 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:51.241+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:51.696 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:51.694+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:51.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:51.838+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:52.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:52.156+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:52.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:52.287+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:52.738 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:52.736+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:52.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:52.842+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:53.152 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:53.150+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:53.244 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:53.242+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:53.762 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:53.724+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:53.808 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:53.807+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:54.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:54.148+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:54.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:54.224+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:54.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:00:54.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:00:54.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:54.751+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:54.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:54.770+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:55.109 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:55.107+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:55.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:55.228+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:55.731 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:55.730+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:55.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:55.780+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:56.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:56.090+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:56.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:56.241+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:56.723 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:56.722+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:56.829 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:56.828+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:57.138 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:57.136+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:57.197 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:57.195+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:57.760 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:57.758+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:57.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:57.801+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:58.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:58.112+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:58.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:58.201+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:58.752 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:58.750+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:58.845 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:58.843+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:59.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:00:59.111+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:59.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:00:59.208+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:59.704 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:00:59.703+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:00:59.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:00:59.869+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:00.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:00.105+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:00.196 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:00.195+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:00.703 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:00.701+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:00.878 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:00.877+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 55 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:01.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:01.060+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 50 slow ops, oldest is osd_op(mds.0.4:38780 3.3 3.216e14a3 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:01.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:01.193+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:01.676 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:01.675+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:01.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:01.923+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:02.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:02.092+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:02.237 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:02.235+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:02.689 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:02.688+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:02.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:02.963+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:03.135 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:03.134+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:03.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:03.192+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:03.661 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:03.658+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:03.934 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:03.932+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:04.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:04.148+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:04.173 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:04.171+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:04.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:04.653+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:04.979 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:04.976+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:05.131 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:05.129+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:05.215 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:05.212+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:05.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:05.629+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:06.008 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:06.006+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:06.104 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:01:06.101+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:01:06.154 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:06.151+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:06.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:06.250+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:06.630 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:06.628+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:07.039 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:07.036+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:07.148 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:07.146+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:07.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:07.231+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:07.656 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:07.654+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:08.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:08.038+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:08.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:08.159+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:08.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:08.256+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:08.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:08.675+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:09.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:09.070+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:09.203 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:09.201+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:09.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:09.208+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:09.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:09.717+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:10.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:10.115+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:10.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:10.194+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:10.206 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:10.204+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:10.751 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:10.748+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:11.110 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:11.107+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:11.162 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:11.159+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:11.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:11.220+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:11.714 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:11.711+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:12.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:12.098+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:12.142 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:12.140+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:12.231 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:12.228+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:12.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:12.722+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:13.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:13.062+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:13.150 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:13.148+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:13.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:13.244+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:13.769 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:13.767+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:14.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:14.038+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:14.166 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:14.163+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:14.264 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:14.261+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:14.801 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:14.799+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:15.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:15.054+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:15.118 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:15.115+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:15.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:15.298+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:15.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:15.813+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:16.017 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:16.014+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:16.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:16.100+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:16.315 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:16.313+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:16.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:16.862+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:17.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:17.052+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:17.123 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:17.120+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:17.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:17.319+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:17.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:17.843+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:18.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:18.052+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:18.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:18.131+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:18.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:18.306+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:18.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:18.868+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:19.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:19.092+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:19.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:19.101+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:19.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:19.291+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:19.906 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:19.904+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:20.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:20.079+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:20.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:20.137+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:20.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:20.248+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:20.857 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:20.855+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:21.077 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:21.075+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:21.106 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:01:21.104+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:01:21.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:21.105+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:21.210 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:21.208+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:21.867 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:21.865+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:22.034 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:22.031+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:22.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:22.096+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:22.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:22.248+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:22.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:22.901+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:23.019 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:23.016+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:23.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:23.112+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:23.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:23.201+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:23.940 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:23.938+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:24.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:24.062+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:24.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:24.101+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:24.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:24.192+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:24.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:01:24.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:01:24.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:24.951+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:25.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:25.084+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:25.115 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:25.113+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:25.223 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:25.221+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:25.954 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:25.952+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:26.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:26.100+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:26.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:26.105+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:26.227 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:26.225+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:26.962 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:26.959+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:27.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:27.083+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:27.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:27.106+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:27.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:27.193+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:27.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:27.949+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:28.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:28.090+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:28.114 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:28.112+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:28.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:28.222+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:28.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:28.986+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:29.098 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:29.096+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:29.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:29.116+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:29.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:29.209+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:30.002 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:30.000+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:30.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:30.123+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:30.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:30.152+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:30.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:30.253+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:31.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:31.037+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:31.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:31.104+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:31.134 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:31.132+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:31.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:31.281+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:32.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:32.031+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:32.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:32.072+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:32.101 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:32.099+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:32.247 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:32.245+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:33.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:33.062+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:33.083 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:33.081+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:33.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:33.140+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:33.294 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:33.292+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:34.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:34.051+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:34.114 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:34.112+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:34.176 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:34.174+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:34.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:34.268+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:35.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:35.061+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:35.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:35.076+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:35.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:35.205+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:35.298 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:35.296+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:36.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:36.027+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:36.104 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:36.102+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:36.122 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:01:36.119+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:01:36.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:36.208+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:36.278 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:36.276+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:37.068 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:37.065+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:37.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:37.073+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:37.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:37.230+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:37.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:37.294+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:38.037 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:38.035+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:38.088 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:38.086+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:38.203 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:38.201+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:38.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:38.284+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:39.022 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:39.021+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:39.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:39.078+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:39.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:39.188+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:39.286 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:39.285+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:40.071 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:40.069+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:40.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:40.070+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:40.172 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:40.170+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:40.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:40.296+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:41.047 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:41.046+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:41.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:41.102+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:41.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:41.159+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:41.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:41.309+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:41.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:41.997+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:42.139 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:42.137+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:42.144 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:42.143+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:42.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:42.293+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:42.951 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:42.949+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:43.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:43.129+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:43.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:43.136+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:43.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:43.283+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:43.989 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:43.987+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:44.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:44.082+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:44.173 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:44.172+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:44.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:44.300+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:44.999 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:44.998+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:45.062 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:45.060+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:45.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:45.191+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:45.287 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:45.285+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:45.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:45.995+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:46.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:46.029+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:46.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:46.166+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:46.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:46.279+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:47.001 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:46.999+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:47.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:47.046+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:47.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:47.209+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:47.283 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:47.282+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:48.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:48.048+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:48.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:48.064+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:48.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:48.207+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:48.311 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:48.309+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:49.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:49.039+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:49.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:49.047+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:49.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:49.173+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:49.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:49.265+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:50.041 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:50.040+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:50.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:50.068+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:50.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:50.163+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:50.250 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:50.248+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:51.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:51.047+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:51.067 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:51.066+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:51.138 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:01:51.136+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:01:51.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:51.168+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:51.284 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:51.282+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:52.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:52.027+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:52.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:52.086+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:52.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:52.155+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:52.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:52.257+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:53.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:53.040+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:53.072 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:53.070+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:53.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:53.191+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:53.270 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:53.268+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:54.006 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:54.005+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:54.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:54.097+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:54.165 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:54.162+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:54.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:54.263+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:54.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:01:54.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:01:55.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:55.012+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:55.096 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:55.093+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:55.138 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:55.135+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:55.266 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:55.263+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:56.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:56.000+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:56.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:56.089+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:56.129 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:56.127+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:56.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:56.233+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:56.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:56.951+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:57.091 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:57.089+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:57.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:57.122+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:57.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:57.256+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:57.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:57.905+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:58.056 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:58.054+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:58.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:58.138+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:58.300 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:58.297+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:58.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:58.877+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:59.036 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:01:59.033+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:59.182 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:01:59.180+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:59.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:01:59.302+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:01:59.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:01:59.865+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:00.033 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:00.031+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:00.214 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:00.212+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:00.301 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:00.299+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:00.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:00.910+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:00.990 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:00.988+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:01.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:01.261+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:01.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:01.304+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:01.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:01.944+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:01.996 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:01.994+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:02.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:02.281+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:02.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:02.319+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:02.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:02.911+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:03.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:03.032+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:03.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:03.282+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:03.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:03.369+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:03.948 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:03.945+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:03.994 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:03.992+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:04.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:04.258+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:04.396 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:04.394+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:04.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:04.902+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:04.944 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:04.942+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:05.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:05.283+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:05.348 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:05.346+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:05.893 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:05.890+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:05.913 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:05.911+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:06.153 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:02:06.151+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:02:06.322 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:06.320+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:06.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:06.326+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:06.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:06.902+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:06.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:06.904+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:07.291 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:07.288+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:07.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:07.365+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:07.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:07.877+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:07.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:07.881+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:08.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:08.247+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:08.402 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:08.399+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:08.844 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:08.841+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:08.892 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:08.890+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:09.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:09.290+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:09.433 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:09.431+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:09.870 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:09.868+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:09.915 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:09.913+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:10.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:10.307+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:10.457 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:10.454+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:10.898 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:10.896+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:10.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:10.960+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:11.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:11.326+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:11.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:11.469+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:11.880 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:11.878+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:11.963 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:11.960+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:12.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:12.285+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:12.431 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:12.428+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:12.874 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:12.872+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:12.998 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:12.996+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:13.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:13.313+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:13.465 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:13.463+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:13.845 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:13.843+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:13.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:13.974+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:14.355 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:14.353+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:14.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:14.486+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:14.852 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:14.849+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:15.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:15.020+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:15.385 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:15.383+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:15.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:15.517+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:15.855 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:15.853+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:15.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:15.983+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:16.422 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:16.420+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:16.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:16.488+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:16.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:16.879+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:16.980 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:16.978+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:17.409 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:17.406+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:17.496 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:17.494+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:17.891 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:17.888+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:17.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:17.993+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:18.426 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:18.423+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:18.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:18.478+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:18.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:18.932+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:18.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:18.963+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:19.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:19.415+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:19.466 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:19.463+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:19.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:19.924+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:19.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:19.974+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:20.407 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:20.405+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:20.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:20.509+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:20.954 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:20.951+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:21.007 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:21.005+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:21.169 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:02:21.167+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:02:21.397 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:21.395+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:21.488 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:21.485+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:21.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:21.981+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:21.992 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:21.991+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:22.352 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:22.349+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:22.470 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:22.468+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:22.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:22.943+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:22.995 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:22.993+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:23.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:23.313+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:23.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:23.427+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:23.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:23.924+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:24.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:24.012+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:24.297 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:24.295+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:24.427 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:24.425+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:24.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:24.909+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:25.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:25.011+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:25.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:02:25.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:02:25.339 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:25.337+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:25.459 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:25.458+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:25.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:25.944+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:25.977 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:25.975+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:26.389 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:26.387+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:26.474 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:26.472+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:26.929 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:26.927+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:26.964 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:26.962+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:27.421 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:27.419+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:27.519 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:27.516+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:27.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:27.951+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:28.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:27.960+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:28.412 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:28.410+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:28.502 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:28.500+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:28.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:28.932+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:28.957 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:28.955+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:29.411 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:29.409+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:29.486 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:29.485+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:29.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:29.949+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:29.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:29.961+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:30.459 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:30.458+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:30.473 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:30.472+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:30.991 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:30.989+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:31.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:31.008+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:31.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:31.489+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:31.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:31.489+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:32.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:32.038+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:32.050 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:32.049+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:32.461 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:32.460+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:32.469 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:32.467+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:33.029 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:33.027+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:33.051 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:33.050+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:33.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:33.501+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:33.519 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:33.517+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:34.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:34.005+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:34.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:34.067+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:34.479 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:34.478+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:34.499 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:34.498+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:35.007 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:35.005+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:35.065 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:35.064+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:35.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:35.477+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:35.529 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:35.528+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:36.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:36.048+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:36.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:36.091+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:36.185 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:02:36.182+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:02:36.490 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:36.489+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:36.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:36.527+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:37.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:37.069+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:37.073 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:37.071+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:37.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:37.525+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:37.568 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:37.567+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:38.045 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:38.043+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:38.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:38.057+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:38.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:38.518+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:38.555 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:38.554+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:39.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:39.046+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:39.064 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:39.063+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:39.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:39.523+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:39.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:39.556+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:40.060 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:40.058+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:40.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:40.107+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:40.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:40.478+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:40.580 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:40.579+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:41.074 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:41.072+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:41.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:41.104+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:41.443 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:41.441+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:41.539 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:41.538+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:42.071 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:42.069+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:42.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:42.147+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:42.477 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:42.476+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:42.583 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:42.582+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:43.078 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:43.076+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:43.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:43.122+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:43.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:43.524+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:43.603 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:43.601+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:44.075 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:44.074+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:44.124 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:44.123+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:44.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:44.568+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:44.606 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:44.605+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:45.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:45.100+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:45.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:45.119+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:45.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:45.606+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:45.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:45.644+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:46.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:46.131+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:46.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:46.145+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:46.602 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:46.600+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:46.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:46.625+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:47.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:47.086+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:47.193 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:47.191+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:47.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:47.571+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:47.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:47.605+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:48.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:48.131+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:48.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:48.192+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:48.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:48.557+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:48.574 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:48.571+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:49.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:49.103+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:49.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:49.200+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:49.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:49.518+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:49.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:49.613+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:50.101 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:50.099+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:50.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:50.156+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:50.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:50.565+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:50.598 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:50.596+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:51.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:51.063+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:51.200 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:02:51.197+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:02:51.208 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:51.206+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:51.572 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:51.570+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:51.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:51.594+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:52.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:52.028+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:52.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:52.230+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:52.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:52.573+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:52.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:52.602+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:53.047 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:53.045+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:53.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:53.255+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:53.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:53.574+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:53.630 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:53.628+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:54.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:54.062+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:54.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:54.270+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:54.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:54.563+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:54.671 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:54.668+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:55.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:55.083+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:55.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:02:55.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:02:55.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:55.316+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:55.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:55.527+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:55.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:55.701+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:56.057 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:56.055+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:56.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:56.271+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:56.511 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:56.508+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:56.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:56.707+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:57.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:57.075+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:57.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:57.321+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:57.525 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:57.523+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:57.703 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:57.701+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:58.117 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:58.114+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:58.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:58.353+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:58.552 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:58.550+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:58.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:58.654+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:59.156 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:02:59.154+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:59.310 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:02:59.308+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:59.510 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:02:59.507+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:02:59.664 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:02:59.662+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:00.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:00.175+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:00.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:00.344+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:00.545 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:00.543+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:00.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:00.649+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:01.133 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:01.131+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:01.343 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:01.341+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:01.528 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:01.526+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:01.604 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:01.602+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:02.132 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:02.130+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:02.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:02.387+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:02.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:02.515+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:02.654 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:02.652+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:03.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:03.162+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:03.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:03.351+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:03.560 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:03.558+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:03.613 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:03.610+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:04.177 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:04.175+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:04.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:04.360+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:04.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:04.574+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:04.582 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:04.580+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:05.165 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:05.162+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:05.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:05.379+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:05.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:05.563+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:05.586 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:05.584+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:06.170 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:06.167+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:06.216 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:03:06.214+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:03:06.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:06.353+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:06.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:06.550+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:06.563 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:06.561+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:07.121 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:07.119+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:07.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:07.384+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:07.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:07.543+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:07.596 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:07.594+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:08.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:08.104+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:08.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:08.387+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:08.521 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:08.519+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:08.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:08.625+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:09.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:09.091+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:09.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:09.388+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:09.566 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:09.563+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:09.586 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:09.584+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:10.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:10.061+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:10.432 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:10.430+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:10.568 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:10.566+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:10.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:10.622+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:11.043 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:11.041+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:11.435 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:11.433+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:11.525 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:11.523+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:11.656 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:11.653+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:12.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:12.088+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:12.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:12.399+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:12.517 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:12.515+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:12.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:12.671+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:13.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:13.051+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:13.424 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:13.422+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:13.530 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:13.528+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:13.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:13.670+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:14.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:14.061+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:14.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:14.419+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:14.520 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:14.518+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:14.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:14.623+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:15.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:15.075+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:15.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:15.424+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:15.545 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:15.543+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:15.583 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:15.581+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:16.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:16.083+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:16.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:16.450+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:16.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:16.551+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:16.612 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:16.610+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:17.081 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:17.079+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:17.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:17.452+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:17.542 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:17.540+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:17.575 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:17.573+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:18.084 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:18.082+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:18.438 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:18.436+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:18.523 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:18.521+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:18.604 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:18.602+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:19.085 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:19.083+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:19.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:19.456+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:19.526 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:19.524+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:19.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:19.618+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:20.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:20.101+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:20.454 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:20.452+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:20.524 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:20.522+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:20.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:20.622+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:21.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:21.092+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:21.232 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:03:21.229+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:03:21.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:21.478+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:21.515 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:21.514+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:21.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:21.647+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:22.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:22.114+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:22.464 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:22.462+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:22.471 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:22.469+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:22.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:22.626+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:23.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:23.108+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:23.448 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:23.447+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:23.477 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:23.475+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:23.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:23.629+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:24.080 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:24.079+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:24.473 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:24.471+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:24.504 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:24.503+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:24.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:24.663+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:25.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:25.106+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:25.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:03:25.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:03:25.458 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:25.456+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:25.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:25.459+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:25.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:25.625+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:26.082 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:26.080+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:26.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:26.409+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:26.420 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:26.418+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:26.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:26.641+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:27.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:27.091+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:27.390 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:27.389+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:27.457 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:27.455+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:27.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:27.608+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:28.143 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:28.141+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:28.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:28.364+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:28.432 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:28.430+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:28.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:28.627+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:29.149 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:29.148+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:29.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:29.323+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:29.470 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:29.468+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:29.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:29.641+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:30.161 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:30.159+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:30.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:30.290+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:30.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:30.490+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:30.644 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:30.642+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:31.113 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:31.112+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:31.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:31.324+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:31.492 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:31.491+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:31.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:31.646+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:32.075 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:32.074+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:32.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:32.355+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:32.449 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:32.448+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:32.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:32.696+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:33.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:33.068+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:33.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:33.336+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:33.443 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:33.442+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:33.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:33.722+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:34.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:34.043+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:34.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:34.343+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:34.430 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:34.428+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:34.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:34.766+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:35.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:35.037+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:35.304 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:35.303+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:35.417 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:35.416+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:35.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:35.716+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:36.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:36.038+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:36.248 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:03:36.246+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:03:36.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:36.348+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:36.416 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:36.414+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:36.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:36.756+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:37.020 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:37.017+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:37.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:37.316+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:37.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:37.448+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:37.730 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:37.727+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:38.044 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:38.042+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:38.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:38.365+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:38.439 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:38.436+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:38.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:38.701+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:39.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:39.049+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:39.356 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:39.354+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:39.483 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:39.481+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:39.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:39.653+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:40.089 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:40.086+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:40.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:40.337+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:40.474 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:40.472+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:40.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:40.663+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:41.049 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:41.046+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:41.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:41.345+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:41.437 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:41.435+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:41.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:41.680+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:42.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:42.059+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:42.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:42.380+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:42.479 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:42.476+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:42.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:42.655+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:43.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:43.051+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:43.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:43.376+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:43.484 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:43.482+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:43.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:43.680+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:44.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:44.076+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:44.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:44.339+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:44.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:44.440+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:44.689 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:44.687+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:45.041 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:45.038+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:45.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:45.367+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:45.433 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:45.431+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:45.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:45.667+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:46.025 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:46.023+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:46.326 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:46.323+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:46.438 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:46.435+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:46.680 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:46.678+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:47.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:47.012+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:47.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:47.280+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:47.415 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:47.412+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:47.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:47.643+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:48.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:48.030+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:48.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:48.286+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:48.452 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:48.450+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:48.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:48.689+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:49.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:49.072+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:49.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:49.335+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:49.478 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:49.475+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:49.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:49.688+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:50.050 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:50.048+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:50.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:50.381+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:50.491 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:50.489+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:50.646 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:50.643+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:51.053 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:51.051+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:51.263 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:03:51.261+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:03:51.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:51.334+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:51.510 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:51.508+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:51.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:51.689+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:52.078 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:52.076+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:52.347 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:52.345+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:52.467 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:52.465+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:52.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:52.651+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:53.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:53.045+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:53.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:53.306+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:53.456 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:53.453+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:53.670 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:53.667+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:54.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:54.094+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:54.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:54.302+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:54.461 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:54.459+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:54.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:54.712+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:55.096 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:55.093+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:55.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:55.318+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:55.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:55.412+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:55.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:03:55.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:03:55.674 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:55.672+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:56.103 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:56.100+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:56.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:56.290+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:56.429 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:56.427+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:56.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:56.637+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:57.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:57.061+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:57.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:57.334+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:57.386 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:57.384+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:57.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:57.680+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:58.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:58.015+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:58.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:58.309+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:58.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:58.346+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:58.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:58.723+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:58.993 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:03:58.991+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:59.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:03:59.262+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:59.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:03:59.312+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:03:59.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:03:59.766+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:00.036 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:00.034+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:00.258 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:00.256+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:00.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:00.299+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:00.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:00.765+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:01.012 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:01.010+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:01.273 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:01.271+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:01.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:01.292+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:01.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:01.764+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:01.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:01.981+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:02.245 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:02.243+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:02.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:02.297+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:02.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:02.784+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:03.013 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:03.011+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:03.261 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:03.259+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:03.319 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:03.317+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:03.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:03.753+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:04.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:04.050+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:04.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:04.280+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:04.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:04.293+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:04.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:04.783+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:05.087 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:05.084+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:05.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:05.287+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:05.301 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:05.299+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:05.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:05.810+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:06.106 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:06.103+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:06.268 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:04:06.266+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:04:06.306 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:06.303+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:06.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:06.311+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:06.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:06.773+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:07.063 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:07.061+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:07.300 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:07.298+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:07.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:07.325+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:07.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:07.812+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:08.024 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:08.022+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:08.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:08.292+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:08.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:08.326+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:08.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:08.797+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:08.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:08.974+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:09.328 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:09.326+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:09.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:09.362+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:09.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:09.818+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:10.003 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:10.001+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:10.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:10.286+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:10.393 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:10.391+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:10.810 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:10.808+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:11.032 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:11.030+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:11.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:11.285+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:11.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:11.352+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:11.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:11.769+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:12.031 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:12.029+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:12.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:12.269+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:12.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:12.312+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:12.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:12.783+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:13.051 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:13.050+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:13.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:13.247+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:13.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:13.344+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:13.817 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:13.815+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:14.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:14.021+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:14.282 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:14.281+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:14.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:14.300+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:14.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:14.818+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:15.027 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:15.026+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:15.301 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:15.299+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:15.330 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:15.328+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:15.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:15.859+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:16.055 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:16.054+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:16.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:16.288+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:16.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:16.337+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:16.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:16.852+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:17.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:17.020+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:17.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:17.286+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:17.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:17.384+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:17.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:17.897+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:18.066 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:18.064+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:18.307 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:18.305+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:18.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:18.378+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:18.898 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:18.897+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:19.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:19.021+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:19.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:19.302+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:19.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:19.363+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:19.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:19.891+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:20.061 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:20.059+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:20.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:20.302+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:20.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:20.407+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:20.935 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:20.934+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:21.040 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:21.038+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:21.279 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:04:21.276+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:04:21.353 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:21.352+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:21.361 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:21.359+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:21.921 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:21.920+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:22.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:22.077+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:22.314 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:22.312+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:22.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:22.327+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:22.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:22.885+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:23.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:23.057+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:23.268 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:23.266+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:23.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:23.339+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:23.860 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:23.858+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:24.021 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:24.020+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:24.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:24.248+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:24.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:24.313+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:24.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:24.875+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:24.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:24.982+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:25.262 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:25.260+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:25.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:25.329+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:25.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:04:25.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:04:25.861 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:25.860+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:25.984 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:25.983+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:26.226 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:26.225+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:26.331 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:26.330+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:26.909 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:26.906+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:26.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:26.950+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:27.180 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:27.178+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:27.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:27.306+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:27.869 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:27.867+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:27.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:27.934+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:28.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:28.156+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:28.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:28.269+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:28.876 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:28.873+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:28.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:28.965+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:29.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:29.124+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:29.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:29.276+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:29.833 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:29.830+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:29.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:29.948+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:30.139 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:30.137+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:30.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:30.269+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:30.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:30.785+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:30.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:30.948+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:31.133 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:31.130+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:31.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:31.238+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:31.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:31.750+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:31.913 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:31.910+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:32.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:32.083+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:32.281 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:32.278+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:32.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:32.755+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:32.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:32.892+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:33.062 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:33.060+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:33.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:33.293+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:33.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:33.756+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:33.871 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:33.868+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:34.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:34.045+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:34.300 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:34.298+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:34.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:34.765+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:34.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:34.824+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:35.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:35.056+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:35.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:35.267+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:35.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:35.772+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:35.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:35.818+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:36.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:36.055+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:36.295 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:04:36.292+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:04:36.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:36.306+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:36.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:36.753+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:36.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:36.833+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:37.059 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:37.056+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:37.339 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:37.336+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:37.795 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:37.792+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:37.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:37.870+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:38.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:38.105+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:38.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:38.329+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:38.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:38.810+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:38.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:38.848+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:39.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:39.091+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:39.357 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:39.355+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:39.800 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:39.797+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:39.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:39.836+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:40.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:40.110+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:40.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:40.339+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:40.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:40.769+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:40.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:40.801+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:41.085 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:41.082+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:41.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:41.368+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:41.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:41.743+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:41.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:41.769+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:42.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:42.115+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:42.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:42.376+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:42.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:42.737+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:42.809 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:42.806+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:43.071 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:43.068+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:43.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:43.336+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:43.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:43.761+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:43.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:43.820+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:44.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:44.102+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:44.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:44.365+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:44.799 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:44.797+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:44.813 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:44.811+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:45.057 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:45.055+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:45.397 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:45.394+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:45.766 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:45.764+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:45.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:45.772+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:46.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:46.066+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:46.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:46.376+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:46.735 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:46.732+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:46.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:46.770+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:47.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:47.066+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:47.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:47.395+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:47.686 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:47.683+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:47.767 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:47.765+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:48.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:48.063+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:48.427 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:48.425+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:48.648 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:48.646+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:48.757 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:48.754+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:49.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:49.076+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:49.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:49.378+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:49.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:49.600+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:49.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:49.757+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:50.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:50.051+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:50.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:50.334+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:50.593 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:50.591+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:50.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:50.716+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:51.098 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:51.095+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:51.311 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:04:51.309+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:04:51.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:51.364+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:51.602 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:51.600+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:51.688 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:51.686+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:52.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:52.126+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:52.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:52.331+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:52.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:52.562+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:52.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:52.735+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:53.168 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:53.166+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:53.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:53.352+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:53.560 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:53.558+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:53.701 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:53.699+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:54.174 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:54.171+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:54.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:54.382+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:54.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:54.562+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:54.681 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:54.679+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:55.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:55.205+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:55.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:55.427+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:55.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:55.560+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:55.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:04:55.646 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:04:55.647 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:55.644+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:56.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:56.222+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:56.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:56.407+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:56.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:56.512+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:56.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:56.616+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:57.227 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:57.224+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:57.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:57.370+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:57.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:57.546+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:57.616 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:57.614+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:58.274 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:58.272+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:58.415 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:58.413+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:58.527 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:58.525+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:58.576 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:58.574+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:59.233 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:04:59.231+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:59.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:04:59.370+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:59.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:04:59.486+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:04:59.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:04:59.620+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:00.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:00.217+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:00.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:00.370+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:00.457 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:00.455+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:00.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:00.627+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:01.217 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:01.215+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:01.366 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:01.364+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:01.469 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:01.467+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:01.609 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:01.607+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:02.222 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:02.220+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:02.320 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:02.318+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:02.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:02.487+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:02.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:02.635+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:03.271 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:03.269+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:03.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:03.293+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:03.453 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:03.451+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:03.679 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:03.677+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:04.259 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:04.257+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:04.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:04.272+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:04.446 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:04.444+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:04.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:04.648+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:05.218 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:05.217+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:05.241 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:05.240+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:05.467 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:05.465+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:05.664 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:05.662+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:06.219 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:06.217+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:06.246 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:06.245+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:06.326 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:05:06.324+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:05:06.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:06.498+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:06.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:06.664+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:07.206 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:07.204+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:07.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:07.233+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:07.475 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:07.474+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:07.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:07.648+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:08.209 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:08.208+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:08.228 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:08.227+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:08.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:08.469+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:08.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:08.655+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:09.239 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:09.237+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:09.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:09.237+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:09.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:09.441+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:09.643 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:09.641+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:10.194 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:10.193+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:10.259 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:10.257+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:10.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:10.398+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:10.602 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:10.600+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:11.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:11.155+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:11.215 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:11.213+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:11.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:11.388+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:11.559 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:11.558+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:12.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:12.128+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:12.264 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:12.263+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:12.399 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:12.398+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:12.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:12.542+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:13.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:13.096+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:13.285 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:13.284+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:13.392 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:13.390+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:13.534 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:13.533+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:14.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:14.125+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:14.294 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:14.292+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:14.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:14.349+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:14.491 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:14.490+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:15.159 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:15.158+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:15.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:15.251+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:15.397 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:15.396+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:15.529 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:15.527+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:16.126 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:16.124+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:16.250 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:16.248+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:16.378 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:16.376+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:16.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:16.544+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:17.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:17.091+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:17.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:17.275+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:17.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:17.356+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:17.590 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:17.587+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:18.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:18.110+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:18.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:18.266+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:18.406 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:18.403+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:18.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:18.598+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:19.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:19.062+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:19.277 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:19.275+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:19.450 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:19.447+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:19.570 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:19.568+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:20.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:20.035+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:20.268 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:20.266+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:20.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:20.494+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:20.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:20.615+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:21.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:21.073+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:21.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:21.228+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:21.342 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:05:21.340+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:05:21.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:21.494+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:21.636 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:21.633+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:22.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:22.082+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:22.187 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:22.185+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:22.456 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:22.453+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:22.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:22.683+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:23.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:23.095+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:23.159 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:23.157+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:23.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:23.477+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:23.685 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:23.682+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:24.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:24.075+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:24.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:24.165+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:24.477 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:24.474+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:24.653 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:24.651+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:25.064 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:25.062+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:25.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:25.195+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:25.483 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:25.480+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:25.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:25.633+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:25.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:05:25.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:05:26.112 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:26.109+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:26.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:26.148+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:26.526 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:26.523+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:26.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:26.618+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:27.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:27.120+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:27.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:27.139+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:27.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:27.493+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:27.654 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:27.651+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:28.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:28.103+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:28.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:28.146+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:28.525 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:28.523+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:28.614 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:28.612+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:29.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:29.056+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:29.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:29.169+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:29.569 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:29.567+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:29.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:29.662+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:30.018 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:30.016+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:30.142 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:30.140+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:30.553 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:30.551+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:30.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:30.667+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:31.046 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:31.043+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:31.105 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:31.102+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:31.570 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:31.567+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:31.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:31.695+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:32.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:32.084+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:32.152 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:32.150+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:32.543 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:32.540+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:32.657 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:32.655+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:33.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:33.058+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:33.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:33.155+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:33.518 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:33.516+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:33.683 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:33.681+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:34.090 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:34.087+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:34.136 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:34.134+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:34.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:34.542+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:34.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:34.726+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:35.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:35.048+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:35.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:35.096+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:35.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:35.560+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:35.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:35.755+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:36.055 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:36.052+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:36.091 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:36.089+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:36.350 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:05:36.347+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:05:36.564 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:36.562+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:36.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:36.752+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:37.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:37.052+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:37.103 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:37.101+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:37.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:37.592+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:37.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:37.776+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:38.024 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:38.021+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:38.088 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:38.086+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:38.580 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:38.578+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:38.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:38.799+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:39.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:39.052+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:39.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:39.075+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:39.585 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:39.582+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:39.812 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:39.810+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:40.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:40.091+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:40.123 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:40.121+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:40.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:40.547+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:40.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:40.803+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:41.063 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:41.061+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:41.164 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:41.162+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:41.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:41.530+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:41.788 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:41.786+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:42.107 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:42.104+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:42.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:42.165+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:42.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:42.526+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:42.752 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:42.750+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:43.072 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:43.070+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:43.147 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:43.145+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:43.488 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:43.486+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:43.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:43.709+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:44.055 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:44.053+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:44.146 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:44.144+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:44.522 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:44.520+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:44.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:44.694+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:45.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:45.087+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:45.102 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:45.100+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:45.514 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:45.512+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:45.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:45.743+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:46.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:46.127+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:46.144 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:46.143+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:46.499 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:46.496+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:46.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:46.714+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:47.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:47.120+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:47.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:47.138+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:47.549 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:47.546+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:47.717 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:47.715+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:48.128 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:48.126+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:48.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:48.159+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:48.590 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:48.588+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:48.737 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:48.735+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:49.121 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:49.118+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:49.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:49.128+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:49.637 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:49.635+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:49.704 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:49.702+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:50.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:50.084+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:50.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:50.178+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:50.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:50.639+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:50.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:50.707+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:51.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:51.052+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:51.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:51.180+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:51.365 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:05:51.363+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:05:51.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:51.590+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:51.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:51.746+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:52.036 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:52.035+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:52.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:52.215+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:52.545 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:52.543+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:52.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:52.737+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:53.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:53.052+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:53.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:53.200+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:53.535 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:53.533+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:53.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:53.690+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:54.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:54.097+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:54.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:54.193+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:54.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:54.581+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:54.665 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:54.663+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:55.104 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:55.102+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:55.240 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:55.238+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:55.592 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:55.591+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:55.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:55.647+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:55.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:05:55.861 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:05:56.068 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:56.066+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:56.195 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:56.194+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:56.599 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:56.597+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:56.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:56.623+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:57.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:57.067+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:57.165 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:57.163+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:57.574 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:57.572+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:57.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:57.656+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:58.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:58.091+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:58.176 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:58.175+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:58.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:58.602+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:58.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:58.668+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:59.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:05:59.128+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:59.168 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:05:59.167+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:59.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:05:59.573+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:05:59.642 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:05:59.641+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:00.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:00.114+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:00.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:00.146+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:00.582 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:00.581+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:00.673 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:00.672+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:01.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:01.123+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:01.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:01.194+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:01.575 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:01.574+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:01.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:01.657+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:02.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:02.120+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:02.202 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:02.201+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:02.612 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:02.611+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:02.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:02.695+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:03.122 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:03.120+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:03.253 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:03.251+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:03.616 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:03.615+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:03.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:03.658+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:04.105 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:04.103+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:04.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:04.300+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:04.633 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:04.632+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:04.671 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:04.670+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:05.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:05.095+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:05.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:05.349+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:05.600 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:05.598+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:05.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:05.650+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:06.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:06.125+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:06.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:06.373+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:06.381 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:06:06.380+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:06:06.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:06.630+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:06.649 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:06.648+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:07.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:07.146+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:07.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:07.324+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:07.634 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:07.632+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:07.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:07.666+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:08.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:08.106+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:08.305 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:08.302+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:08.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:08.669+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:08.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:08.670+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:09.086 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:09.083+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:09.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:09.276+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:09.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:09.683+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:09.700 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:09.697+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:10.050 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:10.047+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:10.249 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:10.247+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:10.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:10.669+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:10.737 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:10.734+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:11.094 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:11.091+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:11.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:11.232+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:11.640 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:11.637+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:11.744 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:11.742+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:12.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:12.085+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:12.248 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:12.245+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:12.600 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:12.597+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:12.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:12.753+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:13.087 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:13.084+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:13.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:13.228+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:13.577 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:13.574+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:13.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:13.800+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:14.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:14.072+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:14.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:14.267+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:14.585 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:14.582+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:14.776 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:14.773+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:15.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:15.080+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:15.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:15.218+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:15.624 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:15.622+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:15.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:15.733+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:16.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:16.063+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:16.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:16.250+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:16.618 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:16.616+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:16.747 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:16.744+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:17.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:17.046+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:17.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:17.296+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:17.599 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:17.596+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:17.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:17.792+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:18.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:18.093+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:18.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:18.333+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:18.638 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:18.636+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:18.807 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:18.804+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:19.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:19.071+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:19.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:19.360+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:19.629 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:19.627+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:19.841 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:19.839+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:20.056 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:20.053+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:20.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:20.335+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:20.651 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:20.648+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:20.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:20.831+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:21.014 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:21.012+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:21.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:21.344+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:21.396 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:06:21.394+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:06:21.675 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:21.672+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:21.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:21.796+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:22.047 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:22.045+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:22.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:22.385+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:22.711 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:22.709+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:22.779 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:22.777+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:23.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:23.094+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:23.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:23.352+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:23.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:23.733+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:23.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:23.783+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:24.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:24.085+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:24.354 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:24.351+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:24.750 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:24.747+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:24.761 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:24.759+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:25.054 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:25.051+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:25.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:25.392+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:25.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:25.733+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:25.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:25.778+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:26.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:06:26.021 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:26.019+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:26.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:06:26.405 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:26.403+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:26.692 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:26.689+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:26.784 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:26.782+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:27.019 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:27.016+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:27.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:27.453+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:27.697 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:27.695+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:27.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:27.772+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:27.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:27.996+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:28.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:28.408+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:28.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:28.714+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:28.797 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:28.795+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:29.012 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:29.010+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:29.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:29.428+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:29.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:29.684+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:29.833 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:29.830+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:29.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:29.994+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:30.452 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:30.450+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:30.729 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:30.727+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:30.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:30.802+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:30.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:30.967+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:31.411 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:31.408+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:31.691 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:31.688+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:31.777 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:31.774+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:31.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:31.974+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:32.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:32.389+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:32.677 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:32.675+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:32.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:32.761+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:32.992 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:32.990+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:33.351 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:33.349+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:33.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:33.707+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:33.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:33.723+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:33.963 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:33.961+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:34.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:34.329+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:34.667 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:34.664+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:34.676 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:34.674+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:34.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:34.935+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:35.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:35.339+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:35.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:35.617+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:35.709 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:35.707+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:35.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:35.975+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:36.360 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:36.358+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:36.412 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:06:36.410+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:06:36.594 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:36.592+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:36.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:36.720+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:36.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:36.958+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:37.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:37.371+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:37.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:37.562+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:37.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:37.747+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:37.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:37.964+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:38.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:38.361+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:38.584 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:38.581+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:38.717 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:38.714+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:38.938 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:38.936+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:39.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:39.330+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:39.557 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:39.555+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:39.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:39.748+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:39.977 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:39.974+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:40.336 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:40.334+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:40.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:40.547+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:40.759 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:40.757+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:41.000 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:40.997+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:41.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:41.372+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:41.589 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:41.587+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:41.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:41.731+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:42.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:42.038+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:42.378 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:42.376+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:42.601 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:42.599+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:42.708 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:42.707+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:43.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:43.086+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:43.409 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:43.407+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:43.650 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:43.648+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:43.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:43.685+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:44.096 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:44.094+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:44.383 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:44.381+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:44.652 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:44.650+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:44.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:44.657+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:45.140 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:45.138+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:45.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:45.414+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:45.696 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:45.694+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:45.701 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:45.700+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:46.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:46.125+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:46.463 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:46.461+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:46.712 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:46.710+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:46.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:46.730+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:47.135 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:47.134+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:47.429 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:47.427+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:47.686 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:47.684+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:47.704 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:47.703+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:48.116 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:48.115+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:48.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:48.472+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:48.685 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:48.683+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:48.716 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:48.714+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:49.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:49.101+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:49.494 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:49.492+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:49.641 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:49.639+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:49.702 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:49.700+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:50.147 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:50.146+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:50.473 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:50.471+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:50.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:50.680+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:50.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:50.739+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:51.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:51.150+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:51.428 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:06:51.425+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:06:51.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:51.482+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:51.687 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:51.685+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:51.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:51.771+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:52.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:52.116+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:52.456 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:52.454+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:52.696 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:52.695+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:52.765 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:52.764+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:53.089 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:53.087+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:53.455 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:53.454+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:53.723 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:53.722+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:53.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:53.727+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:54.128 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:54.126+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:54.408 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:54.407+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:54.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:54.747+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:54.771 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:54.770+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:55.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:55.119+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:55.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:55.400+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:55.754 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:55.753+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:55.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:55.759+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:56.099 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:56.097+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:56.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:06:56.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:06:56.407 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:56.406+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:56.744 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:56.743+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:56.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:56.751+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:57.076 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:57.074+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:57.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:57.410+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:57.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:57.711+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:57.801 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:57.799+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:58.044 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:58.042+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:58.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:58.380+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:58.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:58.753+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:58.826 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:58.825+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:59.070 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:06:59.068+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:59.412 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:06:59.410+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:59.732 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:06:59.730+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:06:59.838 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:06:59.835+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:00.053 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:00.050+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:00.374 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:00.372+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:00.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:00.729+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:00.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:00.864+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:01.077 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:01.074+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:01.350 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:01.347+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:01.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:01.715+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:01.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:01.841+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:02.065 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:02.062+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:02.352 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:02.349+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:02.750 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:02.747+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:02.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:02.837+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:03.092 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:03.089+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:03.367 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:03.364+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:03.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:03.782+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:03.884 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:03.882+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:04.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:04.120+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:04.398 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:04.396+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:04.805 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:04.802+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:04.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:04.870+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:05.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:05.082+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:05.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:05.439+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:05.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:05.813+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:05.908 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:05.905+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:06.111 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:06.109+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:06.423 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:06.421+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:06.444 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:07:06.442+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:07:06.787 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:06.784+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:06.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:06.896+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:07.078 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:07.076+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:07.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:07.377+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:07.830 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:07.828+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:07.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:07.889+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:08.035 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:08.033+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:08.418 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:08.416+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:08.781 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:08.779+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:08.865 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:08.863+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:09.011 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:09.008+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:09.370 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:09.367+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:09.755 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:09.752+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:09.852 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:09.849+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:09.999 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:09.997+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:10.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:10.386+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:10.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:10.732+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:10.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:10.871+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:10.974 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:10.972+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:11.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:11.369+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:11.743 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:11.740+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:11.912 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:11.909+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:11.949 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:11.947+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:12.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:12.356+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:12.741 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:12.739+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:12.879 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:12.877+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:12.948 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:12.945+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:13.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:13.387+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:13.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:13.761+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:13.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:13.834+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:13.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:13.920+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:14.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:14.400+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:14.754 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:14.752+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:14.799 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:14.797+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:14.889 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:14.887+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:15.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:15.423+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:15.751 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:15.749+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:15.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:15.818+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:15.917 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:15.915+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:16.469 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:16.467+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:16.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:16.764+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:16.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:16.854+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:16.905 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:16.903+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:17.422 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:17.419+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:17.742 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:17.739+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:17.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:17.893+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:17.904 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:17.902+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:18.382 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:18.379+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:18.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:18.765+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:18.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:18.915+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:18.932 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:18.930+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:19.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:19.428+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:19.793 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:19.790+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:19.880 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:19.877+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:19.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:19.927+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:20.394 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:20.392+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:20.782 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:20.780+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:20.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:20.892+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:20.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:20.926+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:21.376 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:21.374+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:21.460 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:07:21.458+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:07:21.814 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:21.812+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:21.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:21.887+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:21.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:21.888+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:22.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:22.398+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:22.820 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:22.817+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:22.847 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:22.844+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:22.853 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:22.851+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:23.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:23.366+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:23.778 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:23.775+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:23.848 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:23.845+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:23.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:23.876+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:24.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:24.335+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:24.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:24.807+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:24.839 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:24.837+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:24.846 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:24.843+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:25.295 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:25.292+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:25.809 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:25.807+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:25.840 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:25.837+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:25.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:25.837+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:26.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:07:26.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:07:26.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:26.287+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:26.802 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:26.800+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:26.840 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:26.837+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:26.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:26.842+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:27.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:27.322+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:27.844 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:27.842+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:27.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:27.865+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:27.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:27.888+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:28.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:28.356+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:28.841 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:28.838+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:28.842 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:28.840+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:28.903 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:28.901+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:29.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:29.335+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:29.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:29.802+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:29.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:29.842+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:29.900 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:29.898+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:30.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:30.329+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:30.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:30.807+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:30.855 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:30.852+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:30.880 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:30.878+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:31.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:31.289+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:31.782 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:31.779+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:31.811 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:31.810+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:31.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:31.832+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:32.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:32.333+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:32.817 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:32.815+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:32.820 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:32.818+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:32.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:32.856+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:33.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:33.353+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:33.780 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:33.778+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:33.808 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:33.806+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:33.846 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:33.844+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:34.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:34.322+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:34.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:34.802+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:34.810 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:34.808+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:34.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:34.877+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:35.328 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:35.326+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:35.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:35.827+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:35.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:35.850+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:35.929 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:35.927+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:36.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:36.323+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:36.476 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:07:36.473+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:07:36.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:36.820+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:36.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:36.858+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:36.887 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:36.885+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:37.364 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:37.362+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:37.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:37.828+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:37.851 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:37.850+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:37.862 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:37.861+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:38.335 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:38.333+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:38.869 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:38.868+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:38.900 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:38.898+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:38.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:38.900+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:39.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:39.348+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:39.866 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:39.864+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:39.890 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:39.888+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:39.911 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:39.909+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:40.307 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:40.305+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:40.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:40.865+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:40.872 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:40.871+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:40.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:40.934+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:41.288 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:41.286+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:41.883 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:41.882+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:41.893 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:41.891+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:41.911 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:41.909+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:42.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:42.332+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:42.873 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:42.871+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:42.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:42.913+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:42.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:42.915+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:43.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:43.356+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:43.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:43.876+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:43.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:43.915+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:43.921 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:43.919+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:44.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:44.312+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:44.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:44.893+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:44.913 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:44.912+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:44.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:44.950+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:45.272 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:45.271+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:45.858 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:45.856+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:45.891 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:45.889+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:45.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:45.936+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:46.298 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:46.297+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:46.901 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:46.899+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:46.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:46.939+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:46.951 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:46.950+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:47.291 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:47.289+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:47.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:47.877+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:47.906 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:47.904+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:47.971 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:47.970+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:48.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:48.338+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:48.863 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:48.862+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:48.867 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:48.865+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:48.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:48.925+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:49.349 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:49.348+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:49.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:49.813+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:49.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:49.825+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:49.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:49.967+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:50.325 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:50.322+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:50.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:50.774+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:50.878 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:50.875+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:50.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:50.985+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:51.341 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:51.338+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:51.491 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:07:51.490+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:07:51.824 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:51.821+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:51.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:51.848+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:51.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:51.973+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:52.373 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:52.371+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:52.808 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:52.806+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:52.827 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:52.825+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:52.985 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:52.982+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:53.334 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:53.332+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:53.769 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:53.766+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:53.870 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:53.867+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:53.975 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:53.973+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:54.332 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:54.329+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:54.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:54.781+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:54.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:54.883+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:55.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:55.023+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:55.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:55.290+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:55.756 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:55.753+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:55.930 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:55.927+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:56.010 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:56.007+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:56.283 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:56.281+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:56.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:07:56.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:07:56.772 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:56.770+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:56.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:56.970+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:56.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:56.991+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:57.297 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:57.294+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:57.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:57.780+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:57.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:57.950+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:57.991 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:57.988+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:58.265 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:58.263+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:58.759 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:58.756+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:58.940 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:58.938+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:58.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:58.983+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:59.217 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:07:59.214+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:59.721 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:07:59.718+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:59.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:07:59.938+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:07:59.968 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:07:59.966+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:00.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:00.218+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:00.739 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:00.736+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:00.954 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:00.951+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:00.966 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:00.963+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:01.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:01.214+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:01.770 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:01.767+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:01.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:01.924+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:01.997 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:01.995+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:02.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:02.232+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:02.785 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:02.782+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:02.910 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:02.907+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:02.970 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:02.968+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:03.188 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:03.186+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:03.802 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:03.799+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:03.916 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:03.914+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:03.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:03.954+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:04.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:04.164+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:04.773 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:04.771+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:04.926 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:04.924+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:04.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:04.945+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:05.199 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:05.197+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:05.724 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:05.722+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:05.914 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:05.911+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:05.959 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:05.956+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:06.220 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:06.217+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:06.494 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:08:06.491+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:08:06.693 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:06.691+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:06.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:06.887+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:06.927 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:06.924+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:07.224 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:07.222+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:07.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:07.710+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:07.868 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:07.866+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:07.969 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:07.967+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:08.242 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:08.240+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:08.763 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:08.760+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:08.863 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:08.861+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:08.920 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:08.918+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:09.227 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:09.225+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:09.714 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:09.712+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:09.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:09.884+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:09.965 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:09.963+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:10.271 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:10.269+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:10.712 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:10.710+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:10.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:10.891+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:10.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:10.996+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:11.225 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:11.222+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:11.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:11.682+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:11.928 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:11.926+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:11.960 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:11.957+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:12.216 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:12.213+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:12.661 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:12.658+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:12.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:12.925+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:12.957 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:12.954+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:13.246 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:13.243+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:13.626 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:13.624+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:13.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:13.943+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:13.965 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:13.963+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:14.244 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:14.242+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:14.620 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:14.617+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:14.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:14.912+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:14.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:14.923+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:15.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:15.272+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:15.648 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:15.645+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:15.888 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:15.885+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:15.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:15.899+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:16.234 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:16.232+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:16.619 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:16.617+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:16.894 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:16.891+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:16.941 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:16.939+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:17.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:17.194+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:17.595 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:17.592+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:17.928 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:17.926+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:17.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:17.935+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:18.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:18.216+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:18.553 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:18.551+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:18.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:18.953+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:18.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:18.970+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:19.173 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:19.171+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:19.548 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:19.547+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:19.931 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:19.929+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:19.960 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:19.958+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:20.200 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:20.198+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:20.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:20.562+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:20.896 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:20.894+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:20.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:20.915+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:21.190 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:21.188+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:21.510 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:08:21.507+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:08:21.530 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:21.528+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:21.907 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:21.904+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:21.935 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:21.933+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:22.238 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:22.236+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:22.497 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:22.495+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:22.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:22.922+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:22.981 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:22.978+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:23.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:23.187+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:23.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:23.478+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:23.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:23.941+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:23.961 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:23.959+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:24.174 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:24.171+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:24.446 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:24.444+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:24.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:24.985+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:25.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:24.998+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:25.189 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:25.187+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:25.471 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:25.469+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:25.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:25.971+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:26.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:26.047+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:26.179 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:26.178+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:26.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:26.427+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:26.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:08:26.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:08:26.946 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:26.945+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:27.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:27.052+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:27.218 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:27.217+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:27.426 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:27.425+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:27.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:27.931+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:28.028 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:28.027+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:28.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:28.224+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:28.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:28.454+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:28.950 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:28.949+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:29.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:29.013+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:29.196 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:29.195+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:29.406 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:29.405+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:29.987 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:29.985+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:30.015 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:30.013+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:30.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:30.244+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:30.453 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:30.451+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:31.013 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:31.011+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:31.039 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:31.038+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:31.254 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:31.252+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:31.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:31.427+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:31.966 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:31.965+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:32.079 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:32.078+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:32.229 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:32.228+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:32.436 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:32.434+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:32.958 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:32.957+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:33.102 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:33.100+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:33.270 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:33.269+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:33.463 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:33.461+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:33.956 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:33.954+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:34.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:34.132+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:34.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:34.259+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:34.462 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:34.460+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:34.952 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:34.950+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:35.110 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:35.108+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:35.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:35.283+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:35.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:35.415+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:35.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:35.984+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:36.134 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:36.132+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:36.299 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:36.297+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:36.404 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:36.403+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:36.525 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:08:36.524+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:08:37.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:37.024+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:37.128 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:37.127+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:37.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:37.277+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:37.375 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:37.374+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:38.034 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:38.032+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:38.169 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:38.167+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:38.260 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:38.258+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:38.373 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:38.372+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:39.066 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:39.065+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:39.193 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:39.191+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:39.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:39.276+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:39.376 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:39.375+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:40.048 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:40.047+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:40.197 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:40.195+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:40.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:40.322+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:40.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:40.409+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:41.093 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:41.090+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:41.158 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:41.156+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:41.344 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:41.341+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:41.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:41.364+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:42.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:42.128+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:42.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:42.186+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:42.296 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:42.294+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:42.355 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:42.352+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:43.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:43.151+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:43.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:43.157+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:43.309 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:43.306+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:43.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:43.339+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:44.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:44.127+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:44.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:44.156+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:44.297 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:44.295+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:44.321 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:44.318+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:45.145 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:45.143+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:45.207 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:45.204+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:45.327 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:45.324+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:45.335 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:45.333+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:46.129 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:46.127+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:46.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:46.199+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:46.279 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:46.276+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:46.307 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:46.304+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:47.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:47.151+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:47.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:47.216+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:47.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:47.268+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:47.275 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:47.272+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:48.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:48.146+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:48.226 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:48.224+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:48.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:48.232+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:48.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:48.237+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:49.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:49.162+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:49.252 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:49.249+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:49.255 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:49.253+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:49.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:49.285+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:50.141 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:50.139+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:50.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:50.214+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:50.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:50.260+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:50.287 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:50.285+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:51.153 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:51.150+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:51.216 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:51.214+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:51.253 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:51.251+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:51.308 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:51.305+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:51.541 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:08:51.539+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:08:52.103 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:52.101+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:52.210 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:52.208+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:52.211 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:52.209+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:52.292 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:52.289+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:53.080 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:53.078+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:53.235 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:53.232+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:53.257 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:53.255+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:53.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:53.275+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:54.061 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:54.059+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:54.236 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:54.234+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:54.237 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:54.235+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:54.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:54.299+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:55.108 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:55.105+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:55.238 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:55.235+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:55.272 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:55.269+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:55.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:55.337+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:56.074 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:56.072+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:56.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:56.276+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:56.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:56.277+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:56.346 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:56.344+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:56.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:08:56.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:08:57.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:57.073+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:57.259 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:57.257+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:57.301 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:57.299+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:57.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:57.386+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:58.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:58.035+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:58.273 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:58.270+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:58.287 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:58.284+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:58.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:58.375+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:59.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:08:59.085+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:59.256 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:08:59.254+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:59.326 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:08:59.324+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:08:59.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:08:59.415+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:00.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:00.118+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:00.252 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:00.249+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:00.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:00.304+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:00.450 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:00.447+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:01.117 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:01.114+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:01.291 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:01.289+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:01.357 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:01.355+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:01.426 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:01.423+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:02.150 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:02.147+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:02.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:02.318+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:02.333 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:02.330+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:02.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:02.437+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:03.125 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:03.122+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:03.345 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:03.343+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:03.351 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:03.349+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:03.468 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:03.466+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:04.154 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:04.151+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:04.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:04.322+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:04.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:04.352+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:04.430 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:04.428+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:05.196 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:05.193+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:05.299 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:05.297+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:05.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:05.394+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:05.442 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:05.440+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:06.232 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:06.230+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:06.293 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:06.290+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:06.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:06.393+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:06.445 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:06.443+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:06.559 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:09:06.556+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:09:07.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:07.248+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:07.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:07.301+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:07.398 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:07.396+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:07.467 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:07.466+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:08.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:08.249+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:08.291 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:08.288+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:08.438 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:08.436+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:08.513 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:08.511+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:09.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:09.233+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:09.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:09.256+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:09.397 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:09.395+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:09.484 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:09.482+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:10.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:10.236+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:10.266 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:10.263+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:10.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:10.405+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:10.479 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:10.477+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:11.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:11.234+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:11.272 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:11.270+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:11.377 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:11.374+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:11.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:11.481+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:12.208 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:12.206+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:12.274 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:12.272+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:12.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:12.348+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:12.446 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:12.443+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:13.236 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:13.234+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:13.281 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:13.278+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:13.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:13.392+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:13.399 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:13.397+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:14.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:14.187+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:14.270 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:14.267+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:14.363 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:14.360+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:14.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:14.368+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:15.161 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:15.159+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:15.280 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:15.278+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:15.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:15.346+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:15.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:15.352+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:16.142 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:16.140+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:16.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:16.296+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:16.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:16.328+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:16.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:16.384+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:17.143 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:17.142+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:17.285 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:17.283+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:17.353 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:17.352+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:17.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:17.361+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:18.163 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:18.162+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:18.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:18.330+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:18.362 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:18.360+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:18.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:18.379+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:19.195 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:19.193+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:19.345 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:19.343+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:19.359 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:19.358+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:19.362 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:19.360+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:20.234 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:20.233+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:20.333 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:20.332+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:20.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:20.354+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:20.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:20.374+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:21.186 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:21.184+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:21.327 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:21.326+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:21.340 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:21.338+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:21.354 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:21.353+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:21.566 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:09:21.563+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:09:22.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:22.218+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:22.295 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:22.293+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:22.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:22.328+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:22.345 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:22.344+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:23.248 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:23.246+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:23.271 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:23.270+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:23.349 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:23.347+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:23.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:23.353+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:24.295 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:24.293+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:24.304 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:24.303+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:24.309 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:24.308+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:24.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:24.385+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:25.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:25.273+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:25.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:25.287+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:25.303 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:25.302+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:25.359 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:25.357+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:26.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:26.256+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:26.275 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:26.274+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:26.335 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:26.334+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:26.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:26.374+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:26.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:09:26.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-04-04T04:09:27.271 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:27.270+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:27.293 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:27.292+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:27.342 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:27.340+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:27.375 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:27.373+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:28.293 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:28.291+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:28.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:28.312+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:28.332 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:28.331+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:28.425 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:28.424+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:29.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:29.294+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:29.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:29.334+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:29.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:29.345+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:29.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:29.379+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:30.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:30.288+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:30.379 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:30.377+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:30.385 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:30.384+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:30.401 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:30.400+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:31.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:31.305+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:31.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:31.348+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:31.370 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:31.367+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:31.431 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:31.428+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:32.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:32.338+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:32.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:32.339+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:32.364 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:32.362+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:32.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:32.383+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:33.344 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:33.341+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:33.358 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:33.356+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:33.372 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:33.370+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:33.388 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:33.386+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:34.296 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:34.293+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:34.315 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:34.313+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:34.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:34.344+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:34.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:34.351+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:35.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:35.264+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:35.287 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:35.284+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:35.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:35.355+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:35.386 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:35.383+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:36.288 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:36.285+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:36.289 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:36.287+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:36.355 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:36.352+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:36.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:36.384+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:36.582 INFO:tasks.ceph.mon.a.smithi049.stderr:2022-04-04T04:09:36.579+0000 7ffa00049700 -1 mon.a@0(leader) e1 handle_auth_bad_method hmm, they didn't like 2 result (13) Permission denied 2022-04-04T04:09:37.258 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:37.255+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:37.290 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:37.287+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:37.317 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:37.314+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:37.389 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:37.386+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:38.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2022-04-04T04:09:38.217+0000 7f596d92c700 -1 osd.6 121 get_health_metrics reporting 29 slow ops, oldest is osd_op(mds.0.4:38757 3.11 3.bc557211 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:38.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2022-04-04T04:09:38.261+0000 7f6e44c9f700 -1 osd.7 121 get_health_metrics reporting 58 slow ops, oldest is osd_op(mds.0.4:38678 4.d 4.8021588d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:38.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2022-04-04T04:09:38.334+0000 7f72c425d700 -1 osd.5 121 get_health_metrics reporting 8 slow ops, oldest is osd_op(mds.0.4:38789 3.e 3.58fb57ae (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:38.346 INFO:tasks.ceph.osd.4.smithi117.stderr:2022-04-04T04:09:38.344+0000 7f389e18e700 -1 osd.4 121 get_health_metrics reporting 81 slow ops, oldest is osd_op(mds.0.4:38692 3.14 3.844f3494 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e46) 2022-04-04T04:09:38.871 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-04-04T04:09:38.873 DEBUG:teuthology.task.console_log:Killing console logger for smithi049 2022-04-04T04:09:38.874 DEBUG:teuthology.task.console_log:Killing console logger for smithi117 2022-04-04T04:09:38.875 DEBUG:teuthology.exit:Finished running handlers